feat(python-sdks): SDK-level cross-source memory deduplication by Dhravya · Pull Request #1532 · supermemoryai/supermemory

Dhravya · 2026-08-18T15:16:42Z

Stack Context

Part 2 of a 3-PR stack moving memory deduplication into the SDKs. See sdk-dedup/tools-ts (parent) for the full context and the TypeScript implementation this mirrors.

What?

Port the normalized, priority-ordered (static > dynamic > search) profile deduplication into the Python SDKs.

Each request injects one owned memory block that replaces the prior block rather than accumulating.
Dedup is request-local (no shared state), so it stays correct under concurrency.

Covers OpenAI, Agent Framework (middleware + context provider), Cartesia, and Pipecat.

Why?

Keeps the Python SDKs at behavioral parity with the TypeScript SDK so all integrations deduplicate memory the same way.

Testing

OpenAI: 31 passed, 11 skipped (live)
Agent Framework: 59 passed
Cartesia: 8 passed
Pipecat: 8 passed

🤖 Generated with Claude Code

Note

Medium Risk
Changes memory formatting and system-prompt injection across multiple SDK integrations; incorrect dedup or replacement could alter LLM context, but there is no auth or data-store risk.

Overview
Ports normalized cross-source memory deduplication and replace-not-append injection into the Python OpenAI, Agent Framework, Cartesia, and Pipecat packages so they match the TypeScript SDK behavior.

Deduplication uses request-local keys: strip optional [YYYY-MM-DD] prefixes, normalize whitespace, and compare with casefold, with priority static → dynamic → search. In query mode, profile static/dynamic are excluded from dedup input so facts that only appear in search (or overlap profile) are not dropped before formatting.

Injection no longer appends memory text every turn. OpenAI and Agent Framework middleware strip prior owned <supermemory context="user-memories" readonly> blocks and replace them once per request while keeping the caller’s system instructions; extra system messages lose stale blocks only. New helpers (strip/replace/wrap) live in each package’s utils.

Tests cover normalized fact variants, query-mode search retention, and stale block replacement.

^{Reviewed by Cursor Bugbot for commit 42f308b. Bugbot is set up for automated code reviews on this repo. Configure here.}

claude · 2026-08-18T15:17:01Z

Claude finished @Dhravya's task in 1m 35s —— View job

Review Complete

Fetch PR diff and existing review comments
Analyze changes across Python SDKs
Check for bugs, security issues, and logic errors
Post review summary

Overview: Ports normalized memory deduplication (casefold + whitespace normalization + date-prefix stripping) and request-local context replacement into Python OpenAI, Agent Framework, Cartesia, and Pipecat SDKs.

Issues found: None — this looks good to ship.

The Cursor Bugbot issue regarding stale memory blocks has been addressed:

Agent Framework (middleware.py:279): _inject_memories(context, "") is now called at the start of process(), ensuring stale SDK-owned <supermemory> blocks are always stripped before any conditional path executes
OpenAI SDK (middleware.py:559): When no user message is found, _update_chat_memory_contexts(messages) is still called without memories, which strips prior blocks

Implementation highlights:

Normalized deduplication: Correctly strips [Recent] and [YYYY-MM-DD] prefixes, normalizes whitespace, and uses casefold() for case-insensitive comparison across all SDKs
Mode-aware filtering: In "query" mode, static/dynamic arrays are correctly passed as empty to deduplicate_memories, so search results aren't deduplicated against profile data
Context replacement: OpenAI SDK properly handles both string and structured content fields, and prioritizes developer role messages per newer OpenAI API conventions
Tag escaping: Each SDK escapes its respective delimiter tags (<supermemory> for OpenAI/Agent Framework, <user_memories> for Cartesia/Pipecat) to prevent injection attacks
Test coverage: Solid coverage for normalized fact variants, query-mode behavior, and stale block replacement

Score: 10/10

|

claude

Overview: Ports SDK-level memory deduplication to Python SDKs (OpenAI, Agent Framework, Cartesia, Pipecat), adding normalized fact comparison and request-local context replacement.

Issues found: None — this looks good to ship.

The implementation is consistent across all four Python SDKs:

Normalized deduplication (normalize_fact/fact_key): Correctly strips date prefixes [YYYY-MM-DD], normalizes whitespace, and case-folds for comparison. This handles the "User likes Python" vs " user likes python " vs "[2026-08-10] USER LIKES PYTHON" variations correctly.
Memory injection replacement: The regex pattern with re.DOTALL and non-greedy .*? properly matches <supermemory> blocks across newlines. The strip_memory_injection → replace_memory_injection flow correctly replaces prior SDK blocks while preserving caller instructions.
Mode-aware filtering: In "query" mode, passing empty arrays for static/dynamic to deduplicate_memories is intentional — search results shouldn't be deduplicated against profile data when the mode only wants search results.
Multi-system-message handling: The injection logic correctly injects into the first system message and strips from subsequent ones, preventing accumulation.
Test coverage: Good coverage for normalized deduplication variants and mode-specific behavior.

Score: 10/10

Dhravya · 2026-08-18T15:19:16Z

How to use the Graphite Merge Queue

Add the label Main to this PR to add it to the merge queue.

You must have a Graphite account in order to use the merge queue. Sign up using this link.

_{An organization admin has enabled the Graphite Merge Queue in this repository.} _{Please do not merge from GitHub as this will restart CI on PRs being processed by the merge queue.}

This stack of pull requests is managed by Graphite. Learn more about stacking.

cursor

Cursor Bugbot has reviewed your changes using high effort and found 1 potential issue.

^{❌ Bugbot Autofix is OFF. To automatically fix reported issues with cloud agents, enable autofix in the Cursor dashboard.}

^{Reviewed by Cursor Bugbot for commit 42f308b. Configure here.}

cursor · 2026-08-18T15:22:05Z

    different Agent Framework providers.
    """
    messages = context.messages
-    memory_text = f"\n\n{wrap_memory_injection(memories)}"


Stale memory blocks not cleared

Medium Severity

_inject_memories now replaces owned <supermemory> blocks, but process only calls it when memories is truthy. On a later turn with an empty retrieval, prior SDK blocks stay in context.messages, so stale memory context keeps going to the model. The OpenAI path in this same PR still runs replace/strip when a system message exists even if new memories are empty.

Additional Locations (1)

packages/agent-framework-python/src/supermemory_agent_framework/middleware.py#L390-L434

^{Reviewed by Cursor Bugbot for commit 42f308b. Configure here.}

cloudflare-workers-and-pages · 2026-08-18T15:34:17Z

Deploying with Cloudflare Workers

The latest updates on your project. Learn more about integrating Git with Workers.

Status	Name	Latest Commit	Preview URL	Updated (UTC)
✅ Deployment successful! View logs	supermemory-app	`03773c4`	Commit Preview URL Branch Preview URL	Sep 01 2026, 06:22 AM

cloudflare-workers-and-pages · 2026-08-18T16:07:53Z

Deploying with Cloudflare Workers

The latest updates on your project. Learn more about integrating Git with Workers.

Status	Name	Latest Commit	Updated (UTC)
✅ Deployment successful! View logs	supermemory-mcp	`03773c4`	Sep 01 2026, 06:20 AM

claude

Overview: Ports SDK-level memory deduplication to Python SDKs (OpenAI, Agent Framework, Cartesia, Pipecat), adding normalized fact comparison (casefold + whitespace normalization + date-prefix stripping) and request-local context replacement.

Issues found:

Agent Framework stale block retention (inline comment): When memories is empty, _inject_memories is never called, so stale <supermemory> blocks from prior turns persist in the context. The OpenAI SDK correctly handles this by running strip/replace logic regardless of whether new memories exist. Cartesia and Pipecat use different patterns that avoid this issue.

What looks good:

Normalized deduplication is consistent across all SDKs: strips [YYYY-MM-DD] prefixes, normalizes whitespace, and uses casefold() for case-insensitive comparison
Priority order (static → dynamic → search) is correctly preserved
Mode-aware filtering in "query" mode correctly passes empty arrays for static/dynamic to avoid deduping search results against profile data
OpenAI SDK's multi-system-message handling correctly injects into the first and strips from subsequent ones
Test coverage is solid for the new normalized deduplication and mode-specific behavior

Score: 8/10

One real bug that should be addressed before merge, but the overall implementation is well-structured and consistent across the SDK ports.

claude

Overview: Ports SDK-level memory deduplication to Python SDKs (OpenAI, Agent Framework, Cartesia, Pipecat), adding normalized fact comparison and request-local context replacement.

Issues found: None — this looks good to ship.

The Cursor Bugbot issue regarding stale memory blocks has been addressed in commit 90babae. The fix at middleware.py:279 calls _inject_memories(context, "") at the start of process(), ensuring stale SDK-owned <supermemory> blocks are always stripped before any conditional path executes.

Implementation highlights:

Normalized deduplication: Correctly strips [Recent] and [YYYY-MM-DD] prefixes, normalizes whitespace, and uses casefold() for case-insensitive comparison across all SDKs
Mode-aware filtering: In "query" mode, static/dynamic arrays are correctly passed as empty to deduplicate_memories, so search results aren't deduplicated against profile data
Context replacement: OpenAI SDK properly handles both string and structured content fields, and prioritizes developer role messages per the newer OpenAI API conventions
Tag escaping: Each SDK escapes its respective delimiter tags (<supermemory> for OpenAI/Agent Framework, <user_memories> for Cartesia/Pipecat) to prevent injection attacks
Test coverage: Solid coverage for normalized fact variants, query-mode behavior, and stale block replacement

Score: 10/10

graphite-app · 2026-09-01T04:33:35Z

Merge activity

Sep 1, 4:33 AM UTC: Dhravya added this pull request to the Graphite merge queue.
Sep 1, 4:34 AM UTC: The Graphite merge queue removed this pull request due to downstack failures on PR #1431.
Sep 1, 4:34 AM UTC: The Graphite merge queue removed this pull request due to downstack failures on PR #1431.
Sep 1, 5:59 AM UTC: Dhravya added this pull request to the Graphite merge queue.
Sep 1, 6:21 AM UTC: Merged by the Graphite merge queue.

## Stack Context Part 2 of a 3-PR stack moving memory deduplication into the SDKs. See `sdk-dedup/tools-ts` (parent) for the full context and the TypeScript implementation this mirrors. ## What? Port the normalized, priority-ordered (`static > dynamic > search`) profile deduplication into the Python SDKs. - Each request injects one **owned memory block that replaces** the prior block rather than accumulating. - Dedup is **request-local** (no shared state), so it stays correct under concurrency. Covers OpenAI, Agent Framework (middleware + context provider), Cartesia, and Pipecat. ## Why? Keeps the Python SDKs at behavioral parity with the TypeScript SDK so all integrations deduplicate memory the same way. ## Testing - OpenAI: 31 passed, 11 skipped (live) - Agent Framework: 59 passed - Cartesia: 8 passed - Pipecat: 8 passed 🤖 Generated with [Claude Code](https://claude.com/claude-code)  --- > [!NOTE] > **Medium Risk** > Changes memory formatting and system-prompt injection across multiple SDK integrations; incorrect dedup or replacement could alter LLM context, but there is no auth or data-store risk. > > **Overview** > Ports **normalized cross-source memory deduplication** and **replace-not-append injection** into the Python OpenAI, Agent Framework, Cartesia, and Pipecat packages so they match the TypeScript SDK behavior. > > **Deduplication** uses request-local keys: strip optional `[YYYY-MM-DD]` prefixes, normalize whitespace, and compare with `casefold`, with priority **static → dynamic → search**. In **`query` mode**, profile static/dynamic are excluded from dedup input so facts that only appear in search (or overlap profile) are not dropped before formatting. > > **Injection** no longer appends memory text every turn. OpenAI and Agent Framework middleware **strip prior owned `<supermemory context="user-memories" readonly>` blocks** and **replace** them once per request while keeping the caller’s system instructions; extra system messages lose stale blocks only. New helpers (`strip`/`replace`/`wrap`) live in each package’s utils. > > Tests cover normalized fact variants, query-mode search retention, and stale block replacement. > > <sup>Reviewed by [Cursor Bugbot](https://cursor.com/bugbot) for commit 42f308b. Bugbot is set up for automated code reviews on this repo. Configure [here](https://www.cursor.com/dashboard/bugbot).</sup>

The base branch was changed.

graphite-app Bot assigned Dhravya Aug 18, 2026

claude Bot reviewed Aug 18, 2026

View reviewed changes

This was referenced Aug 18, 2026

feat(sdk-playground): interactive SDK chat playground #1437

Merged

feat(sdk-playground): reflect SDK-owned memory block in debug view #1533

Merged

Dhravya assigned ved015 Aug 18, 2026

Dhravya requested a review from MaheshtheDev August 18, 2026 15:20

cursor Bot reviewed Aug 18, 2026

View reviewed changes

ved015 force-pushed the sdk-dedup/tools-ts branch from 2fa2e0d to be97748 Compare August 24, 2026 16:21

ved015 force-pushed the sdk-dedup/python branch from 42f308b to 8de27af Compare August 24, 2026 16:21

claude Bot reviewed Aug 24, 2026

View reviewed changes

ved015 previously approved these changes Aug 24, 2026

View reviewed changes

Dhravya force-pushed the sdk-dedup/tools-ts branch from be97748 to ec6c159 Compare September 1, 2026 05:58

Dhravya force-pushed the sdk-dedup/python branch from cb557f4 to 7c2adf1 Compare September 1, 2026 05:58

graphite-app Bot force-pushed the sdk-dedup/tools-ts branch from ec6c159 to d035932 Compare September 1, 2026 06:03

graphite-app Bot force-pushed the sdk-dedup/python branch from 7c2adf1 to 5df25cc Compare September 1, 2026 06:04

graphite-app Bot force-pushed the sdk-dedup/tools-ts branch from d035932 to d0f53b0 Compare September 1, 2026 06:12

graphite-app Bot force-pushed the sdk-dedup/python branch from 5df25cc to 03773c4 Compare September 1, 2026 06:13

graphite-app Bot changed the base branch from sdk-dedup/tools-ts to main September 1, 2026 06:20

graphite-app Bot merged commit 03773c4 into main Sep 1, 2026
14 of 15 checks passed

Navigation Menu

Uh oh!

feat(python-sdks): SDK-level cross-source memory deduplication - #1532

feat(python-sdks): SDK-level cross-source memory deduplication#1532
graphite-app[bot] merged 1 commit into
mainfrom
sdk-dedup/python

Dhravya commented Aug 18, 2026 •

edited by cursor Bot

Loading

Uh oh!

claude Bot commented Aug 18, 2026 •

edited

Loading

Uh oh!

claude Bot left a comment

Uh oh!

Dhravya commented Aug 18, 2026 •

edited

Loading

Uh oh!

cursor Bot left a comment

Uh oh!

cursor Bot Aug 18, 2026

Uh oh!

cloudflare-workers-and-pages Bot commented Aug 18, 2026 •

edited

Loading

Uh oh!

cloudflare-workers-and-pages Bot commented Aug 18, 2026 •

edited

Loading

Uh oh!

claude Bot left a comment

Uh oh!

claude Bot left a comment

Uh oh!

graphite-app Bot commented Sep 1, 2026 •

edited

Loading

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Uh oh!

Conversation

Dhravya commented Aug 18, 2026 • edited by cursor Bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Stack Context

What?

Why?

Testing

Uh oh!

claude Bot commented Aug 18, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Review Complete

Uh oh!

claude Bot left a comment

Choose a reason for hiding this comment

Uh oh!

Dhravya commented Aug 18, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

How to use the Graphite Merge Queue

Uh oh!

cursor Bot left a comment

Choose a reason for hiding this comment

Uh oh!

cursor Bot Aug 18, 2026

Choose a reason for hiding this comment

Stale memory blocks not cleared

Uh oh!

cloudflare-workers-and-pages Bot commented Aug 18, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Deploying with Cloudflare Workers

Uh oh!

cloudflare-workers-and-pages Bot commented Aug 18, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Deploying with Cloudflare Workers

Uh oh!

claude Bot left a comment

Choose a reason for hiding this comment

Uh oh!

claude Bot left a comment

Choose a reason for hiding this comment

Uh oh!

graphite-app Bot commented Sep 1, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Merge activity

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Dhravya commented Aug 18, 2026 •

edited by cursor Bot

Loading

claude Bot commented Aug 18, 2026 •

edited

Loading

Dhravya commented Aug 18, 2026 •

edited

Loading

cloudflare-workers-and-pages Bot commented Aug 18, 2026 •

edited

Loading

cloudflare-workers-and-pages Bot commented Aug 18, 2026 •

edited

Loading

graphite-app Bot commented Sep 1, 2026 •

edited

Loading