Skip to content

fix(plugin-markdown): teach extractToc's emphasis rules CommonMark's flanking rule (objectui#7667) - #7672

Merged
os-sam merged 1 commit into
mainfrom
claude/issue-7667-toc-emphasis-flanking
Sep 4, 2026
Merged

fix(plugin-markdown): teach extractToc's emphasis rules CommonMark's flanking rule (objectui#7667)#7672
os-sam merged 1 commit into
mainfrom
claude/issue-7667-toc-emphasis-flanking

Conversation

@os-sam

@os-sam os-sam commented Sep 4, 2026

Copy link
Copy Markdown
Collaborator

Fixes #7667

extractToc's ids must be the ids rehype-slug actually puts on the rendered
headings, because that is the only thing a #id link can resolve to. One
shape in this repository's own docs did not qualify.

What was wrong

stripInline() ended with two hand-rolled emphasis rules that gave * and _
a single shared regex:

.replace(/(\*\*|__)(.*?)\1/g, "$2")   // bold
.replace(/(\*|_)(.*?)\1/g, "$2")      // italic

Neither knew CommonMark's flanking rule, under which a _ run inside a word
opens nothing — it is both left- and right-flanking with no adjacent
punctuation, so it may neither open nor close emphasis. The renderer obeys that
and keeps the underscores. The shared rule paired the first two underscores of
### NON_GRID_ROW_CEILING and ate GRID, then resumed past them and ate ROW:

heading extractToc id id rehype-slug emits
### NON_GRID_ROW_CEILING nongridrow_ceiling non_grid_row_ceiling

The TOC entry rendered, was clickable, and silently went nowhere. Live
instance: packages/react/README.md:224.

The fix

The underscore form becomes its own flanking-aware rule; the asterisk rules are
left byte-identical, because only _ carries the intraword exemption
giving * the same one would break a*b*c, which the renderer really does
emphasise. That counter-direction is pinned too.

Specialised to _, CommonMark's can-open / can-close conditions each reduce to
one boundary test on either side of the whole delimiter run, which is what
the new regex spells:

open  ⟺ preceded by start-of-text, whitespace or punctuation
         AND followed by a non-whitespace character
close ⟺ followed by end-of-text, whitespace or punctuation
         AND preceded by a non-whitespace character

A negative lookbehind and lookahead for one more underscore anchor each match
to a whole run, which keeps x__init__y literal instead of pairing that run's
inner underscores. A matched pair is
dropped at whatever length it has, because it contributes no characters to the
rendered text however it nests (___x___ renders x).

The one-underscore case is a regression pin, not a repair. ## the snake_case name was already correct — a lone underscore has nothing to pair
with, which is exactly why this went unnoticed — and it still slugs
the-snake_case-name. It takes two or more underscores in one heading for the
old italic rule to find a pair.

Evidence

Truth source throughout is the real render pipeline, never a second derivation
of the flanking rule: each heading is rendered through MarkdownImpl and
extractToc's id compared to the id attribute rehype-slug actually
emitted. Every measurement below carries a lit control.

Red first. The new pins were written and run against unmodified toc.ts.
Predicted in writing beforehand: 4 of the 7 new tests red. Observed: exactly
those 4, at exactly the predicted cases.

× resolves the anchor for ### NON_GRID_ROW_CEILING (packages/react/README.md:224)
    expected [ 'nongridrow_ceiling' ] to deeply equal [ 'non_grid_row_ceiling' ]
× keeps every intraword underscore run literal, whatever its length
    expected [ 'abc_d' ] to deeply equal [ 'a_b_c_d' ]
× still strips underscore emphasis that CommonMark really opens
    expected [ 'abc' ] to deeply equal [ 'a_b_c' ]
× agrees when the two markers meet in one heading
    expected [ 'snakecase-and-morewords' ] to deeply equal [ 'snake_case-and-more_words' ]
Tests  4 failed | 11 passed (15)

Corpus sweep, re-run. Same corpus the card measured — content/docs/**
plus every packages/*/README.md, frontmatter stripped from both sides.
Predicted before the baseline run: 223 files / 2941 rendered headings / 5
divergent files. Observed: exactly that. After the fix: 223 / 2941 / 4.

The 4 that remain are all the same, different, already-filed defect — an extra
field-schema entry extractToc lists that the renderer never emits, under a
JSX block with no blank line, which shifts every id after it:
content/docs/fields/{date,rich-text,text,textarea}.mdx. That is #7666, filed
as needing a decision because apps/site renders the same .mdx through
fumadocs; it is deliberately not addressed here and remains open.

Non-vacuity. The naive shared regexes were reinstated on the committed tree
and the pins re-run. Predicted: the same 4 tests red. Observed: the same 4 red,
11 passing. The mutation was proved on disk by anchored fixed-string counts
(new rule 1 to 0, naive rule 0 to 1) and git hash-object movement off the HEAD
blob; restore ran from a trap installed before the mutation, using absolute
paths from git rev-parse --show-toplevel and git checkout HEAD -- ABSOLUTE_PATH,
and was verified three ways — blob equality with the HEAD blob, an empty
git diff HEAD, and the anchored counts back at 1/0. The ablation subject
resolves through a relative source specifier (import { extractToc } from './toc'),
not through the package's exports into dist/, so no rebuild gates the leg.

Gates, all at the final commit 6a44becf, exit codes captured by redirect
before any pipe, each quoted from the gate's own verdict line:

gate verdict
pnpm --filter @object-ui/plugin-markdown test Test Files 5 passed (5) · Tests 46 passed (46)
pnpm --filter @object-ui/plugin-markdown type-check exit 0, tsc --noEmit && tsc -p tsconfig.test.json
pnpm --filter @object-ui/plugin-markdown lint ✖ 7 problems (0 errors, 7 warnings) — all pre-existing, in Mermaid.tsx / index.tsx
pnpm changeset:check ✅ All workspace packages are in the changeset fixed group.
pnpm check:control-bytes ✅ check-control-bytes: OK (scanned 6256 tracked text file(s); skipped 85 binary).

Declared narrowing. The repo-wide pnpm lint farm is CI's run, not
duplicated here. The narrowing excludes nothing, on three readings: the
population came from eslint's own config — eslint . inside
packages/plugin-markdown covers the whole package, a superset of the two
changed source files; the count came from --format json (2 files, 0 errors, 0
warnings), and .changeset/*.md is outside eslint's configured population
entirely ("File ignored because no matching configuration was supplied"); and
eslint.config.js declares neither parserOptions.project nor
projectService, so linting is not type-aware and no untouched file's verdict
can depend on the contents of toc.ts.

Clause-② determination: no

Own determination, same conclusion as the dispatching seat. The criterion is
whether the card changes contract accept/reject behaviour or widens the
published surface, and neither moves:

  • The change is confined to stripInline(), a module-private helper — one
    definition, one call site, never exported and never re-exported from the
    package entry.
  • The exported surface is byte-identical. extractToc's signature, its opts
    shape and the TocItem interface are untouched; the diff contains no
    export and no interface line.
  • There is no accept/reject boundary to move: extractToc accepted every
    string before and accepts every string now. It never validated or rejected.
  • Nothing widens: no new export, no new option, no new accepted spelling of
    anything authorable. @objectstack/spec is untouched.

What moves is only the value of an id that was measurably wrong. That value
now equals what rehype-slug emits — which is the contract TocItem.id's own
doc comment already published ("Slug id, identical to what rehype-slug puts
on the rendered heading"). The change brings the implementation to its declared
contract rather than changing the contract.

Scope

packages/plugin-markdown/src/toc.ts only, plus its pins and a changeset.
Nothing under scripts/ was touched. #7666 is not addressed here.


🤖 Generated with Claude Code

https://claude.ai/code/session_01KbJQ1y1J12nZxYzFWhP8Q3


Generated by Claude Code

…flanking rule (objectui#7667)

`stripInline()` gave `*` and `_` one shared regex, so it did not know that a `_`
run inside a word opens nothing. The renderer keeps those underscores, so
`### NON_GRID_ROW_CEILING` slugged `nongridrow_ceiling` in the TOC against the
`non_grid_row_ceiling` that `rehype-slug` put on the anchor.

The underscore form is now its own flanking-aware rule; the asterisk rules are
unchanged, because only `_` carries the intraword exemption.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01KbJQ1y1J12nZxYzFWhP8Q3
@github-actions

github-actions Bot commented Sep 4, 2026

Copy link
Copy Markdown
Contributor

✅ Console Performance Budget

Metric Value Budget
Eager closure (gzip, 50 chunks) 3180.1 KB 3191.4 KB
Main entry chunk (gzip) 143.2 KB 350 KB
Entry file index-CsFrkX-x.js
Status PASS

The eager closure is every chunk the entry reaches through static imports — what the browser fetches and parses before the app renders. The entry chunk on its own is a small fraction of it.


📦 Bundle Size Report

Package Size Gzipped
app-shell (consoleActionDispatch.js) 0.20KB 0.19KB
app-shell (index.js) 15.67KB 5.75KB
app-shell (runtime-config.js) 20.68KB 7.36KB
app-shell (types.js) 0.01KB 0.04KB
app-shell (urlParams.js) 10.06KB 3.86KB
auth (ActiveOrganizationStorage.js) 25.05KB 9.16KB
auth (AuthContext.js) 0.31KB 0.24KB
auth (AuthGuard.js) 2.07KB 1.00KB
auth (AuthProvider.js) 40.18KB 10.59KB
auth (AuthShell.js) 3.49KB 1.40KB
auth (ForgotPasswordForm.js) 12.21KB 3.45KB
auth (LoginForm.js) 18.15KB 5.39KB
auth (PreviewBanner.js) 0.90KB 0.50KB
auth (RegisterForm.js) 6.65KB 2.22KB
auth (SocialSignInButtons.js) 9.61KB 3.89KB
auth (UserMenu.js) 3.41KB 1.23KB
auth (auth-gate-events.js) 1.29KB 0.66KB
auth (authStyles.js) 5.04KB 1.72KB
auth (createAuthClient.js) 40.21KB 10.80KB
auth (createAuthenticatedFetch.js) 8.46KB 3.43KB
auth (index.js) 3.19KB 1.44KB
auth (invitation-status.js) 1.22KB 0.70KB
auth (org-roles.js) 6.66KB 2.78KB
auth (phone-identifier.js) 1.11KB 0.66KB
auth (types.js) 0.59KB 0.35KB
auth (useAuth.js) 5.30KB 1.02KB
auth (useWorkspaceAdminStatus.js) 5.13KB 2.35KB
collaboration (CommentThread.js) 26.08KB 7.56KB
collaboration (LiveCursors.js) 3.17KB 1.27KB
collaboration (PresenceAvatars.js) 6.49KB 2.64KB
collaboration (PresenceProvider.js) 2.79KB 1.13KB
collaboration (index.js) 1.68KB 0.73KB
collaboration (useCollaborationTranslation.js) 6.05KB 2.52KB
collaboration (useCommentSearch.js) 1.98KB 0.88KB
collaboration (useConflictResolution.js) 7.75KB 1.86KB
collaboration (useMentionNotifications.js) 1.81KB 0.68KB
collaboration (usePresence.js) 6.33KB 1.84KB
collaboration (useRealtimeSubscription.js) 7.91KB 2.01KB
components (index.js) 510.70KB 116.21KB
core (index.js) 6.70KB 2.68KB
create-plugin (index.js) 10.08KB 3.26KB
data-objectstack (index.js) 180.00KB 50.20KB
fields (index.js) 242.27KB 61.22KB
i18n (LocalizationContext.js) 1.76KB 0.96KB
i18n (builtinAggregateLabels.js) 0.86KB 0.49KB
i18n (currency.js) 1.22KB 0.64KB
i18n (fallbackInterpolation.js) 6.25KB 2.77KB
i18n (i18n.js) 4.28KB 1.75KB
i18n (index.js) 3.65KB 1.47KB
i18n (pickLocalized.js) 7.62KB 3.26KB
i18n (provider.js) 26.89KB 9.04KB
i18n (useDisplayLocale.js) 2.85KB 1.45KB
i18n (useObjectLabel.js) 34.34KB 9.17KB
i18n (useSafeTranslation.js) 5.60KB 2.33KB
layout (index.js) 38.98KB 10.98KB
mobile (MobileProvider.js) 0.92KB 0.49KB
mobile (ResponsiveContainer.js) 0.94KB 0.38KB
mobile (breakpoints.js) 1.51KB 0.70KB
mobile (createOfflineDataSource.js) 5.61KB 1.75KB
mobile (index.js) 1.99KB 0.87KB
mobile (offlineQueue.js) 3.91KB 1.35KB
mobile (pwa.js) 0.97KB 0.49KB
mobile (serviceWorker.js) 1.48KB 0.62KB
mobile (serviceWorkerSource.js) 3.41KB 1.48KB
mobile (useBreakpoint.js) 1.54KB 0.65KB
mobile (useGesture.js) 6.96KB 1.98KB
mobile (useOfflineSync.js) 1.99KB 0.72KB
mobile (usePullToRefresh.js) 2.53KB 0.85KB
mobile (useResponsive.js) 0.72KB 0.42KB
mobile (useSpecGesture.js) 4.32KB 1.64KB
mobile (useTouchTarget.js) 1.01KB 0.54KB
permissions (MePermissionsProvider.js) 11.71KB 4.29KB
permissions (PermissionContext.js) 0.31KB 0.25KB
permissions (PermissionGuard.js) 0.89KB 0.45KB
permissions (PermissionProvider.js) 6.24KB 2.16KB
permissions (discardProofCache.js) 1.04KB 0.55KB
permissions (evaluator.js) 5.12KB 1.74KB
permissions (index.js) 0.93KB 0.41KB
permissions (store.js) 0.91KB 0.42KB
permissions (useFieldPermissions.js) 1.28KB 0.53KB
permissions (usePermissions.js) 4.83KB 2.27KB
plugin-ai (index.js) 15.75KB 3.80KB
plugin-calendar (index.js) 48.05KB 13.34KB
plugin-charts (index.js) 70.92KB 19.75KB
plugin-chatbot (index.js) 196.19KB 46.43KB
plugin-dashboard (index.js) 132.86KB 34.68KB
plugin-designer (index.js) 212.86KB 43.19KB
plugin-detail (index.js) 250.55KB 64.06KB
plugin-editor (index.js) 2.46KB 1.10KB
plugin-form (index.js) 132.87KB 32.66KB
plugin-gantt (index.js) 167.41KB 41.04KB
plugin-grid (index.js) 209.40KB 56.80KB
plugin-kanban (index.js) 52.71KB 14.55KB
plugin-list (index.js) 113.28KB 27.59KB
plugin-map (index.js) 20.57KB 6.82KB
plugin-markdown (index.js) 13.93KB 4.81KB
plugin-report (index.js) 43.57KB 11.96KB
plugin-timeline (index.js) 30.84KB 8.85KB
plugin-tree (index.js) 9.35KB 3.23KB
plugin-view (index.js) 85.24KB 20.94KB
providers (DataSourceProvider.js) 0.75KB 0.39KB
providers (MetadataProvider.js) 1.37KB 0.59KB
providers (ThemeProvider.js) 1.90KB 0.85KB
providers (UploadProvider.js) 11.66KB 3.50KB
providers (index.js) 0.45KB 0.23KB
providers (types.js) 0.01KB 0.04KB
react-runtime (index.js) 5.62KB 2.34KB
react (LazyPluginLoader.js) 4.47KB 1.63KB
react (SchemaRenderer.js) 81.07KB 26.86KB
react (data-invalidation.js) 5.05KB 2.08KB
react (index.js) 4.63KB 2.18KB
react (schema-input.js) 2.32KB 1.24KB
react (spec-input.js) 0.20KB 0.18KB
sdui-parser (codegen.js) 5.41KB 2.34KB
sdui-parser (dashboard-widget-options.js) 3.08KB 1.30KB
sdui-parser (index.js) 4.93KB 2.24KB
sdui-parser (input-type.js) 2.84KB 1.40KB
sdui-parser (parse.js) 20.57KB 5.88KB
sdui-parser (provenance.js) 3.66KB 1.82KB
sdui-parser (types.js) 0.28KB 0.23KB
sdui-parser (validate.js) 10.35KB 3.60KB
types (ai.js) 0.20KB 0.17KB
types (api-types.js) 0.20KB 0.18KB
types (app.js) 2.87KB 1.00KB
types (base.js) 0.20KB 0.18KB
types (blocks.js) 0.20KB 0.18KB
types (complex.js) 2.74KB 1.41KB
types (crud.js) 0.20KB 0.18KB
types (dashboard-filter-alias.js) 6.23KB 2.74KB
types (data-display.js) 3.75KB 1.85KB
types (data-protocol.js) 0.20KB 0.19KB
types (data.js) 0.20KB 0.18KB
types (designer.js) 1.85KB 0.85KB
types (disclosure.js) 0.20KB 0.18KB
types (error-code.js) 1.54KB 0.88KB
types (feedback.js) 0.20KB 0.18KB
types (field-types.js) 0.20KB 0.18KB
types (form.js) 0.20KB 0.18KB
types (http-inflight.js) 8.87KB 3.73KB
types (http-retry.js) 4.32KB 2.02KB
types (icon-key-migration.js) 4.26KB 1.63KB
types (index.js) 4.74KB 2.25KB
types (layout.js) 0.20KB 0.18KB
types (managed-by.js) 0.19KB 0.18KB
types (mobile.js) 4.58KB 2.23KB
types (navigation.js) 0.20KB 0.18KB
types (objectql.js) 0.20KB 0.18KB
types (overlay.js) 0.20KB 0.18KB
types (permissions.js) 0.20KB 0.18KB
types (plugin-scope.js) 0.20KB 0.18KB
types (record-components.js) 0.20KB 0.19KB
types (record-semantics.js) 1.28KB 0.67KB
types (registry.js) 0.20KB 0.18KB
types (reports.js) 0.20KB 0.18KB
types (select-option.js) 0.20KB 0.19KB
types (spec-report.js) 5.05KB 1.93KB
types (spec-ui-namespace.js) 0.20KB 0.19KB
types (system-fields.js) 3.33KB 1.54KB
types (theme.js) 6.28KB 2.87KB
types (ui-action.js) 8.11KB 3.32KB
types (views.js) 0.20KB 0.18KB
types (widget.js) 0.20KB 0.18KB

Size Limits

  • ✅ Core packages should be < 50KB gzipped
  • ✅ Component packages should be < 100KB gzipped
  • ⚠️ Plugin packages should be < 150KB gzipped

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

finding(plugin-markdown): extractToc's emphasis rules eat intraword underscores, so a SCREAMING_SNAKE heading gets an id no anchor carries

2 participants