v0.40.0 — what a cold cache costs - #37
Merged
Merged
Conversation
claude-fable-5-1 abbreviated to fabl5 — the same chip as Fable 5 — because the abbreviation predates Fable having a minor. Carry it: fabl5.1. A trailing date component is still not a minor. is_1m_model trusted context_window_size only above 200k; at 200k on a default-1M family the name still painted [1m] over a bar the CLI had already re-based to 200k. That is the frame CLAUDE_CODE_DISABLE_1M_CONTEXT=1 produces on Fable (on Claude Code 2.1.258 the flag drops both the believed window and the auto-compact window to 200k for native-1M models). A reported window now decides in both directions; the name only when the CLI sent none. 474 bats. Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
…dger, re-key the >200k band to rewrite exposure Anthropic's pricing page bills the full 1M window at standard rates on every 4.6+ model, so the "premium band" the bar promised above 200k has no price behind it. The color stays and now means rewrite exposure: what a dead cache re-bills at the write rate (20x a read on most models, 80x on Fable 5.1 where reads dropped to 0.025x). Sized from the CLI's recache_tokens_if_cold when present, else the live context. Claude Code 2.1.251 sends a prompt_cache object (misses, expected rebuilds, tokens re-cached, ttl, expires_at) computed from every response, including the turns the render debounce skipped. get_cache_health_cli reads it: a break is a miss the CLI counted, sized at the delta of what the misses wrote back; a compaction rebuild is ≡~, never ≡!; the deadline is exact. Same state file, new pc_* keys; older CLIs keep get_cache_health. Folds the fabl5.1 chip and the [1m]-follows-the-CLI fix into v0.40.0. 486 bats. Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What
prompt_cache.recache_tokens_if_coldon 2.1.251+, else the live context.prompt_cacheledger (2.1.251+):≡!Nkis sized at what the CLI's counted misses re-cached; a compaction rebuild shows≡~, never≡!; TTL and deadline are exact. Older CLIs keep the inferred detector, same state file.fabl5.1chip forclaude-fable-5-1; the[1m]tag follows the CLI's reported window in both directions (CLAUDE_CODE_DISABLE_1M_CONTEXT=1drops it with the bar).Verify
make check: shellcheck clean, 486 bats≡!205kbold red, a compaction rebuild renders≡~🤖 Generated with Claude Code