Release-note fact check — anthropics/claude-code

v2.1.217 → v2.1.218 · 1 commits · 2 files · +84/−8 · judge: claude-cli/haiku
65unverified
100
correctness
claims supported
100
completeness
churn documented
100
risk
100 − flag penalties
repo: Python 80% · Shell 14% · TypeScript 5% · PowerShell 1% · 463 kB code
release cadence ~1 d
baseline (5 rel.): median churn ±114 Churn per release (oldest → newest) v2.1.212: 114 v2.1.214: 131 v2.1.215: 34 v2.1.216: 109 v2.1.217: 2326 · coverage 0% Note coverage % per release (oldest → newest) v2.1.212: 0 v2.1.214: 0 v2.1.215: 0 v2.1.216: 0 v2.1.217: 0

Score derivation — components, flag penalties and the hard cap, per SCORING.md

0255075100perfect releaseperfect release100correctness 100 × 0.45 weighted share of claims the diff supportscorrectness 100 × 0.450completeness 100 × 0.25 churn-weighted share of commits the notes covercompleteness 100 × 0.250risk 100 × 0.3 no flag penaltiesrisk 100 × 0.30hard cap: unverified claims nobody could check must not read better than checked-with-gapshard cap: unverified−3565/100 unverified65/100 unverified65

Claims at a glance

verified 6partial 0no-evidence 31contradicted 0skipped 0

Risk flags

INFO 31 claim(s) not checkable against this repo's diff

Diff map — tile = file, size = changed lines, color = documentation status, amber border = sensitive path, click opens the diff

feed.xml ±52 lines · evidence (click to open the compare view)feed.xmlCHANGELOG.md ±40 lines · covered (click to open the compare view)CHANGELOG.md
cited as evidence in documented commit undocumented unknown sensitive path (border)

Claims in detail

What's changed

no-evidence Changed `/code-review` to run as a background subagent, so review work no longer fills your conversation and keeps stacked slash commands as its review target 0.95
The only evidence is the feed.xml changelog entry that restates the claim itself; per the rules, a changelog hunk cannot serve as evidence for its own claims. No code changes implementing the background subagent behavior for /code-review are shown in the diff.
feed.xml
verified Added screen-reader announcements of deleted text for word and line deletions (`Option+Delete`, `Ctrl+W`, `Cmd+Backspace`, `Ctrl+U`, `Ctrl+K`) in `--ax-screen-reader` mode 0.80
Identifiers Option+Delete, Ctrl+W, Cmd+Backspace, Ctrl+U, Ctrl+K all appear in the diff (1 file(s)).
feed.xml
verified Fixed Windows paths with `\u`-prefixed segments (like `C:\Users\unicorn`) being corrupted into CJK characters in tool inputs, which made those files inaccessible 0.80
Identifiers \u, C:\Users\unicorn all appear in the diff (1 file(s)).
feed.xml
no-evidence Fixed the left arrow key discarding the conversation with no undo: presses right after editing now ask to confirm, and Esc in the agent view returns to the conversation it backgrounded 0.95
The evidence shows the claim restated verbatim in the release notes feed.xml, but the rules explicitly state: 'A changelog or release-notes hunk restating the claim is NOT evidence — notes cannot prove themselves. A claim about code behavior needs code changes as support.' No code diffs implementing the left-arrow/Esc handling changes are provided, only the documentation restatement.
feed.xml
verified Added HTTP status and error text to `claude mcp list` and `/mcp` when a server fails to connect, and a warning for MCP config values with hidden leading or trailing whitespace 0.80
Identifiers claude mcp list, /mcp all appear in the diff (1 file(s)).
feed.xml
no-evidence Fixed multi-line paste collapsing into one line with `j` in place of newlines in terminals that encode pasted newlines as Ctrl+J 0.95
The evidence shows only feed.xml with release notes text restating the claim, which per the rules is not evidence (changelog hunks cannot prove themselves). No actual code changes are provided in the diff to demonstrate the underlying fix; docs hunks only support claims about documentation, not code behavior.
feed.xml
no-evidence Fixed `/context` reporting stale pre-compact token usage after compacting from the message picker 0.95
The diff shows only the release notes (feed.xml) restating the claim. Per the rules, a changelog hunk cannot prove itself — a claim about code behavior requires code changes as support, not documentation hunks restating the claim.
feed.xml
no-evidence Fixed `/ultrareview` failing on descriptive arguments like "review my auth changes" — they now run a review of your current branch with the text applied as a note to the findings 0.95
The diff shows the claim restated verbatim in feed.xml release notes, but release-notes hunks cannot prove themselves per the rules. No linked commits are provided and the only shown files are feed.xml and CHANGELOG.md (release documentation), not code changes demonstrating the fix was implemented.
feed.xml
no-evidence Fixed `/code-review ultra` silently running a local review in non-interactive sessions — it now launches the cloud review 0.95
The diff shows only documentation changes (feed.xml and CHANGELOG.md entries) restating the claim. Per the rules, a changelog hunk restating a claim is not evidence; a claim about code behavior requires code changes as support. No linked commits or implementation changes are provided.
feed.xml
no-evidence Fixed gateway spend metering to price Bedrock application-inference-profile ARNs and other config-mapped upstream model IDs at the configured model's rates 0.95
The diff shows only a feed.xml changelog entry restating the claim verbatim, which cannot serve as evidence per the rules ('docs hunks only support claims about documentation'). No code changes demonstrating the gateway spend metering fix are provided; CHANGELOG.md is listed as changed but its diff is not shown.
feed.xml
no-evidence Fixed mojibake when a long IDE selection was truncated mid-emoji, and a case where a tool executor error could be silently dropped 0.95
The evidence contains only a changelog/release-notes hunk (feed.xml) restating the claim verbatim. Per the rules, changelog entries cannot serve as evidence for code behavior claims — code changes are required. No commits are linked and the file list shows only documentation files changed, with no actual implementation diffs provided.
feed.xml
no-evidence Fixed an engine teardown race that could start and abandon a phantom turn, and made input pushed after close consistently rejected 0.95
The diff contains only documentation changes—changelog and feed entries that restate the claim verbatim. Per the explicit rule, 'a changelog or release-notes hunk restating the claim is NOT evidence'; a claim about code behavior requires code changes as support. No linked commits, no actual source implementation, no supporting diffs.
CHANGELOG.md, feed.xml
no-evidence Fixed spurious "[Request interrupted by user]" messages after interrupted tool calls, and an unpaired `tool_use` block left in the transcript when a tool aborted mid-response 0.95
The feed.xml diff restates the claim verbatim in release-notes format, but per the rules, release notes cannot prove themselves — code changes are needed to verify a behavioral fix. Only documentation files (feed.xml, and CHANGELOG.md not shown) were provided; no implementation diffs are present to support the claim about fixing spurious messages or unpaired tool_use blocks.
feed.xml
verified Fixed VoiceOver reading "new line" instead of echoing the typed space at the end of the input in `--ax-screen-reader` mode 0.80
Identifiers --ax-screen-reader, VoiceOver all appear in the diff (1 file(s)).
feed.xml
no-evidence Fixed plugin and settings panels not moving the terminal cursor to the focused row, so screen readers and magnifiers can follow arrow-key navigation 0.95
The evidence shows only feed.xml and CHANGELOG.md (documentation files) being changed. The diff restates the claim verbatim in the v2.1.218 release notes, but per the stated rules, 'A changelog or release-notes hunk restating the claim is NOT evidence.' A claim about code behavior (fixing terminal cursor movement) requires code changes to support it, not a changelog entry that merely repeats the claim.
feed.xml
no-evidence Fixed crashes (maximum call stack exceeded) when a deeply nested watched directory tree was deleted or moved, and when rendering deeply nested UI trees 0.95
The diff shows only a release notes entry in feed.xml restating the claim verbatim; this is a changelog restatement, not evidence of code changes implementing the fix. Per the rules, 'A changelog or release-notes hunk restating the claim is NOT evidence — notes cannot prove themselves.' No actual code changes are shown that would support the crash fix.
feed.xml
no-evidence Fixed pull request events occasionally being lost when a session exited immediately after creating or linking a PR 0.95
The feed.xml diff shows the release notes entry restating the exact claim, but per the rules, 'A changelog or release-notes hunk restating the claim is NOT evidence.' No code changes are provided (linked commits: none; only feed.xml and CHANGELOG.md shown), so there is no evidence that the bug fix was actually implemented.
feed.xml
no-evidence Fixed the Bedrock setup wizard failing profile verification for assume-role profiles in partitioned AWS regions and on proxy-only networks 0.95
The diff shows only feed.xml (release notes) being updated with the claim text restated. Per the rules, 'A changelog or release-notes hunk restating the claim is NOT evidence — notes cannot prove themselves.' Code behavior claims require code changes as support; no actual implementation diffs are provided.
feed.xml
no-evidence Fixed rare negative or incorrect turn duration measurements after a system clock adjustment by timing turns with a monotonic clock 0.95
The evidence shows the claim appearing verbatim in the release notes (feed.xml), but the rules explicitly state that a changelog or release-notes hunk restating the claim is NOT evidence. A claim about code behavior (using a monotonic clock for timing) requires actual code changes as support; no implementation files are shown in the provided diffs, only documentation metadata.
feed.xml
no-evidence Fixed the "N MCP servers need authentication" startup notice over-counting claude.ai connectors that aren't connected in claude.ai 0.95
The diff shows only feed.xml (release notes) containing the claim text verbatim; per the rules, a changelog restating the claim is not evidence. No code changes, CHANGELOG.md diff, or implementation details are provided to verify the fix actually exists.
feed.xml
no-evidence Fixed prompt history entries being dropped or duplicated when history writes raced or failed 0.95
The diff shows only a release-notes entry in feed.xml restating the claim verbatim. Per the review rules, changelog entries cannot serve as evidence for code behavior claims — actual implementation changes are required. No code diffs or commit evidence supporting the fix are provided.
feed.xml
no-evidence Fixed a retry loop that re-sent identical doomed requests after a context-overflow error with a large thinking budget; `Ctrl+B` backgrounding now applies the same background-shell caps as other paths 0.95
The diff shows only a changelog entry in feed.xml that restates the claim verbatim ('Fixed a retry loop that re-sent identical doomed requests after a context-overflow error with a large thinking budget; Ctrl+B backgrounding now applies the same background-shell caps as other paths'). Per the rules, 'A changelog or release-notes hunk restating the claim is NOT evidence — notes cannot prove themselves. A claim about code behavior needs code changes as support.' No actual implementation changes ar
feed.xml
no-evidence Fixed agent frontmatter hooks running from untrusted folders: hooks now require the agent file's own folder to have accepted workspace trust 0.95
The evidence contains only the changelog entry restating the claim itself (in feed.xml), which per the rules cannot prove a code behavior change. No diffs to actual implementation code are provided, and the referenced CHANGELOG.md change is not shown in detail.
feed.xml
no-evidence Fixed fork-session lineage being lost after compaction in headless and SDK sessions 0.95
The diff shows only feed.xml and CHANGELOG.md changed, both documentation. The feed.xml entry merely restates the claim; per instructions, a changelog hunk restating a claim is not evidence—a code behavior fix requires code changes as support, not a note about itself.
feed.xml
no-evidence Fixed a resumed session failing every turn, or crashing on resume, when its history held a malformed delta attachment 0.95
The diff shows only feed.xml (a release-notes document) being updated with a changelog entry that restates the claim verbatim. Per the rules, 'A changelog or release-notes hunk restating the claim is NOT evidence — notes cannot prove themselves.' No code changes are provided showing the actual fix to session resume logic or delta-attachment handling.
feed.xml
no-evidence Improved `/ultrareview` error feedback so Claude can correct an invalid argument instead of retrying it unchanged 0.90
The diff shows only feed.xml with the release-notes entry restating the claim verbatim ('Improved /ultrareview error feedback so Claude can correct an invalid argument instead of retrying it unchanged'). Per the rules, a changelog hunk cannot prove itself—code behavior claims require code changes as support. No actual implementation changes are shown in the provided evidence.
feed.xml
no-evidence Improved auto mode: the dangerous-rm, background-`&`, and suspicious-Windows-path checks no longer open permission dialogs; the auto-mode classifier adjudicates them instead 0.95
The feed.xml diff contains an HTML-encoded release note that restates the claim verbatim, but per the rules, 'A changelog or release-notes hunk restating the claim is NOT evidence' — notes cannot prove themselves. A behavioral claim about permission-dialog handling requires actual code changes, not documentation that describes the change. No code diffs or CHANGELOG.md details are provided to verify the implementation.
feed.xml
no-evidence Improved sandbox command restrictions for IDE interactions 0.95
The only evidence is the release notes entry in feed.xml that restates the claim verbatim ('Improved sandbox command restrictions for IDE interactions'). Per the rules, changelog hunks cannot prove themselves; code changes are required to support claims about behavior. No actual implementation changes are provided in the diff to show what restrictions were modified or how.
feed.xml
no-evidence Improved trust dialogs to name the repository root the grant covers 0.95
The only diff provided is feed.xml, which is release-notes documentation restating the claim itself. Per the rules, 'A changelog or release-notes hunk restating the claim is NOT evidence — notes cannot prove themselves.' CHANGELOG.md is listed as changed but no diff is shown. No code changes demonstrating the actual implementation of the trust-dialog improvement are provided.
feed.xml
no-evidence Changed `/deep-research` to start only when invoked manually; Claude no longer launches it on its own 0.95
The evidence is a release-note entry in feed.xml that restates the claim verbatim. Per the rules, a changelog restating the claim is not evidence—behavior claims require code changes, not documentation hunks. No implementation diff is provided.
feed.xml
no-evidence Changed plan mode with auto to no longer prompt for Bash commands the static analyzer can't prove read-only; the auto-mode classifier judges them instead 0.95
The diff shows only feed.xml (release notes) being updated with text that restates the claim verbatim. Per the rules, a changelog or release-notes hunk restating the claim is NOT evidence — actual code changes showing the auto-mode classifier implementation are needed to verify a behavioral change claim.
feed.xml
no-evidence Added an announcement when fast mode changes as a result of switching models via `/config model=<x>` or Remote Control 0.95
The only evidence shown is the release notes in feed.xml, which restates the claim verbatim. Per the rules, changelog entries restating a claim are not evidence—a claim about code behavior requires code changes as support. No source files or implementation diffs are provided.
feed.xml
no-evidence Changed server-managed settings so benign feature and cost toggles no longer trigger the settings-approval prompt 0.95
The only diff provided is feed.xml, which is the release notes feed. Per the evaluation rules, a changelog or release-notes hunk restating the claim is NOT evidence—notes cannot prove themselves. The claim requires code changes showing how server-managed settings behavior changed; no such implementation diffs are provided.
feed.xml
no-evidence Changed agent markdown files to reject agent names containing `:`, which is reserved for plugin namespacing 0.95
The diff shows only documentation files (feed.xml and CHANGELOG.md) containing a release-note entry that restates the claim verbatim. Per the rules, changelog hunks cannot prove themselves — the claim requires code changes (agent file validation logic) as evidence, not documentation that describes it. No implementation files are shown in the diff.
feed.xml, CHANGELOG.md
verified Changed skills with `context: fork` to run in the background by default; opt out per skill with `background: false` 0.80
Identifiers context: fork, background: false all appear in the diff (1 file(s)).
feed.xml
verified Added `yes`/`no`/`on`/`off`/`1`/`0` (case-insensitive) as accepted values for skill and plugin frontmatter booleans, alongside `true`/`false` 0.80
Identifiers yes, no, on, off, 1 all appear in the diff (1 file(s)).
feed.xml
no-evidence Fixed remote sessions continuing to send heartbeats after their worker was replaced, which left long-lived desktop and IDE processes retrying a rejected request every few seconds forever 0.95
The diff shows the claim text appearing verbatim in feed.xml (release notes), but per the fact-check rules, 'a changelog or release-notes hunk restating the claim is NOT evidence — notes cannot prove themselves.' The provided evidence contains only documentation changes (feed.xml, CHANGELOG.md); no code diffs are shown to demonstrate the actual fix was implemented.
feed.xml

Undocumented commits

All commits in the range are covered by the release notes.