{"baseline_card":"eclipse-verbatim-mcp-2026-10-26.json (PARTIAL) — not edited by this bench","bench_date":"2026-10-26","bench_version":"scoped re-bench (fix round Phase 2) — scopes: §17.2 test 1 on amended §5, D-2 fresh shapes, D-3 fresh shapes, cite-check hostile subset, seal/envelope + new-snapshot checks; D-5/D-6/D-7 observation re-confirmation","build_state_benched":{"bench_rerun":"64/64 PASS (unittest discover, 24.5s) + smoke PASS — CONFIRMED","builder_suite_claim":"64/64 + smoke PASS","fix_round_tests":"tests/test_fix_round.py = 14 tests (4 spec-amendment + 3 D-3 + 3 D-2 + 4 D-4), count matches builder claim; suite arithmetic 50 baseline + 14 = 64 consistent","product_commit":"df2b5add7dda883dc88a6e56b7d9205501e8de2b"},"checks":{"D2_tamper_fresh_shapes":{"builder_repro_index10_on_new_snapshot":"names 26 USC §23, signature SIGNATURE_UNVERIFIED — the baseline D-2 repro now passes","byte_len_only_tamper":"manifest_hash_ok false, signature SIGNATURE_UNVERIFIED, divergent empty — PASS (degradation loud; naming is hash-vs-bytes by construction, §17.3's required hash-flip shape names correctly)","clean_control":"manifest_hash_ok/corpus_root_ok/editorial_root_ok all true, signature FIXTURE_SIGNED, divergent_section null, divergent_sections []","corpus_root_field_only_tamper":"manifest_hash_ok false, corpus_root_ok false, signature SIGNATURE_UNVERIFIED, divergent empty — PASS (loud degradation; no section diverges, correctly unnamed)","editorial_entry_index100_notes_hash_flipped":"names 26 USC §56 (layer EDITORIAL), editorial_root_ok false, signature SIGNATURE_UNVERIFIED — PASS (new layer vs builder repro)","editorial_file_bytes_appended_manifest_pristine":"names 26 USC §61 EDITORIAL, signature SIGNATURE_UNVERIFIED — PASS","method":"Isolated copies of the product under /tmp/verbatim-tamper, one mutation per copy, manifest_verify called over the wire. Builder's original repro was sections[10] statutory hash; these shapes go beyond it.","section_file_bytes_appended_manifest_pristine":"manifest_hash_ok true, both roots ok, yet names 26 USC §61 STATUTORY and signature SIGNATURE_UNVERIFIED (entry-vs-stored-bytes divergence) — PASS (strongest fresh shape: store tamper invisible to hash/root checks alone)","signature_field_only_tamper":"signature SIGNATURE_UNVERIFIED — PASS","statutory_entry_index500_flipped":"names 26 USC §643 (layer STATUTORY), corpus_root_ok false, signature SIGNATURE_UNVERIFIED — PASS","two_statutory_entries_flipped_10_and_2000":"divergent_sections = [26 USC §23 STATUTORY, 26 USC §7622 STATUTORY] in entry order, divergent_section = §23, signature SIGNATURE_UNVERIFIED — PASS"},"D3_citation_scope_fresh_shapes":{"malformed_stays_CITATION_MALFORMED":"26 USC §abc, 26 USC § (no number), §, §abc, 26 USC 61 (no section sign), /etc/passwd, https://example.com/61, USC §61 (no title number), cite_check claimed 26 USC §xyz — all CITATION_MALFORMED, no scope misclassification","out_of_scope_all_CORPUS_OUT_OF_SCOPE":"get_section: 11 USC §101, 18 USC §1341, 18 U.S.C. §1341 (dotted), 28 USC §1331, 31 USC §3729, 42 USC §1983, 47 USC §230, 50 USC §3024, 5 USC §552, 15 U.S.C. §78j, 26 CFR §1.61-1, 21 CFR 101.4, 26 cfr 1.61 (lowercase) — 13/13","out_of_scope_other_tools":"notes_get 7 USC §601, section_verify 38 USC §1110, lineage 35 USC §101, manifest_get citation 44 USC §3501, cite_check claimed_citation 18 USC §1341 and 26 CFR 1.61 — all CORPUS_OUT_OF_SCOPE","valid_controls":"26 USC §61 and bare §61 both serve 26 USC §61"},"centerpiece_recompute_canon_1_1":{"against_new_snapshot_usc26-119-124-de68dcc8b3db":"FULL CONVERGENCE: census 8/8 (2277/2162/115/2015/241/17/2/2); statutory 2277/2277 hashes+byte_len+word_count identical; editorial 2277/2277 (note_count, notes_word_count, notes_sha256); corpus_root dd9ee599708984a0ec51906f825d839db3f6d81f5725ef7f6c7dd7ba4aa020bc == served; editorial_root 74c6056ea1d6647add4d952fa3bc30c91c79219b74944b56db6bdc23a85c0fdb == served; manifest_sha256 recomputed fbef079241408774cce87675ac36472145235a377a352194c32304e486413afd == served; §8.1 two-step derivation reproduces suffix de68dcc8b3db exactly.","against_old_snapshot_usc26-119-124-3ba6c8dc5ce0":"Same 1.1 implementation diverges at EXACTLY ONE section: §7519 (bench 0f8f8d82... vs sealed 573f059d...); statutory 2276/2277, editorial 2277/2277, editorial_root identical. This isolates the canon delta to the single published rule change (§5.3.2 rule 4) and proves the amendment record's errata claim: the §5 errata change no sealed byte of the 1.0 corpus.","bench_side_note":"The preserved baseline bench editorial collector (nested note/sourceCredit subtrees skipped within a note's text) diverges from the seal on 7 sections (§112, §403, §430, §3134, §3304, §7804 + 1); the §6-literal reading (all descendant text nodes per §5.4 step 1, no intra-note exclusions) converges 2277/2277. See D-9.","method":"Bench re-implementation written from the AMENDED spec §5/§6/§7/§8.1 alone (evolved from preserved bench code /tmp/verbatim-bench/my_canon.py + variantB/C into /tmp/verbatim-rebench/canon11.py; no product code imported or read for the transform). Source zip/XML hashes re-verified (zip 2fb42db4..., xml 70d0bb23..., 55,889,102 B).","sec168":"IDENTICAL on both seals under the amended spec (hash 7a041431deb905e174069233f9f941a2fee4186e602c4ef8955f87229ea398f6, byte_len 90049, word_count 13422) — the baseline residual divergence (all-empty table row) is closed by the published table strip/empty rules.","sec7519_on_new_canon":"hash 0f8f8d82e5e1f426ee5ed0f8d6ec17149c8901967aa597969a0c9b44795ab5b0, byte_len 8784, word_count 1381; 'Notwithstanding the preceding provisions' occurrence count = 1 (was 2 under 1.0)."},"cite_check_hostile_subset_new_snapshot":{"curly_quotes_to_straight_sec1":"exact curly passage MATCH; straight-quote swap DIVERGES (§9.2: quote marks are bytes)","dropped_oxford_comma":"DIVERGES","editorial_passage_claimed_as_statute_61":"NOT_IN_CORPUS + layer_hint EDITORIAL + editorial_pointer","em_dash_to_hyphen_swap":"DIVERGES","exact_61_control":"MATCH","false_MATCH_count":0,"instruction_shaped_passage":"NOT_IN_CORPUS; real passage + appended instruction = DIVERGES (bytes only)","micro_passage":"PASSAGE_TOO_SHORT named refusal","one_word_substitution":"DIVERGES","overlong_passage_65600B":"-32602 naming passage","punctuation_comma_to_semicolon":"DIVERGES","sec7519_dedup_at_verdict_layer":"formerly duplicated passage, unclaimed on NEW snapshot: MATCH with exactly ONE location (§7519 start 4396 end 4539); on OLD snapshot: MATCH with TWO locations (4396-4539, 5061-5204) — the 1.0 duplication remains visible only in the historical snapshot; claimed §7519 MATCH; 100->99 percent alteration DIVERGES","single_digit_dollar_alteration_sec1":"DIVERGES, passage_offset 9, section_offset 472 (identical localization to baseline)","whitespace_only_variant":"MATCH (published design §5.4/§9.2)","word_transposition_fringe_commissions_swap":"DIVERGES","wrong_section_claim_61_text_claimed_62":"NOT_IN_CORPUS + found_elsewhere [26 USC §61]"},"observations_reconfirmed":{"D-5":"PERSISTS as observation, not a regression: unclaimed cite_check of repealed §4's canonical line on the new snapshot returns MATCH with keys [citation, locations, section_canonical_sha256, snapshot, span, verdict] — still no status field. Spec-conformant (§9.5 may-list unchanged); honesty-gap note stands for a future spec amendment.","D-6":"PERSISTS as observation: 115 identifier-absent entries on the new manifest share derived citation '26 USC §' (first samples all that form); addressing one returns CITATION_MALFORMED (grammar requires digits); still reachable only via manifest_get paging / search / unclaimed cite_check. Unchanged from baseline.","D-7":"PERSISTS as observation: cite_check._candidate_sections still samples 32-byte windows at step 8 (cite_check.py lines 75-87, unchanged); claimed-citation path remains exact. Non-MATCH outcomes only; §9.6 unthreatened."},"seal_envelope_and_snapshots":{"changed_sections_independent":"Manifest-entry diff old vs new = exactly 1 (26 USC §7519: 573f059d79d5060492793e2e8963c57e7ea3b23b95f84cd73fbcc06fa3c3f4b8 -> 0f8f8d82e5e1f426ee5ed0f8d6ec17149c8901967aa597969a0c9b44795ab5b0, byte_len 9278->8784, word_count 1461->1381); editorial entry diffs = 0; meta diffs = 0; header diffs confined to snapshot_id/manifest_sha256/canonicalization_version/sealed_at/signature/sections/corpus_root (editorial_root unchanged); file-level diff over 4557 files per snapshot = manifest.json, build_record.json, sections/1972__7519.txt only. build_record changed_sections = [26 USC §7519] CONFIRMED independently.","envelope_regressions":"malformed JSON -32700; unknown method -32601; unknown vs forbidden tool -32602 identical shape; citation as list -> CITATION_MALFORMED named refusal; credential-shaped value -> SECRET_IN_PAYLOAD; forged snapshot id -> SNAPSHOT_NOT_FOUND with snapshot: null; snapshot block present on all 10 tools' responses carrying the NEW manifest_sha256 + canon 1.1","lineage_recording":"new snapshot build_record.json carries supersedes usc26-119-124-3ba6c8dc5ce0, prior_manifest_sha256 33a12ee1..., canonicalization_version verbatim-canon/1.1; data/history.json has exactly 2 entries, the second carrying supersedes + canon 1.1; current.json points to the new snapshot; snapshot_list serves both newest-first; corpus_status history_count 2.","new_snapshot_identity":"usc26-119-124-de68dcc8b3db, manifest_sha256 fbef079241408774cce87675ac36472145235a377a352194c32304e486413afd (independently recomputed, scope 1), canon verbatim-canon/1.1, sealed_at 2026-10-26T04:35:27+00:00, signer fixture (independently re-verified: signature == HMAC-SHA256(fixture key, raw manifest_sha256 bytes), fingerprint == SHA-256 of fixture key — same for old snapshot)","old_snapshot_untouched_fetchable":"manifest_sha256 still 33a12ee13a1fab7301acca2016975de05ea332bea04de57cc630aedd7ef18d59, corpus_root still 24864e99..., editorial_root unchanged; manifest_verify on old snapshot: all ok, FIXTURE_SIGNED, no divergent; get_section §7519 by explicit old snapshot returns the 1.0 text (passage count 2, hash 573f059d...) — append-only history honored on the wire.","old_tree_hash_claim":"Builder-claimed old-tree hash 1e5b84f5... NOT REPRODUCED under any of 8 natural constructions tried by the bench (paths+hashes lines d139c8a4..., hash-concat 3bf63033..., raw-bytes concat e8ba1c15..., json map 5aa01869..., Merkle over file hashes 84bde395..., sha256sum-style lines d8423de3..., others). No construction for the figure is published in any workspace artifact the bench could find. NON-BLOCKING claim-hygiene note: the substantive property (old snapshot untouched) is proven more strongly by the seal values above, every one identical to the baseline bench's verified values; the unverifiable figure should be dropped or its construction published."},"spec_amendment_audit_D1":{"claim":"amend-only (§5 header/§5.3/§5.3.1/§5.3.2/§5.7/§8.1), version strings -> verbatim-canon/1.1, no test loosened","verdict":"VERIFIED. Amended §5 carries the chapeau/continuation join rule, section-level loose content rule, block-0 omission rule, table strip + all-empty-row rule, §5.3.1 <num> normalization, §5.3.2 walk rules 1-4, complete §5.7 classification, and the §8.1 null-id derivation procedure — and the bench recompute above reproduces the seal from that text. §17.2 test 1, §17.3 tamper line, §9.6 subtle-alteration law, §9.1 caps and §15 vocabulary read unchanged against the baseline card's quotations. canonicalization_version is verbatim-canon/1.1 uniformly (spec §5 header/§7.1/§8.3, canon.py, README, bazaar-manifest.json, both new-snapshot artifacts); 1.0 appears only in amendment-record/historical contexts and in the old snapshot's own artifacts."}},"defects":[{"detail":"All grammar-form non-Title-26 citations (N USC / N U.S.C. / CFR forms, every tool, claimed_citation included) now correctly return CORPUS_OUT_OF_SCOPE. Only the long-form prose spelling falls through to the citation grammar and refuses CITATION_MALFORMED. Arguably spec-conformant (§13.1 grammar names the '26 USC §<num>' reference forms; prose titles are outside the grammar entirely), but §15.1's 'any non-Title-26 citation' wording can be read to cover it. Also noted: '26 US Code §61' (Title 26 prose form) returns CITATION_MALFORMED, which is the correct side of the line. Recommend a one-line §13.1 clarification either way at the next spec touch; not a product fix on its own.","id":"D-8","name":"Long-form prose title citation ('Title 18, United States Code, §1341') returns CITATION_MALFORMED instead of CORPUS_OUT_OF_SCOPE","repro":"get_section {citation: 'Title 18, United States Code, §1341'} -> CITATION_MALFORMED","severity":"OBSERVATION"},{"detail":"The seal includes nested-note text (e.g. §112's '[Amended section 3401 of this title.]'), which is the §5.4-literal reading ('concatenate descendant text nodes in document order', no intra-note exclusions published in §6) and the reading under which this bench's recompute converges 2277/2277 editorially. The preserved baseline bench code implemented the opposite reading and diverges on exactly 7 sections (§112, §403, §430, §3134, §3304, §7804 + 1) editorially only; the statutory seal is unaffected under either reading. Symmetric in kind to D-1 but editorial-only and 7/2277; recommend a one-line §6 erratum ('a note's text is all its descendant text nodes, including any nested note') at the next spec touch so a future independent implementer cannot diverge silently.","id":"D-9","name":"§6 does not state whether text of a note nested inside a note enters the parent note's editorial bytes; the two readings diverge on 7 sections' editorial hashes","severity":"OBSERVATION"}],"environment":"local","history":[{"card":"eclipse-verbatim-mcp-2026-10-26.json","note":"baseline bench (defects D-1..D-7); this card is the scoped re-bench of its fix round, append-only","verdict":"PARTIAL"}],"name_status":"CONDITIONAL (spec D1 TM screen owner-side, still open; gates public surface only, does not gate this local certification)","notes":["Verdict CERTIFIED(local): every scoped item passes. The certification-blocking defect D-1 is closed by evidence, not by assertion — an independent implementation from the amended spec text reproduces the new seal exactly (2277/2277 statutory + 2277/2277 editorial + both roots + manifest_sha256 + snapshot-id derivation), and run against the old seal it diverges at exactly the one section the single published rule change predicts. D-2 and D-3 are closed including shapes beyond the builder's repros (editorial-layer tamper, multi-section tamper, store-bytes tamper with a pristine manifest; 13 title/CFR forms across 6 tools/routes). D-4 is closed in the new snapshot (passage sealed once; one cite-check location) with the 1.0 duplication preserved in the untouched historical snapshot, as append-only law requires.","No new defects above OBSERVATION severity. D-5/D-6/D-7 remain observations with behavior byte-identical to baseline — none regressed, none was in the fix scope. D-8/D-9 are spec-clarification candidates for the next spec touch, not product fixes.","Builder claims audit: suite 64/64 + smoke PASS CONFIRMED by bench re-run; test_fix_round.py 14 tests CONFIRMED by count and by independent wire-level equivalents of its D-2/D-3/D-4 assertions; new snapshot id + manifest_sha256 CONFIRMED; changed_sections [26 USC §7519] CONFIRMED independently from the two manifests and the file trees; old snapshot tree-hash figure 1e5b84f5... NOT REPRODUCED (construction unpublished — see scope 5 note; substantive integrity proven via seal values).","Name remains CONDITIONAL (D1 screen owner-side): this certification covers the local product under its working name; no public surface ships under any name before D1 closes (spec §19). Bazaar copy still states 'Bench pending — no certification claimed' — stale after this card; updating listing copy is a publish-pass action, not a bench action.","Bench artifacts (ephemeral): /tmp/verbatim-rebench/ — canon11.py (independent canon 1.1), run_recompute.py + recompute_result.json, wire_rebench.py + wire_result.json, tamper.py + tamper_result.json (copies under /tmp/verbatim-tamper were deleted per case after each run). Preserved baseline bench code at /tmp/verbatim-bench/ untouched and reused. Product data was not modified by the bench except receipts.jsonl appends, which are the product's own refusal-trail behavior."],"qualifier":"local","scope_verdicts":{"1_spec_literal_recompute_17_2_test1":"PASS — full convergence on amended §5 (see centerpiece)","2_D2_tamper_fresh_shapes":"PASS — every entry/bytes tamper named + signature degraded; metadata-only tampers degrade loudly","3_D3_citation_scope_fresh_shapes":"PASS — all grammar-form non-Title-26 citations CORPUS_OUT_OF_SCOPE; grammar failures stay CITATION_MALFORMED (one new observation D-8 on long-form prose titles)","4_cite_check_hostile_subset":"PASS — zero false MATCH across the subset on the new snapshot","5_seal_envelope_new_snapshot":"PASS — old snapshot untouched and fetchable, changed_sections independently [26 USC §7519] only, lineage recorded (one claim-hygiene note on the builder tree-hash figure, non-blocking)"},"tool":"eclipse-verbatim-mcp","verdict":"CERTIFIED","version":"0.1.0"}