Skip to content

fix: reject duplicate object keys in coverage-ledger.json - #103

Open
rudycelekli wants to merge 1 commit into
cloudflare:mainfrom
rudycelekli:fix/coverage-ledger-duplicate-object-keys
Open

rudycelekli wants to merge 1 commit into
cloudflare:mainfrom
rudycelekli:fix/coverage-ledger-duplicate-object-keys

Conversation

@rudycelekli

Copy link
Copy Markdown

What was wrong

validate-coverage-ledger.cjs passes the ledger to JSON.parse, which keeps the last occurrence of a repeated object key. preflightJsonText already tracks when a string is an object key, because it counts fields toward the 1,000-field limit. It never records which keys it has seen, though. So a unit can carry two values for the same field, and the validator checks only the last one.

Input that triggers it

This is a valid planned unit with "status":"covered", inserted before its real "status":"planned":

[{"coverage_id":"s::b::x::ATTACK-CLASSES.md%23Access%20control", "...": "...",
  "status":"covered","status":"planned","agent_id":null, "...": "..."}]

On main: PASS: 1 coverage units valid.

Fix

When beginString sees a key, it records where the key starts. When that string closes, the key is decoded with JSON.parse and checked against a per-object Set. A repeated key fails with input has duplicate object key "<key>", and the key is escaped with the existing safeQuote.

Keys are compared after decoding, the same way JSON.parse compares them:

  • "st\u0061tus" and "status" are treated as duplicates and rejected.
  • "a" and "A" are different keys, so they're still accepted. So are "\u00e9" and "e\u0301".
  • The same key in sibling objects or nested objects is still accepted.

Preflight on a 5 MB ledger with 900 keys per object still takes about 110 ms.

Tests

node --test skills/security-audit/validate-coverage-ledger.test.cjs
# tests 32, pass 32, fail 0

The new test text preflight rejects duplicate object keys instead of keeping the last one fails on main. It covers direct preflightJsonText calls and the CLI.

The findings validator has the same hole in a separate parser, so it's fixed in a separate PR.

JSON.parse keeps the last occurrence of a repeated key, so a unit such as
{"status":"covered",...,"status":"planned"} was validated only as its final
value. preflightJsonText already tracks when a string is an object key; it now
records each decoded key per object and rejects a repeat, including
escape-spelled repeats such as "st\u0061tus".
athallajovian9-cyber added a commit to JovianOps/security-audit-skill that referenced this pull request Oct 26, 2026
coffeegrind123 added a commit to coffeegrind123/security-audit-skill that referenced this pull request Nov 11, 2026
Upstream main has not moved since 2026-09-14, but 79 pull requests are
open. Each was read at the diff level, tested in its own worktree, and
checked for conflicts; the best of each duplicate group is ported.

Validators: cloudflare#143 archived verifier owner reuse, cloudflare#87 shared artifacts
within one attempt, cloudflare#102/cloudflare#103 duplicate JSON keys, cloudflare#111 1,000-field
objects, cloudflare#127 ordinary class must match assignment, cloudflare#104 self-excluded
ordinary block, cloudflare#141 verbatim quotes checked with --target, cloudflare#45 line
upper bound, cloudflare#84 --terminal rejects open units, cloudflare#145 identity-checked
open on Windows (POSIX still fails closed), cloudflare#48 retained-artifact
check (skills/ part only). Overlapping changes were merged so both
behaviours and both test sets survive.

Method: cloudflare#125 critic reasons through handoff, cloudflare#132 deployment controls
become units, cloudflare#83 carried-record gates, cloudflare#93 abort cleanup, cloudflare#23
streaming tool calls, cloudflare#50 config-dependent reachability stays
needs_validation, cloudflare#58 sequential verifier fallback, cloudflare#96 verifier no
longer sees the hunter's verdict, severity or fix.

Execution safety (cloudflare#76 neutralized git, symlink-safe copies; cloudflare#95
sanitized repo ID and prior-run compatibility; cloudflare#108 untrusted-content
prompt block; cloudflare#129 isolation built beside the host) moves into
EXECUTION-SAFETY.md so SKILL.md stays under its token budget.

Companions: cloudflare#101 cryptography, cloudflare#116 Android, cloudflare#35 edge isolate state.

Skipped: duplicates (cloudflare#82 cloudflare#106 cloudflare#91 cloudflare#70 cloudflare#138 cloudflare#131 cloudflare#75 cloudflare#63 cloudflare#97 cloudflare#123 cloudflare#25
cloudflare#26 cloudflare#16 cloudflare#40 cloudflare#42 cloudflare#142), validator-weakening fallbacks (cloudflare#59 cloudflare#113 cloudflare#99),
README/LICENSE churn, rebrands, scope creep, and cloudflare#85 cloudflare#90 cloudflare#8 cloudflare#89 cloudflare#32.

UPGRADE.md records this sync procedure.

Co-authored-by: Rohankollabathula67 <rohankollabathula67@gmail.com>
Co-authored-by: lab 1207 <hajarevaibhav527@gmail.com>
Co-authored-by: Rudy Celekli <rudy@gradiahq.com>
Co-authored-by: Mohit Rawat <rawatmohit17906@gmail.com>
Co-authored-by: MAHER AL-AQIL <18458259+maqalaqil@users.noreply.github.com>
Co-authored-by: CodeInf <jiuqiaoy@gmail.com>
Co-authored-by: pucedoteth <119044801+pucedoteth@users.noreply.github.com>
Co-authored-by: Matt Van Horn <mvanhorn@users.noreply.github.com>
Co-authored-by: Pizo <pizofreude@proton.me>
Co-authored-by: ZhiHe-ma <302089060+ZhiHe-ma@users.noreply.github.com>
Co-authored-by: shivam <juyaljii610@gmail.com>
Co-authored-by: Dante <duanjl.china@gmail.com>
Co-authored-by: Francisco <francisco@theysay.me>
Co-authored-by: Roman Dolgov <alter@users.noreply.github.com>
Co-authored-by: bodapatisaikrishna <saikrishnabodapati@gmail.com>
Co-authored-by: alvessh <117163985+alvessh@users.noreply.github.com>
Co-authored-by: itinance <hhuebel@itinance.com>
Co-authored-by: ChoYugyeong <cho4639@gmail.com>
Co-authored-by: Shaun Liebenberg <shaun@liebies.co.za>
Co-authored-by: JAI <jai19kharb@gmail.com>
Co-authored-by: ghostzeronz-coder <ghostzeronz-coder@users.noreply.github.com>
Co-authored-by: Aman Mohamed Ali <69119173+spidervirus@users.noreply.github.com>
Co-authored-by: Sandeep.dhami <sandeep84397@gmail.com>
Co-authored-by: jastfan <duohello640@gmail.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant