Skip to content

Close EVAL-010 frozen corpus admission and oracle isolation - #28

Draft
oigorbrito wants to merge 20 commits into
rjudi/wave-f-datajud-source-001from
rjudi/wave-g-eval010-corpus-admission-001
Draft

oigorbrito wants to merge 20 commits into
rjudi/wave-f-datajud-source-001from
rjudi/wave-g-eval010-corpus-admission-001

Conversation

@oigorbrito

@oigorbrito oigorbrito commented Sep 11, 2026 •

Copy link
Copy Markdown
Owner

Wave G — EVAL-010 frozen real-corpus admission

Base: Wave F head ba85b3844af2fb26ad67e3e7234c192e71712e3d.
Current exact head: 30033c517c39dcf6ceb5a7a82d85d65acafdee64.

Scope closed in code:

  • frozen EVAL-010 manifest contract for the pre-specified 30–50 real-case range
  • canonical CNJ validation via existing LegalCaseCnj Módulo 97 rule
  • immutable source, structured-oracle and oracle-review references/hashes per case
  • distinct oracle author/reviewer identifiers and review timestamp
  • exact source/oracle/review SHA-256 verification for every case
  • hard oracle-isolation gate against benchmark evidence
  • benchmark oracle reference/hash bound to frozen manifest
  • exact manifest bytes bound to externally supplied SHA-256
  • rooted external corpus verifier with deterministic exit codes
  • OS-correct lexical root comparison; no symlink/reparse-point sandbox claim
  • Wave G gate runs build/contract tests/diff check before classifying absent external corpus as BLOCKED
  • RJ-BLK-003 narrowed to supply of authorized frozen 30–50 case corpus/oracle/review artifacts

Method classification:

  • 30–50 case range: SUPPORTED_BY_SPEC
  • frozen manifest/artifact hashing: REPRODUCIBILITY_SUPPORTED
  • independent oracle-review metadata and oracle isolation: DERIVED_FROM_METHOD
  • verifier implementation/env names: PROJECT_DECISION

Canonical gate:
.\scripts\test-rjudi-wave-g.ps1

External corpus required for full admission:

  • RJ_EVAL010_MANIFEST_PATH
  • RJ_EVAL010_MANIFEST_SHA256
  • RJ_EVAL010_ARTIFACT_ROOT
  • optional RJ_EVAL010_BENCHMARK_CATALOG_PATH

Exact-head execution state:

  • CI run 34567849125 on 30033c517c39dcf6ceb5a7a82d85d65acafdee64
  • runner-smoke: failure with steps = null and logs_url = null
  • build-test: skipped
  • no checkout, SDK setup, build or repository test command executed
  • product status remains NOT_TESTED / remote execution BLOCKED by RJ-BLK-002

Explicit nonclaims:

  • no real 30–50 case corpus is bundled/admitted yet
  • no oracle quality or cross-tribunal representativeness claim
  • no retrieval/model/provider selection
  • no weighted composite score
  • no exact-head PASS until executable evidence exists
  • no symlink/reparse-point sandbox guarantee

Failure rule:

  • pre-step CI failure = BLOCKED infrastructure, not product FAIL
  • absent real corpus = RJ-BLK-003 BLOCKED after local contract work
  • manifest/hash/oracle-isolation mismatch on supplied real corpus = FAIL until investigated and rerun

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant