Skip to content

ci: exercise PR 32 downstream regex conformance - #34

Draft
btthomas wants to merge 16 commits into
mainfrom
blake.thomas/FFL-2914-pr32-downstream-conformance
Draft

ci: exercise PR 32 downstream regex conformance#34
btthomas wants to merge 16 commits into
mainfrom
blake.thomas/FFL-2914-pr32-downstream-conformance

Conversation

@btthomas

Copy link
Copy Markdown
Contributor

Important

Evidence only. This draft PR is not intended to merge. It runs the fixture proposed by PR 32 across the existing downstream compatibility workflow.

Motivation

PR 32 changes the portable targeting-regex contract from v2 to v3. This run checks that downstream consumers can load all 77 cases and that the declared Go and Rust engine observations still match production evaluator behavior.

The candidate fixture comes from PR 32 commit 102a45880a1f27047d4dc39feadb79e789ba3ca0. Its checked-in SHA-256 is 7ce5d5f7fb3cb3bb589763c4cb6052493b000c23224aed263255c9c1cda77539.

Changes

  • Combine the PR 32 fixture with the downstream workflow from PR 23.
  • Run the focused regex test in Go, Java, JavaScript, Python, Ruby, .NET, PHP, and libdatadog.
  • Preserve the existing distinction between enforced engine observations and informational native behavior.

Decisions

  • Accepted matching behavior is unchanged in v3.
  • Native acceptance of a rejected case is not an SDK production bug.
  • Failures caused only by a hard-coded v2 version, 75-case count, or old hash belong to the evidence test harness.
  • A mismatch in a declared Go or Rust engine observation needs investigation before PR 32 merges.

Checklist

  • JSON files are valid.
  • The canonical regex validator, negative validator tests, SHA-256 check, and fixture validator pass.
  • The workflow script passes bash -n.
  • New regex cases are standalone and do not require flag configuration or evaluation cases.

leoromanovsky and others added 16 commits August 10, 2026 17:43
Run focused Go and Java fixture tests against the baseline and candidate revisions.

Environment: Datadog workspace
Run the candidate regex contract and base-versus-head UFC evaluation across every current tracer evaluator and libdatadog.

Environment: Datadog workspace
Refresh the evidence-only stack after merging main into PR #21 and isolate the regex audit from the canonical compatibility workflow.\n\nEnvironment: Datadog workspace
Run only the candidate regex contract in the evidence-only stack and use the repository-native Python Riot command so infrastructure failures are not reported as conformance mismatches.

Environment: Datadog workspace
Use the focused Python 3.13 Riot environment and make the ephemeral Actions checkout writable by ddtest's container user.

Environment: Datadog workspace
Let Python's suite runner install the project dependencies after fixing checkout permissions, and install the curl development headers required to build the PHP extension.

Environment: Datadog workspace
Create the cache and Riot bind-mount directories before relaxing permissions so Cython and the test environment can write them from the ddtest container.

Environment: Datadog workspace
Environment: Datadog workspace
…ine-unicode-authoring' into blake.thomas/FFL-2914-pr32-downstream-conformance
…nformance-ci' into blake.thomas/FFL-2914-pr32-downstream-conformance
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants