Skip to content

ci: skip online tests due to flakiness - #2156

Merged
morrisonlevi merged 2 commits into
masterfrom
levi/SKIP_ONLINE_TESTS
Jul 13, 2023
Merged

ci: skip online tests due to flakiness#2156
morrisonlevi merged 2 commits into
masterfrom
levi/SKIP_ONLINE_TESTS

Conversation

@morrisonlevi

@morrisonlevi morrisonlevi commented Jul 12, 2023

Copy link
Copy Markdown
Collaborator

Description

The language tests are sometimes flaky with network related tests. Although we've added many to our xfail lists, new ones get added from time to time when we update PHP versions used in the tests. This seems a bit more robust than explicitly listing all of them in the xfail lists.

Some online tests like ext/sockets/tests/socket_shutdown.phpt exist on versions which don't check SKIP_ONLINE_TESTS, so they are added to the xfail lists for the relevant versions.

Readiness checklist

  • Changelog has been added to the release document.
  • Tests added for this feature/bug. This skips tests ^_^

Reviewer checklist

  • Appropriate labels assigned.
  • Milestone is set.

@morrisonlevi morrisonlevi added this to the 0.90.0 milestone Jul 12, 2023
@morrisonlevi
morrisonlevi requested a review from a team as a code owner July 12, 2023 00:08
@morrisonlevi morrisonlevi modified the milestones: 0.90.0, 0.89.0 Jul 12, 2023
@pr-commenter

pr-commenter Bot commented Jul 12, 2023

Copy link
Copy Markdown

Benchmarks

Benchmark execution time: 2023-07-12 00:12:24

Comparing candidate commit e6c9afd in PR branch levi/SKIP_ONLINE_TESTS with baseline commit 610f189 in branch master.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 6 metrics, 0 unstable metrics.

@bwoebi

bwoebi commented Jul 12, 2023

Copy link
Copy Markdown
Collaborator

This socket_shutdown.phpt test should probably also really be added to xfail...

@morrisonlevi
morrisonlevi force-pushed the levi/SKIP_ONLINE_TESTS branch from f4d0157 to eca3f5c Compare July 12, 2023 17:29
@morrisonlevi
morrisonlevi merged commit 2a5cfaf into master Jul 13, 2023
@morrisonlevi
morrisonlevi deleted the levi/SKIP_ONLINE_TESTS branch July 13, 2023 04:50
Leiyks added a commit that referenced this pull request Aug 4, 2026
Bump the libdatadog submodule to PR #2156's head (938c110), which brings in
the v1 sidecar span encoder/decoder (#2145, #2174) via its main base.

Regenerate components-rs/{common,sidecar}.h with cbindgen (exposes the new
ddog_sidecar_send_trace_v1_shm / _bytes entrypoints and the
ASM_RAW_RESPONSE_BODY remote-config capability) and mirror libdatadog's
consolidated [workspace.dependencies] into the root Cargo.toml so the
path-dependency crates resolve their { workspace = true } inheritance.

Wire format is unchanged: v04 remains the default send path.
Leiyks added a commit that referenced this pull request Aug 5, 2026
Bump the libdatadog submodule to PR #2156's head (938c110), which brings in
the v1 sidecar span encoder/decoder (#2145, #2174) via its main base.

Regenerate components-rs/{common,sidecar}.h with cbindgen (exposes the new
ddog_sidecar_send_trace_v1_shm / _bytes entrypoints and the
ASM_RAW_RESPONSE_BODY remote-config capability) and mirror libdatadog's
consolidated [workspace.dependencies] into the root Cargo.toml so the
path-dependency crates resolve their { workspace = true } inheritance.

Wire format is unchanged: v04 remains the default send path.
Leiyks added a commit that referenced this pull request Aug 6, 2026
Bump the libdatadog submodule to PR #2156's head (938c110), which brings in
the v1 sidecar span encoder/decoder (#2145, #2174) via its main base.

Regenerate components-rs/{common,sidecar}.h with cbindgen (exposes the new
ddog_sidecar_send_trace_v1_shm / _bytes entrypoints and the
ASM_RAW_RESPONSE_BODY remote-config capability) and mirror libdatadog's
consolidated [workspace.dependencies] into the root Cargo.toml so the
path-dependency crates resolve their { workspace = true } inheritance.

Wire format is unchanged: v04 remains the default send path.
Leiyks added a commit that referenced this pull request Aug 24, 2026
Bump the libdatadog submodule to PR #2156's head (938c110), which brings in
the v1 sidecar span encoder/decoder (#2145, #2174) via its main base.

Regenerate components-rs/{common,sidecar}.h with cbindgen (exposes the new
ddog_sidecar_send_trace_v1_shm / _bytes entrypoints and the
ASM_RAW_RESPONSE_BODY remote-config capability) and mirror libdatadog's
consolidated [workspace.dependencies] into the root Cargo.toml so the
path-dependency crates resolve their { workspace = true } inheritance.

Wire format is unchanged: v04 remains the default send path.
Leiyks added a commit that referenced this pull request Aug 25, 2026
Bump the libdatadog submodule to PR #2156's head (938c110), which brings in
the v1 sidecar span encoder/decoder (#2145, #2174) via its main base.

Regenerate components-rs/{common,sidecar}.h with cbindgen (exposes the new
ddog_sidecar_send_trace_v1_shm / _bytes entrypoints and the
ASM_RAW_RESPONSE_BODY remote-config capability) and mirror libdatadog's
consolidated [workspace.dependencies] into the root Cargo.toml so the
path-dependency crates resolve their { workspace = true } inheritance.

Wire format is unchanged: v04 remains the default send path.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants