Skip to content

integration tests are flaky on linux-arm64 #4543

Closed

Description

@jamescrosswell

Description

We're regularly seeing one of the integration tests fail on linux-arm64 due to:

Executing dotnet run --project ./net4-console -c Release
  Unhandled exception: An error occurred trying to start process 'mono' with working directory '/home/runner/work/sentry-dotnet/sentry-dotnet/integration-test'. No such file or directory
Error: [-] Ensure System.Reflection.Metadata is not missing 4.42s (4.42s|2ms)
Message
  Expected string '"exception":{"values":\[{"type":"System.ApplicationException","value":"Something happened!"' to match any element in collection @().
  at $output | Should -AnyElementMatch '"exception":{"values":\[{"type":"System.ApplicationException","value":"Something happened!"', /home/runner/work/sentry-dotnet/sentry-dotnet/integration-test/runtime.Tests.ps1:215
  at <ScriptBlock>, /home/runner/work/sentry-dotnet/sentry-dotnet/integration-test/runtime.Tests.ps1:215
Tests completed in 121.26s
Tests Passed: 19, Failed: 1, Skipped: 2, Inconclusive: 0, NotRun: 0

e.g.

Activity

  1. linear commented on Sep 19, 2025

    @linear
  2. jpnurmi commented on Sep 19, 2025

    @jpnurmi
    Collaborator

    Looks like all linux-arm64 builds have started failing. Could be related to the runner image update:

    Last successful build: https://github.com/getsentry/sentry-dotnet/actions/runs/17829095429/job/50689445197

    VM Image
      - OS: Linux (arm64)
      - Source: Partner
      - Name: Ubuntu 22.04 by Arm Limited
      - Version: 20250829.18.1
      - Included Software: https://github.com/actions/partner-runner-images/blob/main/images/arm-ubuntu-22-image.md
    

    vs.

    First failed build: https://github.com/getsentry/sentry-dotnet/actions/runs/17847380085/job/50749611225

    VM Image
      - OS: Linux (arm64)
      - Source: Partner
      - Name: Ubuntu 22.04 by Arm Limited
      - Version: 20250917.23.1
      - Included Software: https://github.com/actions/partner-runner-images/blob/main/images/arm-ubuntu-22-image.md
    
  3. jamescrosswell commented on Sep 19, 2025

    @jamescrosswell
    CollaboratorAuthor

    Yeah, I'm starting to think they're not flaky... they're failing reliably now 😜

    Weirdly, that image/release isn't even documented:

    The most recent "release" of that image seems to be ubuntu22/20250907.50 (i.e. from 10 days before the images we're seeing).

  4. removed
    Flaky TestA test fails intermittently, passes on retry. Productivity killer.
    on Sep 19, 2025
  5. added a commit that references this issue on Sep 19, 2025
    1cd9eee
  6. self-assigned this
    on Sep 19, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

Projects

  • Status
    Done

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions