Skip to content

ConnectWithRevocation_WithCallback(checkRevocation: True) failed on macOS 12 with RevocationStatusUnknown #74034

Closed
Closed
ConnectWithRevocation_WithCallback(checkRevocation: True) failed on macOS 12 with RevocationStatusUnknown#74034
Assignees
rzikm
Labels
area-System.Net.Security
Milestone
8.0.0

Description

@danmoseley
danmoseley
opened on Aug 16, 2022

Affected tests:

Frequency: ConnectWithRevocation_ServerCertWithoutContext_NoStapledOcsp

  • Error: Assert.Contains() Failure Not found: RevocationStatusUnknown In value: X509ChainStatusFlags[] [Revoked]
Day Run Details
8/24 Rolling run 1964517 (7.0-rc1) net7.0-Linux-Release-arm64-NativeAOT_Release-(Ubuntu.1804.ArmArch.Open)Ubuntu.1804.ArmArch.Open
8/23 Rolling run 1963307 (7.0) net7.0-Linux-Release-arm64-NativeAOT_Release-(Ubuntu.1804.ArmArch.Open)Ubuntu.1804.ArmArch.Open
8/19 Rolling run 1955773 (7.0) net7.0-Linux-Release-arm64-NativeAOT_Release-(Ubuntu.1804.ArmArch.Open)Ubuntu.1804.ArmArch.Open

Note it retried the job, so it failed twice in a row
https://dev.azure.com/dnceng/public/_build/results?buildId=1947340&view=ms.vss-test-web.build-test-results-tab&runId=50144598&resultId=201890&paneView=dotnet-dnceng.dnceng-build-release-tasks.helix-test-information-tab

Console log: 'System.Net.Security.Tests' from job afed2094-0e40-4bd4-a0ee-55fa1b2cc3d1 workitem b1b033f0-1b26-438c-bff4-e307225d6774 (osx.1200.amd64.open) executed on machine dci-mac-build-316.local running macOS-10.16-x86_64-i386-64bit
...
Error message
Assert.Contains() Failure
Not found: Revoked
In value:  X509ChainStatusFlags[] [RevocationStatusUnknown]


Stack trace
   at System.Net.Security.Tests.CertificateValidationRemoteServer.<ConnectWithRevocation_WithCallback_Core>g__CertificateValidationCallback|6_0(Object sender, X509Certificate certificate, X509Chain chain, SslPolicyErrors sslPolicyErrors) in /_/src/libraries/System.Net.Security/tests/FunctionalTests/CertificateValidationRemoteServer.cs:line 351
   at System.Net.Security.SslStream.VerifyRemoteCertificate(RemoteCertificateValidationCallback remoteCertValidationCallback, SslCertificateTrust trust, ProtocolToken& alertToken, SslPolicyErrors& sslPolicyErrors, X509ChainStatusFlags& chainStatus) in /_/src/libraries/System.Net.Security/src/System/Net/Security/SslStream.Protocol.cs:line 1031
   at System.Net.Security.SslStream.CompleteHandshake(ProtocolToken& alertToken, SslPolicyErrors& sslPolicyErrors, X509ChainStatusFlags& chainStatus) in /_/src/libraries/System.Net.Security/src/System/Net/Security/SslStream.IO.cs:line 506
   at System.Net.Security.SslStream.CompleteHandshake(SslAuthenticationOptions sslAuthenticationOptions) in /_/src/libraries/System.Net.Security/src/System/Net/Security/SslStream.IO.cs:line 519
   at System.Net.Security.SslStream.ForceAuthenticationAsync[TIOAdapter](Boolean receiveFirst, Byte[] reAuthenticationData, CancellationToken cancellationToken) in /_/src/libraries/System.Net.Security/src/System/Net/Security/SslStream.IO.cs:line 332
   at System.Threading.Tasks.TaskTimeoutExtensions.GetRealException(Task task) in /_/src/libraries/Common/tests/System/Threading/Tasks/TaskTimeoutExtensions.cs:line 120
--- End of stack trace from previous location ---
   at System.Threading.Tasks.TaskTimeoutExtensions.WhenAllOrAnyFailed(Task[] tasks) in /_/src/libraries/Common/tests/System/Threading/Tasks/TaskTimeoutExtensions.cs:line 90
   at System.Threading.Tasks.TaskTimeoutExtensions.WhenAllOrAnyFailed(Task[] tasks, Int32 millisecondsTimeout) in /_/src/libraries/Common/tests/System/Threading/Tasks/TaskTimeoutExtensions.cs:line 55
   at System.Net.Security.Tests.CertificateValidationRemoteServer.ConnectWithRevocation_WithCallback_Core(X509RevocationMode revocationMode, Nullable`1 offlineContext) in /_/src/libraries/System.Net.Security/tests/FunctionalTests/CertificateValidationRemoteServer.cs:line 308
   at System.Net.Security.Tests.CertificateValidationRemoteServer.ConnectWithRevocation_WithCallback_Core(X509RevocationMode revocationMode, Nullable`1 offlineContext) in /_/src/libraries/System.Net.Security/tests/FunctionalTests/CertificateValidationRemoteServer.cs:line 309
   at System.Net.Security.Tests.CertificateValidationRemoteServer.ConnectWithRevocation_WithCallback_Core(X509RevocationMode revocationMode, Nullable`1 offlineContext) in /_/src/libraries/System.Net.Security/tests/FunctionalTests/CertificateValidationRemoteServer.cs:line 309
   at System.Net.Security.Tests.CertificateValidationRemoteServer.ConnectWithRevocation_WithCallback_Core(X509RevocationMode revocationMode, Nullable`1 offlineContext) in /_/src/libraries/System.Net.Security/tests/FunctionalTests/CertificateValidationRemoteServer.cs:line 309
   at System.Net.Security.Tests.CertificateValidationRemoteServer.ConnectWithRevocation_WithCallback_Core(X509RevocationMode revocationMode, Nullable`1 offlineContext) in /_/src/libraries/System.Net.Security/tests/FunctionalTests/CertificateValidationRemoteServer.cs:line 309
--- End of stack trace from previous location ---

failed in #74023 (comment)

Activity

  1. ghost added
    area-System.Net.Security
    on Aug 16, 2022
  2. ghost added
    untriagedNew issue has not been triaged by the area owner
    on Aug 16, 2022

  4. carlossanlop commented on Aug 17, 2022

    @carlossanlop
    carlossanlop
    on Aug 17, 2022 · Hidden as duplicate

  5. carlossanlop commented on Aug 17, 2022

    @carlossanlop
    carlossanlop
    on Aug 17, 2022
    Contributor

    @dotnet/ncl this failure is fairly recent, and I'm seeing it in the RC1 branch. Something to keep in mind in case it needs a backport.

  6. wfurt commented on Aug 17, 2022

    @wfurt
    wfurt
    on Aug 17, 2022
    Member

    added in #69833. cc @bartonjs. We may put in some debug to the AIA HttpListeners....

  7. carlossanlop commented on Aug 18, 2022

    @carlossanlop
    carlossanlop
    on Aug 18, 2022 · Hidden as duplicate

  8. CarnaViire commented on Aug 18, 2022

    @CarnaViire
    CarnaViire
    on Aug 18, 2022
    Member

    Triage: We should look at it in 8.0. @rzikm to check how much this is failing, and we should disable the test if it hurts CI (and backport disabling the test to 7.0)

  9. CarnaViire
    added this to the 8.0.0 milestone on Aug 18, 2022
  10. ghost removed
    untriagedNew issue has not been triaged by the area owner
    on Aug 18, 2022

  11. carlossanlop commented on Aug 18, 2022

    @carlossanlop
    carlossanlop
    on Aug 18, 2022
    Contributor

    @CarnaViire does this meet the bar for 7.0? It was initially found in an RC1 backport PR: #74023

  12. akoeplinger commented on Aug 18, 2022

    @akoeplinger
    akoeplinger
    on Aug 18, 2022 · Hidden as duplicate

  13. rzikm commented on Aug 18, 2022

    @rzikm
    rzikm
    on Aug 18, 2022
    Member

    Fails quite often (4/day)

    2022-08-18T02:03:00.016Z
    2022-08-17T23:16:43.35Z
    2022-08-17T22:43:35.342Z
    2022-08-17T13:45:15.352Z
    2022-08-17T06:18:06.761Z
    2022-08-16T21:29:30.516Z
    2022-08-16T20:59:02.283Z
    2022-08-16T20:27:38.852Z
    2022-08-16T20:12:48.139Z
    2022-08-16T19:40:53.34Z
    2022-08-15T23:31:56.85Z

    I think we should disable this test on unixes until we address this.

  14. rzikm
    self-assigned this
    on Aug 18, 2022

  15. carlossanlop commented on Aug 18, 2022

    @carlossanlop
    carlossanlop
    on Aug 18, 2022
    Contributor

    Thanks @rzikm. Please backport the disabling of the test to rc1.

  16. 4 remaining items

  17. missymessa commented on Aug 19, 2022

    @missymessa
    missymessa
    on Aug 19, 2022
    Member

    Here's a comparable query for the new test reporting tables, since TestResults will be decommissioned in the near future.

    AzureDevOpsTests
    | where TestName contains "ConnectWithRevocation_WithCallback"
    | where RunCompleted > ago(5d)

    Here's a snippet of the results
    image

  18. karelz commented on Aug 24, 2022

    @karelz
    karelz
    on Aug 24, 2022
    Member

    The test was disabled in PR #74168

  19. karelz
    added
    disabled-testThe test is disabled in source code against the issue
    on Aug 24, 2022

  20. karelz commented on Aug 24, 2022

    @karelz
    karelz
    on Aug 24, 2022
    Member

    @rzikm can you please backport the test disabling into 7.0 branch? It is still hitting there. Thanks!

  21. rzikm
    removed their assignment
    on Aug 24, 2022

  22. karelz commented on Aug 25, 2022

    @karelz
    karelz
    on Aug 25, 2022
    Member

    Another similar test ConnectWithRevocation_ServerCertWithoutContext_NoStapledOcsp is failing CI on NativeAOT -- we will need to disable it as well (see top post).
    @rzikm can you please do it? Thanks!

    Marking as blocking-clean-ci until it is disabled in both main and 7.0.

  23. karelz
    added
    blocking-clean-ciBlocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms'
    on Aug 25, 2022
  24. karelz
    assigned
    rzikm
    on Aug 25, 2022

  25. karelz commented on Aug 25, 2022

    @karelz
    karelz
    on Aug 25, 2022
    Member

    The tests tracked by this issue have been merged into tracking issue #70981 -- the PR #74561 above will update the disabled test against that issue.

  26. karelz commented on Aug 25, 2022

    @karelz
    karelz
    on Aug 25, 2022
    Member

    Duplicate of #70981

  27. karelz
    marked this as a duplicate of Assert in System.Net.Security.Tests.CertificateValidationRemoteServer.ConnectWithRevocation_* #70981 on Aug 25, 2022
  28. karelz
    closed this as completedon Aug 25, 2022
  29. karelz
    removed
    blocking-clean-ciBlocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms'
    disabled-testThe test is disabled in source code against the issue
    on Aug 25, 2022
  30. ghost locked as resolved and limited conversation to collaborators on Sep 24, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

area-System.Net.Security

Type

No type

Projects

No projects

    Milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions