Repository navigation
Crypto and Networking tests failing on Linux Mariner when running on Mono. #57506
Copy link
Copy link
Closed
Closed
Copy link
Labels
Milestone
Description
Activity
- ghost addeduntriagedNew issue has not been triaged by the area ownerNew issue has not been triaged by the area owner
on Aug 16, 2021 - removeduntriagedNew issue has not been triaged by the area ownerNew issue has not been triaged by the area owner
on Aug 16, 2021 related to #56478 ? That one is Mono only as well.
https://helix.dot.net/ only talks about mariner.2, but
says mariner.1 (and there's no pipeline using mariner.2 that I see) so I'm not entirely sure the right way to go about clearing the ActiveIssue label here. But, having said that.- (Mariner.1.0.Amd64.Open)ubuntu.1604.amd64.open@mcr.microsoft.com/dotnet-buildtools/prereqs:cbl-mariner-1.0-helix-20210528192219-92bf620 root [ /projects/runtime ]# ./dotnet.sh build /t:Test /p:RuntimeFlavor=mono /p:OuterLoop=true src/libraries/System.Security.Cryptography.X509Certificates/tests/ MSBuild version 17.3.0-preview-22306-01+1c045cf58 for .NET Determining projects to restore... All projects are up-to-date for restore. Microsoft.Interop.SourceGeneration -> /projects/runtime/artifacts/bin/Microsoft.Interop.SourceGeneration/Debug/netstandard2.0/Microsoft.Interop.SourceGeneration.dll LibraryImportGenerator -> /projects/runtime/artifacts/bin/LibraryImportGenerator/Debug/netstandard2.0/Microsoft.Interop.LibraryImportGenerator.dll TestUtilities -> /projects/runtime/artifacts/bin/TestUtilities/Debug/net6.0/TestUtilities.dll System.Runtime -> /projects/runtime/artifacts/bin/System.Runtime/ref/Debug/net7.0/System.Runtime.dll System.Collections -> /projects/runtime/artifacts/bin/System.Collections/ref/Debug/net7.0/System.Collections.dll System.Runtime.Numerics -> /projects/runtime/artifacts/bin/System.Runtime.Numerics/ref/Debug/net7.0/System.Runtime.Numerics.dll System.Formats.Asn1 -> /projects/runtime/artifacts/bin/System.Formats.Asn1/ref/Debug/net7.0/System.Formats.Asn1.dll System.Formats.Asn1 -> /projects/runtime/artifacts/bin/System.Formats.Asn1/Debug/net7.0/System.Formats.Asn1.dll System.Security.Cryptography.Pkcs -> /projects/runtime/artifacts/bin/System.Security.Cryptography.Pkcs/ref/Debug/net7.0/System.Security.Cryptography.Pkcs.dll System.Security.Cryptography.Pkcs -> /projects/runtime/artifacts/bin/System.Security.Cryptography.Pkcs/Debug/net7.0/System.Security.Cryptography.Pkcs.dll System.Security.Cryptography.X509Certificates.Tests -> /projects/runtime/artifacts/bin/System.Security.Cryptography.X509Certificates.Tests/Debug/net7.0-unix/System.Security.Cryptography.X509Certificates.Tests.dll ----- start Fri Aug 5 06:15:01 PM UTC 2022 =============== To repro directly: ===================================================== pushd /projects/runtime/artifacts/bin/System.Security.Cryptography.X509Certificates.Tests/Debug/net7.0-unix /projects/runtime/artifacts/bin/testhost/net7.0-Linux-Debug-x64/dotnet exec --runtimeconfig System.Security.Cryptography.X509Certificates.Tests.runtimeconfig.json --depsfile System.Security.Cryptography.X509Certificates.Tests.deps.json xunit.console.dll System.Security.Cryptography.X509Certificates.Tests.dll -xml testResults.xml -nologo -notrait category=failing popd =========================================================================================================== /projects/runtime/artifacts/bin/System.Security.Cryptography.X509Certificates.Tests/Debug/net7.0-unix /projects/runtime/src/libraries/System.Security.Cryptography.X509Certificates/tests Discovering: System.Security.Cryptography.X509Certificates.Tests (method display = ClassAndMethod, method display options = None) Discovered: System.Security.Cryptography.X509Certificates.Tests (found 832 of 879 test cases) Starting: System.Security.Cryptography.X509Certificates.Tests (parallel test collections = on, max threads = 8) System.Security.Cryptography.X509Certificates.Tests.X509StoreTests.X509Store_MachineStoreLoadSkipsInvalidFiles [SKIP] Condition(s) not met: "NotRunningAsRootAndRemoteExecutorSupported" System.Security.Cryptography.X509Certificates.Tests.X509FilesystemTests.VerifyCrlCache [SKIP] Condition(s) not met: "RunManualTests" Finished: System.Security.Cryptography.X509Certificates.Tests === TEST EXECUTION SUMMARY === System.Security.Cryptography.X509Certificates.Tests Total: 1832, Errors: 0, Failed: 0, Skipped: 2, Time: 114.176s /projects/runtime/src/libraries/System.Security.Cryptography.X509Certificates/tests ----- end Fri Aug 5 06:16:57 PM UTC 2022 ----- exit code 0 ---------------------------------------------------------- exit code 0 means Exited Successfully # ./dotnet.sh build /t:Test /p:RuntimeFlavor=mono /p:OuterLoop=true src/libraries/System.Net.Security/tests/FunctionalTests/ MSBuild version 17.3.0-preview-22306-01+1c045cf58 for .NET Determining projects to restore... Restored /projects/runtime/src/libraries/System.Security.Claims/ref/System.Security.Claims.csproj (in 286 ms). Restored /projects/runtime/src/libraries/System.Security.Principal.Windows/ref/System.Security.Principal.Windows.csproj (in 286 ms). Restored /projects/runtime/src/libraries/System.Security.Principal.Windows/src/System.Security.Principal.Windows.csproj (in 286 ms). Restored /projects/runtime/src/libraries/System.Net.Security/tests/FunctionalTests/System.Net.Security.Tests.csproj (in 2.53 sec). 5 of 9 projects are up-to-date for restore. Microsoft.Interop.SourceGeneration -> /projects/runtime/artifacts/bin/Microsoft.Interop.SourceGeneration/Debug/netstandard2.0/Microsoft.Interop.SourceGeneration.dll LibraryImportGenerator -> /projects/runtime/artifacts/bin/LibraryImportGenerator/Debug/netstandard2.0/Microsoft.Interop.LibraryImportGenerator.dll TestUtilities -> /projects/runtime/artifacts/bin/TestUtilities/Debug/net6.0/TestUtilities.dll System.Runtime -> /projects/runtime/artifacts/bin/System.Runtime/ref/Debug/net7.0/System.Runtime.dll System.Security.Claims -> /projects/runtime/artifacts/bin/System.Security.Claims/ref/Debug/net7.0/System.Security.Claims.dll System.Security.Principal.Windows -> /projects/runtime/artifacts/bin/System.Security.Principal.Windows/ref/Debug/net7.0/System.Security.Principal.Windows.dll System.Security.Principal.Windows -> /projects/runtime/artifacts/bin/System.Security.Principal.Windows/Debug/net7.0/System.Security.Principal.Windows.dll StreamConformanceTests -> /projects/runtime/artifacts/bin/StreamConformanceTests/Debug/net7.0/StreamConformanceTests.dll System.Net.Security.Tests -> /projects/runtime/artifacts/bin/System.Net.Security.Tests/Debug/net7.0-unix/System.Net.Security.Tests.dll ----- start Fri Aug 5 06:20:51 PM UTC 2022 =============== To repro directly: ===================================================== pushd /projects/runtime/artifacts/bin/System.Net.Security.Tests/Debug/net7.0-unix /projects/runtime/artifacts/bin/testhost/net7.0-Linux-Debug-x64/dotnet exec --runtimeconfig System.Net.Security.Tests.runtimeconfig.json --depsfile System.Net.Security.Tests.deps.json xunit.console.dll System.Net.Security.Tests.dll -xml testResults.xml -nologo -notrait category=failing popd =========================================================================================================== /projects/runtime/artifacts/bin/System.Net.Security.Tests/Debug/net7.0-unix /projects/runtime/src/libraries/System.Net.Security/tests/FunctionalTests Discovering: System.Net.Security.Tests (method display = ClassAndMethod, method display options = None) Discovered: System.Net.Security.Tests (found 322 of 487 test cases) Starting: System.Net.Security.Tests (parallel test collections = on, max threads = 8) System.Net.Security.Tests.NegotiateStreamKerberosTest.NegotiateStream_ClientAuthenticationRemote_Fails [SKIP] Condition(s) not met: "IsServerAndDomainAvailable" System.Net.Security.Tests.NegotiateStreamKerberosTest.NegotiateStream_ClientAuthenticationRemote_Success [SKIP] Condition(s) not met: "IsServerAndDomainAvailable" System.Net.Security.Tests.NegotiateStreamKerberosTest.NegotiateStream_ServerAuthenticationRemote_Success [SKIP] Condition(s) not met: "IsClientAvailable" System.Net.Security.Tests.SslStreamEKUTest.SslStream_SelfSignedClientEKUClientAuth_Ok [SKIP] Condition(s) not met: "IsRootCertificateInstalled" System.Net.Security.Tests.SslStreamEKUTest.SslStream_ServerEKUClientAuth_Fails [SKIP] Condition(s) not met: "IsRootCertificateInstalled" System.Net.Security.Tests.SslStreamEKUTest.SslStream_ClientEKUServerAuth_Fails [SKIP] Condition(s) not met: "IsRootCertificateInstalled" System.Net.Security.Tests.SslStreamEKUTest.SslStream_NoEKUServerAuth_Ok [SKIP] Condition(s) not met: "IsRootCertificateInstalled" System.Net.Security.Tests.SslStreamEKUTest.SslStream_NoEKUClientAuth_Ok [SKIP] Condition(s) not met: "IsRootCertificateInstalled" System.Net.Security.Tests.SslStreamCertificateTrustTest.SslStream_SendCertificateTrust_ThrowsOnUnsupportedPlatform [SKIP] Condition(s) not met: "DoesNotSupportSendingCustomCANamesInTls" System.Net.Security.Tests.SslStreamNetworkStreamTest.SslStream_ClientCertificate_SendsChain [SKIP] chain cannot be built 1 Finished: System.Net.Security.Tests === TEST EXECUTION SUMMARY === System.Net.Security.Tests Total: 4853, Errors: 0, Failed: 0, Skipped: 10, Time: 16.989s /projects/runtime/src/libraries/System.Net.Security/tests/FunctionalTests ----- end Fri Aug 5 06:21:10 PM UTC 2022 ----- exit code 0 ---------------------------------------------------------- exit code 0 means Exited Successfully # cat /etc/os-release NAME="Common Base Linux Mariner" VERSION="2.0.20220731" ID=mariner VERSION_ID="2.0" PRETTY_NAME="CBL-Mariner/Linux" ANSI_COLOR="1;34" HOME_URL="https://aka.ms/cbl-mariner" BUG_REPORT_URL="https://aka.ms/cbl-mariner" SUPPORT_URL="https://aka.ms/cbl-mariner"That was with re-enabling all of the disabled tests:
diff --git a/src/libraries/System.Net.Security/tests/FunctionalTests/AssemblyInfo.cs b/src/libraries/System.Net.Security/tests/FunctionalTests/AssemblyInfo.cs index 68b152e1c3b..9adf9f8c835 100644 --- a/src/libraries/System.Net.Security/tests/FunctionalTests/AssemblyInfo.cs +++ b/src/libraries/System.Net.Security/tests/FunctionalTests/AssemblyInfo.cs @@ -5,5 +5,4 @@ using Xunit; [assembly: ActiveIssue("https://github.com/dotnet/runtime/issues/34690", TestPlatforms.Windows, TargetFrameworkMonikers.Netcoreapp, TestRuntimes.Mono)] -[assembly: ActiveIssue("https://github.com/dotnet/runtime/issues/57506", typeof(PlatformDetection), nameof(PlatformDetection.IsMonoRuntime), nameof(PlatformDetection.IsMariner))] -[assembly: SkipOnPlatform(TestPlatforms.Browser, "System.Net.Security is not supported on Browser")] \ No newline at end of file +[assembly: SkipOnPlatform(TestPlatforms.Browser, "System.Net.Security is not supported on Browser")] diff --git a/src/libraries/System.Security.Cryptography.X509Certificates/tests/AssemblyInfo.cs b/src/libraries/System.Security.Cryptography.X509Certificates/tests/AssemblyInfo.cs index d338fa7711a..4eb4b982016 100644 --- a/src/libraries/System.Security.Cryptography.X509Certificates/tests/AssemblyInfo.cs +++ b/src/libraries/System.Security.Cryptography.X509Certificates/tests/AssemblyInfo.cs @@ -5,4 +5,3 @@ using System; using Xunit; -[assembly: ActiveIssue("https://github.com/dotnet/runtime/issues/57810", typeof(PlatformDetection), nameof(PlatformDetection.IsMonoRuntime), nameof(PlatformDetection.IsMariner))] diff --git a/src/libraries/System.Security.Cryptography.X509Certificates/tests/ChainTests.cs b/src/libraries/System.Security.Cryptography.X509Certificates/tests/ChainTests.cs index 614ae070496..bf0b9e230a1 100644 --- a/src/libraries/System.Security.Cryptography.X509Certificates/tests/ChainTests.cs +++ b/src/libraries/System.Security.Cryptography.X509Certificates/tests/ChainTests.cs @@ -11,7 +11,6 @@ namespace System.Security.Cryptography.X509Certificates.Tests { - [ActiveIssue("https://github.com/dotnet/runtime/issues/57506", typeof(PlatformDetection), nameof(PlatformDetection.IsMonoRuntime), nameof(PlatformDetection.IsMariner))] public static class ChainTests { private static bool TrustsMicrosoftDotComRoot diff --git a/src/libraries/System.Security.Cryptography.X509Certificates/tests/CollectionTests.cs b/src/libraries/System.Security.Cryptography.X509Certificates/tests/CollectionTests.cs index df5c022b9fc..73c00e0dd43 100644 --- a/src/libraries/System.Security.Cryptography.X509Certificates/tests/CollectionTests.cs +++ b/src/libraries/System.Security.Cryptography.X509Certificates/tests/CollectionTests.cs @@ -886,7 +886,6 @@ public static void X509CertificateCollectionCopyTo() } [ConditionalFact(typeof(PlatformDetection), nameof(PlatformDetection.IsNonZeroLowerBoundArraySupported))] - [ActiveIssue("https://github.com/dotnet/runtime/issues/57506", typeof(PlatformDetection), nameof(PlatformDetection.IsMonoRuntime), nameof(PlatformDetection.IsMariner))] public static void X509ChainElementCollection_CopyTo_NonZeroLowerBound_ThrowsIndexOutOfRangeException() { using (var microsoftDotCom = new X509Certificate2(TestData.MicrosoftDotComSslCertBytes)) @@ -1302,7 +1301,6 @@ public static void X509Certificate2CollectionGetHashCode() } [Fact] - [ActiveIssue("https://github.com/dotnet/runtime/issues/57506", typeof(PlatformDetection), nameof(PlatformDetection.IsMonoRuntime), nameof(PlatformDetection.IsMariner))] public static void X509ChainElementCollection_IndexerVsEnumerator() { using (var microsoftDotCom = new X509Certificate2(TestData.MicrosoftDotComSslCertBytes)) diff --git a/src/libraries/System.Security.Cryptography.X509Certificates/tests/DynamicChainTests.cs b/src/libraries/System.Security.Cryptography.X509Certificates/tests/DynamicChainTests.cs index c90b43d5243..489298ea58e 100644 --- a/src/libraries/System.Security.Cryptography.X509Certificates/tests/DynamicChainTests.cs +++ b/src/libraries/System.Security.Cryptography.X509Certificates/tests/DynamicChainTests.cs @@ -12,7 +12,6 @@ namespace System.Security.Cryptography.X509Certificates.Tests { - [ActiveIssue("https://github.com/dotnet/runtime/issues/57506", typeof(PlatformDetection), nameof(PlatformDetection.IsMonoRuntime), nameof(PlatformDetection.IsMariner))] public static class DynamicChainTests { private static X509Extension BasicConstraintsCA => new X509BasicConstraintsExtension( diff --git a/src/libraries/System.Security.Cryptography.X509Certificates/tests/FindTests.cs b/src/libraries/System.Security.Cryptography.X509Certificates/tests/FindTests.cs index 4abcce87bc5..a734da8b711 100644 --- a/src/libraries/System.Security.Cryptography.X509Certificates/tests/FindTests.cs +++ b/src/libraries/System.Security.Cryptography.X509Certificates/tests/FindTests.cs @@ -231,7 +231,6 @@ public static void FindByValidThumbprint_ValidOnly(bool validOnly) } [Fact] - [ActiveIssue("https://github.com/dotnet/runtime/issues/57506", typeof(PlatformDetection), nameof(PlatformDetection.IsMonoRuntime), nameof(PlatformDetection.IsMariner))] [SkipOnPlatform(PlatformSupport.MobileAppleCrypto, "Root certificate store is not accessible")] public static void FindByValidThumbprint_RootCert() { diff --git a/src/libraries/System.Security.Cryptography.X509Certificates/tests/RevocationTests/AiaTests.cs b/src/libraries/System.Security.Cryptography.X509Certificates/tests/RevocationTests/AiaTests.cs index 89882f4de5a..88cf0c20b8c 100644 --- a/src/libraries/System.Security.Cryptography.X509Certificates/tests/RevocationTests/AiaTests.cs +++ b/src/libraries/System.Security.Cryptography.X509Certificates/tests/RevocationTests/AiaTests.cs @@ -8,7 +8,6 @@ namespace System.Security.Cryptography.X509Certificates.Tests.RevocationTests { - [ActiveIssue("https://github.com/dotnet/runtime/issues/57506", typeof(PlatformDetection), nameof(PlatformDetection.IsMonoRuntime), nameof(PlatformDetection.IsMariner))] [SkipOnPlatform(TestPlatforms.Android, "Android does not support AIA fetching")] public static class AiaTests { diff --git a/src/libraries/System.Security.Cryptography.X509Certificates/tests/X509StoreTests.cs b/src/libraries/System.Security.Cryptography.X509Certificates/tests/X509StoreTests.cs index c63d118117b..a10c0f48a44 100644 --- a/src/libraries/System.Security.Cryptography.X509Certificates/tests/X509StoreTests.cs +++ b/src/libraries/System.Security.Cryptography.X509Certificates/tests/X509StoreTests.cs @@ -426,7 +426,6 @@ public static void OpenMachineRootStore_Permissions(OpenFlags permissions, bool } [Fact] - [ActiveIssue("https://github.com/dotnet/runtime/issues/57506", typeof(PlatformDetection), nameof(PlatformDetection.IsMonoRuntime), nameof(PlatformDetection.IsMariner))] [SkipOnPlatform(PlatformSupport.MobileAppleCrypto, "Root certificate store is not accessible")] public static void MachineRootStore_NonEmpty() {
So whatever the crashes were, they're gone now... at least on current mariner.2
(Mariner.1.0.Amd64.Open)is container. https://helix.dot.net/ only shows full OSes e.g queues. In the example above,
we run the container on top of Ubuntu 16 -> that should be loooooong dead.I think not would be OK to remove the active issue if we run on Mariner.2.
And we should probably update the test queue to run on current version(s)- ghost locked as resolved and limited conversation to collaborators
on Oct 14, 2023
There are a bunch of tests failing when running on Mono in Linux Mariner.
It seems like all these tests share this common call:
Internal.Cryptography.Pal.ChainPal.BuildChainwhich then calls into openssl. The weird thing is that it only happens with Mono.Some examples:
System.Net.Tests.HttpWebRequestTest_Async.Headers_GetResponseHeaders_ContainsExpectedValue(useSsl: True)
System.Security.Cryptography.X509Certificates.Tests.CertificateCreation.CertificateRequestChainTests.CreateChain_Hybrid
cc: @akoeplinger @steveisok @bartonjs