-
Notifications
You must be signed in to change notification settings - Fork 5.2k
Closed
Labels
area-System.Net.Securitydisabled-testThe test is disabled in source code against the issueThe test is disabled in source code against the issue
Milestone
Description
Affected tests:
- ConnectWithRevocation_WithCallback -
System.Net.Security.Tests.CertificateValidationRemoteServer.ConnectWithRevocation_WithCallback- Frequency in last 30 days as of 8/25: 12x runs affected (all OSX.1200.Amd64.Open on Mono and CoreCLR)
- first occurrence on 8/15 - PR 1945162
- last occurrence on 8/23 - the test was disabled on OSX in main (8.0) in PR Disable ConnectWithRevocation_WithCallback test #74168 and in 7.0 (RC2) in PR [release/7.0] Disable ConnectWithRevocation_WithCallback test #74483
- Note: Updated bug the test is disabled against to this one in PR Disable ConnectWithRevocation_ServerCertWithoutContext_NoStapledOcsp on NativeAoT #74561 on 8/25
- Frequency in last 30 days as of 8/25: 12x runs affected (all OSX.1200.Amd64.Open on Mono and CoreCLR)
- ConnectWithRevocation_ServerCertWithoutContext_NoStapledOcsp -
System.Net.Security.Tests.CertificateValidationRemoteServer.ConnectWithRevocation_ServerCertWithoutContext_NoStapledOcsp- Frequency in last 30 days - see details below
- Test disabled on Debian10 in main (7.0) in PR Disable NoStapledOcsp test on Debian 10 for now. #72634 on 7/22
- Test disabled on NativeAOT in main (8.0) in PR Disable ConnectWithRevocation_ServerCertWithoutContext_NoStapledOcsp on NativeAoT #74561 and in 7.0 (RC2) in PR [release/7.0] Disable ConnectWithRevocation_ServerCertWithoutContext_NoStapledOcsp on NativeAoT #74606 on 8/25
Frequency: ConnectWithRevocation_ServerCertWithoutContext_NoStapledOcsp
- Error:
Assert.Contains() Failure Not found: RevocationStatusUnknown In value: X509ChainStatusFlags[] [Revoked]
| Day | Run | Details |
|---|---|---|
| 8/24 | Report made | |
| 8/24 | Rolling run 1964517 (7.0-rc1) | net7.0-Linux-Release-arm64-NativeAOT_Release-(Ubuntu.1804.ArmArch.Open)Ubuntu.1804.ArmArch.Open |
| 8/23 | Rolling run 1963307 (7.0) | net7.0-Linux-Release-arm64-NativeAOT_Release-(Ubuntu.1804.ArmArch.Open)Ubuntu.1804.ArmArch.Open |
| 8/19 | Rolling run 1955773 (7.0) | net7.0-Linux-Release-arm64-NativeAOT_Release-(Ubuntu.1804.ArmArch.Open)Ubuntu.1804.ArmArch.Open |
| 7/24-8/18 | No hits |
Test failure in ConnectWithRevocation_ServerCertWithoutContext_NoStapledOcsp from 6/20 on Debian10 (Mono)
- Full test name: System.Net.Security.Tests.CertificateValidationRemoteServer.ConnectWithRevocation_ServerCertWithoutContext_NoStapledOcsp
System.Net.Security.Tests.CertificateValidationRemoteServer.ConnectWithRevocation_ServerCertWithoutContext_NoStapledOcsp [FAIL]
Assert.Contains() Failure
Not found: (filter expression)
In value: X509ChainStatus[] [System.Security.Cryptography.X509Certificates.X509ChainStatus]
Stack Trace:
/_/src/libraries/System.Net.Security/tests/FunctionalTests/CertificateValidationRemoteServer.cs(275,0): at System.Net.Security.Tests.CertificateValidationRemoteServer.<ConnectWithRevocation_WithCallback_Core>g__CertificateValidationCallback|6_0(Object sender, X509Certificate certificate, X509Chain chain, SslPolicyErrors sslPolicyErrors)
/_/src/libraries/System.Net.Security/src/System/Net/Security/SslStream.Protocol.cs(984,0): at System.Net.Security.SslStream.VerifyRemoteCertificate(RemoteCertificateValidationCallback remoteCertValidationCallback, SslCertificateTrust trust, ProtocolToken& alertToken, SslPolicyErrors& sslPolicyErrors, X509ChainStatusFlags& chainStatus)
/_/src/libraries/System.Net.Security/src/System/Net/Security/SslStream.IO.cs(512,0): at System.Net.Security.SslStream.CompleteHandshake(ProtocolToken& alertToken, SslPolicyErrors& sslPolicyErrors, X509ChainStatusFlags& chainStatus)
/_/src/libraries/System.Net.Security/src/System/Net/Security/SslStream.IO.cs(525,0): at System.Net.Security.SslStream.CompleteHandshake(SslAuthenticationOptions sslAuthenticationOptions)
/_/src/libraries/System.Net.Security/src/System/Net/Security/SslStream.IO.cs(338,0): at System.Net.Security.SslStream.<ForceAuthenticationAsync>d__146`1[[System.Net.Security.AsyncReadWriteAdapter, System.Net.Security, Version=7.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a]].MoveNext()
/_/src/libraries/Common/tests/System/Threading/Tasks/TaskTimeoutExtensions.cs(120,0): at System.Threading.Tasks.TaskTimeoutExtensions.GetRealException(Task task)
--- End of stack trace from previous location ---
/_/src/libraries/Common/tests/System/Threading/Tasks/TaskTimeoutExtensions.cs(90,0): at System.Threading.Tasks.TaskTimeoutExtensions.WhenAllOrAnyFailed(Task[] tasks)
/_/src/libraries/Common/tests/System/Threading/Tasks/TaskTimeoutExtensions.cs(55,0): at System.Threading.Tasks.TaskTimeoutExtensions.WhenAllOrAnyFailed(Task[] tasks, Int32 millisecondsTimeout)
/_/src/libraries/System.Net.Security/tests/FunctionalTests/CertificateValidationRemoteServer.cs(228,0): at System.Net.Security.Tests.CertificateValidationRemoteServer.ConnectWithRevocation_WithCallback_Core(X509RevocationMode revocationMode, Nullable`1 offlineContext)
/_/src/libraries/System.Net.Security/tests/FunctionalTests/CertificateValidationRemoteServer.cs(229,0): at System.Net.Security.Tests.CertificateValidationRemoteServer.ConnectWithRevocation_WithCallback_Core(X509RevocationMode revocationMode, Nullable`1 offlineContext)
/_/src/libraries/System.Net.Security/tests/FunctionalTests/CertificateValidationRemoteServer.cs(229,0): at System.Net.Security.Tests.CertificateValidationRemoteServer.ConnectWithRevocation_WithCallback_Core(X509RevocationMode revocationMode, Nullable`1 offlineContext)
/_/src/libraries/System.Net.Security/tests/FunctionalTests/CertificateValidationRemoteServer.cs(229,0): at System.Net.Security.Tests.CertificateValidationRemoteServer.ConnectWithRevocation_WithCallback_Core(X509RevocationMode revocationMode, Nullable`1 offlineContext)
/_/src/libraries/System.Net.Security/tests/FunctionalTests/CertificateValidationRemoteServer.cs(229,0): at System.Net.Security.Tests.CertificateValidationRemoteServer.ConnectWithRevocation_WithCallback_Core(X509RevocationMode revocationMode, Nullable`1 offlineContext)
--- End of stack trace from previous location ---
Failures:
-
1832139 rolling build (6/18 AM)
-
6/20:
- 4 failures in last 7 days
- 9 failures in last 30 days (2 Rolling test runs)
- Note: Previously failed on different exception
- First failure on 6/4
- Platforms:
- 2x Debug:
net7.0-Linux-Release-x64-mono_interpreter_release-(Debian.10.Amd64.Open)[email protected]/dotnet-buildtools/prereqs:debian-10-helix-amd64-20210304164434-56c6673 - 7x Release:
net7.0-Linux-Debug-x64-mono_interpreter_release-(Debian.10.Amd64.Open)[email protected]/dotnet-buildtools/prereqs:debian-10-helix-amd64-20210304164434-56c6673
- 2x Debug:
let failedTests = (methodName : string, includePR : bool, messageSubstr: string, includePassedOnRerun : bool) {
cluster('engsrvprod.kusto.windows.net').database('engineeringdata').AzureDevOpsTests
| where TestName startswith "System.Net"
| where includePassedOnRerun or (Outcome == 'Failed')
| extend startOfTestName = indexof_regex(TestName, @"[^.]+$")
| extend Method = substring(TestName, startOfTestName)
| extend Type = substring(TestName, 0, startOfTestName - 1)
| project-away startOfTestName
| where Method == methodName
| where Message contains messageSubstr
| distinct JobId, WorkItemId, Message, StackTrace, Method, Type, Arguments, Outcome
| join kind=inner (cluster('engsrvprod.kusto.windows.net').database('engineeringdata').Jobs
| where ((Branch == 'refs/heads/main') or (Branch == 'refs/heads/master') or (includePR and (Source startswith "pr/")))
| where Type startswith "test/functional/cli/"
and not(Properties contains "runtime-staging")
| summarize arg_max(Finished, Properties, Type, Branch, Source, Started, QueueName) by JobId
| project-rename JobType = Type) on JobId
| extend PropertiesJson = parse_json(Properties)
| extend OS = replace_regex(tostring(PropertiesJson.operatingSystem), @'\((.*)\).*|([^\(].*)', @'\1\2')
| extend Runtime = iif(PropertiesJson.runtimeFlavor == "mono", "Mono", iif(PropertiesJson.DefinitionName contains "coreclr", "CoreCLR", ""))
| extend TargetBranch = extractjson("$.['System.PullRequest.TargetBranch']", Properties)
| extend Architecture = PropertiesJson.architecture
| extend Scenario = iif(isempty(PropertiesJson.scenario), "--", PropertiesJson.scenario)
//| extend DefinitionName = PropertiesJson.DefinitionName
| project-away PropertiesJson
};
failedTests('ConnectWithRevocation_ServerCertWithoutContext_NoStapledOcsp', true, '', true);Report
Summary
| 24-Hour Hit Count | 7-Day Hit Count | 1-Month Count |
|---|---|---|
| 0 | 0 | 0 |
Metadata
Metadata
Assignees
Labels
area-System.Net.Securitydisabled-testThe test is disabled in source code against the issueThe test is disabled in source code against the issue