Skip to content

Conversation

@frank-dong-ms-zz
Copy link
Contributor

  1. new outer loop pipeline that runs all tests
  2. remove flaky tests from CI

@codecov
Copy link

codecov bot commented Jan 22, 2020

Codecov Report

❗ No coverage uploaded for pull request base (master@fa75f4f). Click here to learn what that means.
The diff coverage is 100%.

@@            Coverage Diff            @@
##             master    #4688   +/-   ##
=========================================
  Coverage          ?   75.81%           
=========================================
  Files             ?      951           
  Lines             ?   172437           
  Branches          ?    18616           
=========================================
  Hits              ?   130727           
  Misses            ?    36538           
  Partials          ?     5172
Flag Coverage Δ
#Debug 75.81% <100%> (?)
#production 71.43% <ø> (?)
#test 90.48% <100%> (?)
Impacted Files Coverage Δ
...crosoft.ML.TimeSeries.Tests/TimeSeriesDirectApi.cs 99.27% <ø> (ø)
...Microsoft.ML.Tests/Transformers/NormalizerTests.cs 100% <ø> (ø)
...icrosoft.ML.TestFramework/DataPipe/TestDataPipe.cs 91.99% <ø> (ø)
test/Microsoft.ML.TimeSeries.Tests/TimeSeries.cs 87.85% <ø> (ø)
...est/Microsoft.ML.Predictor.Tests/TestPredictors.cs 67.94% <ø> (ø)
...ests/TrainerEstimators/MatrixFactorizationTests.cs 97.84% <ø> (ø)
...osoft.ML.Tests/TrainerEstimators/TreeEstimators.cs 98.07% <ø> (ø)
...crosoft.ML.Core.Tests/UnitTests/TestEntryPoints.cs 98.36% <ø> (ø)
...cenariosWithDirectInstantiation/TensorflowTests.cs 92.08% <ø> (ø)
...osoft.ML.Functional.Tests/IntrospectiveTraining.cs 100% <ø> (ø)
... and 4 more

@frank-dong-ms-zz frank-dong-ms-zz marked this pull request as ready for review January 23, 2020 01:01
@frank-dong-ms-zz frank-dong-ms-zz requested a review from a team as a code owner January 23, 2020 01:01
@frank-dong-ms-zz
Copy link
Contributor Author

This is the CI build for latest iteration: https://dev.azure.com/dnceng/public/_build/results?buildId=493381&view=results
Success at first attempt


[RetryFact]
#if INNER_LOOP
[Fact(Skip = "skip due to flaky")]
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can you please change the message to something like "Skipping test temporarily. This test will be re-enabled once the cause of failures has been determined"

}
}

#if INNER_LOOP
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can you please investigate whether is possible to skip the test at runtime instead of disabling it at compile time?

@frank-dong-ms-zz frank-dong-ms-zz merged commit 97c4533 into dotnet:master Jan 27, 2020
@frank-dong-ms-zz frank-dong-ms-zz deleted the inner-loop-build-pipeline branch February 3, 2020 21:35
@ghost ghost locked as resolved and limited conversation to collaborators Mar 19, 2022
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants