TransformContinuousIT.testContinousEvents test failed

[przemekwitek]

Build scan:
https://gradle-enterprise.elastic.co/s/rpnsd3e5jwf3y

Repro line:

REPRODUCE WITH: ./gradlew ':x-pack:plugin:transform:qa:single-node-tests:javaRestTest' --tests "org.elasticsearch.xpack.transform.integration.continuous.TransformContinuousIT.testContinousEvents" \
  -Dtests.seed=DA001B314F2CA42D \
  -Dtests.security.manager=true \
  -Dtests.locale=ar-DZ \
  -Dtests.timezone=Asia/Jayapura \
  -Druntime.java=8

REPRODUCE WITH: ./gradlew ':x-pack:plugin:transform:qa:single-node-tests:javaRestTest' --tests "org.elasticsearch.xpack.transform.integration.continuous.TransformContinuousIT.testContinousEvents" \
  -Dtests.seed=DA001B314F2CA42D \
  -Dtests.security.manager=true \
  -Dtests.locale=ar-DZ \
  -Dtests.timezone=Asia/Jayapura \
  -Druntime.java=8

Reproduces locally?:
No

Applicable branches:
7.x

Failure history:
This is the first failure since August 6th.

Failure excerpt:

13:49:46 org.elasticsearch.xpack.transform.integration.continuous.TransformContinuousIT > testContinousEvents FAILED
13:49:46     java.lang.AssertionError: Error in test case [continuous-terms-pivot-test].If you want to mute the test, please mute [org.elasticsearch.xpack.transform.integration.continuous.TermsGroupByIT] only, but _not_ [org.elasticsearch.xpack.transform.integration.continuous.TransformContinuousIT] as a whole.
13:49:46         at __randomizedtesting.SeedInfo.seed([DA001B314F2CA42D:E1366A2AC547267B]:0)
13:49:46         at org.elasticsearch.xpack.transform.integration.continuous.TransformContinuousIT.testContinousEvents(TransformContinuousIT.java:258)
13:49:46 
13:49:46         Caused by:
13:49:46         java.lang.AssertionError: Ingest run: 1 did not match max run: 0.0, iteration: 1
13:49:46         Expected: <0.0>
13:49:46              but: was <1.0>
13:49:46             at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:18)
13:49:46             at org.junit.Assert.assertThat(Assert.java:956)
13:49:46             at org.elasticsearch.xpack.transform.integration.continuous.TermsGroupByIT.testIteration(TermsGroupByIT.java:144)
13:49:46             at org.elasticsearch.xpack.transform.integration.continuous.TransformContinuousIT.testContinousEvents(TransformContinuousIT.java:249)

[elasticmachine]

Pinging @elastic/ml-core (:ml/Transform)

[hendrikmuhs]

Update:

The test failed 14 times in the last 24h. I will add extra debug logging to find the root cause.

[hendrikmuhs]

New failure with extra logging: https://gradle-enterprise.elastic.co/s/zyre3zt5twxb6

[nik9000]

Another failure: https://gradle-enterprise.elastic.co/s/6a3rxv5czjggw/tests/:x-pack:plugin:transform:qa:single-node-tests:javaRestTest/org.elasticsearch.xpack.transform.integration.continuous.TransformContinuousIT/testContinousEvents#1

[mark-vieira]

This is continuing to fail. @hendrikmuhs do we have enough diagnostic info from CI on this? Can we mute this for now until we have a fix?

[nik9000]

This is continuing to fail. @hendrikmuhs do we have enough diagnostic info from CI on this? Can we mute this for now until we have a fix?

I've talked to @hendrikmuhs about this. I he's going to look at this tomorrow and I don't think waiting a day to mute this is a big deal because its not all that frequent. If you feel differently I can mute it.