-
Notifications
You must be signed in to change notification settings - Fork 29k
[SPARK-10540] Fixes flaky all-data-type test #8768
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[SPARK-10540] Fixes flaky all-data-type test #8768
Conversation
|
Test build #42488 has finished for PR 8768 at commit
|
|
Can we let every test run more times (50 or 100 times) before we merge it? |
|
@yhuai OK, I'll make a temporary commit to trigger such a Jenkins build and revert it later. |
|
@yhuai BTW, I did try to run every test 100 times locally, and it works. |
|
oh, then it is fine. We can revert the temp commit and test it again. Once jenkins passes, we can merge it. |
|
Test build #42624 has finished for PR 8768 at commit
|
This reverts commit 9c4fee1.
|
LGTM. Once jenkins is good, I will merge it to master and branch 1.5. |
|
Test build #42671 has finished for PR 8768 at commit
|
|
Thanks! Merging. |
This PR breaks the original test case into multiple ones (one test case for each data type). In this way, test failure output can be much more readable. Within each test case, we build a table with two columns, one of them is for the data type to test, the other is an "index" column, which is used to sort the DataFrame and workaround [SPARK-10591] [1] [1]: https://issues.apache.org/jira/browse/SPARK-10591 Author: Cheng Lian <[email protected]> Closes #8768 from liancheng/spark-10540/test-all-data-types. (cherry picked from commit 00a2911) Signed-off-by: Yin Huai <[email protected]>
This PR breaks the original test case into multiple ones (one test case for each data type). In this way, test failure output can be much more readable. Within each test case, we build a table with two columns, one of them is for the data type to test, the other is an "index" column, which is used to sort the DataFrame and workaround [SPARK-10591] [1] [1]: https://issues.apache.org/jira/browse/SPARK-10591 Author: Cheng Lian <[email protected]> Closes apache#8768 from liancheng/spark-10540/test-all-data-types. (cherry picked from commit 00a2911) Signed-off-by: Yin Huai <[email protected]> (cherry picked from commit e1e781f)
This PR breaks the original test case into multiple ones (one test case for each data type). In this way, test failure output can be much more readable.
Within each test case, we build a table with two columns, one of them is for the data type to test, the other is an "index" column, which is used to sort the DataFrame and workaround SPARK-10591