Commit 4a67541
[SPARK-13023][PROJECT INFRA][FOLLOWUP][BRANCH-1.6] Unable to check
## What changes were proposed in this pull request?
This PR fixes incorrect checking for `root` module (meaning all tests).
I realised that #13806 is being failed due to this one.
The PR corrects two files in `sql` and `core`. Since it seems fixing `core` module triggers all tests by `root` value from `determine_modules_for_files`.
So, `changed_modules` becomes as below:
```
['root', 'sql']
```
and `module.dependent_modules` becaomes as below:
```
['pyspark-mllib', 'pyspark-ml', 'hive-thriftserver', 'sparkr', 'mllib', 'examples', 'pyspark-sql']
```
Now, `modules_to_test` does not include `root` and this checking is skipped but then both `changed_modules` and `modules_to_test` are being merged after that. So, this includes `root` module to test.
This ends up with failing with the message below (e.g. https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60990/consoleFull):
```
Error: unrecognized module 'root'. Supported modules: pyspark-core, pyspark-sql, pyspark-streaming, pyspark-ml, pyspark-mllib
```
## How was this patch tested?
N/A
Author: hyukjinkwon <[email protected]>
Closes #13845 from HyukjinKwon/fix-build-1.6.root module ending up failure of Python tests1 parent 22a496d commit 4a67541
1 file changed
+2
-1
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
113 | 113 | | |
114 | 114 | | |
115 | 115 | | |
| 116 | + | |
116 | 117 | | |
117 | 118 | | |
118 | 119 | | |
119 | | - | |
| 120 | + | |
120 | 121 | | |
121 | 122 | | |
122 | 123 | | |
| |||
0 commit comments