-
Notifications
You must be signed in to change notification settings - Fork 28.9k
[BUILD][MINOR] Fix java style check issues #20323
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
|
I keep forgetting why we can't turn on the checks -- was it just a time thing, because it meant a whole other pass over the code with maven? |
|
@sameeragarwal . Can we turn on Travis CI for that purpose like AppVeyor? If Travis CI can not handle the full traffic of Apache Spark PRs, we may run it for only Java code change PRs. |
|
Test build #86363 has finished for PR 20323 at commit
|
@dongjoon-hyun, do you know if Travis CI supports exclusion/inclusion of only changed files? I was under impression that Travis CI doesn't have this feature although AppVeyor has. |
|
@dongjoon-hyun while I'm not opposed to adding another builder, my concern is that it's hard to justify spending 30+ mins for a simple java style check for every pull request (i.e., if we run an additional If we think that the cost is justified, then either adding a parallel travis builder or a new amplab jenkins builder is essentially serving the same purpose from a user's perspective and we should pick whichever option makes the most sense. However, either way, I'm curious if there are cheaper alternatives to fundamentally get around this dependency problem. |
|
merging this to master/2.3. Thanks! |
## What changes were proposed in this pull request? This patch fixes a few recently introduced java style check errors in master and release branch. As an aside, given that [java linting currently fails](#10763 ) on machines with a clean maven cache, it'd be great to find another workaround to [re-enable the java style checks](https://github.com/apache/spark/blob/3a07eff5af601511e97a05e6fea0e3d48f74c4f0/dev/run-tests.py#L577) as part of Spark PRB. /cc zsxwing JoshRosen srowen for any suggestions ## How was this patch tested? Manual Check Author: Sameer Agarwal <[email protected]> Closes #20323 from sameeragarwal/java. (cherry picked from commit 9c4b998) Signed-off-by: Sameer Agarwal <[email protected]>
|
@HyukjinKwon . Travis CI will trigger at every commit. What I mean is our script can check the Java changes only. @sameeragarwal . Travis CI is independently running on Travis CI site like AppVoyer. That is the exact reason why I added Travis CI.
Please see this. |
|
I'm wondering why we are okay for AppVoyer and not okay for Travis CI. :) |
|
The only downside is spreading the CI here across many different systems. I know we add Appveyor because it was the only way to test on Windows (right?). Adding Travis too just for Java style checks is more questionable. Yes it has nothing to do with Jenkins though. I think we've just punted on this and accepted that Java style checks need to be executed manually once in a while. One middle-ground is to enable style checks in the Jenkins jobs besides the PR builder. You still don't catch violations at the time a PR is submitted, but at least catch them automatically, promptly. |
What changes were proposed in this pull request?
This patch fixes a few recently introduced java style check errors in master and release branch.
As an aside, given that java linting currently fails on machines with a clean maven cache, it'd be great to find another workaround to re-enable the java style checks as part of Spark PRB.
/cc @zsxwing @JoshRosen @srowen for any suggestions
How was this patch tested?
Manual Check