-
Notifications
You must be signed in to change notification settings - Fork 28.9k
[SPARK-28440][MLLIB][TEST] Use TestingUtils to compare floating point values #25191
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[SPARK-28440][MLLIB][TEST] Use TestingUtils to compare floating point values #25191
Conversation
srowen
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks OK pending tests.
|
Test build #4825 has finished for PR 25191 at commit
|
|
addressed failed style checks reported by jenkins |
|
Retest this please. |
|
Test build #107859 has finished for PR 25191 at commit
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This seems to fail in Jenkins environment. Did it pass in your local environment, @eugen-prokhorenko ?
sbt.ForkMain$ForkError: org.scalatest.exceptions.TestFailedException: Expected 0.6 and 1.0 to be within 1.0E-6 using absolute tolerance.
at org.apache.spark.mllib.util.TestingUtils$DoubleWithAlmostEquals.$tilde$eq$eq(TestingUtils.scala:80)
at org.apache.spark.mllib.fpm.AssociationRulesSuite.$anonfun$new$4(AssociationRulesSuite.scala:88)
at org.apache.spark.mllib.fpm.AssociationRulesSuite.$anonfun$new$4$adapted(AssociationRulesSuite.scala:88)
Please make this PR pass the Jenkins.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I don't know how I missed it. For usage in place of a predicate there is a less strict version of the operator (~= returns false without throwing the exception). The patch is underway.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
fixed
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thank you for the swift update!
|
Retest this please. |
|
Test build #107860 has finished for PR 25191 at commit
|
dongjoon-hyun
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
+1, LGTM.
Thank you for your first contribution, @eugen-prokhorenko . Welcome to the Apache Spark community.
Merged to master.
|
@eugen-prokhorenko . What is your Apache JIRA ID? I want to add you to the Apache Spark contributor group and assign SPARK-28440 to you. |
|
@dongjoon-hyun it's eugenzyx |
|
thank you |
|
Thank YOU. It's assigned to you. :) |
What changes were proposed in this pull request?
Use
org.apache.spark.mllib.util.TestingUtilsobject acrossMLLIBcomponent to compare floating point values in tests.How was this patch tested?
build/mvn test- existing tests against updated code.