-
Notifications
You must be signed in to change notification settings - Fork 28.9k
[SPARK-42216][CORE][TESTS] Fix two check conditions and remove redundant toMap in util.JsonProtocolSuite
#39772
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
| assertEquals(e1.executorInfo, e2.executorInfo) | ||
| case (e1: SparkListenerExecutorRemoved, e2: SparkListenerExecutorRemoved) => | ||
| assert(e1.executorId === e1.executorId) | ||
| assert(e1.executorId === e2.executorId) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
According to the PR description, after fixing this, toMap causes failure, right?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
No, two things have been done in this pr : one is code cleanup, the other is bug fix.
Is it better to divide this pr into two parts?
Sorry, my descriptive ability is poor. It seems that there is a misunderstanding ...
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
According to the PR description, after fixing this,
toMapcauses failure, right?
After fixing this, toMap is redundant collection conversion
dongjoon-hyun
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Since this is related to Map, please test Scala 2.13 together.
done |
dongjoon-hyun
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
+1, LGTM (Pending CIs)
immutable.Map by default and fix two check conditions in util.JsonProtocolSuitetoMap in util.JsonProtocolSuite
|
Thanks @dongjoon-hyun |
What changes were proposed in this pull request?
The main changes of this pr as follows:
Remove explicit
import scala.collection.Mapand use the defaultimmutable.Mapinutil.JsonProtocolSuite, and also clean up the redundanttoMapconversion after remove explicitimport scala.collection.MapFix two
assertconditions: changeassert(e1.x === e1.x)toassert(e1.x === e2.x), the originally assert is always true.Why are the changes needed?
immutable.Mapby default inutil.JsonProtocolSuiteand remove redundanttoMapconversion for code cleanuputil.JsonProtocolSuiteDoes this PR introduce any user-facing change?
No, just for test
How was this patch tested?
all test passed