-
Notifications
You must be signed in to change notification settings - Fork 28.9k
[SPARK-16749][SQL] Simplify processing logic in LEAD/LAG processing. #14376
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
|
cc @yhuai |
|
Test build #62916 has finished for PR 14376 at commit
|
| target, | ||
| ordinal, | ||
| functions, | ||
| functions.map(_.asInstanceOf[OffsetWindowFunction]), |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
leave a comment here about why it is safe to blindly cast?
|
Test build #62967 has finished for PR 14376 at commit
|
| */ | ||
| private[execution] final class OffsetWindowFunctionFrame( | ||
| target: MutableRow, | ||
| ordinal: Int, |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Since we are changing this file, can you add comment to explain what is ordinal (with an example)?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Done. In the class doc.
|
Test build #63381 has finished for PR 14376 at commit
|
|
Merging to master. |
What changes were proposed in this pull request?
The logic for LEAD/LAG processing is more complex that it needs to be. This PR fixes that.
How was this patch tested?
Existing tests.