-
Notifications
You must be signed in to change notification settings - Fork 28.9k
[SPARK-10577] [PySpark] DataFrame hint for broadcast join #8801
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
|
Jenkins, test this please. |
python/pyspark/sql/functions.py
Outdated
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
DataFrame(sc._jvm.functions.broadcast(df._jdf), df.sql_ctx)
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@davies changed it. Thank you!
|
Test build #1773 has finished for PR 8801 at commit
|
f8df179 to
987a0cc
Compare
987a0cc to
5bf51b8
Compare
|
@rxin Sorry for inconvenience. Can you authorize a new test for this. I have merged changes into one single commit. Thanks |
|
Test build #1778 has finished for PR 8801 at commit
|
|
Thanks - I've merged this. |
|
@Jianfeng-chs what's your JIRA user id? I need that in order to assign the ticket to you. |
|
Thanks @rxin. My JIRA username is jzhang. |
https://issues.apache.org/jira/browse/SPARK-10577 Author: Jian Feng <[email protected]> Closes #8801 from Jianfeng-chs/master. (cherry picked from commit 0180b84) Signed-off-by: Reynold Xin <[email protected]> Conflicts: python/pyspark/sql/tests.py
https://issues.apache.org/jira/browse/SPARK-10577