-
Notifications
You must be signed in to change notification settings - Fork 28.9k
[SPARK-8215] [SPARK-8212] [SQL] add leaf math expression for e and pi #6716
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
|
Test build #34493 has finished for PR 6716 at commit
|
|
Test build #34501 has finished for PR 6716 at commit
|
|
Test build #34498 timed out for PR 6716 at commit |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Why not just use the java.math definition, i.e.
The double value that is closer than any other to e, the base of the natural logarithms.
|
Can you also add the Python version? Thanks. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
why not just ...
${ctx.javaType(dataType)} ${ev.primitive} = java.lang.Math.$constName;
|
Test build #34560 has finished for PR 6716 at commit
|
python/pyspark/sql/functions.py
Outdated
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
i don't think u need this, since you explicitly defined it. you might need to add it to all at the top of the file
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
let's be consistent with @chenghao-intel's length pr, and move this test into DataFrameFunctionSuite.scala.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
OK. Anyway, I think it looks weird to test sql() in DataFrameFunctionsSuite.
|
LGTM. |
|
Test build #34562 has finished for PR 6716 at commit
|
|
Jenkins, retest this please. |
|
(want to test with this HiveContext also switching to using udfs here) |
|
Test build #34567 has finished for PR 6716 at commit
|
|
Test build #34576 has finished for PR 6716 at commit
|
|
Test build #34582 has finished for PR 6716 at commit
|
|
Thanks. I've merged this. |
Author: Daoyuan Wang <[email protected]> Closes apache#6716 from adrian-wang/epi and squashes the following commits: e2e8dbd [Daoyuan Wang] move tests 11b351c [Daoyuan Wang] add tests and remove pu db331c9 [Daoyuan Wang] py style 599ddd8 [Daoyuan Wang] add py e6783ef [Daoyuan Wang] register function 82d426e [Daoyuan Wang] add function entry dbf3ab5 [Daoyuan Wang] add PI and E
No description provided.