-
Notifications
You must be signed in to change notification settings - Fork 28.9k
[SPARK-22191] [SQL] Add hive serde example with serde properties #19420
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
| // $example off:spark_hive$ | ||
|
|
||
| // Hive serde's are also supported with serde properties. | ||
| String sqlQuery = "CREATE TABLE src_serde(key decimal(38,18), value int) USING hive" |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Hi, @crlalam.
We use 2-space indentation in general.
FYI, maybe, you can see Scala Coding Style.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Hi @dongjoon-hyun ,
Thanks for the review and pointing me to the coding style. Fixed coding style issues and updated the pull request. Please take a look.
|
Jenkins OK to test |
| // $example off:spark_hive$ | ||
|
|
||
| // Hive serde's are also supported with serde properties. | ||
| String sqlQuery = "CREATE TABLE src_serde(key decimal(38,18), value int) USING hive" + |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The indentation here doesn't match the rest of the function.
|
I love more examples, but is there a place we plan to put this in the documentation? |
|
Can one of the admins verify this patch? |
What changes were proposed in this pull request?
Added an example for, specifying serde with serde properties for hive tables using OPTIONS.
How was this patch tested?
Verified manually by running examples with run-example.sh. Verified in Scala, java and python.