Skip to content

[SPARK-10584][SQL][DOC] Documentation about the compatible Hive version is wrong. #8776

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
wants to merge 2 commits into from
Closed

[SPARK-10584][SQL][DOC] Documentation about the compatible Hive version is wrong. #8776

wants to merge 2 commits into from

Conversation

@sarutak
Copy link
Member

@sarutak sarutak commented Sep 16, 2015

In Spark 1.5.0, Spark SQL is compatible with Hive 0.12.0 through 1.2.1 but the documentation is wrong.

/CC @yhuai

yhuai
yhuai reviewed Sep 16, 2015
View reviewed changes
docs/sql-programming-guide.md
Copy link
Contributor

@yhuai yhuai Sep 16, 2015

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@liancheng We should say Hive 1.2.1 at here, right?

Copy link
Contributor

@liancheng liancheng Sep 19, 2015

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah right.

@SparkQA
Copy link

SparkQA commented Sep 16, 2015

Test build #42521 has finished for PR 8776 at commit 4662a25.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds the following public classes (experimental):
    • case class TaskCommitDenied(
    • abstract class LocalNode(conf: SQLConf) extends QueryPlan[LocalNode] with Logging

yhuai
yhuai reviewed Sep 16, 2015
View reviewed changes
docs/sql-programming-guide.md Outdated
Copy link
Contributor

@yhuai yhuai Sep 16, 2015

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

How about we say that Hive SerDes and UDFs are based on Hive 1.2.1, and Spark SQL can be connected to different versions of Hive Metastore (from 0.12.0 to 1.2.1. Also see http://spark.apache.org/docs/latest/sql-programming-guide.html#interacting-with-different-versions-of-hive-metastore). @marmbrus What do you think?

Copy link
Member Author

@sarutak sarutak Sep 18, 2015

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah, it's more clear. Thanks for your suggestion.

@srowen
Copy link
Member

srowen commented Sep 16, 2015

Was this related to #8739 ?

@yhuai
Copy link
Contributor

yhuai commented Sep 16, 2015

@srowen Yeah, it is related to that. This one has two more changes for the doc.

@SparkQA
Copy link

SparkQA commented Sep 18, 2015

Test build #42660 has finished for PR 8776 at commit 89e74dd.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@liancheng
Copy link
Contributor

liancheng commented Sep 19, 2015

LGTM, merging to master and branch-1.5. Thanks!

asfgit pushed a commit that referenced this pull request Sep 19, 2015
@sarutak @liancheng
[SPARK-10584] [SQL] [DOC] Documentation about the compatible Hive ver…
aaae67d 
…sion is wrong.

In Spark 1.5.0, Spark SQL is compatible with Hive 0.12.0 through 1.2.1 but the documentation is wrong.

/CC yhuai

Author: Kousuke Saruta <[email protected]>

Closes #8776 from sarutak/SPARK-10584-2.

(cherry picked from commit d507f9c)
Signed-off-by: Cheng Lian <[email protected]>
@asfgit asfgit closed this in d507f9c Sep 19, 2015
@sarutak sarutak deleted the SPARK-10584-2 branch June 4, 2021 20:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

5 participants

@sarutak @SparkQA @srowen @yhuai @liancheng