Skip to content

[SPARK-13166][SQL] Remove DataStreamReader/Writer #11062

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
wants to merge 2 commits into from
Closed

[SPARK-13166][SQL] Remove DataStreamReader/Writer #11062

wants to merge 2 commits into from

Conversation

@rxin
Copy link
Contributor

@rxin rxin commented Feb 3, 2016

They seem redundant and we can simply use DataFrameReader/Writer. The new usage looks like:

val df = sqlContext.read.stream("...")
val handle = df.write.stream("...")
handle.stop()

tdas
tdas reviewed Feb 3, 2016
View reviewed changes
sql/core/src/main/scala/org/apache/spark/sql/DataFrameWriter.scala Outdated
Copy link
Contributor

@tdas tdas Feb 3, 2016

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

extra space

@SparkQA
Copy link

SparkQA commented Feb 4, 2016

Test build #50693 has finished for PR 11062 at commit 7528abb.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@marmbrus
Copy link
Contributor

marmbrus commented Feb 4, 2016

LGTM, merging to master.

@asfgit asfgit closed this in 915a753 Feb 4, 2016
@zsxwing zsxwing mentioned this pull request Feb 5, 2016
Closed
asfgit pushed a commit that referenced this pull request Feb 5, 2016
@zsxwing
[SPARK-13166][SQL] Rename DataStreamReaderWriterSuite to DataFrameRea…
7b73f17 
…derWriterSuite

A follow up PR for #11062 because it didn't rename the test suite.

Author: Shixiong Zhu <[email protected]>

Closes #11096 from zsxwing/rename.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

4 participants

@rxin @SparkQA @marmbrus @tdas