Skip to content

Conversation

@shijinkui
Copy link
Contributor

https://issues.apache.org/jira/browse/SPARK-12953

fix error when run RDDRelation.main():
"path file:/Users/sjk/pair.parquet already exists"

Set DataFrameWriter's mode to SaveMode.Overwrite

@shijinkui shijinkui changed the title fix error when run RDDRelation.main():"path file:/Users/sjk/pair.parq… [SPARK-12953]RDDRelation writer set overwrite mode Jan 21, 2016
@shijinkui shijinkui changed the title [SPARK-12953]RDDRelation writer set overwrite mode [SPARK-12953][Examples]RDDRelation writer set overwrite mode Jan 21, 2016
@rxin
Copy link
Contributor

rxin commented Jan 23, 2016

Thanks for submitting a patch. However, I don't think these examples are here for you to keep running them -- it is just an example.

@rxin
Copy link
Contributor

rxin commented Jan 23, 2016

Can you close this pull request? Thanks.

@shijinkui shijinkui closed this Jan 24, 2016
@shijinkui
Copy link
Contributor Author

@rxin This case throw exception at the second time of running. Unit test is import to project, example is useful for spark user. :)
this problem is not important and critical, if can be fixed by the way, maybe better for user :)

@rxin
Copy link
Contributor

rxin commented Jan 25, 2016

That's fair -- if you reopen I can merge it provided that tests pass.

@SparkQA
Copy link

SparkQA commented Jan 25, 2016

Test build #2452 has finished for PR 10864 at commit 958a419.

  • This patch fails Scala style tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@shijinkui shijinkui reopened this Jan 25, 2016
@shijinkui
Copy link
Contributor Author

hi, @rxin, I have reopened, please trigger the test

@SparkQA
Copy link

SparkQA commented Jan 25, 2016

Test build #2456 has finished for PR 10864 at commit 2de63ec.

  • This patch fails to build.
  • This patch merges cleanly.
  • This patch adds no public classes.

@shijinkui
Copy link
Contributor Author

test it

@JoshRosen
Copy link
Contributor

Jenkins, retest this please.

@SparkQA
Copy link

SparkQA commented Jan 27, 2016

Test build #50154 has finished for PR 10864 at commit 04c4ef4.

  • This patch fails Scala style tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

…uet already exists"

Setting DataFrameWriter's mode to `SaveMode.Overwrite`
@shijinkui
Copy link
Contributor Author

@JoshRosen fix checkstyle failure, please retest it.

@JoshRosen
Copy link
Contributor

Jenkins, retest this please

@SparkQA
Copy link

SparkQA commented Feb 10, 2016

Test build #51054 has finished for PR 10864 at commit d768182.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@JoshRosen
Copy link
Contributor

LGTM, so I'm merging this to master. Thanks!

@asfgit asfgit closed this in 97ee85d Feb 17, 2016
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants