Skip to content

Conversation

@ymahajan
Copy link

What changes were proposed in this pull request?

Provided schema in StreamSinkProvider#createSink for custom Sink implementations.

How was this patch tested?

manual tests

Please review http://spark.apache.org/contributing.html before opening a pull request.

@AmplabJenkins
Copy link

Can one of the admins verify this patch?

@felixcheung
Copy link
Member

should this be [SS] other than [Streaming]?

@ymahajan ymahajan changed the title [SPARK-20378][CORE][SQL][STREAMING] StreamSinkProvider should provide schema in createSink [SPARK-20378][CORE][SQL][SS] StreamSinkProvider should provide schema in createSink Apr 20, 2017
@ymahajan
Copy link
Author

@felixcheung Thanks, I changed it to [SS] in the subject of this PR.

@InterfaceStability.Unstable
trait StreamSinkProvider {
def createSink(
schema: StructType,
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The interface can't just be changed like this. This breaks backwards compatibility ...

@HyukjinKwon
Copy link
Member

ping @ymahajan

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants