Skip to content

Conversation

@wangyum
Copy link
Member

@wangyum wangyum commented May 25, 2018

What changes were proposed in this pull request?

Spark provides four codecs: lz4, lzf, snappy, and zstd. This pr add missing shortCompressionCodecNames to configuration.

How was this patch tested?

manually tested

@SparkQA
Copy link

SparkQA commented May 25, 2018

Test build #91157 has finished for PR 21431 at commit 877d270.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@wangyum
Copy link
Member Author

wangyum commented May 26, 2018

Yes. I have tested with —conf spark.io.compression.codec=zstd.

asfgit pushed a commit that referenced this pull request May 26, 2018
… to configuration.

## What changes were proposed in this pull request?

Spark provides four codecs: `lz4`, `lzf`, `snappy`, and `zstd`. This pr add missing shortCompressionCodecNames to configuration.

## How was this patch tested?

 manually tested

Author: Yuming Wang <[email protected]>

Closes #21431 from wangyum/SPARK-19112.

(cherry picked from commit ed1a654)
Signed-off-by: hyukjinkwon <[email protected]>
@HyukjinKwon
Copy link
Member

Merged to master and branch-2.3.

@asfgit asfgit closed this in ed1a654 May 26, 2018
@wangyum wangyum deleted the SPARK-19112 branch May 26, 2018 12:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants