Skip to content

Commit 33321cf

Browse files
pan3793wangyum
authored andcommitted
[SPARK-40983][DOC] Remove Hadoop requirements for zstd mentioned in Parquet compression codec
### What changes were proposed in this pull request? Change the doc to remove Hadoop requirements for zstd mentioned in Parquet compression codec. ### Why are the changes needed? This requirement is removed after https://issues.apache.org/jira/browse/PARQUET-1866, and Spark uses Parquet 1.12.3 now. ### Does this PR introduce _any_ user-facing change? Yes, doc updated. ### How was this patch tested? <img width="1144" alt="image" src="https://user-images.githubusercontent.com/26535726/199180625-4e3a2ee1-3e4d-4d61-8842-f1d5b7b9321d.png"> Closes apache#38458 from pan3793/SPARK-40983. Authored-by: Cheng Pan <[email protected]> Signed-off-by: Yuming Wang <[email protected]> (cherry picked from commit 9c1bb41) Signed-off-by: Yuming Wang <[email protected]>
1 parent fb2bdea commit 33321cf

File tree

1 file changed

+1
-2
lines changed

1 file changed

+1
-2
lines changed

docs/sql-data-sources-parquet.md

Lines changed: 1 addition & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -404,8 +404,7 @@ Configuration of Parquet can be done using the `setConf` method on `SparkSession
404404
<code>parquet.compression</code> is specified in the table-specific options/properties, the precedence would be
405405
<code>compression</code>, <code>parquet.compression</code>, <code>spark.sql.parquet.compression.codec</code>. Acceptable values include:
406406
none, uncompressed, snappy, gzip, lzo, brotli, lz4, zstd.
407-
Note that <code>zstd</code> requires <code>ZStandardCodec</code> to be installed before Hadoop 2.9.0, <code>brotli</code> requires
408-
<code>BrotliCodec</code> to be installed.
407+
Note that <code>brotli</code> requires <code>BrotliCodec</code> to be installed.
409408
</td>
410409
<td>1.1.1</td>
411410
</tr>

0 commit comments

Comments
 (0)