Skip to content

Commit d6d6a67

Browse files
pan3793yhuang-db
pan3793
authored and
yhuang-db
committed
[SPARK-51301][BUILD] Bump zstd-jni 1.5.7-3
### What changes were proposed in this pull request? Bump zstd-jni to the latest version. ### Why are the changes needed? https://github.com/facebook/zstd/releases/tag/v1.5.7 luben/zstd-jni@v1.5.6-10...v1.5.7-3 ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? Pass GHA, also update the benchmark results. ### Was this patch authored or co-authored using generative AI tooling? No. Closes apache#50057 from pan3793/SPARK-51301. Authored-by: Cheng Pan <[email protected]> Signed-off-by: yangjie01 <[email protected]>
1 parent 5ba15b1 commit d6d6a67

File tree

6 files changed

+110
-110
lines changed

6 files changed

+110
-110
lines changed

‎core/benchmarks/ZStandardBenchmark-jdk21-results.txt‎

Lines changed: 28 additions & 28 deletions
Original file line numberDiff line numberDiff line change
@@ -2,48 +2,48 @@
22
Benchmark ZStandardCompressionCodec
33
================================================================================================
44

5-
OpenJDK 64-Bit Server VM 21.0.6+7-LTS on Linux 6.8.0-1020-azure
5+
OpenJDK 64-Bit Server VM 21.0.7+6-LTS on Linux 6.11.0-1014-azure
66
AMD EPYC 7763 64-Core Processor
77
Benchmark ZStandardCompressionCodec: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
88
--------------------------------------------------------------------------------------------------------------------------------------
9-
Compression 10000 times at level 1 without buffer pool 656 668 12 0.0 65591.6 1.0X
10-
Compression 10000 times at level 2 without buffer pool 709 711 2 0.0 70934.6 0.9X
11-
Compression 10000 times at level 3 without buffer pool 814 818 5 0.0 81370.9 0.8X
12-
Compression 10000 times at level 1 with buffer pool 601 603 2 0.0 60100.1 1.1X
13-
Compression 10000 times at level 2 with buffer pool 634 636 2 0.0 63449.9 1.0X
14-
Compression 10000 times at level 3 with buffer pool 748 753 5 0.0 74789.7 0.9X
9+
Compression 10000 times at level 1 without buffer pool 657 673 15 0.0 65664.9 1.0X
10+
Compression 10000 times at level 2 without buffer pool 718 726 13 0.0 71830.9 0.9X
11+
Compression 10000 times at level 3 without buffer pool 815 819 7 0.0 81453.1 0.8X
12+
Compression 10000 times at level 1 with buffer pool 598 600 1 0.0 59809.3 1.1X
13+
Compression 10000 times at level 2 with buffer pool 637 639 2 0.0 63710.0 1.0X
14+
Compression 10000 times at level 3 with buffer pool 754 757 3 0.0 75403.8 0.9X
1515

16-
OpenJDK 64-Bit Server VM 21.0.6+7-LTS on Linux 6.8.0-1020-azure
16+
OpenJDK 64-Bit Server VM 21.0.7+6-LTS on Linux 6.11.0-1014-azure
1717
AMD EPYC 7763 64-Core Processor
1818
Benchmark ZStandardCompressionCodec: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
1919
------------------------------------------------------------------------------------------------------------------------------------------
20-
Decompression 10000 times from level 1 without buffer pool 817 818 1 0.0 81723.2 1.0X
21-
Decompression 10000 times from level 2 without buffer pool 817 818 1 0.0 81729.4 1.0X
22-
Decompression 10000 times from level 3 without buffer pool 817 818 1 0.0 81719.7 1.0X
23-
Decompression 10000 times from level 1 with buffer pool 749 757 14 0.0 74864.9 1.1X
24-
Decompression 10000 times from level 2 with buffer pool 748 749 1 0.0 74789.1 1.1X
25-
Decompression 10000 times from level 3 with buffer pool 748 749 1 0.0 74811.6 1.1X
20+
Decompression 10000 times from level 1 without buffer pool 832 835 2 0.0 83247.0 1.0X
21+
Decompression 10000 times from level 2 without buffer pool 833 840 8 0.0 83277.8 1.0X
22+
Decompression 10000 times from level 3 without buffer pool 833 833 0 0.0 83280.6 1.0X
23+
Decompression 10000 times from level 1 with buffer pool 753 755 2 0.0 75333.7 1.1X
24+
Decompression 10000 times from level 2 with buffer pool 751 752 1 0.0 75115.3 1.1X
25+
Decompression 10000 times from level 3 with buffer pool 753 754 2 0.0 75254.0 1.1X
2626

27-
OpenJDK 64-Bit Server VM 21.0.6+7-LTS on Linux 6.8.0-1020-azure
27+
OpenJDK 64-Bit Server VM 21.0.7+6-LTS on Linux 6.11.0-1014-azure
2828
AMD EPYC 7763 64-Core Processor
2929
Parallel Compression at level 3: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
3030
------------------------------------------------------------------------------------------------------------------------
31-
Parallel Compression with 0 workers 57 59 1 0.0 447789.9 1.0X
32-
Parallel Compression with 1 workers 42 44 3 0.0 326565.8 1.4X
33-
Parallel Compression with 2 workers 39 41 1 0.0 303072.5 1.5X
34-
Parallel Compression with 4 workers 38 40 1 0.0 295414.4 1.5X
35-
Parallel Compression with 8 workers 40 42 1 0.0 315081.4 1.4X
36-
Parallel Compression with 16 workers 44 46 1 0.0 344861.3 1.3X
31+
Parallel Compression with 0 workers 77 78 1 0.0 601317.6 1.0X
32+
Parallel Compression with 1 workers 64 70 4 0.0 499456.2 1.2X
33+
Parallel Compression with 2 workers 53 56 3 0.0 410610.6 1.5X
34+
Parallel Compression with 4 workers 45 47 1 0.0 350847.8 1.7X
35+
Parallel Compression with 8 workers 47 49 1 0.0 370647.8 1.6X
36+
Parallel Compression with 16 workers 50 52 1 0.0 390524.8 1.5X
3737

38-
OpenJDK 64-Bit Server VM 21.0.6+7-LTS on Linux 6.8.0-1020-azure
38+
OpenJDK 64-Bit Server VM 21.0.7+6-LTS on Linux 6.11.0-1014-azure
3939
AMD EPYC 7763 64-Core Processor
4040
Parallel Compression at level 9: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
4141
------------------------------------------------------------------------------------------------------------------------
42-
Parallel Compression with 0 workers 158 160 1 0.0 1236127.4 1.0X
43-
Parallel Compression with 1 workers 189 191 2 0.0 1477461.1 0.8X
44-
Parallel Compression with 2 workers 113 118 9 0.0 880537.6 1.4X
45-
Parallel Compression with 4 workers 107 110 2 0.0 837459.4 1.5X
46-
Parallel Compression with 8 workers 114 115 2 0.0 888143.3 1.4X
47-
Parallel Compression with 16 workers 113 116 2 0.0 880682.5 1.4X
42+
Parallel Compression with 0 workers 243 244 2 0.0 1894990.4 1.0X
43+
Parallel Compression with 1 workers 299 300 2 0.0 2335128.6 0.8X
44+
Parallel Compression with 2 workers 167 177 11 0.0 1308212.2 1.4X
45+
Parallel Compression with 4 workers 161 163 3 0.0 1254638.0 1.5X
46+
Parallel Compression with 8 workers 166 170 4 0.0 1299104.0 1.5X
47+
Parallel Compression with 16 workers 167 170 2 0.0 1301666.4 1.5X
4848

4949

‎core/benchmarks/ZStandardBenchmark-results.txt‎

Lines changed: 28 additions & 28 deletions
Original file line numberDiff line numberDiff line change
@@ -2,48 +2,48 @@
22
Benchmark ZStandardCompressionCodec
33
================================================================================================
44

5-
OpenJDK 64-Bit Server VM 17.0.14+7-LTS on Linux 6.8.0-1020-azure
5+
OpenJDK 64-Bit Server VM 17.0.15+6-LTS on Linux 6.11.0-1014-azure
66
AMD EPYC 7763 64-Core Processor
77
Benchmark ZStandardCompressionCodec: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
88
--------------------------------------------------------------------------------------------------------------------------------------
9-
Compression 10000 times at level 1 without buffer pool 661 662 1 0.0 66080.2 1.0X
10-
Compression 10000 times at level 2 without buffer pool 701 702 1 0.0 70111.0 0.9X
11-
Compression 10000 times at level 3 without buffer pool 792 796 5 0.0 79224.8 0.8X
12-
Compression 10000 times at level 1 with buffer pool 573 573 0 0.0 57276.4 1.2X
13-
Compression 10000 times at level 2 with buffer pool 602 602 0 0.0 60206.9 1.1X
14-
Compression 10000 times at level 3 with buffer pool 707 707 1 0.0 70665.0 0.9X
9+
Compression 10000 times at level 1 without buffer pool 651 654 3 0.0 65120.6 1.0X
10+
Compression 10000 times at level 2 without buffer pool 701 702 1 0.0 70069.5 0.9X
11+
Compression 10000 times at level 3 without buffer pool 788 790 2 0.0 78845.5 0.8X
12+
Compression 10000 times at level 1 with buffer pool 577 578 2 0.0 57688.1 1.1X
13+
Compression 10000 times at level 2 with buffer pool 607 608 1 0.0 60653.3 1.1X
14+
Compression 10000 times at level 3 with buffer pool 716 717 0 0.0 71634.8 0.9X
1515

16-
OpenJDK 64-Bit Server VM 17.0.14+7-LTS on Linux 6.8.0-1020-azure
16+
OpenJDK 64-Bit Server VM 17.0.15+6-LTS on Linux 6.11.0-1014-azure
1717
AMD EPYC 7763 64-Core Processor
1818
Benchmark ZStandardCompressionCodec: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
1919
------------------------------------------------------------------------------------------------------------------------------------------
20-
Decompression 10000 times from level 1 without buffer pool 635 635 0 0.0 63471.5 1.0X
21-
Decompression 10000 times from level 2 without buffer pool 637 638 1 0.0 63693.2 1.0X
22-
Decompression 10000 times from level 3 without buffer pool 637 638 1 0.0 63687.9 1.0X
23-
Decompression 10000 times from level 1 with buffer pool 545 545 0 0.0 54463.9 1.2X
24-
Decompression 10000 times from level 2 with buffer pool 544 545 1 0.0 54405.3 1.2X
25-
Decompression 10000 times from level 3 with buffer pool 544 545 1 0.0 54399.6 1.2X
20+
Decompression 10000 times from level 1 without buffer pool 621 621 0 0.0 62063.9 1.0X
21+
Decompression 10000 times from level 2 without buffer pool 620 621 1 0.0 62003.0 1.0X
22+
Decompression 10000 times from level 3 without buffer pool 620 622 1 0.0 62017.4 1.0X
23+
Decompression 10000 times from level 1 with buffer pool 544 544 0 0.0 54377.6 1.1X
24+
Decompression 10000 times from level 2 with buffer pool 544 544 1 0.0 54404.3 1.1X
25+
Decompression 10000 times from level 3 with buffer pool 543 544 1 0.0 54310.2 1.1X
2626

27-
OpenJDK 64-Bit Server VM 17.0.14+7-LTS on Linux 6.8.0-1020-azure
27+
OpenJDK 64-Bit Server VM 17.0.15+6-LTS on Linux 6.11.0-1014-azure
2828
AMD EPYC 7763 64-Core Processor
2929
Parallel Compression at level 3: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
3030
------------------------------------------------------------------------------------------------------------------------
31-
Parallel Compression with 0 workers 61 62 0 0.0 475889.8 1.0X
32-
Parallel Compression with 1 workers 43 45 2 0.0 338238.7 1.4X
33-
Parallel Compression with 2 workers 42 45 2 0.0 327766.3 1.5X
34-
Parallel Compression with 4 workers 43 45 1 0.0 334407.0 1.4X
35-
Parallel Compression with 8 workers 44 47 1 0.0 345047.0 1.4X
36-
Parallel Compression with 16 workers 50 52 1 0.0 387573.7 1.2X
31+
Parallel Compression with 0 workers 77 79 1 0.0 603481.7 1.0X
32+
Parallel Compression with 1 workers 65 68 3 0.0 504835.7 1.2X
33+
Parallel Compression with 2 workers 50 55 3 0.0 393366.7 1.5X
34+
Parallel Compression with 4 workers 45 48 2 0.0 352491.0 1.7X
35+
Parallel Compression with 8 workers 46 49 1 0.0 362934.5 1.7X
36+
Parallel Compression with 16 workers 50 53 1 0.0 393219.4 1.5X
3737

38-
OpenJDK 64-Bit Server VM 17.0.14+7-LTS on Linux 6.8.0-1020-azure
38+
OpenJDK 64-Bit Server VM 17.0.15+6-LTS on Linux 6.11.0-1014-azure
3939
AMD EPYC 7763 64-Core Processor
4040
Parallel Compression at level 9: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
4141
------------------------------------------------------------------------------------------------------------------------
42-
Parallel Compression with 0 workers 161 163 1 0.0 1260900.1 1.0X
43-
Parallel Compression with 1 workers 192 194 3 0.0 1501584.9 0.8X
44-
Parallel Compression with 2 workers 116 119 2 0.0 908607.3 1.4X
45-
Parallel Compression with 4 workers 112 116 6 0.0 878265.0 1.4X
46-
Parallel Compression with 8 workers 118 121 3 0.0 921810.4 1.4X
47-
Parallel Compression with 16 workers 115 120 3 0.0 899718.4 1.4X
42+
Parallel Compression with 0 workers 237 239 1 0.0 1852985.0 1.0X
43+
Parallel Compression with 1 workers 299 301 2 0.0 2339270.2 0.8X
44+
Parallel Compression with 2 workers 167 174 6 0.0 1303651.0 1.4X
45+
Parallel Compression with 4 workers 160 165 3 0.0 1248593.3 1.5X
46+
Parallel Compression with 8 workers 166 170 3 0.0 1295084.3 1.4X
47+
Parallel Compression with 16 workers 165 169 3 0.0 1288571.2 1.4X
4848

4949

0 commit comments

Comments
 (0)