Skip to content

Commit

Permalink
[SPARK-42483][TESTS] Regenerate benchmark results
Browse files Browse the repository at this point in the history 
### What changes were proposed in this pull request?

This aims to regenerate benchmark results on `master` branch as a baseline for Spark 3.5.0 and a way to comparing Apache Spark 3.4.0 branch.

### Why are the changes needed?

These are reference values with minor changes.
```
- OpenJDK 64-Bit Server VM 1.8.0_352-b08 on Linux 5.15.0-1023-azure
+ OpenJDK 64-Bit Server VM 1.8.0_362-b09 on Linux 5.15.0-1031-azure

- OpenJDK 64-Bit Server VM 11.0.17+8 on Linux 5.15.0-1023-azure
+ OpenJDK 64-Bit Server VM 11.0.18+10 on Linux 5.15.0-1031-azure

- OpenJDK 64-Bit Server VM 17.0.5+8 on Linux 5.15.0-1023-azure
+ OpenJDK 64-Bit Server VM 17.0.6+10 on Linux 5.15.0-1031-azure
```

### Does this PR introduce _any_ user-facing change?

No.

### How was this patch tested?

Manual review.

Closes apache#40072 from dongjoon-hyun/SPARK-42483.

Authored-by: Dongjoon Hyun <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
  • Loading branch information
@dongjoon-hyun
dongjoon-hyun committed Feb 18, 2023
1 parent 1389c9f commit 2552a79
Show file tree
Hide file tree
Showing 204 changed files with 11,048 additions and 11,048 deletions.
76 changes: 38 additions & 38 deletions connector/avro/benchmarks/AvroReadBenchmark-jdk11-results.txt
View file
Original file line number Diff line number Diff line change
Expand Up @@ -2,140 +2,140 @@
SQL Single Numeric Column Scan
================================================================================================

OpenJDK 64-Bit Server VM 11.0.17+8 on Linux 5.15.0-1023-azure
OpenJDK 64-Bit Server VM 11.0.18+10 on Linux 5.15.0-1031-azure
Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
SQL Single TINYINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Sum 3347 3438 130 4.7 212.8 1.0X
Sum 3012 3013 1 5.2 191.5 1.0X

OpenJDK 64-Bit Server VM 11.0.17+8 on Linux 5.15.0-1023-azure
OpenJDK 64-Bit Server VM 11.0.18+10 on Linux 5.15.0-1031-azure
Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
SQL Single SMALLINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Sum 3347 3359 17 4.7 212.8 1.0X
Sum 2961 3008 66 5.3 188.3 1.0X

OpenJDK 64-Bit Server VM 11.0.17+8 on Linux 5.15.0-1023-azure
OpenJDK 64-Bit Server VM 11.0.18+10 on Linux 5.15.0-1031-azure
Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
SQL Single INT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Sum 3389 3407 26 4.6 215.5 1.0X
Sum 3137 3159 31 5.0 199.5 1.0X

OpenJDK 64-Bit Server VM 11.0.17+8 on Linux 5.15.0-1023-azure
OpenJDK 64-Bit Server VM 11.0.18+10 on Linux 5.15.0-1031-azure
Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
SQL Single BIGINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Sum 3651 3655 6 4.3 232.1 1.0X
Sum 3517 3522 7 4.5 223.6 1.0X

OpenJDK 64-Bit Server VM 11.0.17+8 on Linux 5.15.0-1023-azure
OpenJDK 64-Bit Server VM 11.0.18+10 on Linux 5.15.0-1031-azure
Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
SQL Single FLOAT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Sum 3396 3410 19 4.6 215.9 1.0X
Sum 3085 3188 145 5.1 196.1 1.0X

OpenJDK 64-Bit Server VM 11.0.17+8 on Linux 5.15.0-1023-azure
OpenJDK 64-Bit Server VM 11.0.18+10 on Linux 5.15.0-1031-azure
Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
SQL Single DOUBLE Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Sum 3518 3523 7 4.5 223.7 1.0X
Sum 3367 3384 23 4.7 214.1 1.0X


================================================================================================
Int and String Scan
================================================================================================

OpenJDK 64-Bit Server VM 11.0.17+8 on Linux 5.15.0-1023-azure
OpenJDK 64-Bit Server VM 11.0.18+10 on Linux 5.15.0-1031-azure
Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
Int and String Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Sum of columns 5611 5671 84 1.9 535.1 1.0X
Sum of columns 5340 5383 61 2.0 509.3 1.0X


================================================================================================
Partitioned Table Scan
================================================================================================

OpenJDK 64-Bit Server VM 11.0.17+8 on Linux 5.15.0-1023-azure
OpenJDK 64-Bit Server VM 11.0.18+10 on Linux 5.15.0-1031-azure
Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
Partitioned Table: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Data column 3883 3942 83 4.1 246.9 1.0X
Partition column 3584 3596 17 4.4 227.9 1.1X
Both columns 4050 4060 14 3.9 257.5 1.0X
Data column 3727 3804 109 4.2 236.9 1.0X
Partition column 3576 3639 89 4.4 227.4 1.0X
Both columns 4035 4045 14 3.9 256.6 0.9X


================================================================================================
Repeated String Scan
================================================================================================

OpenJDK 64-Bit Server VM 11.0.17+8 on Linux 5.15.0-1023-azure
OpenJDK 64-Bit Server VM 11.0.18+10 on Linux 5.15.0-1031-azure
Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
Repeated String: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Sum of string length 4093 4105 17 2.6 390.3 1.0X
Sum of string length 3924 3962 54 2.7 374.2 1.0X


================================================================================================
String with Nulls Scan
================================================================================================

OpenJDK 64-Bit Server VM 11.0.17+8 on Linux 5.15.0-1023-azure
OpenJDK 64-Bit Server VM 11.0.18+10 on Linux 5.15.0-1031-azure
Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
String with Nulls Scan (0.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Sum of string length 5718 5745 38 1.8 545.3 1.0X
Sum of string length 5417 5493 107 1.9 516.6 1.0X

OpenJDK 64-Bit Server VM 11.0.17+8 on Linux 5.15.0-1023-azure
OpenJDK 64-Bit Server VM 11.0.18+10 on Linux 5.15.0-1031-azure
Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
String with Nulls Scan (50.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Sum of string length 4192 4216 33 2.5 399.8 1.0X
Sum of string length 4116 4145 42 2.5 392.5 1.0X

OpenJDK 64-Bit Server VM 11.0.17+8 on Linux 5.15.0-1023-azure
OpenJDK 64-Bit Server VM 11.0.18+10 on Linux 5.15.0-1031-azure
Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
String with Nulls Scan (95.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Sum of string length 2453 2471 26 4.3 233.9 1.0X
Sum of string length 2288 2362 104 4.6 218.2 1.0X


================================================================================================
Select All From Wide Columns
================================================================================================

OpenJDK 64-Bit Server VM 11.0.17+8 on Linux 5.15.0-1023-azure
OpenJDK 64-Bit Server VM 11.0.18+10 on Linux 5.15.0-1031-azure
Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
Wide Column Scan from 1000 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Select of all columns 41994 42185 271 0.0 83987.7 1.0X
Select of all columns 42872 43072 283 0.0 85744.0 1.0X


================================================================================================
Single Column Scan From Wide Columns
================================================================================================

OpenJDK 64-Bit Server VM 11.0.17+8 on Linux 5.15.0-1023-azure
OpenJDK 64-Bit Server VM 11.0.18+10 on Linux 5.15.0-1031-azure
Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
Single Column Scan from 100 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Sum of single column 5194 5202 12 0.2 4953.0 1.0X
Sum of single column 5140 5149 13 0.2 4901.4 1.0X

OpenJDK 64-Bit Server VM 11.0.17+8 on Linux 5.15.0-1023-azure
OpenJDK 64-Bit Server VM 11.0.18+10 on Linux 5.15.0-1031-azure
Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
Single Column Scan from 200 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Sum of single column 9806 10034 323 0.1 9351.8 1.0X
Sum of single column 9924 9952 40 0.1 9464.0 1.0X

OpenJDK 64-Bit Server VM 11.0.17+8 on Linux 5.15.0-1023-azure
OpenJDK 64-Bit Server VM 11.0.18+10 on Linux 5.15.0-1031-azure
Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
Single Column Scan from 300 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Sum of single column 14811 15131 453 0.1 14124.8 1.0X
Sum of single column 14287 14488 284 0.1 13625.0 1.0X


OpenJDK 64-Bit Server VM 11.0.17+8 on Linux 5.15.0-1023-azure
OpenJDK 64-Bit Server VM 11.0.18+10 on Linux 5.15.0-1031-azure
Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
Filters pushdown: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
w/o filters 9694 9737 59 0.1 9693.7 1.0X
pushdown disabled 10598 10609 12 0.1 10597.8 0.9X
w/ filters 5038 5085 65 0.2 5038.1 1.9X
w/o filters 9825 9832 12 0.1 9825.0 1.0X
pushdown disabled 9434 9476 36 0.1 9434.4 1.0X
w/ filters 4539 4555 14 0.2 4539.0 2.2X

Loading

0 comments on commit 2552a79

Please sign in to comment.