Skip to content

Commit

Permalink
DEBUG
Browse files Browse the repository at this point in the history
  • Loading branch information
@petervdonovan
petervdonovan committed Jul 15, 2022
1 parent b9f341a commit 8f4a38d
Showing 1 changed file with 1 addition and 3 deletions.
4 changes: 1 addition & 3 deletions .github/workflows/continuous-benchmark.yml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -72,9 +72,7 @@ jobs:
output-file-path: continuous-benchmarking-results-multi-threaded.json
github-token: ${{ secrets.GITHUB_TOKEN }}
auto-push: true

# Show alert with commit comment on detecting possible performance regression
alert-threshold: '100%' # FIXME: After russel is set up, lower the threshold and set alert/comment to true
alert-threshold: '1%' # FIXME: After russel is set up, lower the threshold and set alert/comment to true
comment-on-alert: true
fail-on-alert: false

Expand Down

1 comment on commit 8f4a38d

@github-actions
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'Lingua Franca C Benchmark -- Multithreaded'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 0.01.

Benchmark suite Current: 8f4a38d Previous: b9f341a Ratio
Thread Ring (scheduler=NP) 32.23066666666667 ms 41.4645 ms 0.78
Thread Ring (scheduler=GEDF_NP) 32.26958333333333 ms 38.26125 ms 0.84
Thread Ring (scheduler=adaptive) 31.72866666666667 ms 38.455000000000005 ms 0.83
Ping Pong (scheduler=NP) 36.62741666666667 ms 43.948249999999994 ms 0.83
Ping Pong (scheduler=GEDF_NP) 36.63975 ms 45.6395 ms 0.80
Ping Pong (scheduler=adaptive) 36.71241666666666 ms 43.257666666666665 ms 0.85
Chameneos (scheduler=NP) 86.20541666666666 ms 110.12266666666666 ms 0.78
Chameneos (scheduler=GEDF_NP) 87.39091666666666 ms 110.75399999999998 ms 0.79
Chameneos (scheduler=adaptive) 87.41966666666667 ms 113.06108333333333 ms 0.77
Producer Consumer (bounded) (scheduler=NP) 211.80050000000003 ms 257.3848333333333 ms 0.82
Producer Consumer (bounded) (scheduler=GEDF_NP) 212.04983333333334 ms 265.4788333333333 ms 0.80
Producer Consumer (bounded) (scheduler=adaptive) 216.85291666666663 ms 269.0346666666666 ms 0.81
A-Star Search (scheduler=NP) 29.864384615384616 ms 39.319923076923075 ms 0.76
A-Star Search (scheduler=GEDF_NP) 29.596461538461533 ms 37.62653846153846 ms 0.79
A-Star Search (scheduler=adaptive) 29.46361538461538 ms 37.35569230769231 ms 0.79
Fork Join (throughput) (scheduler=NP) 18.9635 ms 25.697333333333333 ms 0.74
Fork Join (throughput) (scheduler=GEDF_NP) 18.913166666666665 ms 23.2555 ms 0.81
Fork Join (throughput) (scheduler=adaptive) 18.9385 ms 22.690083333333334 ms 0.83
Radix Sort (scheduler=NP) 123.75458333333334 ms 156.04566666666668 ms 0.79
Radix Sort (scheduler=GEDF_NP) 123.52125000000001 ms 154.42708333333334 ms 0.80
Radix Sort (scheduler=adaptive) 123.46391666666666 ms 151.01808333333332 ms 0.82
Concurrent Sorted Linked List (scheduler=NP) 243.75424999999996 ms 281.7248333333334 ms 0.87
Concurrent Sorted Linked List (scheduler=GEDF_NP) 243.64866666666668 ms 281.71 ms 0.86
Concurrent Sorted Linked List (scheduler=adaptive) 243.72433333333333 ms 279.514 ms 0.87
Big (scheduler=NP) 123.63841666666667 ms 150.60524999999998 ms 0.82
Big (scheduler=GEDF_NP) 119.66924999999999 ms 165.9539166666667 ms 0.72
Big (scheduler=adaptive) 121.707 ms 161.32791666666665 ms 0.75
Sleeping Barber (scheduler=NP) 37.0715 ms 38.36233333333333 ms 0.97
Sleeping Barber (scheduler=GEDF_NP) 37.327416666666664 ms 39.96366666666666 ms 0.93
Sleeping Barber (scheduler=adaptive) 37.097 ms 40.63216666666666 ms 0.91
Logistic Map Series (scheduler=NP) 32.802416666666666 ms 45.27866666666667 ms 0.72
Logistic Map Series (scheduler=GEDF_NP) 32.457249999999995 ms 45.74483333333333 ms 0.71
Logistic Map Series (scheduler=adaptive) 32.21083333333334 ms 45.844833333333334 ms 0.70
Trapezoidal Approximation (scheduler=NP) 145.50783333333334 ms 161.04425 ms 0.90
Trapezoidal Approximation (scheduler=GEDF_NP) 145.00733333333335 ms 161.81975 ms 0.90
Trapezoidal Approximation (scheduler=adaptive) 145.96675000000002 ms 169.51333333333335 ms 0.86
Bank Transaction (scheduler=NP) 111.73900000000002 ms 162.43541666666667 ms 0.69
Bank Transaction (scheduler=GEDF_NP) 116.94091666666668 ms 166.36825 ms 0.70
Bank Transaction (scheduler=adaptive) 111.00891666666668 ms 158.89200000000002 ms 0.70
Recursive Matrix Multiplication (scheduler=NP) 180.5299166666667 ms 205.89049999999997 ms 0.88
Recursive Matrix Multiplication (scheduler=GEDF_NP) 180.391 ms 213.35533333333333 ms 0.85
Recursive Matrix Multiplication (scheduler=adaptive) 180.80066666666667 ms 216.50933333333333 ms 0.84
Cigarette Smokers (scheduler=NP) 0.8085000000000001 ms 1.0279166666666666 ms 0.79
Cigarette Smokers (scheduler=GEDF_NP) 0.8115833333333332 ms 1.0005833333333334 ms 0.81
Cigarette Smokers (scheduler=adaptive) 0.8060833333333334 ms 1.0113333333333332 ms 0.80
Filter Bank (scheduler=NP) 148.39908333333335 ms 210.1113333333333 ms 0.71
Filter Bank (scheduler=GEDF_NP) 147.25166666666667 ms 205.2915 ms 0.72
Filter Bank (scheduler=adaptive) 147.6915 ms 211.39999999999998 ms 0.70
All-Pairs Shortest Path (scheduler=NP) 113.25800000000002 ms 295.42775 ms 0.38
All-Pairs Shortest Path (scheduler=GEDF_NP) 113.10158333333332 ms 294.88983333333334 ms 0.38
All-Pairs Shortest Path (scheduler=adaptive) 113.39691666666666 ms 286.38733333333334 ms 0.40
Precise Pi Computation (scheduler=NP) 152.82691666666668 ms 167.83483333333334 ms 0.91
Precise Pi Computation (scheduler=GEDF_NP) 153.0224166666667 ms 155.82391666666666 ms 0.98
Precise Pi Computation (scheduler=adaptive) 152.89458333333332 ms 156.9315 ms 0.97
NQueens first N solutions (scheduler=NP) 483.35158333333334 ms 641.5290833333333 ms 0.75
NQueens first N solutions (scheduler=GEDF_NP) 487.13108333333327 ms 637.4771666666667 ms 0.76
NQueens first N solutions (scheduler=adaptive) 480.98499999999996 ms 639.6350833333333 ms 0.75
Philosophers (scheduler=NP) 28.677916666666672 ms 41.76166666666666 ms 0.69
Philosophers (scheduler=GEDF_NP) 28.561916666666665 ms 43.08516666666667 ms 0.66
Philosophers (scheduler=adaptive) 28.729416666666662 ms 41.17958333333333 ms 0.70
Counting Actor (scheduler=NP) 94.06575 ms 119.87708333333335 ms 0.78
Counting Actor (scheduler=GEDF_NP) 93.75375000000001 ms 117.31766666666665 ms 0.80
Counting Actor (scheduler=adaptive) 93.73466666666667 ms 120.55708333333335 ms 0.78
Concurrent Dictionary (scheduler=NP) 62.58775000000001 ms 77.0055 ms 0.81
Concurrent Dictionary (scheduler=GEDF_NP) 62.903333333333336 ms 81.38975 ms 0.77
Concurrent Dictionary (scheduler=adaptive) 62.40233333333333 ms 78.26125 ms 0.80

This comment was automatically generated by workflow using github-action-benchmark.

Please sign in to comment.