|
| 1 | +``` |
| 2 | +================================================================================ |
| 3 | +Running task system grading harness... (22 total tests) |
| 4 | + - Detected CPU with 4 execution contexts |
| 5 | + - Task system configured to use at most 8 threads |
| 6 | +================================================================================ |
| 7 | +================================================================================ |
| 8 | +Executing test: super_super_light... |
| 9 | +Results for: super_super_light |
| 10 | + STUDENT REFERENCE PERF? |
| 11 | +[Serial] 8.338 8.389 0.99 (OK) |
| 12 | +[Parallel + Always Spawn] 46.094 54.383 0.85 (OK) |
| 13 | +[Parallel + Thread Pool + Spin] 17.055 47.597 0.36 (OK) |
| 14 | +[Parallel + Thread Pool + Sleep] 19.059 12.608 1.51 (NOT OK) |
| 15 | +================================================================================ |
| 16 | +Executing test: super_super_light_async... |
| 17 | +Results for: super_super_light_async |
| 18 | + STUDENT REFERENCE PERF? |
| 19 | +[Serial] 8.354 8.404 0.99 (OK) |
| 20 | +[Parallel + Always Spawn] 13.999 55.395 0.25 (OK) |
| 21 | +[Parallel + Thread Pool + Spin] 13.677 26.666 0.51 (OK) |
| 22 | +[Parallel + Thread Pool + Sleep] 13.979 10.657 1.31 (NOT OK) |
| 23 | +================================================================================ |
| 24 | +Executing test: super_light... |
| 25 | +Results for: super_light |
| 26 | + STUDENT REFERENCE PERF? |
| 27 | +[Serial] 89.307 116.398 0.77 (OK) |
| 28 | +[Parallel + Always Spawn] 96.013 101.305 0.95 (OK) |
| 29 | +[Parallel + Thread Pool + Spin] 64.269 109.494 0.59 (OK) |
| 30 | +[Parallel + Thread Pool + Sleep] 63.936 67.048 0.95 (OK) |
| 31 | +================================================================================ |
| 32 | +Executing test: super_light_async... |
| 33 | +Results for: super_light_async |
| 34 | + STUDENT REFERENCE PERF? |
| 35 | +[Serial] 89.276 117.207 0.76 (OK) |
| 36 | +[Parallel + Always Spawn] 71.112 100.79 0.71 (OK) |
| 37 | +[Parallel + Thread Pool + Spin] 67.452 80.345 0.84 (OK) |
| 38 | +[Parallel + Thread Pool + Sleep] 69.162 74.506 0.93 (OK) |
| 39 | +================================================================================ |
| 40 | +Executing test: ping_pong_equal... |
| 41 | +Results for: ping_pong_equal |
| 42 | + STUDENT REFERENCE PERF? |
| 43 | +[Serial] 1442.407 1877.638 0.77 (OK) |
| 44 | +[Parallel + Always Spawn] 910.883 1028.092 0.89 (OK) |
| 45 | +[Parallel + Thread Pool + Spin] 840.524 1236.856 0.68 (OK) |
| 46 | +[Parallel + Thread Pool + Sleep] 839.26 991.787 0.85 (OK) |
| 47 | +================================================================================ |
| 48 | +Executing test: ping_pong_equal_async... |
| 49 | +Results for: ping_pong_equal_async |
| 50 | + STUDENT REFERENCE PERF? |
| 51 | +[Serial] 1451.004 1881.116 0.77 (OK) |
| 52 | +[Parallel + Always Spawn] 837.339 1029.782 0.81 (OK) |
| 53 | +[Parallel + Thread Pool + Spin] 832.986 1252.628 0.66 (OK) |
| 54 | +[Parallel + Thread Pool + Sleep] 833.146 1025.67 0.81 (OK) |
| 55 | +================================================================================ |
| 56 | +Executing test: ping_pong_unequal... |
| 57 | +Results for: ping_pong_unequal |
| 58 | + STUDENT REFERENCE PERF? |
| 59 | +[Serial] 2532.003 2452.024 1.03 (OK) |
| 60 | +[Parallel + Always Spawn] 1333.656 1305.536 1.02 (OK) |
| 61 | +[Parallel + Thread Pool + Spin] 1301.364 1636.859 0.80 (OK) |
| 62 | +[Parallel + Thread Pool + Sleep] 1297.269 1277.869 1.02 (OK) |
| 63 | +================================================================================ |
| 64 | +Executing test: ping_pong_unequal_async... |
| 65 | +Results for: ping_pong_unequal_async |
| 66 | + STUDENT REFERENCE PERF? |
| 67 | +[Serial] 2535.181 2456.022 1.03 (OK) |
| 68 | +[Parallel + Always Spawn] 1292.255 1305.478 0.99 (OK) |
| 69 | +[Parallel + Thread Pool + Spin] 1287.762 1625.302 0.79 (OK) |
| 70 | +[Parallel + Thread Pool + Sleep] 1286.702 1302.037 0.99 (OK) |
| 71 | +================================================================================ |
| 72 | +Executing test: recursive_fibonacci... |
| 73 | +Results for: recursive_fibonacci |
| 74 | + STUDENT REFERENCE PERF? |
| 75 | +[Serial] 1284.658 1392.133 0.92 (OK) |
| 76 | +[Parallel + Always Spawn] 663.422 679.983 0.98 (OK) |
| 77 | +[Parallel + Thread Pool + Spin] 662.333 801.293 0.83 (OK) |
| 78 | +[Parallel + Thread Pool + Sleep] 663.667 684.598 0.97 (OK) |
| 79 | +================================================================================ |
| 80 | +Executing test: recursive_fibonacci_async... |
| 81 | +Results for: recursive_fibonacci_async |
| 82 | + STUDENT REFERENCE PERF? |
| 83 | +[Serial] 1284.809 1391.144 0.92 (OK) |
| 84 | +[Parallel + Always Spawn] 646.895 679.92 0.95 (OK) |
| 85 | +[Parallel + Thread Pool + Spin] 646.897 738.808 0.88 (OK) |
| 86 | +[Parallel + Thread Pool + Sleep] 647.797 679.018 0.95 (OK) |
| 87 | +================================================================================ |
| 88 | +Executing test: math_operations_in_tight_for_loop... |
| 89 | +Results for: math_operations_in_tight_for_loop |
| 90 | + STUDENT REFERENCE PERF? |
| 91 | +[Serial] 1850.071 1858.966 1.00 (OK) |
| 92 | +[Parallel + Always Spawn] 1389.166 1030.783 1.35 (NOT OK) |
| 93 | +[Parallel + Thread Pool + Spin] 1043.315 1436.264 0.73 (OK) |
| 94 | +[Parallel + Thread Pool + Sleep] 1040.169 827.997 1.26 (NOT OK) |
| 95 | +================================================================================ |
| 96 | +Executing test: math_operations_in_tight_for_loop_async... |
| 97 | +Results for: math_operations_in_tight_for_loop_async |
| 98 | + STUDENT REFERENCE PERF? |
| 99 | +[Serial] 1857.827 1857.36 1.00 (OK) |
| 100 | +[Parallel + Always Spawn] 1038.932 1029.518 1.01 (OK) |
| 101 | +[Parallel + Thread Pool + Spin] 1037.371 1145.084 0.91 (OK) |
| 102 | +[Parallel + Thread Pool + Sleep] 1039.098 1198.745 0.87 (OK) |
| 103 | +================================================================================ |
| 104 | +Executing test: math_operations_in_tight_for_loop_fewer_tasks... |
| 105 | +Results for: math_operations_in_tight_for_loop_fewer_tasks |
| 106 | + STUDENT REFERENCE PERF? |
| 107 | +[Serial] 1847.826 1858.804 0.99 (OK) |
| 108 | +[Parallel + Always Spawn] 1285.502 1037.551 1.24 (NOT OK) |
| 109 | +[Parallel + Thread Pool + Spin] 1137.28 1458.775 0.78 (OK) |
| 110 | +[Parallel + Thread Pool + Sleep] 1133.542 969.813 1.17 (OK) |
| 111 | +================================================================================ |
| 112 | +Executing test: math_operations_in_tight_for_loop_fewer_tasks_async... |
| 113 | +Results for: math_operations_in_tight_for_loop_fewer_tasks_async |
| 114 | + STUDENT REFERENCE PERF? |
| 115 | +[Serial] 1849.209 1859.226 0.99 (OK) |
| 116 | +[Parallel + Always Spawn] 771.113 1037.105 0.74 (OK) |
| 117 | +[Parallel + Thread Pool + Spin] 774.459 860.592 0.90 (OK) |
| 118 | +[Parallel + Thread Pool + Sleep] 771.884 764.977 1.01 (OK) |
| 119 | +================================================================================ |
| 120 | +Executing test: math_operations_in_tight_for_loop_fan_in... |
| 121 | +Results for: math_operations_in_tight_for_loop_fan_in |
| 122 | + STUDENT REFERENCE PERF? |
| 123 | +[Serial] 949.893 952.25 1.00 (OK) |
| 124 | +[Parallel + Always Spawn] 532.024 431.374 1.23 (NOT OK) |
| 125 | +[Parallel + Thread Pool + Spin] 459.57 585.486 0.78 (OK) |
| 126 | +[Parallel + Thread Pool + Sleep] 460.577 415.873 1.11 (OK) |
| 127 | +================================================================================ |
| 128 | +Executing test: math_operations_in_tight_for_loop_fan_in_async... |
| 129 | +Results for: math_operations_in_tight_for_loop_fan_in_async |
| 130 | + STUDENT REFERENCE PERF? |
| 131 | +[Serial] 947.505 953.627 0.99 (OK) |
| 132 | +[Parallel + Always Spawn] 394.958 430.167 0.92 (OK) |
| 133 | +[Parallel + Thread Pool + Spin] 396.159 436.493 0.91 (OK) |
| 134 | +[Parallel + Thread Pool + Sleep] 395.85 393.66 1.01 (OK) |
| 135 | +================================================================================ |
| 136 | +Executing test: math_operations_in_tight_for_loop_reduction_tree... |
| 137 | +Results for: math_operations_in_tight_for_loop_reduction_tree |
| 138 | + STUDENT REFERENCE PERF? |
| 139 | +[Serial] 946.524 950.761 1.00 (OK) |
| 140 | +[Parallel + Always Spawn] 404.882 400.539 1.01 (OK) |
| 141 | +[Parallel + Thread Pool + Spin] 424.312 562.105 0.75 (OK) |
| 142 | +[Parallel + Thread Pool + Sleep] 420.446 396.951 1.06 (OK) |
| 143 | +================================================================================ |
| 144 | +Executing test: math_operations_in_tight_for_loop_reduction_tree_async... |
| 145 | +Results for: math_operations_in_tight_for_loop_reduction_tree_async |
| 146 | + STUDENT REFERENCE PERF? |
| 147 | +[Serial] 947.12 953.824 0.99 (OK) |
| 148 | +[Parallel + Always Spawn] 391.929 400.122 0.98 (OK) |
| 149 | +[Parallel + Thread Pool + Spin] 395.371 438.058 0.90 (OK) |
| 150 | +[Parallel + Thread Pool + Sleep] 396.776 390.173 1.02 (OK) |
| 151 | +================================================================================ |
| 152 | +Executing test: spin_between_run_calls... |
| 153 | +Results for: spin_between_run_calls |
| 154 | + STUDENT REFERENCE PERF? |
| 155 | +[Serial] 456.451 478.421 0.95 (OK) |
| 156 | +[Parallel + Always Spawn] 235.553 246.914 0.95 (OK) |
| 157 | +[Parallel + Thread Pool + Spin] 235.309 636.797 0.37 (OK) |
| 158 | +[Parallel + Thread Pool + Sleep] 235.402 247.102 0.95 (OK) |
| 159 | +================================================================================ |
| 160 | +Executing test: spin_between_run_calls_async... |
| 161 | +Results for: spin_between_run_calls_async |
| 162 | + STUDENT REFERENCE PERF? |
| 163 | +[Serial] 456.361 478.467 0.95 (OK) |
| 164 | +[Parallel + Always Spawn] 235.459 246.917 0.95 (OK) |
| 165 | +[Parallel + Thread Pool + Spin] 235.194 601.78 0.39 (OK) |
| 166 | +[Parallel + Thread Pool + Sleep] 235.389 247.021 0.95 (OK) |
| 167 | +================================================================================ |
| 168 | +Executing test: mandelbrot_chunked... |
| 169 | +Results for: mandelbrot_chunked |
| 170 | + STUDENT REFERENCE PERF? |
| 171 | +[Serial] 487.579 490.051 0.99 (OK) |
| 172 | +[Parallel + Always Spawn] 149.528 146.324 1.02 (OK) |
| 173 | +[Parallel + Thread Pool + Spin] 151.792 166.389 0.91 (OK) |
| 174 | +[Parallel + Thread Pool + Sleep] 151.723 147.163 1.03 (OK) |
| 175 | +================================================================================ |
| 176 | +Executing test: mandelbrot_chunked_async... |
| 177 | +Results for: mandelbrot_chunked_async |
| 178 | + STUDENT REFERENCE PERF? |
| 179 | +[Serial] 487.735 490.634 0.99 (OK) |
| 180 | +[Parallel + Always Spawn] 148.698 147.058 1.01 (OK) |
| 181 | +[Parallel + Thread Pool + Spin] 151.208 168.821 0.90 (OK) |
| 182 | +[Parallel + Thread Pool + Sleep] 148.716 147.52 1.01 (OK) |
| 183 | +================================================================================ |
| 184 | +Overall performance results |
| 185 | +[Serial] : All passed Perf |
| 186 | +[Parallel + Always Spawn] : Perf did not pass all tests |
| 187 | +[Parallel + Thread Pool + Spin] : All passed Perf |
| 188 | +[Parallel + Thread Pool + Sleep] : Perf did not pass all tests |
| 189 | +
|
| 190 | +``` |
0 commit comments