Skip to content

Commit

Permalink
update benchmark results
Browse files Browse the repository at this point in the history
  • Loading branch information
cdump committed Jun 5, 2024
1 parent 6050247 commit 770468e
Showing 1 changed file with 24 additions and 24 deletions.
48 changes: 24 additions & 24 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -130,11 +130,11 @@ See [examples](./examples) for more
</tr>
<tr>
<td><i>Time</i></td>
<td>0.7s · 1.5s · 2.0s</td>
<td>3.0s</td>
<td>0.5s · 1.3s · 1.9s</td>
<td>2.6s</td>
<td>0.7s</td>
<td>727.2s</td>
<td>1.9s</td>
<td>719.9s</td>
<td>1.7s</td>
</tr>
<tr><td colspan="7"></td></tr>
<tr>
Expand Down Expand Up @@ -172,11 +172,11 @@ See [examples](./examples) for more
</tr>
<tr>
<td><i>Time</i></td>
<td>9.8s · 19.6s · 36.4s</td>
<td>52.3s</td>
<td>9.8s · 19.1s · 37.3s</td>
<td>46.9s</td>
<td>11.5s</td>
<!-- -->
<td>46.3s</td>
<td>47.9s</td>
</tr>
<tr><td colspan="8"></td></tr>
<tr>
Expand Down Expand Up @@ -214,11 +214,11 @@ See [examples](./examples) for more
</tr>
<tr>
<td><i>Time</i></td>
<td>0.6s · 0.9s · 1.4s</td>
<td>2.3s</td>
<td>0.6s</td>
<td>17.0s</td>
<td>1.2s</td>
<td>0.7s · 0.7s · 1.2s</td>
<td>2.0s</td>
<td>0.4s</td>
<td>16.4s</td>
<td>1.1s</td>
</tr>
</table>

Expand All @@ -236,49 +236,49 @@ See [examples](./examples) for more
<tr>
<td rowspan="2"><b>largest1k</b><br><sub>1000<br>contracts<br><br>24427<br>functions</sub></td>
<td><i>Errors</i></td>
<td>15.0%, 3652 🥇</td>
<td>42.7%, 10438</td>
<td>14.8%, 3616 🥇</td>
<td>42.7%, 10421</td>
<td>58.3%, 14242</td>
</tr>
<tr>
<td><i>Time</i></td>
<td>1.1s · 7.5s · 15.7s</td>
<td>731.4s</td>
<td>0.8s</td>
<td>0.8s · 7.5s · 15.9s</td>
<td>724.4s</td>
<td>0.6s</td>
</tr>
<tr><td colspan="5"></td></tr>
<tr>
<td rowspan="2"><b>random50k</b><br><sub>50000<br>contracts<br><br>1171102<br>functions</sub></td>
<td><i>Errors</i></td>
<td>5.1%, 59484 🥇</td>
<td>5.0%, 58705 🥇</td>
<td rowspan="2">waiting fixes</td>
<td>54.9%, 643213</td>
</tr>
<tr>
<td><i>Time</i></td>
<td>22.6s · 247.0s · 584.7s</td>
<td>23.1s · 238.8s · 606.6s</td>
<!-- -->
<td>9.5s</td>
<td>9.6s</td>
</tr>
<tr><td colspan="5"></td></tr>
<tr>
<td rowspan="2"><b>vyper</b><br><sub>780<br>contracts<br><br>21244<br>functions</sub></td>
<td><i>Errors</i></td>
<td>50.9%, 10805 🥇</td>
<td>50.7%, 10771 🥇</td>
<td>100.0%, 21244</td>
<td>56.8%, 12077</td>
</tr>
<tr>
<td><i>Time</i></td>
<td>0.9s · 7.3s · 13.9s</td>
<td>0.7s · 7.2s · 14.1s</td>
<td>16.8s</td>
<td>0.7s</td>
<td>0.5s</td>
</tr>
</table>

See [benchmark/README.md](./benchmark/) for the methodology and commands to reproduce these results

<i>versions: evmole v0.3.3; whatsabi v0.11.0; evm-hound-rs v0.1.4; heimdall-rs v0.7.3</i>
<i>versions: evmole v0.3.4; whatsabi v0.11.0; evm-hound-rs v0.1.4; heimdall-rs v0.7.3</i>

## How it works

Expand Down

0 comments on commit 770468e

Please sign in to comment.