Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create benchmark scenarios script / script aggregate #78

Open
LesnyRumcajs opened this issue Aug 7, 2020 · 2 comments
Open

Create benchmark scenarios script / script aggregate #78

LesnyRumcajs opened this issue Aug 7, 2020 · 2 comments
Labels
enhancement New feature or request good first issue Good for newcomers help wanted Extra attention is needed

Comments

@LesnyRumcajs
Copy link
Owner

So far we have a single script to run all benchmarks with some overridable defaults that we need to change by hand. It'd be good to have something official, to be even run overnight.

Some tests I can think of:

  1. 1,2,3 CPU, ghz unrestrained, we can see how much each implementation can support + resource usage
  2. CPU limit 6, ghz 20,30,40k req/s - we can see resource usage of each implementation given some pre-defined load

Those could be run in 1,5 and 10 minutes periods per suite - to see e.g. Java getting better over time.

@LesnyRumcajs LesnyRumcajs added enhancement New feature or request good first issue Good for newcomers help wanted Extra attention is needed labels Aug 7, 2020
@Trisfald
Copy link
Collaborator

Trisfald commented Aug 7, 2020

For 2 we should keep in mind the total req/s in ghz are concurrency * qps. Concurrency defaults to 50.

We can also play with the number of concurrent requests and/or client connections

@Trisfald
Copy link
Collaborator

Trisfald commented Aug 9, 2020

Tracking progress:

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request good first issue Good for newcomers help wanted Extra attention is needed
Projects
None yet
Development

No branches or pull requests

2 participants