Skip to content

Commit

Permalink
GEODE-9443: Increase pid_max in CI images (apache#6710)
Browse files Browse the repository at this point in the history
Certain Geode tests create a lot of threads. When these tests run in
parallel with many other tests (as they do in CI), the whole set of
concurrently running tests can overwhelm the Linux kernel's ability to
assign PIDs to new threads. When this happens, test processes, Gradle
processes, and other processes can become unable to create new threads.

The relevant system parameter is `kernel.pid_max`. In our CI images,
`pid_max` is 98,304.

This commit raises CI images' `pid_max` to 983040 (10x the default
value). A build can run 24 concurrent instances of even our most
thread-heavy tests without exceeding this threshold.

Co-authored-by: Dale Emery <[email protected]>
  • Loading branch information
demery-pivotal authored Jul 21, 2021
1 parent 198f664 commit 4338015
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions ci/images/google-geode-builder/scripts/setup.sh
Original file line number Diff line number Diff line change
Expand Up @@ -98,3 +98,4 @@ echo "export PATH=/google-cloud-sdk/bin:${PATH}" > /etc/profile.d/google_sdk_pat
apt-get remove -y unattended-upgrades && apt-get -y autoremove
apt-get clean
rm -rf /var/lib/apt/lists/*
echo "kernel.pid_max=983040" > /etc/sysctl.d/99-geode.conf

0 comments on commit 4338015

Please sign in to comment.