You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
In order to be able to build the upgrade image, a debs.tar.gz is created for each VM artifact, containing all of the debian packages that were installed in the process of building that VM artifact. This deb.tar.gz averages a bit over 3GB in size, so for a nightly build containing all platforms and variants, these files consume about 150GB of space.
To save space, and probably some amount of time, we should consider changing debs.tar.gz from a collection of packages to a list of package names and versions. When we build the upgrade image, we would then fetch the packages we need from the apt mirrors instead of from debs.tar.gz. In addition to saving space in S3, this would also likely be faster, since it would eliminate most of the duplicated downloading of packages, as well as all of uploading, tarring, compressing, untarring, and decompressing of the debs.tar.gz files.
The text was updated successfully, but these errors were encountered:
In order to be able to build the upgrade image, a
debs.tar.gz
is created for each VM artifact, containing all of the debian packages that were installed in the process of building that VM artifact. Thisdeb.tar.gz
averages a bit over 3GB in size, so for a nightly build containing all platforms and variants, these files consume about 150GB of space.To save space, and probably some amount of time, we should consider changing
debs.tar.gz
from a collection of packages to a list of package names and versions. When we build the upgrade image, we would then fetch the packages we need from the apt mirrors instead of fromdebs.tar.gz
. In addition to saving space in S3, this would also likely be faster, since it would eliminate most of the duplicated downloading of packages, as well as all of uploading, tarring, compressing, untarring, and decompressing of thedebs.tar.gz
files.The text was updated successfully, but these errors were encountered: