You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Since filter values are int32, the maximum safe chunk size is (1 < 31) - 1; e.g., blosc would fail otherwise. Should we limit chunk sizes by 2GB? (at least when using min-kb mode, or when determining chunk size automatically)
It might also be nice to add Chunk::Max which would pick the largest possible chunk size (i.e., shape), but limited by 2GB.
The text was updated successfully, but these errors were encountered:
aldanor
changed the title
Add Chunk::Max (chunk_max) and limits chunks to 2GB in auto modes
Add Chunk::Max (chunk_max) and limit chunks to 2GB in auto modes
Nov 19, 2021
Since filter values are int32, the maximum safe chunk size is (1 < 31) - 1; e.g., blosc would fail otherwise. Should we limit chunk sizes by 2GB? (at least when using min-kb mode, or when determining chunk size automatically)
It might also be nice to add
Chunk::Max
which would pick the largest possible chunk size (i.e., shape), but limited by 2GB.The text was updated successfully, but these errors were encountered: