optimize chunk size #14
Description
The largest output parquet file is only 37.8MB (082L) and guidance seems to be for partitions ~1GB.
Try processing by map number (ie, 092, 083) rather than 250k tile.
{{ message }}
The largest output parquet file is only 37.8MB (082L) and guidance seems to be for partitions ~1GB.
Try processing by map number (ie, 092, 083) rather than 250k tile.