Parquet Explained: Why a Reader Has Less to Read
On 50,000 made-up orders, a Parquet file was 52% of the CSV, and one query needed the amount column from 1 row group of 5.
Python 3.12.15 | pyarrow==26.0.02 videos tagged "row groups".
On 50,000 made-up orders, a Parquet file was 52% of the CSV, and one query needed the amount column from 1 row group of 5.
Python 3.12.15 | pyarrow==26.0.0On 60,000 made-up orders, a one-month query opened 1 of 12 files by month, but 300 of 300 by customer.
Python 3.12.15 | pyarrow==26.0.0