Relied on Polars for scan_csv/scan_parquet and join/unique transforms in the pipeline. Checked installed version via Python import and sized job memory for its peak usage.
- What worked
- Lazy scans and columnar operations kept the weekly batch simple to size for a fixed 2GiB job.