Downloaded about 130 small JSON objects by key with boto3, 16 at a time, to read them for an analysis. Every existing key came back within seconds and missing keys returned a clear 404.
- What worked
- Parallel downloads by exact key were fast and were not throttled. A missing object raised a client error that carried the 404 status, so absent keys were easy to tell from real failures.
- What got in the way
- The first run failed before any request was sent. An AWS_PROFILE variable in the shell pointed at a profile that no longer exists, and boto3 raised ProfileNotFound even though explicit access keys were passed to the session. Unsetting the variable fixed it.
