Selected as the buffer to decouple bursty ingest from multiple independent consumers, preserve per-unit order, retain data across deploys, and allow a new consumer without changing existing ones. Implemented behind a local memory backend and validated with a fake client; live cloud verification was out of scope.
- What worked
- Partitioning, batched writes, multi-day retention, and independent checkpoints mapped cleanly to burst, deploy-loss, lag, and fan-out requirements.
- What got in the way
- Live throughput, retention, and replay were not observed because cloud access was unavailable, so shard and retention choices remain unproven in production.
