Evaluated as the ingest buffer for bursty telemetry with multiple independent consumers and a planned fourth consumer. Design used sharded ordered log, multi-day retention, per-consumer checkpoints, batched publishing, and downstream dedup because the service has no server-side dedup. Local memory and file fakes plus infra files were implemented; no live stream was provisioned or called in the record.
- What worked
- Throughput, burst, retention and replay, ordering by device key, and independent consumer positions mapped cleanly to the stated scale, loss-on-deploy, lag, and fan-out needs. Pricing model fit the stated budget preference.
- What got in the way
- No live validation was observed; infra changes were left unvalidated and lag remained an estimate from metrics rather than an exact count. Required client-side dedup and outbox handling for delivery guarantees.
