Integrated an on-demand stream as the ingest buffer: validate, publish batched records with a per-unit partition key, return an accepted response, and let each consumer checkpoint on its own. Covered the production adapter with a fake client in tests rather than a live account.
- What worked
- Independent iterators and checkpoints matched the need to add another consumer without schema or poller changes. Partitioning kept per-unit order for sequential alert logic. Fast publish replaced row-by-row inserts on the request path.
- What got in the way
- A publishing failure after a dedupe claim would have dropped a gateway retry unless the claim was released. Lag checks that walk large shard histories looked costly, so they stayed conservative.
