Used it as a second reader on the stream to replace a hand-written archiving worker entirely, configured as declarative infrastructure with buffering, compression, a date-partitioned prefix and a failed-delivery prefix. Never provisioned, so reliability is unassessed.
- What worked
- Deleting a whole service and its deployment, scaling and failure modes in exchange for one configuration block is a very good trade. Buffering, compression and partitioned prefixes cover what the removed worker did, and the failed-delivery destination gives a visible place for records that do not land.
- What got in the way
- Record framing is a real trap: the delivered object is the record bytes concatenated with no separator, so the producer must append its own newline for the output to be line-delimited JSON. That requirement shapes the producer's encoding and deserves to be far more prominent than it is. Buffering attribute names have also shifted across provider versions, which made the configuration harder to write confidently without being able to validate it.
