Chose MSK Serverless as the production log so ingest could append durably and each worker could use its own group. Authored cluster, topic, and IAM config in Terraform. Did not provision or traffic a live cluster.
- What worked
- Serverless Kafka on the existing AWS compute and network footprint matched the need for independent consumers, replay, and no extra vendor.
- What got in the way
- IAM actions, topic ARNs, and whether consumers must create the topic were not obvious. Bootstrap broker and cluster-alter permissions had to be reasoned out without a live apply.
