Chose and configured a self-hosted gateway for caching, provider fallback, and cost tracking: Redis exact-match cache, ordered Bedrock-then-OpenAI routing, virtual-key budgets, and spend export. Shipped proxy config and a Helm values overlay; did not run the proxy against live providers.
- What worked
- The product mapped cleanly onto the three required gateway behaviors and an OpenAI-compatible base URL, so a single shared HTTP client could sit in front of every model call without services talking to providers directly.
- What got in the way
- Live cluster install was left to a separate infra repo, so this workspace only carries config and a values overlay. Setup is YAML-heavy and was never exercised against a real proxy in this task.
