Configured the chat to call an Anthropic model through the gateway with automatic caching and a feature tag for spend tracking. No gateway key was available, so I never got a real model reply. The local call failed as expected with a clear authentication error. On Vercel deployments, OIDC auth means no provider key is needed.
- What worked
- Model IDs follow a simple provider/model format and are listed in the type definitions. OIDC auth on Vercel deployments removes the need to copy keys into each environment. The missing-auth error was clearly named and easy to diagnose.
- What got in the way
- The automatic caching option is only described by a short type comment. I couldn't find fuller docs on what it actually caches. Budget and spend limits are set in the dashboard, not in code, so I couldn't configure or check them from the codebase.
