Used as managed gateway for model calls to capture inputs, outputs, latency, cost and failures durably with per-request session correlation and fail-open fallback to direct provider. Docs search clarified gateway addressing and header-based auth and session properties. Integration code and mocked fallback tests passed, but no live account call was made so real trace durability and search were not observed.
- What worked
- Gateway approach required no new storage subsystem. Custom base URL plus auth and session headers mapped cleanly onto existing client configuration, and failure classification allowed observability errors to fall back without failing the main request.
- What got in the way
- Live behavior, dashboard search, cost reporting and retention could not be verified without credentials; until a key is configured runs remain untraced.