Evaluated managed search plus generation options against a one second budget, a few thousand daily calls, and a single machine setup. Selected the fast base model for single call short answers with source links. Wrote a server client with timeout, concise answer constraints, validation before network use, and safe upstream error mapping.
- What worked
- Documentation made the single call pattern clear: one request returns a short synthesis plus links, avoiding a separate search plus summarizer pipeline and extra infrastructure.
- What got in the way
- Live success path was never exercised because no service key was configured, so real latency, cost and citation quality remain unobserved.