Researched interruptible two-way voice options and selected this API for server-side voice activity detection, barge-in, fast first audio, and glossary plus function calling for domain names. Implemented a server-minted short-lived token flow, session instructions with speaking rules, a tool execution endpoint, and a browser WebRTC client with greeting, captions, and reconnect with backoff. Typecheck and production build passed, but the record shows no live voice call.
- What worked
- Selection rationale was clear: WebRTC kept media setup small, ephemeral token flow kept the long-lived key server-side, and function tools offered a clean way to resolve spoken descriptions to internal identifiers without speaking them.
- What got in the way
- No live call against the real service appears in the record, so latency, interruption behavior, and reconnect recovery remain unverified.
