Researched browser WebRTC voice options and implemented a speech-to-speech assistant with server voice activity detection, interruption handling, tool-based cart confirmation, and reconnect logic with a short-lived token route.
- What worked
- Documentation clearly described ephemeral tokens, WebRTC session setup, server VAD, and function calling, which mapped well to low-latency and barge-in needs.
- What got in the way
- Some integration details were spread across examples, so session instructions, tool schemas, and reconnection behavior took extra cross-checking.
