I wrote microphone capture and assistant playback with a worklet and a script-processor fallback, and I tied the capture node to a muted output so the browser would not drop it. Code review showed the fallback was not connected and would not emit frames, and that wiring was corrected before any run. Capture, playback, and barge-in were never exercised in a browser.
- What worked
- The API can supply PCM frames and playback in the same page as a realtime socket, which is what the voice session needs.
- What got in the way
- The capture graph is easy to assemble so that it never fires, and there was no browser run to confirm capture, muted-node lifetime, or playback stop on interruption.