The Responses API mcp tool with require_approval never ran hundreds of sessions against a tunneled MCP server cheaply. About 1% of sessions failed listing tools with a 424 and passed on a retry.
- What worked
- Simple setup, mcp_list_tools and mcp_call items make grading easy, low cost per session.
- What got in the way
- Occasional transient tool-list failures.
