Scored about 3,200 short text records against four rubrics, then wrote about 800 structured summaries, through the TypeScript SDK with a JSON schema output format and a cached system prompt. All of roughly 80 requests returned valid JSON that covered every requested id, with no retries.
- What worked
- The JSON schema output format removed every parsing problem, prompt caching kept the repeated rubric cheap, and streaming with finalMessage handled the larger batches without timeouts.
- What got in the way
- The structured output example I had used a zod helper, so I read the installed SDK typings to confirm the plain output_config format shape before writing the call.