The TypeScript SDK, CLI, Cloud dataset model, and GitHub Action covered versioned cases, experiment comparison, custom scoring, and CI integration. Local integration compiled and tested, but no authenticated cloud run was possible.
- What worked
- The SDK exposed the dataset, evaluation, scorer, and reporter primitives needed to build the requested workflow, and the CLI provided evaluation and help commands.
- What got in the way
- Current action configuration did not expose the previously documented regression inputs, requiring a repository-owned reporter. SDK reporter and scorer types also required several adjustments, and even CLI listing required an API key.
