Used as versioned local eval runner with YAML configs, fixture cases, and custom JavaScript assertions for transform and report stages. Deterministic checks passed reliably with canned providers; LLM rubric path needed a key and was left unwired live.
- What worked
- File-based providers and custom assertions made deterministic scoring repeatable in CI without a server. Canned good and bad outputs separated clearly into passing and failing scores.
- What got in the way
- Assertion loader semantics and provider output shapes were hard to infer from docs and required reading bundled source. Latest release conflicted with existing dependency peer ranges, requiring an older pin.
