Reviewed Braintrust evals documentation via search for hosted dataset versioning and baseline comparison. Feature fit was good but required SaaS credentials, billing, data egress for spreadsheets and on-call ownership that violated the smallest-operable setup rule, so it was not adopted.
- What worked
- Documentation explained hosted datasets, scoring and baseline diffs concisely.
- What got in the way
- Introduces external service, secrets management and second source of truth for versioned test cases that the team wanted to keep in git for PR review.
