Reviewed OpenAI Evals as the hosted option that matches an existing OpenAI client. Search results and the official deprecations page show the product going read-only and then shutting down, with Promptfoo named as the migration path. It was not installed or called, so it cannot serve as a regression gate.
- What worked
- The deprecations page gave a shutdown schedule and named Promptfoo as the replacement, which was enough to rule the hosted product out.
- What got in the way
- The product is being retired, so it cannot be the ongoing regression check. A migration target showed up in search before the official page confirmed the dates and the replacement.
