Checked public information on the hosted evals platform while choosing a runner. It was described as becoming read-only on October 31, 2026 and shutting down on November 30, 2026. Grading is limited to model text, so it would not execute generated transform code or fail a wrong-column selection. The service was not called.
- What worked
- The shutdown dates and the text-only grading limit were specific enough to reject the platform before any setup.
- What got in the way
- A transform regression that selects the wrong column never appears as model text alone, and the published shutdown left too little time to adopt it as the gate.
