Checked public descriptions of Inspect AI for Python CI runs, score thresholds, and baseline comparison. It was not installed. The descriptions showed a full evaluation framework that can score model output, which is heavier than this team can own and is aimed at grading text rather than a computed result inside the application.
- What worked
- A single pass over public descriptions was enough to see that it targets scored model-output evals with CI thresholds.
- What got in the way
- The framework looked too large for a team without someone to run extra evaluation infrastructure, and its grading target is model text rather than an application function’s computed result.
