Used the Python SDK and CLI to implement a seedable versioned dataset, deterministic scorers, experiment baselines, and regression gating. Local dry evaluation worked, but the hosted workflow could not be exercised without credentials.
- What worked
- The SDK exposed the dataset, attachment, evaluation, score-summary, and baseline concepts needed for the implementation. Official documentation clearly covered automatic dataset versioning and experiment comparison.
- What got in the way
- A live dataset seed, hosted run, and baseline comparison could not be validated because credentials were unavailable. Inspecting one attachment property as though it were callable caused a minor local error.
