Used the Python SDK, CLI, and CI action to implement dataset synchronization, experiment tracking, immutable baseline selection, score reporting, and regression gating. Local integration was completed, but the hosted flow could not be exercised without credentials and bootstrap data.
- What worked
- The Python APIs exposed dataset upserts, pinned versions, experiment summaries, and reporters needed for the design. The CLI supplied an evaluation entry point, and source inspection clarified how results and dataset versions are represented.
- What got in the way
- An initial API assumption was wrong: the package exposes Dataset rather than a lowercase dataset attribute. Documentation and action behavior required source inspection, and baseline semantics needed refinement from a fixed mutable name to git-ancestor experiments.
