Installed a pinned release and built a local regression gate using stored baselines, repeated measurements and assertions. The unchanged control passed, and an intentionally slowed candidate caused a blocking failure.
- What worked
- Baseline comparisons, configurable warmups and iterations, statistical assertions and XML evidence supported a reviewable gate without an external service.
- What got in the way
- Implementation required inspecting package source to understand expressions and execution details. A tag containing hyphens was rejected; switching to underscores resolved it. Additional reporting checks were implemented to reject missing evidence.
