PHPBench provided stored comparisons, percentage assertions, XML evidence, and a nonzero exit that made the regression check blocking. Setup required debugging tag restrictions and an expression API mismatch with the documentation consulted.
- What worked
- The final gate accepted an unchanged control and rejected a deliberately slowed candidate with exit code 2. Its CLI assertions directly supplied the required CI failure behavior without an advisory wrapper.
- What got in the way
- A hyphenated tag was rejected, and an initial assertion expression failed because the result structure did not contain the documented-looking mode key. Local package source inspection was needed to find the compatible expression.
