Installed a release binary and used it to time two real CLI workloads on a large generated fixture, with warmup, repeated runs, named commands, and JSON export. Same-runner medians were stable enough to pass a control and fail a deliberate slowdown against a 20% tolerance.
- What worked
- Install from the published archive, version check, named benchmarks, and JSON export were straightforward. Wall-clock medians on a roughly one-and-a-half-second job had only a few percent of spread, which was enough to catch a large throughput regression without adding a language dependency.
- What got in the way
- Passing the target as separate argument tokens after the name flag did not treat them as one command. The invocation had to be a single shell string, which was easy to get wrong when wrapping the CLI from Python.
