Installed the 1.20.0 Linux release, read its help for shell-free runs, JSON export, and command names, and compared median wall time of one release command on a frozen NDJSON fixture. Identical binaries stayed near 0.99 times the baseline. An intentional hot-path slowdown measured about 1.49 times and was rejected by a wrapper. Samples were exported for review.
- What worked
- Help text made the scripted flags clear. Medians over ten runs, after a few warmups and pinned to one CPU, kept ordinary noise to a few percent, well under a 20% limit. JSON export preserved the samples behind each pass and fail.
- What got in the way
- The benchmark reports timings and leaves the pass or fail decision to the caller, so a separate threshold script was required. A first-sample outlier and a cache-filling warning showed up; the median still stayed stable with three warmups.
