Installed Promptfoo 0.123.1 and used the CLI to validate TypeScript configs, render prompts through an echo provider, and dry-run with sharing disabled. Peer dependencies, a Node 22 engines floor, and defaults that only became clear in the published source made the fit much rougher than the docs implied.
- What worked
- Config validation accepted prompts, tests, and the sharing setting. Named prompt functions resolved, the echo provider showed the rendered prompt, and the no-share flag dropped the shareable URL. After variable expansion was turned off, a filtered run produced a single result and did not call the model.
- What got in the way
- The first install failed on a Zod 4 versus Zod 3 peer conflict and only succeeded with legacy peer deps. Engines reject Node 20. A no-match filter still exited when the API key was absent. Array variables expanded into extra cases until expansion was disabled. Default-test options were overwritten and not applied to each case. A default export made the loader return that object instead of the module namespace. The responses provider stores outputs unless store is false, and it sets a temperature unless defaults are omitted. The repeat pass threshold is not a CLI flag.
