Changelog

1.0.0 (upcoming)

The first public release of ParetoOps.

• Free: analyze (Pareto frontier of cost per successful task, sweet spot, recommendations, low-sample warnings), gate on accuracy and cost-per-success thresholds, importers for Promptfoo, LangSmith, Braintrust, DeepEval, CSV and JSON, the pricing catalog, custom rates and the Python SDK.
• Pro (coming soon): the regression gate against your last good run, the git-branch baseline store, early stopping with watch, and the CI gate with a pull request comment (pareto-ops ci).
• Install: npx pareto-ops, pip install pareto-ops, or ghcr.io/paretoops/pareto-ops, on macOS, Linux and Windows (x64 and arm64).