v0.20.0Iris says what it checked. A verdict tells a pass from a check that never ran, names who recorded the evidence it judged, and cannot be replaced by the agent it judges→

Pricing

Free to run. Open source, no limits.

Iris scores agent output for quality, safety, and cost, and it runs entirely on your machine — MIT licensed, no evaluation limit, no account.

Install the open-source server →Tell us what is missing →

Open Source

Everything Iris does, self-hosted

$0

MIT licensed — no limits, no account

Install
  • Unlimited evaluations — no metering, no quota
  • All 26 built-in eval rules
  • Custom Zod rules (unlimited)
  • LLM-as-judge + citation verification (your API key, no proxy)
  • Dashboard + playground
  • stdio + HTTP transports
  • Community support (GitHub Issues + Discussions)

Nothing leaves your machine unless you turn one of these on: an OpenTelemetry endpoint (IRIS_OTEL_ENDPOINT), which exports traces to the collector you name; the LLM judge with your own key, which sends the text it judges to that provider, and whose citation check fetches the pages an output cites; or a webhook, which posts ids, the verdict and rule names, never the text, to the address you set.

FAQ

What does it cost to run Iris today?
Nothing. Iris is MIT licensed and runs on your own machine. There is no metering, no quota, no account, and no evaluation limit — the server does not count your usage, because there is nothing to count it for.
Is LLM-as-judge a paid feature?
No. LLM-as-judge and citation verification ship in the open-source server. They call Anthropic or OpenAI with your own API key and do not route through us, so you pay your provider directly with no markup. A per-evaluation cost cap is enforced before each call, and the heuristic rules stay free and offline.
Can I self-host?
Yes — that is how Iris runs: @iris-eval/mcp-server on npm or Docker, with the dashboard and playground in-process, on your machine or your own infrastructure.
Is there a hosted or paid version?
Not today. Iris runs as the open-source server on your machine or your own infrastructure. Hosted storage, shared team history and alerting are under consideration, not under construction. No feature that is free today will move behind a paywall: if a hosted version is offered, it will earn its price on hosting, shared team history and scale, not by taking away what you already have.
Do you have SOC 2 or other compliance certifications?
No. Iris runs on your infrastructure and sends no telemetry, so many teams with compliance requirements can use it; whether it meets yours is your assessment to make. Iris itself holds no certification, and none will be claimed before it is held.

What exists today

Today Iris is the open-source server. It has no evaluation limit and no account, and nothing in it is held back. If shared team history or hosted storage would help you, or something you need is missing, tell us at hello@iris-eval.com.

See the install docs →