# AISI eval infrastructure (ControlArena + the Inspect family)

> Updated 2026-10-14 · type: tool · category: ai-infrastructure · status: active · rev 1

AISI's eval stack — ControlArena, Transect, and Inspect Cyber — is a free, MIT, self-hostable alternative to paid LLM-eval platforms.

- Open source: yes (MIT)
- Self-hostable: yes
- Pricing: Free and open source (MIT); self-hostable via pip plus Docker sandboxes. Only cost is the external model API you point it at.
- Best for: A technical founder or lean team building or buying LLM-powered features who wants to run capability, safety, cyber, and control evaluations on infrastructure they own instead of renting a hosted eval platform.
- Not for: Teams who want a fully managed, no-ops eval dashboard, or who have no need to evaluate model or agent behavior at all.
- Last verified: 2026-10-14

- **Canonical:** https://gtmstacker.com/registry/tool/aisi-eval-infrastructure/
- **Source:** [github · UKGovernmentBEIS / AI-Safety-Institute](https://github.com/UKGovernmentBEIS/control-arena) — HZoete
- **Tags:** ai-infrastructure, mcp-agents, ai-evals, developer-tools
- **Repository:** https://github.com/UKGovernmentBEIS/control-arena

## Is AISI eval infrastructure (ControlArena + the Inspect family) open source?

Yes, AISI eval infrastructure (ControlArena + the Inspect family) is open source under the MIT license.

## How much does AISI eval infrastructure (ControlArena + the Inspect family) cost?

Free and open source (MIT); self-hostable via pip plus Docker sandboxes. Only cost is the external model API you point it at. (free).

## Can I self-host AISI eval infrastructure (ControlArena + the Inspect family)?

Yes, AISI eval infrastructure (ControlArena + the Inspect family) can be self-hosted (the source is available under the MIT license).

## Alternatives & related

- [Inspect AI](https://gtmstacker.com/registry/tool/inspect-ai/)


---

The UK AI Security Institute (AISI) has published a stack of free, MIT-licensed, self-hostable evaluation and AI-control tooling, all built on or around its Inspect AI framework. This entry anchors on **ControlArena** — a settings-and-protocols library for running AI-control evaluations (testing whether a model stays safe under adversarial pressure), built on Inspect AI together with Redwood Research, installable via pip with Docker sandboxes. Around it sits a verified family: **Transect** (a capability-eval runner, a joint AISI + Meridian Labs project under the AI-Safety-Institute org), **Inspect Cyber** (cyber-capability evaluations), and the **Inspect AI** core framework itself, which the registry already catalogues under the slug `inspect-ai`. Every component named here carries an MIT license read from the GitHub license endpoint, not inferred.

## Provenance

- SPDX MIT confirmed via the GitHub license endpoint (`licenseInfo.key = mit`) for control-arena, transect, inspect_cyber, and the inspect_ai core — verified, never guessed.
- Star and activity numbers are tool-measured via the GitHub API on 2026-10-14, not taken from the viral X post: control-arena 253 stars (pushed 2026-10-13), transect 54 stars (pushed 2026-10-14), inspect_cyber 43 stars (pushed 2026-06-18), inspect_ai 3,003 stars (pushed 2026-10-14). All self-hostable via pip / uv.
- Two genuine AISI orgs host the family: UKGovernmentBEIS (control-arena, inspect_cyber, inspect_ai) and AI-Safety-Institute (transect, a joint project with Meridian Labs). Both resolved to the real UK AI Security Institute; no name-squat was mistaken for a real repo.
- `aisi-sandboxing` was explicitly excluded: its GitHub license metadata is null, the /license endpoint 404s, the repo contains no LICENSE file, and it was last pushed 2025-08-07. Per the never-guess-a-license rule, it is dropped from the verified component list.
- Surfaced via the 2026-10-14 OSS X pull (poster HZoete); curated from the GTM Stacker signal registry (run 2026-10-14-registry-update-01); licenses and figures independently verified 2026-10-14.

## Why it matters for a GTM stack

Any team shipping an LLM-powered feature eventually needs to evaluate it — for capability, safety, cyber-exposure, and whether an agent misbehaves under pressure — and the default path is a paid, hosted eval platform. AISI's stack is the owned-infrastructure answer: MIT-licensed harnesses you pip-install and run locally, with only the external model API as a cost. The honest read: this is a family of related repos rather than one install, aimed at people who already evaluate models (not a managed dashboard for everyone), and the Inspect AI core it builds on is catalogued separately. One component from the same org, aisi-sandboxing, was left out precisely because its license could not be verified — the kind of distinction that is the point of an evidence-graded registry. For a team that wants to own its eval and control tooling instead of renting it, this is a credible, government-published, license-clean foundation.