Hyper-τ-Bench is Sierra's open-source benchmark for whether an AI agent can research, design and build a working customer-service agent end to end.
Yes, Hyper-τ-Bench is open source under the MIT license.
Hyper-τ-Bench is free to use.
Yes, Hyper-τ-Bench can be self-hosted (the source is available under the MIT license).
Open-source benchmark (MIT, Python) from Sierra Research that tests whether an AI coding agent can BUILD a working customer-service agent — not just operate one: the developer agent gets a sandbox with business records, a codebase and a production API, and must design, wire and ship a functioning agent scored against simulated customers.
"An agent will build your support agent" is the pitch behind a wave of GTM tooling. This is the first open yardstick for that exact claim, and the current numbers argue for buying expert-built or building carefully — useful evidence in any build-vs-buy conversation about agentic customer service.