1
Get an API key
Sign in at benchspan.com/login with Google. We provision your workspace and a default API key on first sign-in.Copy it when shown. The key is hashed on the server and can’t be recovered. You can always mint a new one in Dashboard → API Keys.
Free tier: 50,000 scans / month, forever. No credit card required.
2
Install the SDK
3
Run your first scan
4
Wire it into your agent
Benchspan plugs into your agent framework as a callback, hook, or middleware. Pick your framework:
LangChain
CrewAI
OpenAI Agents SDK
Vercel AI SDK
Google ADK
OpenAI / Anthropic (raw)
What happens next
When your agent runs in production, every tool output and user message flows through Benchspan. By default it uses block mode: if an injection is detected, the SDK raisesInjectionDetectedError before your LLM is called. You can switch to warn mode during evaluation to log injections without blocking, with zero added latency on the LLM call; see Modes.
All scans show up in real time on your dashboard: request count, block rate, latency percentiles, and per-agent breakdowns.