One pass rate can hide a zero: introducing the Agent Reliability Kit
An adversarial suite can pass at 90% while one kind of attack gets through every time. We've open-sourced the eval harness and scorecard we use to catch that.
Pushpendra Singh
Oct 28, 2026
AI Evals Agentic AI AI Safety Open Source