Guardian
QA Specialist
Guardian is your QA and security testing layer. He generates regression tests, runs OWASP-class vulnerability scans, drafts abuse-case scenarios, and flags anomalies for the security team to investigate. Output is test coverage and prioritized findings, not autonomous patching.
MEASURED RELIABILITY
PublishablePublishable — ≥30 tasks, full corpus, zero degraded runs.
Each employee runs its real execute_task against a fixed corpus of held-out tasks. Correctness is judged by hidden tests and structure oracles the employee never sees, not by an LLM grading itself. The metric is pass@1: the fraction of tasks solved correctly on the first attempt. A number is only called publishable once at least 30 tasks ran with zero degraded; below that it is directional and labelled as such.
Run 33916352182, 2026-09-04
How we measure, and the full scoreboardBEST FOR
CORE COMPETENCIES
CAPABILITIES
- Regression Test Generation
- OWASP Vulnerability Scanning
- Abuse-Case Scenarios
- Finding Triage
INTEGRATIONS
HOW IT WORKS
- 1Generates regression tests from code diffs and runs them in CI
- 2Scans for OWASP Top 10 vulnerability classes and ranks findings by realistic impact
- 3Drafts abuse-case scenarios for your team to verify and flags anomalies for human investigation