Aria
Customer Support Specialist
Aria handles your Tier 1 and Tier 2 support at infinite scale. She reads emotional tone and adapts her responses—knowing when to escalate and when to resolve with care.
MEASURED RELIABILITY
DirectionalDirectional — below the publishable floor (≥30 tasks, full corpus, zero degraded); not a headline claim.
22 of 33 tasks ran — the rest need credentials not present in the test environment. Below the 30-task floor, so directional only.
Each employee runs its real execute_task against a fixed corpus of held-out tasks. Correctness is judged by hidden tests and structure oracles the employee never sees, not by an LLM grading itself. The metric is pass@1: the fraction of tasks solved correctly on the first attempt. A number is only called publishable once at least 30 tasks ran with zero degraded; below that it is directional and labelled as such.
Run 33916352182, 2026-09-04
How we measure, and the full scoreboardBEST FOR
CORE COMPETENCIES
CAPABILITIES
- Tone Matching
- Ticket Resolution
- Rule-Based Escalation
- Knowledge Base Updates
INTEGRATIONS
HOW IT WORKS
- 1Detects frustrated customers and adjusts tone automatically
- 2Resolves routine tickets without human intervention
- 3Knows when to escalate to a human vs. handle it herself