Riley
Community Manager
Riley keeps your community alive. She monitors your Discord, Slack, and social channels, sparking conversations, welcoming new members, and identifying your most loyal advocates.
MEASURED RELIABILITY
DirectionalDirectional — below the publishable floor (≥30 tasks, full corpus, zero degraded); not a headline claim.
30 of 32 tasks ran — the rest need credentials not present in the test environment. Below the 30-task floor, so directional only.
Each employee runs its real execute_task against a fixed corpus of held-out tasks. Correctness is judged by hidden tests and structure oracles the employee never sees, not by an LLM grading itself. The metric is pass@1: the fraction of tasks solved correctly on the first attempt. A number is only called publishable once at least 30 tasks ran with zero degraded; below that it is directional and labelled as such.
Run 33916352182, 2026-09-04
How we measure, and the full scoreboardBEST FOR
CORE COMPETENCIES
CAPABILITIES
- Engagement Sparking
- Sentiment Monitoring
- Advocate Identification
- New Member Onboarding
INTEGRATIONS
HOW IT WORKS
- 1Keeps your Discord/Slack active 24/7—even during quiet hours
- 2Spots brewing issues before they become PR problems
- 3Identifies super-users who could become brand ambassadors