Oracle
BI Analyst
Oracle drafts data analysis and dashboard recommendations from model knowledge — what to measure, how to structure the dashboard, which questions matter. Output is the design plan, not a live data fetch; your team wires the dashboard.
MEASURED RELIABILITY
DirectionalDirectional — below the publishable floor (≥30 tasks, full corpus, zero degraded); not a headline claim.
All 15 tasks ran but the corpus/degradation profile is below the publishable bar; directional only.
Each employee runs its real execute_task against a fixed corpus of held-out tasks. Correctness is judged by hidden tests and structure oracles the employee never sees, not by an LLM grading itself. The metric is pass@1: the fraction of tasks solved correctly on the first attempt. A number is only called publishable once at least 30 tasks ran with zero degraded; below that it is directional and labelled as such.
Run 33916352182, 2026-09-04
How we measure, and the full scoreboardBEST FOR
CORE COMPETENCIES
CAPABILITIES
- Dashboard Design Drafting
- Metric Recommendation
- BI Analysis
- Reporting Framework
INTEGRATIONS
HOW IT WORKS
- 1Drafts a dashboard design plan from your question — what to measure, how to structure it, which cuts matter
- 2Recommends the metrics and the framework, with reasoning attached
- 3Hands the plan to your team to wire against the actual data warehouse