Every agent has a defined role, audience, guardrails, an evaluation test set and a human-review policy.
Performance Brief
v1.4 · released W12
Drafts weekly narrative from certified KPIs
Audience: Exec, Brand
Illustrative pass rate97%
- Certified KPIs only
- Every sentence cited
- Holds numbers when feed late
Sample policy: Human review required
KPI Q&A (Ask iZO)
v2.1 · released W13
Answers KPI questions for leaders & field
Audience: Exec, Brand, Field
Illustrative pass rate95%
- Small-cell suppression <5
- No financial forecasts
- Declines out-of-scope
Sample policy: Sampled 10% weekly
Sandbox Analyst
v1.2 · released W11
Generates SQL over governed de-identified datasets
Audience: Analytics power users
Illustrative pass rate92%
- Read-only governed zone
- Row-level de-identification
- SQL shown for every answer
Sample policy: Analyst validates
Data Quality Monitor
v1.1 · released W10
Checks feed freshness and rules; writes the refresh exception summary
Audience: Data ops, Brand Analytics
Illustrative pass rate99%
- Cannot edit data
- Escalates to owner
- Auto-holds dependent KPIs
Sample policy: Automated + weekly review
Knowledge retrieval evaluation
ule-knowledge-v3 · Keyword baseline only · Synthetic fixtures
Audit log
Session-only interactions · illustrative history · no durable retention
| Timestamp | User role | Agent | Question | Tools & source versions | Suppression |
|---|---|---|---|---|---|
| W14 Thu 08:42 | Brand Lead | KPI Q&A | How many patients started this week and where are delays? | K02, K13 | N |
| W14 Thu 08:17 | Field (KAM) | KPI Q&A | How many patients does Site-07 have in the pipeline? | K20 | Y |
| W14 Thu 07:55 | Analyst | Sandbox Analyst | Median days hub → coverage by payer | K07 | N |
| W14 Thu 07:30 | System | Data Quality Monitor | Claims period completeness check | — | N |
| W14 Wed 17:12 | VP Commercial | KPI Q&A | What will Q3 revenue be? | — (declined) | N |
| W14 Wed 16:03 | Field (RAD) | KPI Q&A | Pipeline in Southeast accounts | K20 | Y |
| W14 Wed 09:00 | System | Performance Brief | Generate Week 14 brief | K01–K07 | N |
| W14 Tue 14:21 | Market Access | KPI Q&A | Why did time to coverage increase? | K07, K18 | N |
Governance · Read-only view