Agent Performance & Evaluation
Agent quality is measured continuously. Rejected recommendations and unresolved issues feed back into risk-model tuning.
Recommendations generated
3
Recommendations approved
2
Recommendations rejected
1
Issues resolved
1
50% of executed actions
False-positive risk alerts
1
Rejected or cancelled by a human
Average time to resolution
4.2 days
Prepared action → issue closed
Human override rate
33%
Edited or rejected before execution
Autonomous executions
0
By design — approval always required
Evaluation log
| Site | Action | Approval | Outcome | Evaluation note |
|---|---|---|---|---|
| MI-303 | Create operational task — data query cleanup | Approved | Resolved | Open queries reduced 21 → 6 after site follow-up. Issue marked resolved by Clinical Ops. |
| NY-102 | Schedule follow-up monitoring review | Approved | Executed | — |
| SC-205 | Escalate enrollment risk | Rejected | Cancelled | Rejected by user: site activated 4 weeks ago, enrollment within expected ramp. False positive. |