Service
notion
Last audit · 2026-03-13 · opus + sonnet
Findings
5
open · 5 problem findings · 9 total
critical 1 major 1 minor 3 positive 4
Runs · universal-baseline-2026-03-13
| metric | opus | sonnet |
|---|---|---|
| tool_calls | 81 | 59 |
| interventions | 1 | 1 |
Findings · latest audit
critical Invalid select option silently accepted — schema extended without error open → major SDK v5 breaking change — properties silently ignored instead of rejected open → minor Cleanup semantics inconsistent — archive vs delete, no unified endpoint open → minor Integration setup instructions pointed to wrong UI form open → minor Rich text 2,000-character limit required chunking workaround open → positive Authentication was clean and immediately verifiable → positive Both models discovered the API capabilities and data model from public docs → positive Database query filtering and sorting worked as documented → positive Three of four error scenarios returned structured, actionable responses →
Audit history
2026-03-13 universal-baseline-2026-03-13 9 findings · opus + sonnet