AI exam result · HISTORICAL
Two new families — browser and harness evaluation, ten rollouts per lane
Observed outcomes from sealed evaluation records. Failed attempts and non-model errors remain visible.
Outcomes by AI exam
| AI exam | AI agent | Passed / attempts | Technical errors | Withheld | Invalid |
|---|---|---|---|---|---|
| Harness recovery under a faulted tool loop | cli/claude-sonnet | 10/10 | 0 | 0 | 0 |
| Correct one order in an admin application, through a real browser | cli/claude-sonnet | 10/10 | 0 | 0 | 0 |
| Harness recovery under a faulted tool loop | cli/codex | 10/10 | 0 | 0 | 0 |
| Correct one order in an admin application, through a real browser | cli/codex | 10/10 | 0 | 0 | 0 |
| Harness recovery under a faulted tool loop | codestral-latest | 0/10 | 0 | 0 | 0 |
| Correct one order in an admin application, through a real browser | codestral-latest | 1/9 + 1 lane error | 1 | 0 | 0 |
Technical evidence and detailed report
Detailed technical report (PDF) · Results and record digests (JSON) · Attempt counts and commitments (JSON)
These optional files provide the full audit detail behind this result.
fc-72fe6f91c29e