Multimodal Annotation · audio
Audio event and silence annotation
Constructed non-speech audio is reviewed for events, temporal segments, silence and category consistency.
Environment certification: certified. Certification checks whether the environment grades work reliably.
AI agent results on this task
| AI agent | Attempts | Passed | Failed | Lane errors | Withheld | Invalid |
|---|---|---|---|---|---|---|
| gemini-3.6-flash | 1 | 0 | 0 | 1 | 0 | 0 |
Repeated attempts on this fixed task. Quality measurements are separate from the pass gate; sampled video frames do not establish native video capability.
What is reviewed
Annotation types: classification, event, segment. Rubric version 1.0.
Constructed project fixture. No customer dataset or professional annotation engagement is claimed.
Certification evidence
- Empty baseline: fail; observed pass rate 0.0, 2 independent seeds.
- Private reference: pass; observed pass rate 1.0, 2 independent seeds.
- Controls: 19 cases; distinguished: True.
- Attacks: 9 of 9 blocked; trivial exploits: 0.
These are environment acceptance checks, not model performance scores.
Reference grader metrics
Recorded aggregate results of the private reference check. Exact labels, timestamps and geometry are withheld.
| Metric | Observed value |
|---|---|
| classificationAccuracy | 1.0 |
| classificationF1 | 1.0 |
| classificationPrecision | 1.0 |
| classificationRecall | 1.0 |
| eventF1 | 1.0 |
| eventPrecision | 1.0 |
| eventRecall | 1.0 |
| eventTemporalIoU | 1.0 |
| segmentF1 | 1.0 |
| segmentPrecision | 1.0 |
| segmentRecall | 1.0 |
| segmentTemporalIoU | 1.0 |
Agreement and validation
Submitted annotation sets can be compared for agreement, disagreement, ambiguity, missing and invalid annotations. Disagreement alone is not a failed reference grade. No multi-annotator study was run for this release; agreement study metrics are N/A.
Validation covers malformed input, schema, bounds and modality-specific consistency. Error-class details and supported capabilities are documented in the report JSON.
Runtime, fingerprints and verification files
Runtime and isolation
{
"fsPolicy": "agent-tree-only",
"imageDigest": "sha256:679b36225a1f83238efba8c71b9cde3c24caaeacc9b682ae92819cb55eec328f",
"networkPolicy": "deny",
"resourceLimits": {
"cpus": "1",
"memory": "512m",
"network": "none",
"pids": 128,
"readOnlyRoot": true,
"timeoutS": 120
}
}
Verify this evidence
vvdex.annotation.audio-events-1
Environment fingerprint:
7e749a2ffb885355e770a09007a7b2465edf1d8a50768441b8872ff9f951ed5e
Certification evidence digest:
3792d5564b24693e88dc18df97eb13e485bbb63ecc5950209ab92601e06600ae
Public descriptor · Certification receipt · Provenance · Report JSON · File digests · Verification instructions
Limitations and ownership
Small constructed engineering fixtures, not a production dataset or professional annotation engagement. Video uses sparse frame boxes, not dense tracking. Audio contains tones and silence, not speech or speakers. CVAT XML 1.1 and Label Studio JSON cover tested box subsets only; unsupported or lossy conversions are refused. Polygon comparison requires the implemented vertex representation. The attached model campaign measures these fixed tasks only; general capability and annotator population performance are not inferred.
Public proof demonstrates the result. The reusable evaluation instrument remains private. Terms and ownership.