Published
Report 231 Research — Empirical Study

Summary

Comprehensive statistical meta-analysis of the full non-OBLITERATUS corpus (n=5,969 LLM-graded results across 42 models). Provider explains only 6.6% of model-level ASR variance (ICC=0.066). Within-provider variance dominates: models from the same provider vary by 20-40pp in ASR.

This research informs our commercial services. See how we can help →