AI benchmark results and model performance
Individual benchmark scores plotted by date.
| Organisation | Model | Reported | Top Score | Info | Self Reported | Source |
|---|---|---|---|---|---|---|
| GPT 4o (2024-08-06) | 06 Aug 2024 | 13.10% | - | Yes | Source | |
| GPT 4o Audio Preview (2025-06-03) | 03 Jun 2025 | 13.10% | inferred modality/version alias from gpt-4o-2024-08-06 | Yes | Source | |
| GPT 4o Audio Preview (2024-10-01) | 01 Oct 2024 | 13.10% | inferred modality/version alias from gpt-4o-2024-08-06 | Yes | Source | |
| GPT 4o Audio Preview (2024-12-17) | 17 Dec 2024 | 13.10% | inferred modality/version alias from gpt-4o-2024-08-06 | Yes | Source | |
| GPT 4o Realtime Preview (2025-06-03) | 03 Jun 2025 | 13.10% | inferred modality/version alias from gpt-4o-2024-08-06 | Yes | Source | |
| GPT 4o Realtime Preview (2024-10-01) | 01 Oct 2024 | 13.10% | inferred modality/version alias from gpt-4o-2024-08-06 | Yes | Source | |
| GPT 4o Search Preview | 11 Mar 2025 | 13.10% | inferred modality/version alias from gpt-4o-2024-08-06 | Yes | Source | |
| GPT 4o Transcribe | 20 Mar 2025 | 13.10% | inferred modality/version alias from gpt-4o-2024-08-06 | Yes | Source | |
| GPT 4o Transcribe Diarize | 15 Oct 2025 | 13.10% | inferred modality/version alias from gpt-4o-2024-08-06 | Yes | Source | |
| Claude 3.5 Sonnet (2024-10-22) | 22 Oct 2024 | 16% | - | Yes | - | |
| GPT 4.1 Nano | 14 Apr 2025 | 29.40% | - | Yes | Source | |
| Gemini 2.0 Flash | 05 Feb 2025 | 32% | Single Attempt | Yes | Source | |
| GPT 4.5 Preview | 27 Feb 2025 | 36.70% | - | Yes | Source | |
| DeepSeek OCR | 20 Oct 2025 | 39.20% | inferred family alias from deepseek-v3 (score=0.3000; benches=20) | Yes | Source | |
| DeepSeek V2 (2024-06-28) | 28 Jun 2024 | 39.20% | inferred family alias from deepseek-v3 (score=0.4159; benches=20) | Yes | Source | |
| DeepSeek V3 (2024-12-26) | 26 Dec 2024 | 39.20% | - | No | Source | |
| DeepSeek V4 | - | 39.20% | inferred high-confidence family alias from deepseek-v3 (score=0.5818; benches=20) | Yes | Source | |
| o1 preview | 12 Sept 2024 | 42% | - | Yes | Source | |
| GPT 4.1 | 14 Apr 2025 | 48.10% | - | Yes | Source | |
| GPT 4.1 Mini | 14 Apr 2025 | 49.60% | - | Yes | Source | |
| QwQ 32B Preview | - | 50% | - | Yes | Source | |
| Phi 4 Mini Reasoning | 30 Apr 2025 | 57.50% | - | Yes | Source | |
| DeepSeek V3 (2025-03-24) | 24 Mar 2025 | 59.40% | - | Yes | Source | |
| DeepSeek V3.1 | 21 Aug 2025 | 66.30% | Non-thinking: 66.3%, Thinking: 93.1% | Yes | Source | |
| DeepSeek V3.1 Terminus | 22 Sept 2025 | 66.30% | inferred alias from deepseek-v3.1 | Yes | Source |
