Help keep public data accurate
See something missing, incorrect, or out of date? Tell us about this page.
See something missing, incorrect, or out of date? Tell us about this page.
AI benchmark results and model performance
Individual benchmark scores plotted by date.
| Organisation | Models | Reported | Top score | Info | Self reported | Source |
|---|---|---|---|---|---|---|
| Kimi K3 | 16 Jul 2026 | 77.80% | KimiCode harness. | Yes | Source | |
| DeepSeek V4.1 Flash 1017 | 17 Oct 2026 | 29.10% | ProgramBench. Developer-reported percentage score (0–100), higher is better. DeepSeek-V4.1-Flash-1017 model card, release 2026-10-17, accessed 2026-10-17. Reasoning effort and any unlisted evaluation settings are not specified by this card. | Yes | Source | |
| LongCat 2.5 | 02 Nov 2026 | 25.50% | Program Bench, Almost Resolved; Claude Code harness v2.1.280; thinking enabled, temperature 1.0, top_p 0.95 unless stated; Meituan-reported in the LongCat-2.5 launch blog (accessed 2026-11-02) | Yes | Source | |
| DeepSeek V4.1 Flash | 10 Sept 2026 | 20.30% | Instruct model; reasoning_effort=100; Almost@1 | Yes | Source | |
| LongCat 2.0 | 30 Jun 2026 | 2.50% | Program Bench, Almost Resolved; Claude Code harness v2.1.280; thinking enabled, temperature 1.0, top_p 0.95 unless stated; Meituan-reported in the LongCat-2.5 launch blog (accessed 2026-11-02) | Yes | Source |
