MMLU-Pro

Name: MMLU-Pro
Keywords: MMLU-Pro, AI benchmark, model evaluation, leaderboard, AI performance

AI benchmark results and model performance

Type: percentage

Recorded Results

157

Average Score

71.58%

Score Range

16% - 88.50%

Leading Model (lowest score)

16% - Ernie 4.5 21B A3B

Scores Over Time

Individual benchmark scores plotted by date.

Model Results

Organisation	Model	Reported	Top Score	Info	Self Reported	Source
Baidu	Ernie 4.5 21B A3B	-	16%	inferred version-family alias from ernie-4.5	Yes	Source
Baidu	Ernie 4.5 21B A3B Thinking	-	16%	inferred version-family alias from ernie-4.5	Yes	Source
Baidu	Ernie 4.5 300B A47B	-	16%	inferred version-family alias from ernie-4.5	Yes	Source
Baidu	Ernie 4.5 Turbo	-	16%	inferred version-family alias from ernie-4.5	Yes	Source
Baidu	Ernie 4.5 VL 28B A3B	-	16%	inferred version-family alias from ernie-4.5	Yes	Source
Baidu	Ernie 4.5 VL 424B A47B	-	16%	inferred version-family alias from ernie-4.5	Yes	Source
Qwen	Qwen 3.5 0.8B	02 Mar 2026	42.30%	-	Yes	Source
Qwen	Qwen 2 Audio 7B	-	44.10%	inferred modality/version alias from qwen2-7b-instruct	Yes	Source
Qwen	Qwen 2 Math 7B	-	44.10%	inferred high-confidence family alias from qwen2-7b-instruct (score=0.4706; benches=14)	Yes	Source
Microsoft	Phi 3.5 MoE instruct	23 Aug 2024	45.30%	-	Yes	Source
Qwen	Qwen 2.5 Coder 3B	-	47%	inferred family alias from qwen2.5-omni-7b (score=0.3000; benches=45)	Yes	Source
Qwen	Qwen 2.5 Coder 7B	-	47%	inferred high-confidence family alias from qwen2.5-omni-7b (score=0.4700; benches=45)	Yes	Source
Qwen	Qwen 2.5 Math 7B	-	47%	inferred high-confidence family alias from qwen2.5-omni-7b (score=0.4767; benches=45)	Yes	Source
Qwen	Qwen 2.5 Math 7B PRM800K	-	47%	inferred family alias from qwen2.5-omni-7b (score=0.3696; benches=45)	Yes	Source
Qwen	Qwen 2.5 Math PRM 7B	-	47%	inferred family alias from qwen2.5-omni-7b (score=0.4092; benches=45)	Yes	Source
Qwen	Qwen 2.5 Omni 3B	-	47%	inferred high-confidence family alias from qwen2.5-omni-7b (score=0.4933; benches=45)	Yes	Source
Qwen	Qwen 2.5 Omni 7B	-	47%	-	Yes	Source
Microsoft	Phi 3 Mini 128K Instruct	-	47.40%	inferred family alias from phi-3.5-mini-instruct (score=0.3533; benches=31)	Yes	Source
Microsoft	Phi 3.5 mini instruct	23 Aug 2024	47.40%	-	Yes	Source
IBM	Granite 4.1 3B	29 Apr 2026	49.83%	5-shot, CoT	Yes	Source
SpaceXAI	Grok 1.5	28 Mar 2024	51%	-	Yes	Source
Microsoft	Phi 4 Mini	01 Feb 2025	52.80%	-	Yes	Source
IBM	Granite 4.1 8B	29 Apr 2026	55.99%	5-shot, CoT	Yes	Source
Qwen	Qwen 7B	-	56.30%	inferred family alias from qwen-2.5-7b-instruct (score=0.3083; benches=14)	Yes	Source
Google	Gemini 1.5 Flash 8B	15 Mar 2024	58.70%	-	Yes	Source