CMMLU Benchmark Leaderboard | Phaseo

CMMLU

AI benchmark results and model performance

Type: numericalGeneral

Recorded Results

9

Average Score

0.56

Score Range

0.40 - 0.90

Leading Model (lowest score)

0.40 - Ernie 4.5 21B A3B

Scores Over Time

Individual benchmark scores plotted by date.

No scores available to display.

Models Using This Benchmark

Organisation	Model	Reported	Top Score	Info	Self Reported	Source
Baidu	Ernie 4.5 21B A3B	-	0.40	inferred version-family alias from ernie-4.5	Yes	Source
Baidu	Ernie 4.5 21B A3B Thinking	-	0.40	inferred version-family alias from ernie-4.5	Yes	Source
Baidu	Ernie 4.5 300B A47B	-	0.40	inferred version-family alias from ernie-4.5	Yes	Source
Baidu	Ernie 4.5 Turbo	-	0.40	inferred version-family alias from ernie-4.5	Yes	Source
Baidu	Ernie 4.5 VL 28B A3B	-	0.40	inferred version-family alias from ernie-4.5	Yes	Source
Baidu	Ernie 4.5 VL 424B A47B	-	0.40	inferred version-family alias from ernie-4.5	Yes	Source
Meituan	LongCat Flash Chat	-	0.84	inferred high-confidence family alias from longcat-flash-chat (score=0.4667; benches=16)	Yes	Source
Qwen	Qwen 2 Math 72B	-	0.90	inferred high-confidence family alias from qwen2-72b-instruct (score=0.4667; benches=17)	Yes	Source
Qwen	Qwen 2 Math RM 72B	-	0.90	inferred family alias from qwen2-72b-instruct (score=0.3917; benches=17)	Yes	Source