Android Control High_EM Benchmark Leaderboard | Phaseo

Android Control High_EM

AI benchmark results and model performance

Type: percentageMultimodal

Recorded Results

11

Average Score

65.33%

Score Range

60.10% - 69.60%

Leading Model (lowest score)

60.10% - Qwen 2.5 0.5B

Scores Over Time

Individual benchmark scores plotted by date.

Models Using This Benchmark

Organisation	Model	Reported	Top Score	Info	Self Reported	Source
Qwen	Qwen 2.5 0.5B	-	60.10%	inferred family alias from qwen2.5-vl-7b (score=0.3131; benches=32)	Yes	Source
Qwen	Qwen 2.5 1.5B	-	60.10%	inferred family alias from qwen2.5-vl-7b (score=0.3131; benches=32)	Yes	Source
Qwen	Qwen 2.5 3B	-	60.10%	inferred family alias from qwen2.5-vl-7b (score=0.3531; benches=32)	Yes	Source
Qwen	Qwen 2.5 VL 7B Instruct	-	60.10%	-	Yes	Source
Qwen	Qwen 2.5 Math 72B	-	67.36%	inferred high-confidence family alias from qwen2.5-vl-72b (score=0.4700; benches=30)	Yes	Source
Qwen	Qwen 2.5 Math PRM 72B	-	67.36%	inferred family alias from qwen2.5-vl-72b (score=0.4050; benches=30)	Yes	Source
Qwen	Qwen 2.5 Math RM 72B	-	67.36%	inferred family alias from qwen2.5-vl-72b (score=0.4092; benches=30)	Yes	Source
Qwen	Qwen 2.5 VL 72B Instruct	26 Jan 2025	67.36%	-	Yes	Source
Qwen	Qwen 2.5 Coder 32B Instruct	-	69.60%	inferred high-confidence family alias from qwen2.5-vl-32b (score=0.4641; benches=28)	Yes	Source
Qwen	Qwen 2.5 VL 32B Instruct	24 Mar 2025	69.60%	-	Yes	Source
Qwen	Qwen 2.5 VL 3B Instruct	-	69.60%	inferred high-confidence family alias from qwen2.5-vl-32b (score=0.4914; benches=28)	Yes	Source