AndroidWorld_SR Benchmark Leaderboard | Phaseo

AndroidWorld_SR

AI benchmark results and model performance

Type: percentageAgents

Recorded Results

17

Average Score

41.25%

Score Range

22% - 71.10%

Leading Model (lowest score)

22% - Qwen 2.5 Coder 32B Instruct

Scores Over Time

Individual benchmark scores plotted by date.

Models Using This Benchmark

Organisation	Model	Reported	Top Score	Info	Self Reported	Source
Qwen	Qwen 2.5 Coder 32B Instruct	-	22%	inferred high-confidence family alias from qwen2.5-vl-32b (score=0.4641; benches=28)	Yes	Source
Qwen	Qwen 2.5 VL 32B Instruct	24 Mar 2025	22%	-	Yes	Source
Qwen	Qwen 2.5 VL 3B Instruct	-	22%	inferred high-confidence family alias from qwen2.5-vl-32b (score=0.4914; benches=28)	Yes	Source
Qwen	Qwen 2.5 0.5B	-	25.50%	inferred family alias from qwen2.5-vl-7b (score=0.3131; benches=32)	Yes	Source
Qwen	Qwen 2.5 1.5B	-	25.50%	inferred family alias from qwen2.5-vl-7b (score=0.3131; benches=32)	Yes	Source
Qwen	Qwen 2.5 3B	-	25.50%	inferred family alias from qwen2.5-vl-7b (score=0.3531; benches=32)	Yes	Source
Qwen	Qwen 2.5 VL 7B Instruct	-	25.50%	-	Yes	Source
Qwen	Qwen 2.5 Math 72B	-	35%	inferred high-confidence family alias from qwen2.5-vl-72b (score=0.4700; benches=30)	Yes	Source
Qwen	Qwen 2.5 Math PRM 72B	-	35%	inferred family alias from qwen2.5-vl-72b (score=0.4050; benches=30)	Yes	Source
Qwen	Qwen 2.5 Math RM 72B	-	35%	inferred family alias from qwen2.5-vl-72b (score=0.4092; benches=30)	Yes	Source
Qwen	Qwen 2.5 VL 72B Instruct	26 Jan 2025	35%	-	Yes	Source
Qwen	Qwen 3 VL 235B A22B Instruct	-	63.70%	-	Yes	-
Qwen	Qwen 3 VL 32B Thinking	-	63.70%	-	Yes	-
Qwen	Qwen 3.5 27B	24 Feb 2026	64.20%	-	Yes	Source
Qwen	Qwen 3.5 Flash	23 Feb 2026	64.20%	inferred family alias from qwen3.5-27b (score=0.4147; benches=81)	Yes	Source
Qwen	Qwen 3.5 122B A10B	24 Feb 2026	66.40%	-	Yes	Source
Qwen	Qwen 3.5 35B A3B	24 Feb 2026	71.10%	-	Yes	Source