MVBench

AI benchmark results and model performance

Type: percentageMultimodal

Recorded Results

Average Score

70.68%

Score Range

68.70% - 76.60%

Leading Model (lowest score)

68.70% - Qwen 3 VL 8B Instruct

Scores Over Time

Individual benchmark scores plotted by date.

Models Using This Benchmark

Organisation	Model	Reported	Top Score	Info	Self Reported	Source
Qwen	Qwen 3 VL 8B Instruct	-	68.70%	-	Yes	-
Qwen	Qwen 3 VL 4B Instruct	-	68.90%	-	Yes	-
Qwen	Qwen 3 8B	-	69%	inferred high-confidence family alias from qwen3-vl-8b-thinking (score=0.4600; benches=50)	Yes	-
Qwen	Qwen 3 Guard Stream 8B	-	69%	inferred family alias from qwen3-vl-8b-thinking (score=0.3371; benches=50)	Yes	-
Qwen	Qwen 3 VL 8B Thinking	-	69%	-	Yes	-
Qwen	Qwen 3 VL Embedding 8B	-	69%	inferred high-confidence family alias from qwen3-vl-8b-thinking (score=0.5232; benches=50)	Yes	-
Qwen	Qwen 3 VL Reranker 8B	-	69%	inferred high-confidence family alias from qwen3-vl-8b-thinking (score=0.5275; benches=50)	Yes	-
Qwen	Qwen 3 4B Instruct 2507	-	69.30%	inferred family alias from qwen3-vl-4b-thinking (score=0.3462; benches=48)	Yes	-
Qwen	Qwen 3 4B SafeRL	-	69.30%	inferred family alias from qwen3-vl-4b-thinking (score=0.3850; benches=48)	Yes	-
Qwen	Qwen 3 4B Thinking 2507	-	69.30%	inferred family alias from qwen3-vl-4b-thinking (score=0.3462; benches=48)	Yes	-
Qwen	Qwen 3 Embedding 4B	-	69.30%	inferred family alias from qwen3-vl-4b-thinking (score=0.3850; benches=48)	Yes	-
Qwen	Qwen 3 Guard Gen 4B	-	69.30%	inferred family alias from qwen3-vl-4b-thinking (score=0.3400; benches=48)	Yes	-
Qwen	Qwen 3 Guard Stream 4B	-	69.30%	inferred family alias from qwen3-vl-4b-thinking (score=0.3371; benches=48)	Yes	-
Qwen	Qwen 3 Reranker 4B	-	69.30%	inferred family alias from qwen3-vl-4b-thinking (score=0.3850; benches=48)	Yes	-
Qwen	Qwen 3 VL 4B Thinking	-	69.30%	-	Yes	-
Qwen	Qwen 2.5 0.5B	-	69.60%	inferred family alias from qwen2.5-vl-7b (score=0.3131; benches=32)	Yes	Source
Qwen	Qwen 2.5 1.5B	-	69.60%	inferred family alias from qwen2.5-vl-7b (score=0.3131; benches=32)	Yes	Source
Qwen	Qwen 2.5 3B	-	69.60%	inferred family alias from qwen2.5-vl-7b (score=0.3531; benches=32)	Yes	Source
Qwen	Qwen 2.5 VL 7B Instruct	-	69.60%	-	Yes	Source
Qwen	Qwen 2.5 Coder 3B	-	70.30%	inferred family alias from qwen2.5-omni-7b (score=0.3000; benches=45)	Yes	Source
Qwen	Qwen 2.5 Coder 7B	-	70.30%	inferred high-confidence family alias from qwen2.5-omni-7b (score=0.4700; benches=45)	Yes	Source
Qwen	Qwen 2.5 Math 7B	-	70.30%	inferred high-confidence family alias from qwen2.5-omni-7b (score=0.4767; benches=45)	Yes	Source
Qwen	Qwen 2.5 Math 7B PRM800K	-	70.30%	inferred family alias from qwen2.5-omni-7b (score=0.3696; benches=45)	Yes	Source
Qwen	Qwen 2.5 Math PRM 7B	-	70.30%	inferred family alias from qwen2.5-omni-7b (score=0.4092; benches=45)	Yes	Source
Qwen	Qwen 2.5 Omni 3B	-	70.30%	inferred high-confidence family alias from qwen2.5-omni-7b (score=0.4933; benches=45)	Yes	Source
Qwen	Qwen 2.5 Omni 7B	-	70.30%	-	Yes	Source
Qwen	Qwen 2.5 Math 72B	-	70.40%	inferred high-confidence family alias from qwen2.5-vl-72b (score=0.4700; benches=30)	Yes	Source
Qwen	Qwen 2.5 Math PRM 72B	-	70.40%	inferred family alias from qwen2.5-vl-72b (score=0.4050; benches=30)	Yes	Source
Qwen	Qwen 2.5 Math RM 72B	-	70.40%	inferred family alias from qwen2.5-vl-72b (score=0.4092; benches=30)	Yes	Source
Qwen	Qwen 2.5 VL 72B Instruct	26 Jan 2025	70.40%	-	Yes	Source
Qwen	Qwen 3 VL 30B A3B Thinking	-	72%	-	Yes	-
Qwen	Qwen 3 VL 30B A3B Instruct	-	72.30%	-	Yes	-
Qwen	Qwen 3 VL 32B Instruct	-	72.80%	-	Yes	-
Qwen	Qwen 3 VL 32B Thinking	-	73.20%	-	Yes	-
Qwen	Qwen 2 VL 2B	-	73.60%	inferred family alias from qwen2-vl-72b (score=0.4083; benches=15)	Yes	Source
Qwen	Qwen 2 VL 72B	-	73.60%	-	Yes	Source
Qwen	Qwen 3.5 27B	24 Feb 2026	74.60%	-	Yes	Source
Qwen	Qwen 3.5 Flash	23 Feb 2026	74.60%	inferred family alias from qwen3.5-27b (score=0.4147; benches=81)	Yes	Source
Qwen	Qwen 3.5 35B A3B	24 Feb 2026	74.80%	-	Yes	Source
Qwen	Qwen 3.5 122B A10B	24 Feb 2026	76.60%	-	Yes	Source