CharXiv-D

AI benchmark results and model performance

Type: percentageMultimodal

Recorded Results

Average Score

85.20%

Score Range

76.20% - 90.50%

Leading Model (lowest score)

76.20% - Qwen 3 VL 4B Instruct

Scores Over Time

Individual benchmark scores plotted by date.

Models Using This Benchmark

Organisation	Model	Reported	Top Score	Info	Self Reported	Source
Qwen	Qwen 3 VL 4B Instruct	-	76.20%	-	Yes	-
Qwen	Qwen 3 VL 8B Instruct	-	83%	-	Yes	-
Qwen	Qwen 3 4B Instruct 2507	-	83.90%	inferred family alias from qwen3-vl-4b-thinking (score=0.3462; benches=48)	Yes	-
Qwen	Qwen 3 4B SafeRL	-	83.90%	inferred family alias from qwen3-vl-4b-thinking (score=0.3850; benches=48)	Yes	-
Qwen	Qwen 3 4B Thinking 2507	-	83.90%	inferred family alias from qwen3-vl-4b-thinking (score=0.3462; benches=48)	Yes	-
Qwen	Qwen 3 Embedding 4B	-	83.90%	inferred family alias from qwen3-vl-4b-thinking (score=0.3850; benches=48)	Yes	-
Qwen	Qwen 3 Guard Gen 4B	-	83.90%	inferred family alias from qwen3-vl-4b-thinking (score=0.3400; benches=48)	Yes	-
Qwen	Qwen 3 Guard Stream 4B	-	83.90%	inferred family alias from qwen3-vl-4b-thinking (score=0.3371; benches=48)	Yes	-
Qwen	Qwen 3 Reranker 4B	-	83.90%	inferred family alias from qwen3-vl-4b-thinking (score=0.3850; benches=48)	Yes	-
Qwen	Qwen 3 VL 4B Thinking	-	83.90%	-	Yes	-
OpenAI	GPT 4o (2024-08-06)	06 Aug 2024	85.30%	-	Yes	Source
OpenAI	GPT 4o Audio Preview (2025-06-03)	03 Jun 2025	85.30%	inferred modality/version alias from gpt-4o-2024-08-06	Yes	Source
OpenAI	GPT 4o Audio Preview (2024-10-01)	01 Oct 2024	85.30%	inferred modality/version alias from gpt-4o-2024-08-06	Yes	Source
OpenAI	GPT 4o Audio Preview (2024-12-17)	17 Dec 2024	85.30%	inferred modality/version alias from gpt-4o-2024-08-06	Yes	Source
OpenAI	GPT 4o Realtime Preview (2025-06-03)	03 Jun 2025	85.30%	inferred modality/version alias from gpt-4o-2024-08-06	Yes	Source
OpenAI	GPT 4o Realtime Preview (2024-10-01)	01 Oct 2024	85.30%	inferred modality/version alias from gpt-4o-2024-08-06	Yes	Source
OpenAI	GPT 4o Search Preview	11 Mar 2025	85.30%	inferred modality/version alias from gpt-4o-2024-08-06	Yes	Source
OpenAI	GPT 4o Transcribe	20 Mar 2025	85.30%	inferred modality/version alias from gpt-4o-2024-08-06	Yes	Source
OpenAI	GPT 4o Transcribe Diarize	15 Oct 2025	85.30%	inferred modality/version alias from gpt-4o-2024-08-06	Yes	Source
Qwen	Qwen 3 VL 30B A3B Instruct	-	85.50%	-	Yes	-
Qwen	Qwen 3 8B	-	85.90%	inferred high-confidence family alias from qwen3-vl-8b-thinking (score=0.4600; benches=50)	Yes	-
Qwen	Qwen 3 Guard Stream 8B	-	85.90%	inferred family alias from qwen3-vl-8b-thinking (score=0.3371; benches=50)	Yes	-
Qwen	Qwen 3 VL 8B Thinking	-	85.90%	-	Yes	-
Qwen	Qwen 3 VL Embedding 8B	-	85.90%	inferred high-confidence family alias from qwen3-vl-8b-thinking (score=0.5232; benches=50)	Yes	-
Qwen	Qwen 3 VL Reranker 8B	-	85.90%	inferred high-confidence family alias from qwen3-vl-8b-thinking (score=0.5275; benches=50)	Yes	-
Qwen	Qwen 3 VL 30B A3B Thinking	-	86.90%	-	Yes	-
OpenAI	GPT 4.5 Preview	27 Feb 2025	90%	-	Yes	Source
Qwen	Qwen 3 VL 32B Thinking	-	90.20%	-	Yes	-
Qwen	Qwen 3 VL 32B Instruct	-	90.50%	-	Yes	-