FLEURS

AI benchmark results and model performance

Type: numericalLanguage

Recorded Results

Average Score

0.17

Score Range

0.04 - 0.86

Leading Model (lowest score)

0.04 - Qwen 2.5 Coder 3B

Scores Over Time

Individual benchmark scores plotted by date.

Models Using This Benchmark

Organisation	Model	Reported	Top Score	Info	Self Reported	Source
Qwen	Qwen 2.5 Coder 3B	-	0.04	inferred family alias from qwen2.5-omni-7b (score=0.3000; benches=45)	Yes	Source
Qwen	Qwen 2.5 Coder 7B	-	0.04	inferred high-confidence family alias from qwen2.5-omni-7b (score=0.4700; benches=45)	Yes	Source
Qwen	Qwen 2.5 Math 7B	-	0.04	inferred high-confidence family alias from qwen2.5-omni-7b (score=0.4767; benches=45)	Yes	Source
Qwen	Qwen 2.5 Math 7B PRM800K	-	0.04	inferred family alias from qwen2.5-omni-7b (score=0.3696; benches=45)	Yes	Source
Qwen	Qwen 2.5 Math PRM 7B	-	0.04	inferred family alias from qwen2.5-omni-7b (score=0.4092; benches=45)	Yes	Source
Qwen	Qwen 2.5 Omni 3B	-	0.04	inferred high-confidence family alias from qwen2.5-omni-7b (score=0.4933; benches=45)	Yes	Source
Qwen	Qwen 2.5 Omni 7B	-	0.04	-	Yes	Source
Google	Gemini 1.0 Nano	06 Dec 2023	0.06	inferred modality/version alias from gemini-1.0-pro	No	Source
Google	Gemini 1.0 Pro	06 Dec 2023	0.06	-	No	Source
Google	Gemini 1.0 Pro Vision 001	15 Feb 2024	0.06	inferred modality/version alias from gemini-1.0-pro	No	Source
Google	Gemini 1.5 Pro 001	23 May 2024	0.07	inferred alias from gemini-1.5-pro	Yes	Source
Google	Gemini 1.5 Pro Exp (2024-08-01)	01 Aug 2024	0.07	inferred alias from gemini-1.5-pro	Yes	Source
Google	Gemini 1.5 Pro Exp (2024-08-27)	27 Aug 2024	0.07	inferred alias from gemini-1.5-pro	Yes	Source
Google	Gemini Robotics ER 1.5 Preview	25 Sept 2025	0.07	inferred family alias from gemini-1.5-pro (score=0.3717; benches=23)	Yes	Source
Google	LearnLM 1.5 Pro Experimental	19 Nov 2024	0.07	inferred family alias from gemini-1.5-pro (score=0.3700; benches=23)	Yes	Source
Google	Gemma 4 12B	03 Jun 2026	0.07	Lower is better; excluding Chinese language	Yes	Source
Google	Gemini 1.5 Flash 001	23 May 2024	0.10	inferred alias from gemini-1.5-flash	Yes	Source
Google	Gemini 1.5 Flash Preview	14 May 2024	0.10	inferred alias from gemini-1.5-flash	Yes	Source
Google	Gemini 1.5 Flash 8B	15 Mar 2024	0.86	-	Yes	Source
Google	Gemini 1.5 Flash 8B Exp (2024-08-27)	27 Aug 2024	0.86	inferred alias from gemini-1.5-flash-8b	Yes	Source
Google	Gemini 1.5 Flash 8B Exp (2024-09-24)	24 Sept 2024	0.86	inferred alias from gemini-1.5-flash-8b	Yes	Source