EgoSchema

AI benchmark results and model performance

Type: percentageLong Context

Recorded Results

Average Score

70.36%

Score Range

55.70% - 77.90%

Leading Model (lowest score)

55.70% - Gemini 1.0 Nano

Scores Over Time

Individual benchmark scores plotted by date.

Models Using This Benchmark

Organisation	Model	Reported	Top Score	Info	Self Reported	Source
Google	Gemini 1.0 Nano	06 Dec 2023	55.70%	inferred modality/version alias from gemini-1.0-pro	Yes	Source
Google	Gemini 1.0 Pro	06 Dec 2023	55.70%	-	Yes	Source
Google	Gemini 1.0 Pro Vision 001	15 Feb 2024	55.70%	inferred modality/version alias from gemini-1.0-pro	Yes	Source
Google	Gemini 2.0 Flash Lite	05 Feb 2025	67.20%	-	Yes	Source
Qwen	Qwen 2.5 Coder 3B	-	68.60%	inferred family alias from qwen2.5-omni-7b (score=0.3000; benches=45)	Yes	Source
Qwen	Qwen 2.5 Coder 7B	-	68.60%	inferred high-confidence family alias from qwen2.5-omni-7b (score=0.4700; benches=45)	Yes	Source
Qwen	Qwen 2.5 Math 7B	-	68.60%	inferred high-confidence family alias from qwen2.5-omni-7b (score=0.4767; benches=45)	Yes	Source
Qwen	Qwen 2.5 Math 7B PRM800K	-	68.60%	inferred family alias from qwen2.5-omni-7b (score=0.3696; benches=45)	Yes	Source
Qwen	Qwen 2.5 Math PRM 7B	-	68.60%	inferred family alias from qwen2.5-omni-7b (score=0.4092; benches=45)	Yes	Source
Qwen	Qwen 2.5 Omni 3B	-	68.60%	inferred high-confidence family alias from qwen2.5-omni-7b (score=0.4933; benches=45)	Yes	Source
Qwen	Qwen 2.5 Omni 7B	-	68.60%	-	Yes	Source
Google	Gemini 2.0 Flash	05 Feb 2025	71.50%	-	Yes	Source
Google	Gemini 2.0 Flash Exp	-	71.50%	inferred alias from gemini-2.0-flash	Yes	Source
Google	Gemini 2.0 Pro Exp (2025-02-05)	05 Feb 2025	71.50%	inferred modality/version alias from gemini-2.0-flash	Yes	Source
Google	LearnLM 2.0 Flash Experimental	17 Apr 2025	71.50%	inferred family alias from gemini-2.0-flash (score=0.3700; benches=13)	Yes	Source
OpenAI	GPT 4o (2024-08-06)	06 Aug 2024	72.20%	-	Yes	Source
OpenAI	GPT 4o Audio Preview (2025-06-03)	03 Jun 2025	72.20%	inferred modality/version alias from gpt-4o-2024-08-06	Yes	Source
OpenAI	GPT 4o Audio Preview (2024-10-01)	01 Oct 2024	72.20%	inferred modality/version alias from gpt-4o-2024-08-06	Yes	Source
OpenAI	GPT 4o Audio Preview (2024-12-17)	17 Dec 2024	72.20%	inferred modality/version alias from gpt-4o-2024-08-06	Yes	Source
OpenAI	GPT 4o Realtime Preview (2025-06-03)	03 Jun 2025	72.20%	inferred modality/version alias from gpt-4o-2024-08-06	Yes	Source
OpenAI	GPT 4o Realtime Preview (2024-10-01)	01 Oct 2024	72.20%	inferred modality/version alias from gpt-4o-2024-08-06	Yes	Source
OpenAI	GPT 4o Search Preview	11 Mar 2025	72.20%	inferred modality/version alias from gpt-4o-2024-08-06	Yes	Source
OpenAI	GPT 4o Transcribe	20 Mar 2025	72.20%	inferred modality/version alias from gpt-4o-2024-08-06	Yes	Source
OpenAI	GPT 4o Transcribe Diarize	15 Oct 2025	72.20%	inferred modality/version alias from gpt-4o-2024-08-06	Yes	Source
Qwen	Qwen 2.5 Math 72B	-	76.20%	inferred high-confidence family alias from qwen2.5-vl-72b (score=0.4700; benches=30)	Yes	Source
Qwen	Qwen 2.5 Math PRM 72B	-	76.20%	inferred family alias from qwen2.5-vl-72b (score=0.4050; benches=30)	Yes	Source
Qwen	Qwen 2.5 Math RM 72B	-	76.20%	inferred family alias from qwen2.5-vl-72b (score=0.4092; benches=30)	Yes	Source
Qwen	Qwen 2.5 VL 72B Instruct	26 Jan 2025	76.20%	-	Yes	Source
Qwen	Qwen 2 VL 2B	-	77.90%	inferred family alias from qwen2-vl-72b (score=0.4083; benches=15)	Yes	Source
Qwen	Qwen 2 VL 72B	-	77.90%	-	Yes	Source