Scale MCP Atlas

AI benchmark results and model performance

Type: percentage

Recorded Results

Average Score

67.82%

Score Range

24.60% - 88.10%

Leading Model (lowest score)

24.60% - Nova 2 Lite

Scores Over Time

Individual benchmark scores plotted by date.

Models Using This Benchmark

Organisation	Model	Reported	Top Score	Info	Self Reported	Source
Amazon	Nova 2 Lite	02 Dec 2025	24.60%	-	Yes	Source
OpenAI	GPT 5.4 Nano	17 Mar 2026	56.10%	-	Yes	Source
Google	Gemini 3 Flash Preview	17 Dec 2025	57.40%	-	Yes	Source
OpenAI	GPT 5.4 Mini	17 Mar 2026	57.70%	-	Yes	Source
OpenAI	GPT 5.2 Chat	11 Dec 2025	60.60%	inferred alias from gpt-5.2-2025-12-11	Yes	Source
Anthropic	Claude Sonnet 4.6	17 Feb 2026	61.30%	-	Yes	Source
Amazon	Nova 2 Pro	02 Dec 2025	61.60%	-	Yes	Source
Anthropic	Claude Opus 4.6	05 Feb 2026	62.70%	High effort	Yes	Source
OpenAI	GPT 5 Pro	07 Aug 2025	67.20%	inferred family alias from gpt-5.4 (score=0.4083; benches=19)	Yes	Source
OpenAI	GPT 5 Search API	14 Oct 2025	67.20%	inferred family alias from gpt-5.4 (score=0.3050; benches=19)	Yes	Source
OpenAI	GPT 5.4	05 Mar 2026	67.20%	-	Yes	Source
z.AI	GLM 5	11 Feb 2026	67.80%	-	Yes	Source
DeepSeek	DeepSeek V4 Flash	24 Apr 2026	69%	MCPAtlas; Pass@1; DeepSeek-V4-Flash Max	Yes	Source
Google	Gemini 3.1 Pro Preview	19 Feb 2026	69.20%	-	Yes	-
z.AI	GLM 5.1	07 Apr 2026	71.80%	Public Set	Yes	Source
DeepSeek	DeepSeek V4 Pro	24 Apr 2026	73.60%	MCPAtlas Public; Pass@1; DeepSeek-V4-Pro Max	Yes	Source
Qwen	Qwen 3.6 Plus	01 Apr 2026	74.10%	-	Yes	Source
MiniMax	MiniMax M3	01 Jun 2026	74.20%	Public Set	Yes	Source
OpenAI	GPT 5.5	23 Apr 2026	75.30%	April 2026 update	Yes	Source
Meta	Muse Glimmer 30B	10 Aug 2026	75.50%	MCP Atlas public set; high reasoning; mean pass rate over four runs	Yes	Source
Qwen	Qwen 3.7 Max	21 May 2026	76.40%	MCP-Atlas public set; Gemini 2.5 Pro judge	Yes	Source
Anthropic	Claude Opus 4.7	16 Apr 2026	77.30%	-	Yes	Source
Google	Gemini 3.5 Flash	19 May 2026	83.60%	MCP Atlas	Yes	Source
Moonshot	Kimi K3	16 Jul 2026	84.20%	500-task public subset; 100-turn limit; Gemini 3.1 Pro judge.	Yes	Source
Meta	Muse Spark 1.1	09 Jul 2026	88.10%	MCP Atlas; scaled tool use	Yes	Source