Internal API instruction following (hard) Benchmark Leaderboard | Phaseo

Internal API instruction following (hard)

AI benchmark results and model performance

Type: percentageGeneral

Recorded Results

11

Average Score

33.35%

Score Range

29.20% - 54%

Leading Model (lowest score)

29.20% - GPT 4o (2024-08-06)

Scores Over Time

Individual benchmark scores plotted by date.

Models Using This Benchmark

Organisation	Model	Reported	Top Score	Info	Self Reported	Source
OpenAI	GPT 4o (2024-08-06)	06 Aug 2024	29.20%	-	Yes	Source
OpenAI	GPT 4o Audio Preview (2025-06-03)	03 Jun 2025	29.20%	inferred modality/version alias from gpt-4o-2024-08-06	Yes	Source
OpenAI	GPT 4o Audio Preview (2024-10-01)	01 Oct 2024	29.20%	inferred modality/version alias from gpt-4o-2024-08-06	Yes	Source
OpenAI	GPT 4o Audio Preview (2024-12-17)	17 Dec 2024	29.20%	inferred modality/version alias from gpt-4o-2024-08-06	Yes	Source
OpenAI	GPT 4o Realtime Preview (2025-06-03)	03 Jun 2025	29.20%	inferred modality/version alias from gpt-4o-2024-08-06	Yes	Source
OpenAI	GPT 4o Realtime Preview (2024-10-01)	01 Oct 2024	29.20%	inferred modality/version alias from gpt-4o-2024-08-06	Yes	Source
OpenAI	GPT 4o Search Preview	11 Mar 2025	29.20%	inferred modality/version alias from gpt-4o-2024-08-06	Yes	Source
OpenAI	GPT 4o Transcribe	20 Mar 2025	29.20%	inferred modality/version alias from gpt-4o-2024-08-06	Yes	Source
OpenAI	GPT 4o Transcribe Diarize	15 Oct 2025	29.20%	inferred modality/version alias from gpt-4o-2024-08-06	Yes	Source
OpenAI	o3 mini	30 Jan 2025	50%	-	Yes	Source
OpenAI	GPT 4.5 Preview	27 Feb 2025	54%	-	Yes	Source