PopQA Benchmark Leaderboard | Phaseo

PopQA

AI benchmark results and model performance

Type: percentageGeneral

Recorded Results

15

Average Score

25.30%

Score Range

22.90% - 26.17%

Leading Model (lowest score)

22.90% - Granite 4.0 Micro

Scores Over Time

Individual benchmark scores plotted by date.

Models Using This Benchmark

Organisation	Model	Reported	Top Score	Info	Self Reported	Source
IBM	Granite 4.0 Micro	02 Oct 2025	22.90%	inferred high-confidence family alias from granite-4.0-tiny-preview (score=0.4700; benches=12)	Yes	Source
IBM	Granite 4.0 Small	02 Oct 2025	22.90%	inferred high-confidence family alias from granite-4.0-tiny-preview (score=0.4700; benches=12)	Yes	Source
IBM	Granite 4.0 Tiny	02 Oct 2025	22.90%	inferred alias from granite-4.0-tiny-preview	Yes	Source
IBM	Granite 4.0 Tiny Preview	02 May 2025	22.90%	-	Yes	Source
IBM	Granite 3.0 8B Instruct	-	26.17%	inferred high-confidence family alias from granite-3.3-8b-instruct (score=0.4911; benches=14)	Yes	Source
IBM	Granite 3.1 8B Instruct	-	26.17%	inferred high-confidence family alias from granite-3.3-8b-instruct (score=0.4911; benches=14)	Yes	Source
IBM	Granite 3.2 8B Instruct	-	26.17%	inferred high-confidence family alias from granite-3.3-8b-instruct (score=0.4911; benches=14)	Yes	Source
IBM	Granite 3.2 8B Instruct Preview	-	26.17%	inferred high-confidence family alias from granite-3.3-8b-instruct (score=0.4687; benches=14)	Yes	Source
IBM	Granite 3.3 2B Instruct	16 Apr 2025	26.17%	inferred family alias from granite-3.3-8b-instruct (score=0.3627; benches=14)	Yes	Source
IBM	Granite 3.3 8B Instruct	16 Apr 2025	26.17%	-	Yes	Source
IBM	Granite Guardian 3.0 8B	-	26.17%	inferred family alias from granite-3.3-8b-instruct (score=0.4062; benches=14)	Yes	Source
IBM	Granite Guardian 3.1 8B	-	26.17%	inferred family alias from granite-3.3-8b-instruct (score=0.4062; benches=14)	Yes	Source
IBM	Granite Guardian 3.3 8B	-	26.17%	inferred high-confidence family alias from granite-3.3-8b-instruct (score=0.5071; benches=14)	Yes	Source
IBM	Granite Speech 3.2 8B	-	26.17%	inferred family alias from granite-3.3-8b-instruct (score=0.4062; benches=14)	Yes	Source
IBM	Granite Speech 3.3 8B	-	26.17%	inferred high-confidence family alias from granite-3.3-8b-instruct (score=0.5071; benches=14)	Yes	Source