OpenBookQA

AI benchmark results and model performance

Type: percentageGeneral

77.56%

60.60% - 89.60%

60.60% - Mistral Nemo 12B

Scores Over Time

Individual benchmark scores plotted by date.

Models Using This Benchmark

Organisation	Model	Reported	Top Score	Info	Self Reported	Source
Mistral	Mistral Nemo 12B	18 Jul 2024	60.60%	inferred family alias from mistral-nemo-instruct-2407 (score=0.3250; benches=8)	Yes	Source
Microsoft	Phi 3 Mini 128K Instruct	-	79.20%	inferred family alias from phi-3.5-mini-instruct (score=0.3533; benches=31)	Yes	Source
Microsoft	Phi 3.5 mini instruct	23 Aug 2024	79.20%	-	Yes	Source
Microsoft	Phi 4 Mini	01 Feb 2025	79.20%	-	Yes	Source
Microsoft	Phi 3.5 MoE instruct	23 Aug 2024	89.60%	-	Yes	Source