Qasper

AI benchmark results and model performance

Type: percentageLong Context

41.27%

40% - 41.90%

40% - Phi 3.5 MoE instruct

Scores Over Time

Individual benchmark scores plotted by date.

Organisation	Model	Reported	Top Score	Info	Self Reported	Source
Microsoft	Phi 3.5 MoE instruct	23 Aug 2024	40%	-	Yes	Source
Microsoft	Phi 3 Mini 128K Instruct	-	41.90%	inferred family alias from phi-3.5-mini-instruct (score=0.3533; benches=31)	Yes	Source
Microsoft	Phi 3.5 mini instruct	23 Aug 2024	41.90%	-	Yes	Source