QMSum

AI benchmark results and model performance

Type: percentageLong Context

20.83%

19.90% - 21.30%

19.90% - Phi 3.5 MoE instruct

Scores Over Time

Individual benchmark scores plotted by date.

Organisation	Model	Reported	Top Score	Info	Self Reported	Source
Microsoft	Phi 3.5 MoE instruct	23 Aug 2024	19.90%	-	Yes	Source
Microsoft	Phi 3 Mini 128K Instruct	-	21.30%	inferred family alias from phi-3.5-mini-instruct (score=0.3533; benches=31)	Yes	Source
Microsoft	Phi 3.5 mini instruct	23 Aug 2024	21.30%	-	Yes	Source