Matches word count

Test: Write N of X

Avg. Score

71.8%

Scenarios

Overall Performance

Performance Score Distribution (Top 20)

Click a model name to view its detail page.

Rank ▲	Model	Score	Avg. Cost	Avg. Time	Stability
1	Inception Mercury	99.8%	$0.0002	2.1s	98%
2	Inception Mercury 2	99.8%	$0.0009	1.2s	98%
3	GPT-5.4 Nano (Reasoning)	99.9%	$0.0010	4.4s	99%
4	GPT-5.4 Mini (Reasoning)	99.9%	$0.0031	3.8s	99%
5	Nemotron 3 Super	100.0%	$0.0000	15.3s	100%
6	Stealth: Aurora Alpha	99.5%	—	2.4s	94%
7	GPT-5 Nano	100.0%	$0.0008	19.2s	100%
8	GPT-5.1	99.8%	$0.0073	9.2s	99%
9	GPT-5 Mini	99.2%	$0.0024	11.6s	93%
10	GPT-5.2	99.7%	$0.0087	9.6s	98%
11	o4 Mini	99.5%	$0.0069	14.8s	96%
12	GPT-5.4 (Reasoning)	99.7%	$0.0098	11.2s	98%
13	Z.AI GLM 5 Turbo	100.0%	$0.011	25.2s	100%
14	Qwen 3.5 Flash	100.0%	$0.0036	54.0s	100%
15	GPT-5	98.4%	$0.013	18.1s	91%
16	Gemini 3 Flash (Preview, Reasoning)	100.0%	$0.018	28.6s	100%
17	o4 Mini High	99.4%	$0.010	36.6s	94%
18	GPT-4.1	94.6%	$0.0020	2.5s	67%
19	ByteDance Seed 1.6	99.1%	$0.0061	1.0m	93%
20	Qwen 3.5 35B	100.0%	$0.017	49.8s	100%
21	Gemini 3 Flash (Preview)	93.0%	$0.0011	1.5s	58%
22	GPT-4o, Aug. 6th (temp=0)	94.8%	$0.0048	2.2s	61%
23	GPT-4o, Aug. 6th (temp=1)	93.3%	$0.0048	2.0s	60%
24	Claude Sonnet 4.6 (Reasoning)	100.0%	$0.035	19.6s	100%
25	GPT-5.4 Mini (Reasoning, Low)	92.1%	$0.0018	2.4s	51%
26	Qwen 3.5 27B	100.0%	$0.019	1.3m	100%
27	Gemini 3.1 Flash Lite (Preview)	89.7%	$0.0005	1.1s	48%
28	Z.AI GLM 5	100.0%	$0.016	1.6m	100%
29	GPT-5.4 (Reasoning, Low)	87.4%	$0.0043	3.6s	46%
30	Gemini 3 Pro (Preview)	100.0%	$0.046	28.1s	100%
31	Claude Opus 4.6 (Reasoning)	100.0%	$0.050	19.6s	100%
32	MoonshotAI: Kimi K2.5	99.9%	$0.016	2.0m	99%
33	ByteDance Seed 2.0 Lite	95.3%	$0.0055	1.0m	61%
34	GPT-4o Mini (temp=1)	90.9%	$0.0003	42.7s	50%
35	Nemotron 3 Nano	90.0%	$0.0004	22.7s	40%
36	GPT-5.4 Nano (Reasoning, Low)	86.2%	$0.0007	2.9s	35%
37	Z.AI GLM 4.7 Flash	96.8%	$0.0026	1.8m	69%
38	MiniMax M2.7	88.3%	$0.0022	27.8s	38%
39	GPT-5.4	81.9%	$0.0028	2.9s	33%
40	GPT-4o Mini (temp=0)	84.1%	$0.0003	10.7s	30%
41	GPT-4.1 Nano	78.7%	$0.0001	2.2s	30%
42	GPT-4.1 Mini	79.9%	$0.0004	2.3s	27%
43	Qwen 3.5 9B	98.0%	$0.0016	2.2m	72%
44	Gemini 2.5 Pro	86.0%	$0.013	10.9s	40%
45	Qwen 3.5 122B	97.5%	$0.027	1.1m	71%
46	GPT-5.4 Mini	79.5%	$0.0009	1.1s	25%
47	Z.AI GLM 4.7	100.0%	$0.0098	3.0m	100%
48	Grok 4 Fast	77.8%	$0.0004	3.4s	27%
49	Grok 4	83.2%	$0.010	13.3s	36%
50	GPT-4o, May 13th (temp=1)	82.3%	$0.0091	17.6s	32%
51	Claude Opus 4.5	81.5%	$0.012	4.4s	28%
52	Stealth: Healer Alpha	78.4%	$0.0000	15.6s	21%
53	Claude Opus 4.6	80.4%	$0.012	6.0s	30%
54	Grok 4.20 (Beta, Reasoning)	86.4%	$0.019	11.3s	35%
55	DeepSeek V3 (2024-12-26)	72.2%	$0.0006	3.8s	21%
56	GPT-5.4 Nano	71.1%	$0.0004	1.4s	20%
57	Claude Sonnet 4.5	74.1%	$0.0070	4.1s	25%
58	Gemini 2.5 Flash Lite (Reasoning)	70.3%	$0.0005	4.5s	19%
59	DeepSeek V3 (2025-03-24)	71.5%	$0.0005	6.5s	17%
60	Mistral Large 3	68.3%	$0.0010	2.7s	18%
61	Claude Sonnet 4.6	74.8%	$0.0071	3.5s	20%
62	Mistral Medium 3.1	68.1%	$0.0009	2.9s	16%
63	Gemini 2.5 Flash Lite	66.9%	$0.0002	711ms	14%
64	Stealth: Hunter Alpha	69.8%	$0.0000	15.6s	17%
65	GPT-4o, May 13th (temp=0)	78.7%	$0.0091	18.7s	21%
66	Claude 3.7 Sonnet	70.3%	$0.0069	4.8s	16%
67	Grok 4.20 (Beta)	61.2%	$0.0015	863ms	15%
68	Grok 4.1 Fast	66.5%	$0.0007	6.3s	11%
69	Ministral 3 14B	63.0%	$0.0003	1.3s	12%
70	MiniMax M2.5	70.4%	$0.0012	17.6s	12%
71	Gemini 3.1 Pro (Preview)	100.0%	$0.075	1.0m	100%
72	Claude Sonnet 4	67.6%	$0.0070	3.8s	14%
73	Z.AI GLM 4.5	61.3%	$0.0006	3.7s	12%
74	Aion 2.0	74.2%	$0.0035	34.4s	16%
75	Ministral 3 8B	59.0%	$0.0003	1.0s	11%
76	Gemma 3 27B	58.9%	$0.0002	3.8s	11%
77	ByteDance Seed 2.0 Mini	96.5%	$0.0031	3.3m	66%
78	Z.AI GLM 4.6	72.5%	$0.0036	48.5s	19%
79	Hermes 3 405B	60.3%	$0.0000	11.0s	8%
80	Claude 3.5 Sonnet	62.7%	$0.0067	10.3s	13%
81	Gemma 3 12B	56.2%	$0.0001	3.1s	6%
82	Qwen 3.5 397B A17B	100.0%	$0.030	3.5m	100%
83	DeepSeek-V2 Chat	55.9%	$0.0003	8.1s	8%
84	Mistral Small 4 (Reasoning)	58.9%	$0.0014	14.4s	8%
85	Qwen 3.5 Plus (2026-02-15)	57.6%	$0.0009	6.6s	5%
86	DeepSeek V3.1	54.5%	$0.0004	8.5s	8%
87	Llama 3.1 8B	53.0%	$0.0003	694ms	6%
88	LFM2 24B	52.1%	$0.0001	3.6s	7%
89	Gemini 2.5 Flash (Reasoning)	61.7%	$0.0066	12.0s	8%
90	Ministral 3 3B	52.1%	$0.0002	716ms	4%
91	Mistral Small 3.2 24B	51.3%	$0.0002	2.3s	5%
92	Llama 3.1 Nemotron 70B	50.2%	$0.0006	3.3s	7%
93	Arcee AI: Trinity Large (Preview)	50.4%	$0.0000	3.1s	4%
94	Qwen 2.5 72B	49.7%	$0.0007	3.1s	5%
95	Mistral Small 4	48.9%	$0.0003	1.5s	3%
96	Llama 3.1 70B	45.7%	$0.0015	1.3s	6%
97	Claude Haiku 4.5	48.5%	$0.0023	2.3s	3%
98	Qwen 3 32B	46.7%	$0.0004	10.7s	4%
99	Claude Opus 4	76.9%	$0.035	21.6s	22%
100	Gemini 2.5 Flash	41.3%	$0.0005	1.1s	1%
101	DeepSeek V3.2	42.3%	$0.0005	6.1s	1%
102	Cohere Command R+ (Aug. 2024)	44.9%	$0.0051	2.7s	3%
103	Mistral Small Creative	39.2%	$0.0002	927ms	0%
104	ByteDance Seed 1.6 Flash	46.6%	$0.0010	17.0s	0%
105	Qwen3 235B A22B Instruct 2507	39.6%	$0.0002	5.2s	0%
106	Claude 3.5 Haiku	40.6%	$0.0018	3.3s	0%
107	Arcee AI: Trinity Mini	31.3%	$0.0001	1.7s	0%
108	Claude 3 Haiku	33.5%	$0.0005	17.9s	0%
109	Writer: Palmyra X5	30.3%	$0.0018	8.3s	0%
110	Mistral NeMO	22.0%	$0.0003	2.4s	0%
111	Ministral 8B	18.8%	$0.0002	1.4s	0%
112	Mistral Large 2	23.5%	$0.0042	3.0s	0%
113	Hermes 3 70B	17.3%	$0.0007	4.8s	0%
114	Ministral 3B	14.1%	$0.0001	710ms	0%
115	WizardLM 2 8x22b	18.5%	$0.0015	19.8s	0%
116	Gemma 3 4B	3.8%	$0.0001	1.9s	0%
117	Rocinante 12B	5.4%	$0.0006	17.7s	0%
118	Mistral Large	21.9%	$0.017	29.8s	0%
71.84%

Individual Scenarios

words

▼

10 word summary

Model	# 1	# 2	# 3	# 4	# 5	# 6	# 7	# 8	# 9	# 10	Avg ▼
Gemini 3.1 Pro (Preview)	100	100	100	100	100	100	100	100	100	100	100.0%
Z.AI GLM 5 Turbo	100	100	100	100	100	100	100	100	100	100	100.0%
Claude Sonnet 4.6 (Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5.4 (Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5 Mini	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5.1	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5	100	100	100	100	100	100	100	100	100	100	100.0%
Qwen 3.5 397B A17B	100	100	100	100	100	100	100	100	100	100	100.0%
Qwen 3.5 122B	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5.4 (Reasoning, Low)	100	100	100	100	100	100	100	100	100	100	100.0%
Z.AI GLM 5	100	100	100	100	100	100	100	100	100	100	100.0%
MoonshotAI: Kimi K2.5	100	100	100	100	100	100	100	100	100	100	100.0%
Qwen 3.5 27B	100	100	100	100	100	100	100	100	100	100	100.0%
ByteDance Seed 1.6	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5.4 Mini (Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
Gemini 3 Flash (Preview, Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
o4 Mini High	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5.2	100	100	100	100	100	100	100	100	100	100	100.0%
Gemini 3 Pro (Preview)	100	100	100	100	100	100	100	100	100	100	100.0%
Z.AI GLM 4.7	100	100	100	100	100	100	100	100	100	100	100.0%
o4 Mini	100	100	100	100	100	100	100	100	100	100	100.0%
Qwen 3.5 35B	100	100	100	100	100	100	100	100	100	100	100.0%
ByteDance Seed 2.0 Mini	100	100	100	100	100	100	100	100	100	100	100.0%
Qwen 3.5 Flash	100	100	100	100	100	100	100	100	100	100	100.0%
Qwen 3.5 9B	100	100	100	100	100	100	100	100	100	100	100.0%
Gemini 3.1 Flash Lite (Preview)	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5.4 Mini (Reasoning, Low)	100	100	100	100	100	100	100	100	100	100	100.0%
Z.AI GLM 4.7 Flash	100	100	100	100	100	100	100	100	100	100	100.0%
ByteDance Seed 2.0 Lite	100	100	100	100	100	100	100	100	100	100	100.0%
Nemotron 3 Super	100	100	100	100	100	100	100	100	100	100	100.0%
Inception Mercury 2	100	100	100	100	100	100	100	100	100	100	100.0%
Stealth: Aurora Alpha	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5 Nano	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-4o, Aug. 6th (temp=0)	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5.4 Nano (Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
Inception Mercury	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-4o Mini (temp=0)	100	100	100	100	100	100	100	100	100	100	100.0%
MiniMax M2.7	100	100	100	100	100	100	100	100	100	100	100.0%
Gemini 2.5 Pro	100	100	100	100	100	100	100	100	100	100	100.0%
Claude 3.5 Sonnet	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5.4 Mini	100	100	100	100	100	100	100	100	100	100	100.0%
Nemotron 3 Nano	100	100	100	100	100	100	100	100	100	100	100.0%
Grok 4.1 Fast	100	100	100	100	100	100	100	100	100	100	100.0%
Claude Sonnet 4	100	100	100	100	100	100	100	100	100	100	100.0%
Gemini 2.5 Flash (Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
Gemini 3 Flash (Preview)	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5.4	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-4o, Aug. 6th (temp=1)	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5.4 Nano (Reasoning, Low)	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-4o Mini (temp=1)	100	100	100	100	100	100	100	100	100	100	100.0%
ByteDance Seed 1.6 Flash	100	100	100	100	100	100	100	100	100	100	100.0%
Claude Opus 4.6 (Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
Z.AI GLM 4.6	100	100	100	100	100	100	100	100	100	100	100.0%
Claude 3.7 Sonnet	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5.4 Nano	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-4.1	100	100	100	100	100	100	100	100	100	100	100.0%
Grok 4 Fast	100	100	100	100	100	100	100	100	100	100	100.0%
Grok 4.20 (Beta)	100	100	100	100	100	100	100	100	100	100	100.0%
Gemini 2.5 Flash Lite	100	100	100	100	100	100	100	100	100	100	100.0%
Claude Sonnet 4.5	100	100	100	100	100	100	100	100	100	100	99.9%
Claude 3.5 Haiku	100	100	100	100	100	100	100	100	100	100	99.9%
Grok 4	100	100	100	100	100	100	100	100	100	100	99.9%
Gemma 3 12B	100	100	100	100	100	100	100	100	100	100	99.9%
Claude Opus 4.6	100	100	100	100	100	100	100	100	100	100	99.9%
Claude Opus 4	100	100	100	100	100	100	100	100	100	100	99.9%
GPT-4.1 Mini	100	100	100	100	100	100	100	100	100	100	99.9%
Ministral 3 14B	100	100	100	100	100	100	100	100	100	100	99.9%
Gemma 3 27B	100	100	100	100	100	100	100	100	100	100	99.9%
MiniMax M2.5	100	100	100	100	100	100	100	100	100	98	99.8%
Stealth: Healer Alpha	100	100	100	100	100	100	100	100	100	98	99.8%
Gemini 2.5 Flash Lite (Reasoning)	100	100	100	100	100	100	100	100	100	98	99.8%
GPT-4.1 Nano	100	100	100	100	100	100	100	100	100	98	99.8%
Claude Haiku 4.5	100	100	100	100	100	100	100	100	100	98	99.8%
Qwen 3.5 Plus (2026-02-15)	100	100	100	100	100	100	100	100	100	98	99.8%
Cohere Command R+ (Aug. 2024)	100	100	100	100	100	100	100	100	100	98	99.8%
Mistral Medium 3.1	100	100	100	100	100	100	100	100	100	98	99.8%
Mistral Small 4	100	100	100	100	100	100	100	100	100	98	99.8%
Mistral Small 4 (Reasoning)	100	100	100	100	100	100	100	100	98	98	99.7%
Mistral Small Creative	100	100	100	100	100	100	100	100	98	98	99.7%
GPT-4o, May 13th (temp=1)	100	100	100	100	100	100	100	100	98	98	99.6%
Stealth: Hunter Alpha	100	100	100	100	100	100	100	100	98	98	99.6%
DeepSeek-V2 Chat	100	100	100	100	100	100	100	100	98	98	99.6%
Mistral Small 3.2 24B	100	100	100	100	100	100	100	100	98	98	99.6%
Aion 2.0	100	100	100	100	100	100	100	98	98	98	99.5%
GPT-4o, May 13th (temp=0)	100	100	100	100	100	100	100	98	98	98	99.5%
Z.AI GLM 4.5	100	100	100	100	100	100	98	98	98	98	99.3%
Claude Opus 4.5	100	100	100	100	100	100	98	98	98	98	99.3%
Mistral Large 3	100	100	100	100	100	98	98	98	98	98	99.2%
DeepSeek V3.1	100	100	100	100	100	98	98	98	98	98	99.2%
DeepSeek V3 (2025-03-24)	100	100	100	100	100	100	100	100	98	92	99.0%
LFM2 24B	100	98	98	98	98	98	98	98	98	98	98.6%
Ministral 3 8B	100	100	98	98	98	98	98	98	98	92	98.1%
Claude Sonnet 4.6	100	100	100	100	100	100	98	98	92	92	98.1%
DeepSeek V3.2	100	100	100	100	100	98	98	98	92	92	97.9%
Llama 3.1 8B	100	100	100	100	100	98	98	98	92	92	97.9%
DeepSeek V3 (2024-12-26)	100	100	100	100	98	98	98	98	92	92	97.8%
Ministral 3 3B	100	100	100	100	98	98	98	98	98	77	96.9%
Writer: Palmyra X5	100	100	100	100	100	100	98	98	92	77	96.6%
Claude 3 Haiku	100	100	100	98	98	98	98	92	92	77	95.5%
Gemini 2.5 Flash	100	100	100	100	100	98	92	92	92	77	95.2%
Hermes 3 405B	100	100	100	100	100	100	100	98	98	54	95.0%
Qwen3 235B A22B Instruct 2507	100	100	100	100	100	100	100	100	92	54	94.5%
Arcee AI: Trinity Mini	92	92	92	92	92	92	92	92	92	77	90.7%
Qwen 2.5 72B	100	98	98	98	98	98	92	92	77	54	90.7%
Qwen 3 32B	100	100	100	100	98	98	92	92	92	27	90.0%
Grok 4.20 (Beta, Reasoning)	100	100	100	100	100	100	100	100	100	0	90.0%
Llama 3.1 Nemotron 70B	98	98	98	92	92	92	92	77	77	54	87.2%
Arcee AI: Trinity Large (Preview)	100	100	100	100	100	100	100	98	54	0	85.2%
Llama 3.1 70B	98	92	92	92	92	92	77	77	77	54	84.5%
WizardLM 2 8x22b	100	100	100	98	98	77	54	2	0	0	62.9%
Mistral NeMO	100	98	98	77	77	77	27	0	0	0	55.6%
Hermes 3 70B	100	98	98	92	92	0	0	0	0	0	48.1%
Mistral Large	100	100	100	77	77	9	2	0	0	0	46.5%
Ministral 8B	98	98	92	54	9	0	0	0	0	0	35.2%
Ministral 3B	98	98	92	27	27	2	0	0	0	0	34.5%
Mistral Large 2	98	98	2	2	0	0	0	0	0	0	20.1%
Rocinante 12B	98	77	0	0	0	0	0	0	0	0	17.6%
Gemma 3 4B	54	27	2	0	0	0	0	0	0	0	8.3%

▼

20 word summary

Model	# 1	# 2	# 3	# 4	# 5	# 6	# 7	# 8	# 9	# 10	Avg ▼
Claude Opus 4.6 (Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
Gemini 3.1 Pro (Preview)	100	100	100	100	100	100	100	100	100	100	100.0%
Z.AI GLM 5 Turbo	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5.4 (Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5 Mini	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5.1	100	100	100	100	100	100	100	100	100	100	100.0%
Qwen 3.5 397B A17B	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5.4 (Reasoning, Low)	100	100	100	100	100	100	100	100	100	100	100.0%
Z.AI GLM 5	100	100	100	100	100	100	100	100	100	100	100.0%
MoonshotAI: Kimi K2.5	100	100	100	100	100	100	100	100	100	100	100.0%
Qwen 3.5 27B	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5.4 Mini (Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
Gemini 3 Flash (Preview, Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
o4 Mini High	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5.2	100	100	100	100	100	100	100	100	100	100	100.0%
MiniMax M2.7	100	100	100	100	100	100	100	100	100	100	100.0%
Gemini 3 Pro (Preview)	100	100	100	100	100	100	100	100	100	100	100.0%
Z.AI GLM 4.7	100	100	100	100	100	100	100	100	100	100	100.0%
o4 Mini	100	100	100	100	100	100	100	100	100	100	100.0%
Qwen 3.5 35B	100	100	100	100	100	100	100	100	100	100	100.0%
ByteDance Seed 2.0 Mini	100	100	100	100	100	100	100	100	100	100	100.0%
Qwen 3.5 Flash	100	100	100	100	100	100	100	100	100	100	100.0%
Qwen 3.5 9B	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5.4 Mini (Reasoning, Low)	100	100	100	100	100	100	100	100	100	100	100.0%
Mistral Large 3	100	100	100	100	100	100	100	100	100	100	100.0%
ByteDance Seed 2.0 Lite	100	100	100	100	100	100	100	100	100	100	100.0%
Nemotron 3 Super	100	100	100	100	100	100	100	100	100	100	100.0%
Inception Mercury 2	100	100	100	100	100	100	100	100	100	100	100.0%
Stealth: Aurora Alpha	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5 Nano	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5.4 Nano (Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
Inception Mercury	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-4o Mini (temp=0)	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5	100	100	100	100	100	100	100	100	100	100	100.0%
ByteDance Seed 1.6	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5.4 Nano (Reasoning, Low)	100	100	100	100	100	100	100	100	100	100	100.0%
Z.AI GLM 4.7 Flash	100	100	100	100	100	100	100	100	100	100	100.0%
Claude Sonnet 4.6 (Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-4o Mini (temp=1)	100	100	100	100	100	100	100	100	100	100	100.0%
Gemini 3 Flash (Preview)	100	100	100	100	100	100	100	100	100	100	100.0%
Gemini 3.1 Flash Lite (Preview)	100	100	100	100	100	100	100	100	100	100	99.9%
Gemini 2.5 Pro	100	100	100	100	100	100	100	100	100	100	99.9%
GPT-4o, May 13th (temp=0)	100	100	100	100	100	100	100	100	100	100	99.9%
Grok 4	100	100	100	100	100	100	100	100	100	98	99.8%
Grok 4.20 (Beta, Reasoning)	100	100	100	100	100	100	100	100	100	98	99.8%
Gemini 2.5 Flash (Reasoning)	100	100	100	100	100	100	100	100	100	98	99.8%
Gemini 2.5 Flash Lite (Reasoning)	100	100	100	100	100	100	100	100	100	98	99.8%
GPT-4o, May 13th (temp=1)	100	100	100	100	100	100	100	100	100	98	99.8%
DeepSeek V3 (2025-03-24)	100	100	100	100	100	100	100	100	100	98	99.8%
Ministral 3 3B	100	100	100	100	100	100	100	100	100	98	99.8%
Claude Sonnet 4.6	100	100	100	100	100	100	100	100	100	98	99.8%
GPT-4.1 Nano	100	100	100	100	100	100	100	100	100	98	99.8%
Mistral Small 4 (Reasoning)	100	100	100	100	100	100	100	100	98	98	99.7%
GPT-5.4	100	100	100	100	100	100	100	100	98	98	99.7%
Grok 4.1 Fast	100	100	100	100	100	100	100	98	98	98	99.5%
Z.AI GLM 4.5	100	100	100	100	100	100	100	98	98	98	99.5%
Qwen 3.5 Plus (2026-02-15)	100	100	100	100	100	100	100	98	98	98	99.5%
GPT-4.1	100	100	100	100	100	100	100	98	98	98	99.5%
GPT-4.1 Mini	100	100	100	100	100	100	100	98	98	98	99.5%
Claude 3.7 Sonnet	100	100	100	100	100	100	100	98	98	98	99.5%
Claude 3.5 Haiku	100	100	100	100	100	100	98	98	98	98	99.3%
GPT-4o, Aug. 6th (temp=1)	100	100	100	100	100	100	98	98	98	98	99.3%
ByteDance Seed 1.6 Flash	100	100	100	100	100	100	100	100	100	92	99.2%
Stealth: Healer Alpha	100	100	100	100	100	100	100	100	100	92	99.2%
Grok 4 Fast	100	100	100	100	100	100	100	100	100	92	99.2%
Claude Opus 4	100	100	100	100	100	98	98	98	98	98	99.2%
DeepSeek V3 (2024-12-26)	100	100	100	100	100	100	100	100	98	92	99.0%
GPT-5.4 Nano	100	100	100	100	100	100	100	100	98	92	99.0%
MiniMax M2.5	100	100	100	100	100	100	100	98	98	92	98.9%
GPT-5.4 Mini	100	100	100	100	100	100	100	98	98	92	98.9%
Claude 3.5 Sonnet	100	100	100	100	100	100	98	98	98	92	98.7%
GPT-4o, Aug. 6th (temp=0)	98	98	98	98	98	98	98	98	98	98	98.4%
Qwen 2.5 72B	100	100	100	100	100	100	100	100	92	92	98.4%
DeepSeek-V2 Chat	100	100	100	100	100	100	100	100	92	92	98.4%
Z.AI GLM 4.6	100	100	100	98	98	98	98	98	98	92	98.2%
Stealth: Hunter Alpha	100	100	100	100	100	98	98	98	92	92	97.9%
Gemini 2.5 Flash Lite	100	100	100	100	100	98	98	98	92	92	97.9%
Claude Sonnet 4	100	100	100	98	98	98	98	98	92	92	97.6%
Aion 2.0	100	100	100	100	100	100	100	100	92	77	97.0%
Gemma 3 12B	100	100	100	100	100	98	98	98	92	77	96.4%
Ministral 3 8B	100	100	98	98	98	98	92	92	92	77	94.8%
Claude Opus 4.6	100	98	98	98	98	98	92	92	92	77	94.6%
Claude Opus 4.5	100	100	100	100	98	98	98	98	92	54	93.9%
Mistral Small 3.2 24B	100	98	98	98	98	98	92	77	77	77	91.6%
Nemotron 3 Nano	100	100	100	100	100	100	100	100	100	2	90.2%
Qwen 3.5 122B	100	100	100	100	100	100	100	100	100	0	90.0%
Cohere Command R+ (Aug. 2024)	100	98	98	98	98	92	77	77	77	77	89.5%
Hermes 3 405B	100	100	100	100	100	100	98	92	92	0	88.3%
Mistral Medium 3.1	100	100	98	98	92	92	92	77	77	54	88.2%
Mistral Small 4	100	100	100	100	98	92	77	77	77	54	87.6%
Claude Sonnet 4.5	100	98	98	92	92	92	92	77	77	54	87.4%
DeepSeek V3.1	100	100	100	98	98	92	92	77	54	27	83.9%
Ministral 3 14B	100	98	92	77	77	77	77	77	77	77	83.3%
Llama 3.1 8B	100	100	100	100	100	98	92	77	27	27	82.3%
Arcee AI: Trinity Large (Preview)	100	100	100	100	98	98	92	92	27	0	80.9%
Gemma 3 27B	100	98	98	92	92	92	77	77	27	27	78.3%
Mistral Small Creative	100	77	77	77	77	77	77	77	77	54	77.3%
Qwen 3 32B	100	100	100	100	92	92	92	77	9	9	77.2%
Qwen3 235B A22B Instruct 2507	100	100	98	92	92	77	77	54	54	2	74.6%
Claude 3 Haiku	100	100	100	100	98	77	54	54	27	9	71.9%
Grok 4.20 (Beta)	100	100	100	98	92	77	54	54	9	9	69.3%
Claude Haiku 4.5	100	100	100	98	77	54	54	27	27	9	64.6%
Gemini 2.5 Flash	98	92	92	77	77	77	54	27	27	9	63.2%
Llama 3.1 Nemotron 70B	100	100	98	98	92	27	9	9	2	0	53.6%
DeepSeek V3.2	100	98	92	77	54	2	2	2	0	0	42.7%
Writer: Palmyra X5	92	92	77	54	27	9	0	0	0	0	35.2%
WizardLM 2 8x22b	100	98	98	0	0	0	0	0	0	0	29.7%
Ministral 3B	92	92	54	0	0	0	0	0	0	0	23.8%
Hermes 3 70B	77	54	0	0	0	0	0	0	0	0	13.1%
Arcee AI: Trinity Mini	77	54	0	0	0	0	0	0	0	0	13.1%
Ministral 8B	100	2	0	0	0	0	0	0	0	0	10.2%
Mistral NeMO	92	0	0	0	0	0	0	0	0	0	9.2%
Rocinante 12B	92	0	0	0	0	0	0	0	0	0	9.2%
Mistral Large	54	9	9	0	0	0	0	0	0	0	7.2%
LFM2 24B	54	2	2	2	2	2	2	0	0	0	6.4%
Llama 3.1 70B	27	0	0	0	0	0	0	0	0	0	2.8%
Gemma 3 4B	0	0	0	0	0	0	0	0	0	0	0.0%
Mistral Large 2	0	0	0	0	0	0	0	0	0	0	0.0%

▼

50 word summary

Model	# 1	# 2	# 3	# 4	# 5	# 6	# 7	# 8	# 9	# 10	Avg ▼
Claude Opus 4.6 (Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
Gemini 3.1 Pro (Preview)	100	100	100	100	100	100	100	100	100	100	100.0%
Z.AI GLM 5 Turbo	100	100	100	100	100	100	100	100	100	100	100.0%
Claude Sonnet 4.6 (Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5 Mini	100	100	100	100	100	100	100	100	100	100	100.0%
Qwen 3.5 397B A17B	100	100	100	100	100	100	100	100	100	100	100.0%
Qwen 3.5 122B	100	100	100	100	100	100	100	100	100	100	100.0%
Z.AI GLM 5	100	100	100	100	100	100	100	100	100	100	100.0%
MoonshotAI: Kimi K2.5	100	100	100	100	100	100	100	100	100	100	100.0%
Qwen 3.5 27B	100	100	100	100	100	100	100	100	100	100	100.0%
Gemini 3 Flash (Preview, Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
o4 Mini High	100	100	100	100	100	100	100	100	100	100	100.0%
Gemini 3 Pro (Preview)	100	100	100	100	100	100	100	100	100	100	100.0%
Z.AI GLM 4.7	100	100	100	100	100	100	100	100	100	100	100.0%
Qwen 3.5 35B	100	100	100	100	100	100	100	100	100	100	100.0%
ByteDance Seed 2.0 Mini	100	100	100	100	100	100	100	100	100	100	100.0%
Qwen 3.5 Flash	100	100	100	100	100	100	100	100	100	100	100.0%
Qwen 3.5 9B	100	100	100	100	100	100	100	100	100	100	100.0%
Z.AI GLM 4.7 Flash	100	100	100	100	100	100	100	100	100	100	100.0%
ByteDance Seed 2.0 Lite	100	100	100	100	100	100	100	100	100	100	100.0%
Nemotron 3 Super	100	100	100	100	100	100	100	100	100	100	100.0%
Inception Mercury 2	100	100	100	100	100	100	100	100	100	100	100.0%
Stealth: Aurora Alpha	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-4o Mini (temp=0)	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5.2	100	100	100	100	100	100	100	100	100	100	100.0%
o4 Mini	100	100	100	100	100	100	100	100	100	100	100.0%
Gemini 3.1 Flash Lite (Preview)	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5.4 Mini (Reasoning, Low)	100	100	100	100	100	100	100	100	100	100	100.0%
Gemini 3 Flash (Preview)	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5 Nano	100	100	100	100	100	100	100	100	100	100	100.0%
ByteDance Seed 1.6	100	100	100	100	100	100	100	100	100	100	100.0%
Inception Mercury	100	100	100	100	100	100	100	100	100	100	100.0%
Grok 4.20 (Beta, Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5.4 Nano (Reasoning, Low)	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-4o, May 13th (temp=0)	100	100	100	100	100	100	100	100	100	100	99.9%
GPT-5.1	100	100	100	100	100	100	100	100	100	98	99.8%
GPT-5.4 Mini (Reasoning)	100	100	100	100	100	100	100	100	100	98	99.8%
GPT-5.4 Nano (Reasoning)	100	100	100	100	100	100	100	100	100	98	99.8%
GPT-5.4 (Reasoning)	100	100	100	100	100	100	100	100	100	98	99.8%
GPT-4o, Aug. 6th (temp=0)	100	100	100	100	100	100	100	100	100	98	99.8%
Gemini 2.5 Pro	100	100	100	100	100	100	100	100	98	98	99.7%
MiniMax M2.7	100	100	100	100	100	100	100	98	98	98	99.5%
GPT-4o Mini (temp=1)	100	100	100	100	100	100	100	100	100	92	99.2%
Grok 4	100	100	100	100	100	100	100	100	92	92	98.4%
Claude Opus 4.5	100	100	100	100	100	100	100	100	92	92	98.4%
GPT-4.1 Mini	100	100	100	100	100	100	98	98	92	92	98.1%
GPT-5.4	100	100	100	100	100	100	98	98	92	92	98.1%
Claude Opus 4	100	100	100	100	100	98	98	98	92	92	97.9%
Stealth: Healer Alpha	100	100	100	100	100	100	100	100	98	77	97.6%
GPT-4o, May 13th (temp=1)	100	100	100	100	100	100	98	92	92	92	97.5%
GPT-5.4 (Reasoning, Low)	100	100	100	100	100	100	98	98	98	77	97.2%
Claude Opus 4.6	100	100	100	100	100	98	98	98	98	77	97.1%
GPT-4.1	100	100	100	100	100	100	98	98	92	77	96.6%
GPT-4o, Aug. 6th (temp=1)	100	100	100	100	100	100	98	92	92	77	96.0%
GPT-5.4 Mini	100	100	100	100	98	98	98	92	92	77	95.7%
Mistral Medium 3.1	100	100	100	100	98	98	92	92	92	77	95.1%
Stealth: Hunter Alpha	100	100	100	100	100	100	100	92	77	77	94.7%
GPT-4.1 Nano	100	100	100	98	98	98	92	92	92	54	92.5%
Grok 4 Fast	100	100	100	98	98	98	98	92	77	54	91.7%
Z.AI GLM 4.6	100	100	100	100	100	100	98	77	77	54	90.7%
Grok 4.1 Fast	100	100	100	100	100	100	98	98	92	2	89.1%
Aion 2.0	100	100	100	100	100	100	100	100	77	0	87.7%
GPT-5.4 Nano	100	100	100	98	98	92	77	77	77	54	87.5%
Gemma 3 27B	100	100	100	98	98	98	92	77	77	9	85.1%
Gemini 2.5 Flash Lite	100	100	98	98	98	92	92	92	77	2	85.1%
Gemini 2.5 Flash Lite (Reasoning)	100	100	100	100	98	92	92	77	77	9	84.7%
Claude Sonnet 4.6	100	100	100	98	98	92	92	77	77	9	84.5%
MiniMax M2.5	100	100	98	98	92	92	92	92	77	0	84.3%
Llama 3.1 Nemotron 70B	100	100	100	98	98	92	92	77	77	2	83.7%
Qwen 3.5 Plus (2026-02-15)	100	100	100	98	98	98	77	77	54	2	80.5%
Claude Sonnet 4.5	100	100	100	100	100	98	77	77	27	0	78.0%
Grok 4.20 (Beta)	100	100	98	98	92	77	77	54	27	27	75.2%
Llama 3.1 70B	100	100	98	98	92	77	54	27	27	27	70.2%
Nemotron 3 Nano	100	100	100	100	100	100	100	0	0	0	70.0%
Claude 3.7 Sonnet	98	98	98	92	92	92	54	27	27	9	68.9%
Z.AI GLM 4.5	100	98	98	98	92	54	54	54	27	9	68.4%
DeepSeek V3 (2025-03-24)	100	98	98	92	92	77	54	54	2	0	66.7%
Ministral 3 14B	100	100	100	92	92	77	77	2	2	0	64.2%
Claude 3.5 Sonnet	100	100	98	92	77	54	54	27	27	9	63.9%
Mistral Small 4 (Reasoning)	100	100	100	100	100	54	27	27	2	0	61.0%
Hermes 3 405B	100	98	98	98	92	77	27	9	2	0	60.3%
DeepSeek V3 (2024-12-26)	100	100	98	92	92	54	27	27	9	0	60.0%
Claude Haiku 4.5	100	100	98	98	77	77	27	9	2	0	59.0%
Mistral Small 3.2 24B	100	100	100	98	98	27	27	27	9	0	58.8%
Gemini 2.5 Flash (Reasoning)	100	100	100	92	92	54	27	2	2	0	56.9%
Claude Sonnet 4	98	92	92	77	54	54	27	27	2	0	52.4%
DeepSeek V3.1	100	77	54	54	54	54	54	27	27	9	50.9%
Qwen 3 32B	100	100	77	77	54	54	27	2	0	0	49.1%
LFM2 24B	100	98	92	77	77	9	9	9	2	2	47.6%
Mistral NeMO	100	100	92	77	54	27	2	0	0	0	45.2%
Llama 3.1 8B	100	100	77	54	54	27	27	0	0	0	43.9%
Mistral Large 3	100	100	100	27	27	27	27	27	0	0	43.7%
Mistral Large 2	98	92	77	77	54	27	0	0	0	0	42.6%
DeepSeek-V2 Chat	92	92	54	54	54	54	27	0	0	0	42.6%
Ministral 8B	100	98	92	77	27	0	0	0	0	0	39.6%
DeepSeek V3.2	100	98	77	27	9	9	9	9	9	0	34.9%
Ministral 3 8B	100	98	54	54	9	2	0	0	0	0	31.6%
ByteDance Seed 1.6 Flash	100	100	100	0	0	0	0	0	0	0	30.0%
Arcee AI: Trinity Mini	98	77	77	27	9	0	0	0	0	0	29.0%
Arcee AI: Trinity Large (Preview)	100	92	92	0	0	0	0	0	0	0	28.4%
Mistral Small 4	100	98	54	9	9	2	0	0	0	0	27.2%
Qwen 2.5 72B	92	77	54	27	9	2	2	0	0	0	26.3%
Ministral 3 3B	98	54	54	2	2	0	0	0	0	0	20.9%
Qwen3 235B A22B Instruct 2507	54	0	0	0	0	0	0	0	0	0	5.4%
Gemma 3 12B	27	9	2	0	0	0	0	0	0	0	3.8%
Mistral Large	27	2	0	0	0	0	0	0	0	0	2.9%
Claude 3.5 Haiku	27	0	0	0	0	0	0	0	0	0	2.7%
Ministral 3B	9	9	2	2	0	0	0	0	0	0	2.1%
Gemma 3 4B	9	0	0	0	0	0	0	0	0	0	0.9%
Writer: Palmyra X5	0	0	0	0	0	0	0	0	0	0	0.0%
Gemini 2.5 Flash	0	0	0	0	0	0	0	0	0	0	0.0%
Cohere Command R+ (Aug. 2024)	0	0	0	0	0	0	0	0	0	0	0.0%
Rocinante 12B	0	0	0	0	0	0	0	0	0	0	0.0%
Hermes 3 70B	0	0	0	0	0	0	0	0	0	0	0.0%
Mistral Small Creative	0	0	0	0	0	0	0	0	0	0	0.0%
Claude 3 Haiku	0	0	0	0	0	0	0	0	0	0	0.0%
WizardLM 2 8x22b	0	0	0	0	0	0	0	0	0	0	0.0%

▼

100 word summary

Model	# 1	# 2	# 3	# 4	# 5	# 6	# 7	# 8	# 9	# 10	Avg ▼
Claude Opus 4.6 (Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
Gemini 3.1 Pro (Preview)	100	100	100	100	100	100	100	100	100	100	100.0%
Z.AI GLM 5 Turbo	100	100	100	100	100	100	100	100	100	100	100.0%
Claude Sonnet 4.6 (Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
Qwen 3.5 397B A17B	100	100	100	100	100	100	100	100	100	100	100.0%
Qwen 3.5 122B	100	100	100	100	100	100	100	100	100	100	100.0%
Z.AI GLM 5	100	100	100	100	100	100	100	100	100	100	100.0%
Qwen 3.5 27B	100	100	100	100	100	100	100	100	100	100	100.0%
Gemini 3 Flash (Preview, Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
Gemini 3 Pro (Preview)	100	100	100	100	100	100	100	100	100	100	100.0%
Z.AI GLM 4.7	100	100	100	100	100	100	100	100	100	100	100.0%
Qwen 3.5 35B	100	100	100	100	100	100	100	100	100	100	100.0%
Qwen 3.5 9B	100	100	100	100	100	100	100	100	100	100	100.0%
ByteDance Seed 2.0 Mini	100	100	100	100	100	100	100	100	100	100	100.0%
Qwen 3.5 Flash	100	100	100	100	100	100	100	100	100	100	100.0%
ByteDance Seed 2.0 Lite	100	100	100	100	100	100	100	100	100	100	100.0%
Stealth: Aurora Alpha	100	100	100	100	100	100	100	100	100	100	100.0%
MoonshotAI: Kimi K2.5	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5.4 Nano (Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
o4 Mini	100	100	100	100	100	100	100	100	100	100	100.0%
ByteDance Seed 1.6	100	100	100	100	100	100	100	100	100	100	99.9%
Nemotron 3 Super	100	100	100	100	100	100	100	100	100	98	99.8%
GPT-5.4 Mini (Reasoning)	100	100	100	100	100	100	100	100	100	98	99.8%
GPT-5 Nano	100	100	100	100	100	100	100	100	100	98	99.8%
GPT-5 Mini	100	100	100	100	100	100	100	100	100	98	99.8%
GPT-4o Mini (temp=0)	100	100	100	100	100	100	100	100	100	98	99.8%
GPT-5.4 (Reasoning)	100	100	100	100	100	100	100	100	98	98	99.7%
Gemini 3.1 Flash Lite (Preview)	100	100	100	100	100	100	100	100	98	98	99.6%
o4 Mini High	100	100	100	100	100	100	100	98	98	98	99.5%
GPT-5.1	100	100	100	100	100	100	100	98	98	98	99.5%
GPT-4o, Aug. 6th (temp=1)	100	100	100	100	100	100	100	98	98	98	99.5%
GPT-5.2	100	100	100	100	100	100	98	98	98	98	99.4%
Gemini 3 Flash (Preview)	100	100	100	100	100	100	98	98	98	98	99.3%
Inception Mercury 2	100	100	100	100	100	100	100	100	100	92	99.2%
Inception Mercury	100	100	100	100	100	100	100	100	100	92	99.2%
Grok 4.20 (Beta, Reasoning)	100	100	100	100	100	100	100	100	98	92	99.1%
GPT-4.1	100	100	100	100	100	100	100	98	98	92	98.9%
Z.AI GLM 4.7 Flash	100	100	100	100	100	100	100	100	92	92	98.4%
GPT-4o Mini (temp=1)	100	100	100	100	100	98	98	98	92	92	97.9%
Claude Opus 4.5	100	100	100	100	100	100	100	98	98	77	97.4%
GPT-4o, Aug. 6th (temp=0)	100	100	100	100	100	98	98	92	92	92	97.3%
GPT-5.4 Mini (Reasoning, Low)	100	100	100	100	100	100	100	100	98	54	95.2%
GPT-5	100	100	100	100	100	100	98	98	77	77	95.1%
GPT-5.4 (Reasoning, Low)	100	100	98	98	98	98	92	92	92	77	94.8%
Claude Opus 4.6	100	100	100	100	98	98	98	92	77	77	94.2%
GPT-4o, May 13th (temp=0)	100	100	100	100	98	98	98	92	77	77	94.2%
Claude Sonnet 4.6	100	100	98	98	98	92	92	92	92	54	91.7%
GPT-4.1 Mini	100	100	98	98	92	92	92	77	77	77	90.6%
Nemotron 3 Nano	100	100	100	100	100	100	100	100	100	0	90.0%
MiniMax M2.7	100	100	100	100	100	100	100	98	98	0	89.7%
GPT-5.4 Nano (Reasoning, Low)	100	100	100	100	100	100	98	98	98	0	89.5%
GPT-4o, May 13th (temp=1)	100	100	100	100	98	98	77	77	54	54	85.8%
GPT-5.4	100	98	98	98	92	92	92	77	77	27	85.4%
Claude 3.7 Sonnet	100	100	100	100	100	98	92	77	54	9	83.0%
GPT-5.4 Mini	100	100	100	98	98	98	92	77	54	0	81.8%
Gemini 2.5 Pro	100	98	92	92	92	77	77	77	54	54	81.4%
DeepSeek V3 (2025-03-24)	100	100	100	98	92	92	92	92	27	0	79.4%
Claude Sonnet 4	100	100	100	98	98	98	98	92	2	0	78.7%
DeepSeek V3 (2024-12-26)	100	100	100	98	92	92	77	54	54	0	76.7%
Grok 4 Fast	100	100	98	92	92	92	77	77	27	9	76.6%
Z.AI GLM 4.6	100	100	98	98	92	77	54	54	54	2	72.9%
Llama 3.1 70B	100	100	98	98	92	77	54	54	27	9	71.0%
Claude Opus 4	100	100	100	98	77	77	77	27	27	0	68.5%
Aion 2.0	100	100	100	100	100	98	77	0	0	0	67.6%
GPT-4.1 Nano	100	100	98	92	77	77	54	54	2	0	65.4%
LFM2 24B	100	100	92	92	77	54	54	27	0	0	59.6%
GPT-5.4 Nano	100	100	92	77	77	54	27	27	27	9	59.2%
Stealth: Healer Alpha	100	100	100	100	100	77	2	0	0	0	57.9%
Hermes 3 405B	100	100	98	98	77	77	27	0	0	0	57.9%
Stealth: Hunter Alpha	100	100	77	77	54	54	54	54	0	0	56.9%
Mistral Large 2	100	100	100	92	77	77	0	0	0	0	54.7%
Grok 4.20 (Beta)	100	98	77	77	54	54	54	27	2	2	54.5%
Mistral Large	100	100	92	92	92	54	0	0	0	0	53.0%
Grok 4	100	92	92	92	77	54	9	9	2	2	52.9%
Gemma 3 12B	100	92	92	92	92	54	2	2	0	0	52.6%
Gemini 2.5 Flash Lite	98	98	77	77	54	54	27	27	0	0	51.4%
Claude 3.5 Sonnet	100	98	92	77	54	54	27	9	0	0	51.1%
MiniMax M2.5	100	100	100	100	92	9	0	0	0	0	50.1%
Claude Sonnet 4.5	100	100	98	77	77	27	9	9	0	0	49.9%
Mistral Medium 3.1	100	92	92	92	77	9	0	0	0	0	46.3%
Gemini 2.5 Flash Lite (Reasoning)	98	98	92	77	27	27	9	2	0	0	43.2%
Ministral 3 8B	77	77	77	77	77	27	9	0	0	0	42.4%
Llama 3.1 8B	100	100	100	98	9	2	0	0	0	0	40.9%
Gemini 2.5 Flash	100	100	100	92	9	0	0	0	0	0	40.1%
Gemini 2.5 Flash (Reasoning)	100	100	100	77	9	9	2	2	0	0	39.9%
Z.AI GLM 4.5	100	100	92	27	27	27	9	9	2	0	39.4%
DeepSeek-V2 Chat	100	77	77	54	27	27	0	0	0	0	36.3%
Mistral Small 4 (Reasoning)	100	92	77	27	27	9	9	2	0	0	34.4%
Mistral Large 3	98	77	77	54	27	9	0	0	0	0	34.3%
Qwen 2.5 72B	100	100	77	54	2	0	0	0	0	0	33.3%
Ministral 3 3B	100	92	77	54	9	0	0	0	0	0	33.2%
Arcee AI: Trinity Large (Preview)	100	92	92	27	9	9	2	0	0	0	33.2%
Grok 4.1 Fast	92	77	54	54	54	0	0	0	0	0	33.1%
Cohere Command R+ (Aug. 2024)	92	77	54	54	27	9	9	0	0	0	32.2%
Ministral 3 14B	100	100	100	9	9	0	0	0	0	0	31.8%
Llama 3.1 Nemotron 70B	100	54	54	27	27	2	0	0	0	0	26.3%
Gemma 3 27B	98	92	27	27	9	0	0	0	0	0	25.5%
Hermes 3 70B	100	100	54	0	0	0	0	0	0	0	25.4%
DeepSeek V3.1	100	54	54	0	0	0	0	0	0	0	20.7%
DeepSeek V3.2	100	77	27	2	0	0	0	0	0	0	20.6%
Mistral Small 4	98	92	9	0	0	0	0	0	0	0	20.0%
Arcee AI: Trinity Mini	54	54	27	2	0	0	0	0	0	0	13.6%
Qwen 3 32B	100	9	9	2	0	0	0	0	0	0	12.0%
Qwen3 235B A22B Instruct 2507	77	27	0	0	0	0	0	0	0	0	10.5%
Claude Haiku 4.5	98	0	0	0	0	0	0	0	0	0	9.9%
Ministral 3B	98	0	0	0	0	0	0	0	0	0	9.8%
Mistral Small Creative	92	0	0	0	0	0	0	0	0	0	9.2%
Ministral 8B	92	0	0	0	0	0	0	0	0	0	9.2%
Qwen 3.5 Plus (2026-02-15)	77	2	2	0	0	0	0	0	0	0	8.1%
Writer: Palmyra X5	27	27	9	2	0	0	0	0	0	0	6.5%
Mistral Small 3.2 24B	54	9	2	0	0	0	0	0	0	0	6.4%
ByteDance Seed 1.6 Flash	27	0	0	0	0	0	0	0	0	0	2.7%
Claude 3.5 Haiku	9	0	0	0	0	0	0	0	0	0	0.9%
Mistral NeMO	0	0	0	0	0	0	0	0	0	0	0.0%
Rocinante 12B	0	0	0	0	0	0	0	0	0	0	0.0%
Gemma 3 4B	0	0	0	0	0	0	0	0	0	0	0.0%
Claude 3 Haiku	0	0	0	0	0	0	0	0	0	0	0.0%
WizardLM 2 8x22b	0	0	0	0	0	0	0	0	0	0	0.0%

▼

200 word summary

Model	# 1	# 2	# 3	# 4	# 5	# 6	# 7	# 8	# 9	# 10	Avg ▼
Claude Opus 4.6 (Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
Gemini 3.1 Pro (Preview)	100	100	100	100	100	100	100	100	100	100	100.0%
Claude Sonnet 4.6 (Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
Qwen 3.5 397B A17B	100	100	100	100	100	100	100	100	100	100	100.0%
Z.AI GLM 5	100	100	100	100	100	100	100	100	100	100	100.0%
Qwen 3.5 27B	100	100	100	100	100	100	100	100	100	100	100.0%
Gemini 3 Pro (Preview)	100	100	100	100	100	100	100	100	100	100	100.0%
Qwen 3.5 35B	100	100	100	100	100	100	100	100	100	100	100.0%
Qwen 3.5 Flash	100	100	100	100	100	100	100	100	100	100	100.0%
Gemini 3 Flash (Preview, Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
Z.AI GLM 4.7	100	100	100	100	100	100	100	100	100	100	100.0%
Inception Mercury 2	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5 Nano	100	100	100	100	100	100	100	100	100	100	100.0%
Inception Mercury	100	100	100	100	100	100	100	100	100	100	100.0%
Nemotron 3 Nano	100	100	100	100	100	100	100	100	100	100	100.0%
Nemotron 3 Super	100	100	100	100	100	100	100	100	100	100	100.0%
Z.AI GLM 5 Turbo	100	100	100	100	100	100	100	100	100	98	99.8%
GPT-5.4 Mini (Reasoning)	100	100	100	100	100	100	100	100	100	98	99.8%
GPT-5.1	100	100	100	100	100	100	100	98	98	98	99.5%
GPT-5.4 Nano (Reasoning)	100	100	100	100	100	100	100	98	98	98	99.5%
MoonshotAI: Kimi K2.5	100	100	100	100	100	100	98	98	98	98	99.4%
GPT-5.2	100	100	100	100	100	100	100	100	98	92	99.1%
GPT-5.4 (Reasoning)	100	100	100	100	100	100	100	100	98	92	99.0%
Stealth: Aurora Alpha	100	100	100	100	100	100	100	100	100	77	97.7%
o4 Mini High	100	100	100	100	100	100	100	98	98	77	97.4%
Qwen 3.5 122B	100	100	100	100	100	100	100	98	98	77	97.4%
o4 Mini	100	100	100	100	100	98	98	92	92	92	97.3%
GPT-5	100	100	98	98	98	98	98	92	92	92	96.9%
GPT-5 Mini	100	100	100	100	98	98	98	98	92	77	96.3%
ByteDance Seed 1.6	100	100	100	100	100	98	98	92	92	77	95.8%
Qwen 3.5 9B	100	100	100	100	100	100	100	100	100	0	90.0%
Z.AI GLM 4.7 Flash	100	100	100	100	100	100	100	100	54	0	85.3%
ByteDance Seed 2.0 Mini	100	100	100	100	100	100	100	100	27	0	82.7%
GPT-4o, Aug. 6th (temp=0)	100	98	98	98	98	98	98	92	0	0	78.3%
GPT-4.1	100	100	98	98	98	92	77	77	27	9	77.9%
ByteDance Seed 2.0 Lite	100	100	100	100	100	100	100	54	9	0	76.3%
GPT-4o, Aug. 6th (temp=1)	98	98	98	98	92	92	77	54	9	0	71.8%
Gemini 3 Flash (Preview)	100	92	92	92	92	77	54	54	2	2	65.7%
GPT-5.4 Mini (Reasoning, Low)	100	100	100	98	98	77	77	2	0	0	65.3%
Grok 4	100	100	98	92	92	77	54	27	9	0	65.0%
Mistral Large 3	100	100	100	98	92	92	54	9	0	0	64.5%
GPT-4o Mini (temp=1)	100	100	98	92	92	54	27	9	2	2	57.6%
Claude Sonnet 4.5	100	100	100	98	92	54	9	2	0	0	55.5%
MiniMax M2.7	100	100	100	98	98	27	0	0	0	0	52.4%
Gemini 2.5 Pro	100	100	98	92	92	9	0	0	0	0	49.2%
Gemini 3.1 Flash Lite (Preview)	98	92	77	77	54	54	27	9	2	0	49.1%
LFM2 24B	98	92	92	92	54	27	27	0	0	0	48.3%
GPT-5.4 (Reasoning, Low)	100	100	77	54	54	27	27	9	0	0	44.8%
Grok 4.20 (Beta, Reasoning)	100	100	100	77	54	0	0	0	0	0	43.1%
GPT-5.4 Nano (Reasoning, Low)	100	92	92	77	54	2	0	0	0	0	41.7%
Stealth: Healer Alpha	100	100	100	77	0	0	0	0	0	0	37.7%
GPT-4.1 Nano	100	98	77	27	27	27	0	0	0	0	35.8%
Ministral 3 14B	100	98	77	54	27	0	0	0	0	0	35.7%
GPT-4o, May 13th (temp=1)	100	100	77	9	2	0	0	0	0	0	28.8%
Gemma 3 12B	100	98	77	9	0	0	0	0	0	0	28.5%
Ministral 3 8B	100	100	54	27	0	0	0	0	0	0	28.1%
DeepSeek V3 (2024-12-26)	100	100	77	0	0	0	0	0	0	0	27.7%
GPT-5.4	77	77	54	54	2	0	0	0	0	0	26.4%
Arcee AI: Trinity Large (Preview)	98	92	54	0	0	0	0	0	0	0	24.4%
Gemini 2.5 Flash Lite (Reasoning)	77	54	54	54	0	0	0	0	0	0	23.8%
Grok 4 Fast	98	77	27	9	2	0	0	0	0	0	21.4%
GPT-5.4 Mini	100	100	9	2	0	0	0	0	0	0	21.1%
GPT-4o Mini (temp=0)	77	77	54	0	0	0	0	0	0	0	20.9%
Aion 2.0	100	92	0	0	0	0	0	0	0	0	19.2%
MiniMax M2.5	98	92	0	0	0	0	0	0	0	0	19.1%
Claude Opus 4	98	92	0	0	0	0	0	0	0	0	19.1%
Claude Opus 4.5	100	77	9	0	0	0	0	0	0	0	18.7%
DeepSeek V3.1	100	77	0	0	0	0	0	0	0	0	17.7%
Claude Opus 4.6	92	27	27	9	2	2	0	0	0	0	16.0%
DeepSeek V3.2	100	54	2	0	0	0	0	0	0	0	15.5%
Writer: Palmyra X5	77	27	27	0	0	0	0	0	0	0	13.2%
Qwen3 235B A22B Instruct 2507	100	27	2	0	0	0	0	0	0	0	12.9%
DeepSeek V3 (2025-03-24)	98	27	0	0	0	0	0	0	0	0	12.6%
Gemini 2.5 Flash (Reasoning)	92	27	0	0	0	0	0	0	0	0	12.0%
GPT-4.1 Mini	77	27	9	2	0	0	0	0	0	0	11.6%
Mistral Medium 3.1	77	27	9	0	0	0	0	0	0	0	11.4%
Grok 4.1 Fast	100	9	2	0	0	0	0	0	0	0	11.1%
Arcee AI: Trinity Mini	98	2	0	0	0	0	0	0	0	0	10.0%
Mistral Small Creative	100	0	0	0	0	0	0	0	0	0	10.0%
GPT-5.4 Nano	100	0	0	0	0	0	0	0	0	0	10.0%
Mistral Small 4	100	0	0	0	0	0	0	0	0	0	10.0%
Gemma 3 4B	98	0	0	0	0	0	0	0	0	0	9.8%
Ministral 3 3B	98	0	0	0	0	0	0	0	0	0	9.8%
Claude Sonnet 4	92	0	0	0	0	0	0	0	0	0	9.2%
Claude Haiku 4.5	92	0	0	0	0	0	0	0	0	0	9.2%
Gemini 2.5 Flash	77	0	0	0	0	0	0	0	0	0	7.8%
Grok 4.20 (Beta)	54	9	9	0	0	0	0	0	0	0	7.2%
Gemma 3 27B	27	27	2	0	0	0	0	0	0	0	5.6%
Qwen 3 32B	54	0	0	0	0	0	0	0	0	0	5.4%
Cohere Command R+ (Aug. 2024)	27	0	0	0	0	0	0	0	0	0	2.8%
DeepSeek-V2 Chat	27	0	0	0	0	0	0	0	0	0	2.7%
Z.AI GLM 4.6	9	0	0	0	0	0	0	0	0	0	0.9%
ByteDance Seed 1.6 Flash	9	0	0	0	0	0	0	0	0	0	0.9%
Gemini 2.5 Flash Lite	2	0	0	0	0	0	0	0	0	0	0.2%
Claude Sonnet 4.6	2	0	0	0	0	0	0	0	0	0	0.2%
GPT-4o, May 13th (temp=0)	0	0	0	0	0	0	0	0	0	0	0.0%
Claude 3.7 Sonnet	0	0	0	0	0	0	0	0	0	0	0.0%
Qwen 3.5 Plus (2026-02-15)	0	0	0	0	0	0	0	0	0	0	0.0%
Mistral Small 4 (Reasoning)	0	0	0	0	0	0	0	0	0	0	0.0%
Stealth: Hunter Alpha	0	0	0	0	0	0	0	0	0	0	0.0%
Claude 3.5 Haiku	0	0	0	0	0	0	0	0	0	0	0.0%
Rocinante 12B	0	0	0	0	0	0	0	0	0	0	0.0%
Qwen 2.5 72B	0	0	0	0	0	0	0	0	0	0	0.0%
Claude 3 Haiku	0	0	0	0	0	0	0	0	0	0	0.0%
Z.AI GLM 4.5	0	0	0	0	0	0	0	0	0	0	0.0%
Claude 3.5 Sonnet	0	0	0	0	0	0	0	0	0	0	0.0%
Hermes 3 405B	0	0	0	0	0	0	0	0	0	0	0.0%
Mistral Large 2	0	0	0	0	0	0	0	0	0	0	0.0%
Mistral Large	0	0	0	0	0	0	0	0	0	0	0.0%
Mistral Small 3.2 24B	0	0	0	0	0	0	0	0	0	0	0.0%
Llama 3.1 70B	0	0	0	0	0	0	0	0	0	0	0.0%
Llama 3.1 Nemotron 70B	0	0	0	0	0	0	0	0	0	0	0.0%
Hermes 3 70B	0	0	0	0	0	0	0	0	0	0	0.0%
WizardLM 2 8x22b	0	0	0	0	0	0	0	0	0	0	0.0%
Mistral NeMO	0	0	0	0	0	0	0	0	0	0	0.0%
Ministral 8B	0	0	0	0	0	0	0	0	0	0	0.0%
Llama 3.1 8B	0	0	0	0	0	0	0	0	0	0	0.0%
Ministral 3B	0	0	0	0	0	0	0	0	0	0	0.0%

Matches word count

Overall Performance

Performance Score Distribution (Top 20)

Price-Performance Score Distribution (Top 20)

Most Stable Models (Top 20)

Top Overall Models (Top 20)

Individual Scenarios

words

10 word summary

20 word summary

50 word summary

100 word summary

200 word summary