Matches word count

Test: Write N of X

Avg. Score

64.8%

Scenarios

Overall Performance

Performance Score Distribution (Top 20)

Click a model name to view its detail page.

Rank ▲	Model	Score	Avg. Cost	Avg. Time	Stability
1	Stealth: Aurora Alpha	99.5%	—	2.4s	94%
2	Gemini 3 Flash (Preview)	97.8%	$0.0011	1.5s	89%
3	GPT-5 Nano	97.9%	$0.0008	19.2s	89%
4	GPT-5.1	96.4%	$0.0073	9.2s	78%
5	GPT-5.2	96.9%	$0.0087	9.6s	74%
6	GPT-5 Mini	94.2%	$0.0024	11.6s	62%
7	GPT-4o, Aug. 6th (temp=0)	91.5%	$0.0048	2.2s	61%
8	o4 Mini	93.1%	$0.0069	14.8s	63%
9	GPT-4o Mini (temp=1)	94.1%	$0.0003	42.7s	64%
10	GPT-4o, Aug. 6th (temp=1)	88.6%	$0.0048	2.0s	52%
11	o4 Mini High	95.3%	$0.010	36.6s	69%
12	Z.AI GLM 5	99.0%	$0.016	1.6m	96%
13	GPT-4.1	85.9%	$0.0020	2.5s	44%
14	Gemini 2.5 Pro	91.5%	$0.013	10.9s	55%
15	GPT-5	91.0%	$0.013	18.1s	57%
16	GPT-4o Mini (temp=0)	85.6%	$0.0003	10.7s	38%
17	Gemini 3 Pro (Preview)	98.8%	$0.046	28.1s	93%
18	Grok 4	85.5%	$0.010	13.3s	43%
19	Z.AI GLM 4.7 Flash	94.9%	$0.0026	1.8m	67%
20	GPT-4o, May 13th (temp=1)	84.6%	$0.0091	17.6s	35%
21	Z.AI GLM 4.7	99.6%	$0.0098	3.0m	98%
22	Grok 4 Fast	77.4%	$0.0004	3.4s	23%
23	GPT-4.1 Mini	76.6%	$0.0004	2.3s	21%
24	MoonshotAI: Kimi K2.5	96.1%	$0.016	2.0m	75%
25	Mistral Large 3	74.9%	$0.0010	2.7s	20%
26	Claude Sonnet 4.5	74.8%	$0.0070	4.1s	27%
27	GPT-4.1 Nano	71.6%	$0.0001	2.2s	19%
28	Gemini 2.5 Flash Lite	71.1%	$0.0002	711ms	17%
29	Mistral Medium 3.1	70.6%	$0.0009	2.9s	19%
30	Grok 4.1 Fast	73.5%	$0.0007	6.3s	18%
31	Claude Opus 4.5	79.5%	$0.012	4.4s	24%
32	GPT-4o, May 13th (temp=0)	79.6%	$0.0091	18.7s	26%
33	Claude Opus 4.6	76.6%	$0.012	6.0s	24%
34	Claude 3.7 Sonnet	72.8%	$0.0069	4.8s	19%
35	DeepSeek V3 (2025-03-24)	66.8%	$0.0005	6.5s	16%
36	Minimax M2.5	70.1%	$0.0012	17.6s	15%
37	Gemini 3.1 Pro (Preview)	100.0%	$0.075	1.0m	100%
38	Claude Sonnet 4.6	67.4%	$0.0071	3.5s	16%
39	Llama 3.1 Nemotron 70B	62.1%	$0.0006	3.3s	12%
40	DeepSeek V3 (2024-12-26)	62.9%	$0.0006	3.8s	11%
41	Z.AI GLM 4.5	61.5%	$0.0006	3.7s	11%
42	Claude 3.5 Sonnet	67.2%	$0.0067	10.3s	16%
43	Claude Sonnet 4	65.5%	$0.0070	3.8s	14%
44	Z.AI GLM 4.6	76.0%	$0.0036	48.5s	20%
45	Ministral 3 14B	60.0%	$0.0003	1.3s	8%
46	Llama 3.1 8B	58.6%	$0.0003	694ms	8%
47	Ministral 3 8B	57.4%	$0.0003	1.0s	9%
48	Gemma 3 12B	57.4%	$0.0001	3.1s	9%
49	DeepSeek V3.1	56.8%	$0.0004	8.5s	11%
50	Hermes 3 405B	60.9%	$0.0000	11.0s	7%
51	Qwen 3.5 397B A17B	99.9%	$0.030	3.5m	99%
52	Llama 3.1 70B	52.6%	$0.0015	1.3s	9%
53	Qwen 3.5 Plus (2026-02-15)	57.3%	$0.0009	6.6s	4%
54	Ministral 3 3B	52.4%	$0.0002	716ms	5%
55	Qwen 2.5 72B	51.3%	$0.0007	3.1s	5%
56	Gemma 3 27B	49.0%	$0.0002	3.8s	7%
57	Claude Haiku 4.5	50.4%	$0.0023	2.3s	6%
58	Mistral Small 3.2 24B	50.3%	$0.0002	2.3s	2%
59	DeepSeek V3.2	47.7%	$0.0005	6.1s	3%
60	DeepSeek-V2 Chat	48.9%	$0.0003	8.1s	2%
61	ByteDance Seed 1.6	67.3%	$0.0061	1.0m	17%
62	Arcee AI: Trinity Large (Preview)	45.8%	$0.0000	3.1s	2%
63	Claude Opus 4	75.4%	$0.035	21.6s	22%
64	Mistral Small Creative	39.9%	$0.0002	927ms	0%
65	Claude 3.5 Haiku	42.1%	$0.0018	3.3s	0%
66	ByteDance Seed 1.6 Flash	46.0%	$0.0010	17.0s	0%
67	Cohere Command R+ (Aug. 2024)	43.1%	$0.0051	2.7s	0%
68	Gemini 2.5 Flash	35.7%	$0.0005	1.1s	0%
69	Arcee AI: Trinity Mini	31.5%	$0.0001	1.7s	0%
70	Claude 3 Haiku	32.9%	$0.0005	17.9s	0%
71	Writer: Palmyra X5	25.8%	$0.0018	8.3s	0%
72	Ministral 8B	18.3%	$0.0002	1.4s	0%
73	Mistral NeMO	18.7%	$0.0003	2.4s	0%
74	Mistral Large 2	22.8%	$0.0042	3.0s	0%
75	Ministral 3B	13.7%	$0.0001	710ms	0%
76	Hermes 3 70B	15.8%	$0.0007	4.8s	0%
77	WizardLM 2 8x22b	17.7%	$0.0015	19.8s	0%
78	Gemma 3 4B	2.7%	$0.0001	1.9s	0%
79	Rocinante 12B	5.2%	$0.0006	17.7s	0%
80	Mistral Large	18.2%	$0.017	29.8s	0%
64.83%

Individual Scenarios

words

▼

10 word summary

Model	# 1	# 2	# 3	# 4	# 5	# 6	# 7	# 8	# 9	# 10	Avg ▼
Gemini 3.1 Pro (Preview)	100	100	100	100	100	100	100	100	100	100	100.0%
Qwen 3.5 397B A17B	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5 Mini	100	100	100	100	100	100	100	100	100	100	100.0%
MoonshotAI: Kimi K2.5	100	100	100	100	100	100	100	100	100	100	100.0%
Z.AI GLM 5	100	100	100	100	100	100	100	100	100	100	100.0%
Z.AI GLM 4.7	100	100	100	100	100	100	100	100	100	100	100.0%
Gemini 3 Pro (Preview)	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5 Nano	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-4o, Aug. 6th (temp=0)	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-4o Mini (temp=0)	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5	100	100	100	100	100	100	100	100	100	100	100.0%
o4 Mini	100	100	100	100	100	100	100	100	100	100	100.0%
Gemini 2.5 Pro	100	100	100	100	100	100	100	100	100	100	100.0%
Z.AI GLM 4.7 Flash	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5.2	100	100	100	100	100	100	100	100	100	100	100.0%
Claude Sonnet 4	100	100	100	100	100	100	100	100	100	100	100.0%
Grok 4.1 Fast	100	100	100	100	100	100	100	100	100	100	100.0%
Stealth: Aurora Alpha	100	100	100	100	100	100	100	100	100	100	100.0%
ByteDance Seed 1.6 Flash	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-4o Mini (temp=1)	100	100	100	100	100	100	100	100	100	100	100.0%
Z.AI GLM 4.6	100	100	100	100	100	100	100	100	100	100	100.0%
Gemini 3 Flash (Preview)	100	100	100	100	100	100	100	100	100	100	100.0%
Claude 3.5 Sonnet	100	100	100	100	100	100	100	100	100	100	100.0%
Claude 3.7 Sonnet	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5.1	100	100	100	100	100	100	100	100	100	100	100.0%
o4 Mini High	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-4o, Aug. 6th (temp=1)	100	100	100	100	100	100	100	100	100	100	100.0%
Grok 4	100	100	100	100	100	100	100	100	100	100	100.0%
ByteDance Seed 1.6	100	100	100	100	100	100	100	100	100	100	100.0%
Grok 4 Fast	100	100	100	100	100	100	100	100	100	100	100.0%
Mistral Small 3.2 24B	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-4.1	100	100	100	100	100	100	100	100	100	100	100.0%
Claude Sonnet 4.5	100	100	100	100	100	100	100	100	100	100	99.9%
Gemini 2.5 Flash Lite	100	100	100	100	100	100	100	100	100	100	99.9%
Claude Opus 4	100	100	100	100	100	100	100	100	100	100	99.9%
Mistral Small Creative	100	100	100	100	100	100	100	100	100	100	99.9%
Gemma 3 12B	100	100	100	100	100	100	100	100	100	100	99.9%
Claude Opus 4.6	100	100	100	100	100	100	100	100	100	100	99.9%
Minimax M2.5	100	100	100	100	100	100	100	100	100	98	99.8%
GPT-4.1 Nano	100	100	100	100	100	100	100	100	100	98	99.8%
Qwen 3.5 Plus (2026-02-15)	100	100	100	100	100	100	100	100	100	98	99.8%
Claude Haiku 4.5	100	100	100	100	100	100	100	100	100	98	99.8%
Mistral Medium 3.1	100	100	100	100	100	100	100	100	100	98	99.8%
Claude 3.5 Haiku	100	100	100	100	100	100	100	100	98	98	99.6%
GPT-4.1 Mini	100	100	100	100	100	100	100	100	98	98	99.6%
GPT-4o, May 13th (temp=1)	100	100	100	100	100	100	100	98	98	98	99.5%
DeepSeek-V2 Chat	100	100	100	100	100	100	100	98	98	98	99.5%
Z.AI GLM 4.5	100	100	100	100	100	100	100	98	98	98	99.5%
GPT-4o, May 13th (temp=0)	100	100	100	100	100	100	100	98	98	98	99.5%
Mistral Large 3	100	100	100	100	100	100	100	98	98	98	99.5%
Claude Opus 4.5	100	100	100	100	100	100	98	98	98	98	99.3%
DeepSeek V3.1	100	100	100	100	100	98	98	98	98	98	99.2%
Gemma 3 27B	100	100	100	100	98	98	98	98	98	98	99.0%
Cohere Command R+ (Aug. 2024)	100	100	100	100	100	100	100	100	98	92	99.0%
DeepSeek V3 (2025-03-24)	100	100	100	100	100	100	100	100	98	92	99.0%
Llama 3.1 8B	100	100	100	100	100	100	100	98	98	92	98.8%
Ministral 3 14B	100	100	98	98	98	98	98	98	98	98	98.7%
DeepSeek V3.2	100	100	100	100	100	100	98	98	98	92	98.7%
Ministral 3 8B	100	100	98	98	98	98	98	98	98	92	98.1%
Claude Sonnet 4.6	100	100	100	100	100	100	98	98	92	92	98.1%
DeepSeek V3 (2024-12-26)	100	100	100	100	98	98	98	98	92	92	97.8%
Ministral 3 3B	100	100	100	100	98	98	98	98	98	77	96.9%
Llama 3.1 Nemotron 70B	100	100	100	98	98	98	98	92	92	77	95.5%
Claude 3 Haiku	100	100	100	98	98	98	98	92	92	77	95.5%
Gemini 2.5 Flash	100	100	100	100	98	98	92	92	92	77	95.0%
Hermes 3 405B	100	100	100	100	100	100	100	100	98	27	92.5%
Writer: Palmyra X5	100	100	100	100	100	100	100	98	92	27	91.7%
Arcee AI: Trinity Mini	92	92	92	92	92	92	92	92	92	77	90.7%
Qwen 2.5 72B	100	98	98	98	98	98	92	92	77	27	88.1%
Llama 3.1 70B	98	98	98	92	92	92	92	77	77	54	87.2%
Arcee AI: Trinity Large (Preview)	100	100	100	100	100	100	98	98	27	0	82.4%
WizardLM 2 8x22b	100	100	100	98	98	77	27	0	0	0	60.1%
Hermes 3 70B	100	100	98	92	92	0	0	0	0	0	48.3%
Mistral NeMO	100	92	92	77	77	27	9	0	0	0	47.6%
Mistral Large	100	100	100	77	77	9	2	0	0	0	46.5%
Ministral 8B	100	98	77	54	9	0	0	0	0	0	33.8%
Ministral 3B	98	98	92	27	9	2	0	0	0	0	32.7%
Mistral Large 2	98	92	0	0	0	0	0	0	0	0	19.1%
Rocinante 12B	92	77	0	0	0	0	0	0	0	0	17.0%
Gemma 3 4B	54	27	2	0	0	0	0	0	0	0	8.3%

▼

20 word summary

Model	# 1	# 2	# 3	# 4	# 5	# 6	# 7	# 8	# 9	# 10	Avg ▼
Gemini 3.1 Pro (Preview)	100	100	100	100	100	100	100	100	100	100	100.0%
Qwen 3.5 397B A17B	100	100	100	100	100	100	100	100	100	100	100.0%
Z.AI GLM 5	100	100	100	100	100	100	100	100	100	100	100.0%
Z.AI GLM 4.7	100	100	100	100	100	100	100	100	100	100	100.0%
Gemini 3 Pro (Preview)	100	100	100	100	100	100	100	100	100	100	100.0%
Stealth: Aurora Alpha	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-4o Mini (temp=0)	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5 Mini	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5.2	100	100	100	100	100	100	100	100	100	100	100.0%
MoonshotAI: Kimi K2.5	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5	100	100	100	100	100	100	100	100	100	100	100.0%
o4 Mini	100	100	100	100	100	100	100	100	100	100	100.0%
Z.AI GLM 4.7 Flash	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5 Nano	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-4o Mini (temp=1)	100	100	100	100	100	100	100	100	100	100	99.9%
GPT-5.1	100	100	100	100	100	100	100	100	100	100	99.9%
Mistral Large 3	100	100	100	100	100	100	100	100	100	100	99.9%
GPT-4o, May 13th (temp=0)	100	100	100	100	100	100	100	100	100	100	99.9%
o4 Mini High	100	100	100	100	100	100	100	100	100	98	99.8%
Gemini 2.5 Pro	100	100	100	100	100	100	100	100	100	98	99.8%
GPT-4o, May 13th (temp=1)	100	100	100	100	100	100	100	100	100	98	99.8%
GPT-4.1	100	100	100	100	100	100	100	100	100	98	99.8%
Gemini 3 Flash (Preview)	100	100	100	100	100	100	100	100	100	98	99.8%
Ministral 3 3B	100	100	100	100	100	100	100	100	100	98	99.8%
GPT-4.1 Nano	100	100	100	100	100	100	100	100	100	98	99.8%
GPT-4.1 Mini	100	100	100	100	100	100	100	100	98	98	99.6%
DeepSeek V3 (2025-03-24)	100	100	100	100	100	100	100	100	98	98	99.6%
Claude Sonnet 4.6	100	100	100	100	100	100	100	100	98	98	99.6%
DeepSeek V3 (2024-12-26)	100	100	100	100	100	100	100	100	98	98	99.6%
Claude 3.7 Sonnet	100	100	100	100	100	100	100	100	98	98	99.6%
GPT-4o, Aug. 6th (temp=1)	100	100	100	100	100	100	100	100	98	98	99.6%
Grok 4.1 Fast	100	100	100	100	100	100	100	98	98	98	99.5%
Z.AI GLM 4.5	100	100	100	100	100	100	100	98	98	98	99.5%
Qwen 3.5 Plus (2026-02-15)	100	100	100	100	100	100	98	98	98	98	99.4%
Z.AI GLM 4.6	100	100	100	100	100	100	98	98	98	98	99.3%
Grok 4	100	100	100	100	100	100	100	100	100	92	99.2%
ByteDance Seed 1.6 Flash	100	100	100	100	100	100	100	100	100	92	99.2%
Grok 4 Fast	100	100	100	100	100	100	100	100	100	92	99.2%
Claude 3.5 Haiku	100	100	100	100	100	98	98	98	98	98	99.2%
Claude Opus 4	100	100	100	100	100	98	98	98	98	98	99.2%
Minimax M2.5	100	100	100	100	100	100	100	100	98	92	99.0%
ByteDance Seed 1.6	100	100	100	100	100	100	100	100	98	92	99.0%
Mistral Medium 3.1	100	100	100	100	100	100	100	98	98	92	98.8%
GPT-4o, Aug. 6th (temp=0)	98	98	98	98	98	98	98	98	98	98	98.4%
Claude Sonnet 4	100	100	100	98	98	98	98	98	98	92	98.2%
Gemini 2.5 Flash Lite	100	100	100	100	98	98	98	98	92	92	97.8%
Claude 3.5 Sonnet	100	100	100	100	100	100	98	98	98	77	97.2%
Ministral 3 14B	100	100	100	98	98	98	98	92	92	92	97.0%
DeepSeek-V2 Chat	100	100	100	100	100	100	100	100	92	77	96.9%
Mistral Small 3.2 24B	100	98	98	98	98	98	98	92	92	92	96.7%
Gemma 3 12B	100	100	100	100	98	98	98	92	92	77	95.7%
Qwen 2.5 72B	100	100	100	100	100	100	100	100	92	54	94.5%
Claude Opus 4.5	100	100	100	100	98	98	98	98	92	54	93.9%
Ministral 3 8B	100	100	100	98	92	92	92	92	92	77	93.7%
Cohere Command R+ (Aug. 2024)	100	100	98	98	98	98	92	77	77	77	91.8%
Claude Opus 4.6	98	98	98	98	92	92	92	92	92	54	90.8%
Llama 3.1 8B	100	100	98	98	98	92	77	77	77	77	89.7%
Hermes 3 405B	100	100	100	100	100	100	98	98	92	0	88.9%
Claude Sonnet 4.5	100	98	98	92	92	92	92	77	77	54	87.4%
DeepSeek V3.1	100	100	100	100	100	100	98	92	54	27	87.1%
Mistral Small Creative	98	98	92	92	92	92	92	77	77	54	86.6%
Arcee AI: Trinity Large (Preview)	100	100	100	98	98	98	92	77	2	0	76.6%
Llama 3.1 Nemotron 70B	100	100	100	100	98	77	54	54	9	0	69.2%
Claude 3 Haiku	100	100	100	100	98	54	54	54	27	2	68.8%
Claude Haiku 4.5	100	100	100	98	77	54	54	27	9	9	62.8%
Gemma 3 27B	98	98	92	77	77	54	54	27	9	2	58.9%
Gemini 2.5 Flash	98	92	92	54	54	54	54	9	9	2	51.7%
DeepSeek V3.2	100	98	98	92	54	27	2	2	0	0	47.3%
WizardLM 2 8x22b	98	92	92	0	0	0	0	0	0	0	28.3%
Ministral 3B	92	77	54	0	0	0	0	0	0	0	22.3%
Writer: Palmyra X5	54	54	27	27	9	2	0	0	0	0	17.3%
Arcee AI: Trinity Mini	98	54	0	0	0	0	0	0	0	0	15.2%
Hermes 3 70B	54	54	0	0	0	0	0	0	0	0	10.7%
Ministral 8B	100	0	0	0	0	0	0	0	0	0	10.0%
Mistral NeMO	92	0	0	0	0	0	0	0	0	0	9.2%
Rocinante 12B	92	0	0	0	0	0	0	0	0	0	9.2%
Llama 3.1 70B	77	2	2	0	0	0	0	0	0	0	8.1%
Mistral Large	27	9	9	0	0	0	0	0	0	0	4.6%
Gemma 3 4B	0	0	0	0	0	0	0	0	0	0	0.0%
Mistral Large 2	0	0	0	0	0	0	0	0	0	0	0.0%

▼

50 word summary

Model	# 1	# 2	# 3	# 4	# 5	# 6	# 7	# 8	# 9	# 10	Avg ▼
Gemini 3.1 Pro (Preview)	100	100	100	100	100	100	100	100	100	100	100.0%
Qwen 3.5 397B A17B	100	100	100	100	100	100	100	100	100	100	100.0%
Gemini 3 Pro (Preview)	100	100	100	100	100	100	100	100	100	100	100.0%
Stealth: Aurora Alpha	100	100	100	100	100	100	100	100	100	100	100.0%
o4 Mini High	100	100	100	100	100	100	100	100	100	100	100.0%
Z.AI GLM 4.7	100	100	100	100	100	100	100	100	100	100	100.0%
Z.AI GLM 4.7 Flash	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5 Mini	100	100	100	100	100	100	100	100	100	100	99.9%
GPT-4o Mini (temp=0)	100	100	100	100	100	100	100	100	100	100	99.9%
Z.AI GLM 5	100	100	100	100	100	100	100	100	100	98	99.8%
MoonshotAI: Kimi K2.5	100	100	100	100	100	100	100	100	100	98	99.8%
GPT-5.2	100	100	100	100	100	100	100	100	98	98	99.7%
GPT-5 Nano	100	100	100	100	100	100	100	98	98	98	99.5%
Gemini 2.5 Pro	100	100	100	100	100	100	100	98	98	98	99.5%
Gemini 3 Flash (Preview)	100	100	100	100	100	100	100	98	98	98	99.5%
GPT-4o, Aug. 6th (temp=0)	100	100	100	100	100	100	100	98	98	98	99.5%
GPT-5	100	100	100	100	100	100	98	98	98	98	99.3%
GPT-5.1	100	100	100	100	100	100	98	98	98	92	98.7%
GPT-4o, May 13th (temp=0)	98	98	98	98	98	98	98	98	98	98	98.4%
Grok 4	100	100	100	100	100	100	100	98	92	92	98.2%
Claude Opus 4.5	100	100	100	100	100	100	100	98	92	92	98.2%
Claude Opus 4	100	100	100	100	100	100	98	98	92	92	98.1%
GPT-4o Mini (temp=1)	100	100	100	100	100	98	98	98	92	92	97.9%
GPT-4o, May 13th (temp=1)	100	100	100	100	100	98	98	98	98	77	97.1%
o4 Mini	100	100	100	100	100	100	100	98	92	77	96.7%
Claude Opus 4.6	100	100	98	98	98	98	98	98	98	77	96.6%
GPT-4.1 Mini	100	100	100	100	100	98	98	92	92	77	95.8%
Grok 4 Fast	100	100	100	98	98	92	92	92	92	92	95.8%
Z.AI GLM 4.6	100	100	100	100	100	100	98	98	77	77	95.1%
Llama 3.1 Nemotron 70B	100	100	100	100	100	98	98	98	98	54	94.7%
GPT-4o, Aug. 6th (temp=1)	100	100	100	100	100	98	98	98	92	54	94.0%
Grok 4.1 Fast	100	100	100	100	100	100	98	98	92	27	91.6%
Llama 3.1 70B	100	100	100	100	100	92	77	77	77	54	87.8%
Mistral Medium 3.1	100	100	100	98	92	92	77	77	77	54	86.8%
GPT-4.1 Nano	100	100	100	98	98	98	98	92	54	27	86.7%
Gemini 2.5 Flash Lite	100	100	100	98	98	92	92	92	77	2	85.2%
ByteDance Seed 1.6	100	100	100	100	98	92	77	77	77	27	85.0%
GPT-4.1	100	100	100	98	98	92	92	77	54	27	83.9%
Qwen 3.5 Plus (2026-02-15)	100	100	100	100	98	98	92	92	27	9	81.7%
Claude Sonnet 4.6	100	100	100	98	92	92	77	77	77	2	81.6%
Claude Sonnet 4.5	100	100	100	100	100	98	77	77	27	0	78.0%
Claude 3.7 Sonnet	100	98	98	98	98	92	77	54	27	27	77.1%
Gemma 3 27B	100	100	98	98	92	77	77	54	54	9	76.0%
Minimax M2.5	100	100	100	98	98	92	54	54	54	0	74.9%
Mistral Large 3	92	92	92	92	92	92	92	54	2	2	70.2%
Claude 3.5 Sonnet	100	100	100	98	77	54	54	54	54	9	69.9%
DeepSeek V3.1	98	77	77	77	77	77	54	54	27	9	62.9%
Hermes 3 405B	100	100	100	98	92	92	27	9	2	0	62.1%
Claude Haiku 4.5	100	100	100	92	77	54	54	27	9	0	61.3%
Z.AI GLM 4.5	100	100	98	92	92	27	27	27	9	2	57.5%
Llama 3.1 8B	100	98	98	92	77	54	54	0	0	0	57.3%
DeepSeek V3 (2025-03-24)	100	92	92	77	77	54	27	9	0	0	52.9%
Mistral Small 3.2 24B	100	100	100	98	92	9	9	2	2	0	51.2%
Ministral 3 14B	100	100	100	100	54	27	27	0	0	0	50.8%
Claude Sonnet 4	98	92	92	77	54	54	27	9	0	0	50.4%
DeepSeek V3.2	100	100	92	77	27	27	27	9	9	0	47.0%
DeepSeek V3 (2024-12-26)	100	98	92	77	54	9	9	0	0	0	44.0%
Qwen 2.5 72B	100	98	77	77	54	27	2	0	0	0	43.6%
Mistral Large 2	98	92	77	54	54	27	0	0	0	0	40.3%
Ministral 8B	100	92	92	77	9	9	0	0	0	0	38.0%
Mistral NeMO	98	92	92	54	27	2	0	0	0	0	36.5%
ByteDance Seed 1.6 Flash	100	100	98	0	0	0	0	0	0	0	29.8%
Arcee AI: Trinity Mini	92	77	77	27	0	0	0	0	0	0	27.4%
Arcee AI: Trinity Large (Preview)	100	77	54	0	0	0	0	0	0	0	23.1%
Ministral 3 3B	92	77	27	0	0	0	0	0	0	0	19.7%
Ministral 3 8B	98	77	9	9	2	0	0	0	0	0	19.6%
DeepSeek-V2 Chat	54	27	27	9	9	9	0	0	0	0	13.5%
Gemma 3 12B	54	27	2	2	0	0	0	0	0	0	8.5%
Ministral 3B	27	2	2	2	0	0	0	0	0	0	3.2%
Claude 3.5 Haiku	27	2	0	0	0	0	0	0	0	0	2.9%
Mistral Large	9	0	0	0	0	0	0	0	0	0	0.9%
Gemma 3 4B	0	0	0	0	0	0	0	0	0	0	0.0%
Writer: Palmyra X5	0	0	0	0	0	0	0	0	0	0	0.0%
Gemini 2.5 Flash	0	0	0	0	0	0	0	0	0	0	0.0%
Rocinante 12B	0	0	0	0	0	0	0	0	0	0	0.0%
Cohere Command R+ (Aug. 2024)	0	0	0	0	0	0	0	0	0	0	0.0%
Hermes 3 70B	0	0	0	0	0	0	0	0	0	0	0.0%
Claude 3 Haiku	0	0	0	0	0	0	0	0	0	0	0.0%
Mistral Small Creative	0	0	0	0	0	0	0	0	0	0	0.0%
WizardLM 2 8x22b	0	0	0	0	0	0	0	0	0	0	0.0%

▼

100 word summary

Model	# 1	# 2	# 3	# 4	# 5	# 6	# 7	# 8	# 9	# 10	Avg ▼
Gemini 3.1 Pro (Preview)	100	100	100	100	100	100	100	100	100	100	100.0%
Qwen 3.5 397B A17B	100	100	100	100	100	100	100	100	100	100	100.0%
Stealth: Aurora Alpha	100	100	100	100	100	100	100	100	100	100	100.0%
Z.AI GLM 4.7	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-4o Mini (temp=1)	100	100	100	100	100	100	100	100	98	98	99.6%
Gemini 3 Pro (Preview)	100	100	100	100	100	100	100	98	98	92	98.9%
GPT-5 Mini	100	100	100	100	100	100	100	98	98	92	98.9%
MoonshotAI: Kimi K2.5	100	100	100	100	100	98	98	98	98	92	98.6%
Z.AI GLM 5	100	100	100	100	100	98	98	98	98	92	98.6%
GPT-4o, Aug. 6th (temp=0)	100	100	100	100	98	98	98	98	98	92	98.4%
Gemini 3 Flash (Preview)	100	100	100	100	98	98	98	98	98	92	98.4%
GPT-5.2	100	100	100	98	98	98	98	98	98	92	98.2%
o4 Mini High	100	100	100	98	98	98	98	98	92	92	97.6%
GPT-5.1	100	100	100	100	100	98	98	92	92	92	97.3%
Gemini 2.5 Pro	100	100	98	98	98	98	98	92	92	92	96.9%
GPT-5 Nano	100	100	100	100	100	100	100	98	92	77	96.8%
Z.AI GLM 4.7 Flash	100	100	100	98	98	98	92	92	92	92	96.4%
Claude Opus 4.5	100	100	100	100	100	98	98	92	92	77	95.8%
o4 Mini	100	100	100	100	100	98	92	92	92	77	95.2%
GPT-4.1	100	100	100	100	100	100	98	98	77	77	95.1%
GPT-4o Mini (temp=0)	100	92	92	92	92	92	92	92	92	92	93.0%
Grok 4 Fast	100	100	100	100	98	98	98	77	77	54	90.3%
GPT-4o, May 13th (temp=0)	100	100	100	100	100	98	98	92	77	27	89.3%
Claude Opus 4.6	100	100	100	100	100	98	98	77	54	54	88.1%
GPT-4.1 Mini	100	100	98	98	98	92	92	92	54	54	87.9%
Z.AI GLM 4.6	100	100	100	98	98	92	92	92	54	27	85.4%
Claude 3.7 Sonnet	100	100	100	100	98	98	98	77	54	27	85.3%
GPT-5	100	100	100	100	98	98	92	54	54	54	85.0%
GPT-4o, Aug. 6th (temp=1)	100	100	100	100	98	92	92	54	54	54	84.3%
Llama 3.1 70B	100	100	98	98	98	92	77	77	54	2	79.7%
GPT-4o, May 13th (temp=1)	100	100	100	98	98	92	92	77	27	9	79.5%
Claude Sonnet 4	98	98	98	98	77	77	77	77	9	0	71.2%
Claude 3.5 Sonnet	100	98	98	92	92	77	77	54	2	0	69.1%
Gemini 2.5 Flash Lite	100	100	98	92	92	92	54	54	9	0	69.1%
Grok 4	100	98	92	92	92	92	54	27	27	9	68.5%
Claude Sonnet 4.5	100	100	98	92	92	77	54	27	9	0	65.0%
Claude Opus 4	100	98	98	92	77	54	54	27	27	0	62.8%
Hermes 3 405B	100	100	98	98	92	92	27	2	0	0	61.0%
Gemma 3 12B	100	100	98	98	92	77	27	9	2	0	60.4%
DeepSeek V3 (2025-03-24)	100	92	92	77	77	77	54	27	2	0	59.9%
Claude Sonnet 4.6	100	92	77	77	77	54	54	27	9	9	57.7%
Minimax M2.5	100	100	98	98	92	77	2	0	0	0	56.8%
Mistral Large 2	100	100	100	92	77	77	0	0	0	0	54.7%
Z.AI GLM 4.5	100	100	98	77	54	27	27	27	0	0	51.2%
Llama 3.1 Nemotron 70B	100	98	92	92	54	54	9	9	2	0	51.0%
ByteDance Seed 1.6	100	98	92	54	54	54	27	9	9	2	49.8%
Llama 3.1 8B	100	98	92	92	77	9	0	0	0	0	46.9%
Grok 4.1 Fast	98	92	92	77	77	9	9	9	0	0	46.5%
GPT-4.1 Nano	100	98	77	77	54	54	2	2	0	0	46.4%
DeepSeek V3 (2024-12-26)	100	92	92	54	54	27	9	9	2	0	43.9%
Mistral Large	100	100	100	54	27	9	0	0	0	0	39.0%
Mistral Large 3	100	100	98	77	9	0	0	0	0	0	38.5%
Mistral Medium 3.1	98	98	77	77	27	2	0	0	0	0	38.1%
Ministral 3 8B	100	98	77	54	27	9	9	0	0	0	37.5%
Ministral 3 3B	98	92	92	54	27	0	0	0	0	0	36.4%
Gemini 2.5 Flash	100	100	77	27	0	0	0	0	0	0	30.5%
Qwen 2.5 72B	100	100	92	9	2	0	0	0	0	0	30.3%
Ministral 3 14B	100	98	98	0	0	0	0	0	0	0	29.7%
DeepSeek V3.2	98	92	77	2	0	0	0	0	0	0	27.0%
DeepSeek-V2 Chat	98	92	27	2	2	0	0	0	0	0	22.1%
DeepSeek V3.1	92	92	9	9	9	9	0	0	0	0	22.1%
Arcee AI: Trinity Large (Preview)	100	100	9	0	0	0	0	0	0	0	20.9%
Hermes 3 70B	98	92	9	2	0	0	0	0	0	0	20.1%
Claude Haiku 4.5	100	54	0	0	0	0	0	0	0	0	15.4%
Arcee AI: Trinity Mini	54	54	27	2	2	0	0	0	0	0	13.8%
Gemma 3 27B	54	54	2	2	0	0	0	0	0	0	11.0%
Ministral 3B	100	0	0	0	0	0	0	0	0	0	10.0%
Ministral 8B	98	0	0	0	0	0	0	0	0	0	9.9%
Cohere Command R+ (Aug. 2024)	54	27	9	2	0	0	0	0	0	0	9.2%
Claude 3.5 Haiku	77	9	0	0	0	0	0	0	0	0	8.6%
Qwen 3.5 Plus (2026-02-15)	54	2	0	0	0	0	0	0	0	0	5.5%
Mistral Small Creative	54	0	0	0	0	0	0	0	0	0	5.4%
Mistral Small 3.2 24B	27	9	0	0	0	0	0	0	0	0	3.7%
Writer: Palmyra X5	9	9	0	0	0	0	0	0	0	0	1.8%
ByteDance Seed 1.6 Flash	9	0	0	0	0	0	0	0	0	0	0.9%
Mistral NeMO	0	0	0	0	0	0	0	0	0	0	0.0%
Rocinante 12B	0	0	0	0	0	0	0	0	0	0	0.0%
Gemma 3 4B	0	0	0	0	0	0	0	0	0	0	0.0%
Claude 3 Haiku	0	0	0	0	0	0	0	0	0	0	0.0%
WizardLM 2 8x22b	0	0	0	0	0	0	0	0	0	0	0.0%

▼

200 word summary

Model	# 1	# 2	# 3	# 4	# 5	# 6	# 7	# 8	# 9	# 10	Avg ▼
Gemini 3.1 Pro (Preview)	100	100	100	100	100	100	100	100	100	100	100.0%
Qwen 3.5 397B A17B	100	100	100	100	100	100	100	100	98	98	99.7%
Z.AI GLM 4.7	100	100	98	98	98	98	98	98	98	92	98.1%
Stealth: Aurora Alpha	100	100	100	100	100	100	100	100	100	77	97.7%
Z.AI GLM 5	100	100	98	98	98	98	98	92	92	92	96.9%
Gemini 3 Pro (Preview)	100	100	100	100	98	98	92	92	92	77	95.1%
GPT-5 Nano	100	100	98	98	98	98	92	92	77	77	93.3%
Gemini 3 Flash (Preview)	100	100	100	100	98	92	92	77	77	77	91.5%
GPT-5.2	100	100	98	98	98	98	92	92	77	9	86.4%
GPT-5.1	100	98	98	98	98	92	92	77	77	27	86.0%
MoonshotAI: Kimi K2.5	98	98	98	98	98	92	77	77	54	27	82.0%
o4 Mini High	100	100	100	98	98	98	77	54	54	9	78.9%
Z.AI GLM 4.7 Flash	98	98	98	98	98	92	92	54	54	0	78.4%
o4 Mini	100	100	100	100	98	92	54	54	27	9	73.4%
GPT-4o Mini (temp=1)	100	100	100	100	92	77	77	54	27	2	73.0%
GPT-5 Mini	100	100	98	98	92	92	77	27	27	9	72.2%
GPT-5	100	98	98	92	77	77	77	77	9	2	70.9%
Mistral Large 3	100	100	100	98	98	92	77	0	0	0	66.7%
GPT-4o, Aug. 6th (temp=1)	100	100	98	92	92	77	54	27	9	2	65.2%
Grok 4	100	100	98	92	92	54	54	27	2	0	61.9%
Gemini 2.5 Pro	100	100	98	77	77	77	54	27	0	0	61.2%
GPT-4o, Aug. 6th (temp=0)	98	98	92	54	54	54	54	54	27	27	61.1%
GPT-4.1	100	100	92	77	54	54	27	2	2	0	50.8%
GPT-4o, May 13th (temp=1)	100	98	92	92	77	9	0	0	0	0	46.9%
Claude Sonnet 4.5	100	98	77	77	54	27	0	0	0	0	43.4%
Ministral 3 8B	98	98	92	92	0	0	0	0	0	0	38.1%
GPT-4o Mini (temp=0)	98	98	92	9	9	9	9	9	9	9	35.2%
Grok 4.1 Fast	98	98	92	9	0	0	0	0	0	0	29.8%
Mistral Medium 3.1	92	92	54	27	27	2	0	0	0	0	29.4%
DeepSeek V3 (2024-12-26)	100	98	92	0	0	0	0	0	0	0	29.1%
Arcee AI: Trinity Large (Preview)	100	98	27	27	9	0	0	0	0	0	26.2%
GPT-4.1 Nano	100	92	27	27	9	0	0	0	0	0	25.6%
Ministral 3 14B	100	92	27	9	9	2	0	0	0	0	23.9%
Gemma 3 12B	92	54	54	27	0	0	0	0	0	0	22.7%
DeepSeek V3 (2025-03-24)	100	98	27	0	0	0	0	0	0	0	22.6%
Minimax M2.5	100	92	9	0	0	0	0	0	0	0	20.1%
DeepSeek V3.2	100	77	9	0	0	0	0	0	0	0	18.7%
Writer: Palmyra X5	100	77	2	2	0	0	0	0	0	0	18.1%
Claude Opus 4	92	77	0	0	0	0	0	0	0	0	17.0%
Cohere Command R+ (Aug. 2024)	77	77	2	0	0	0	0	0	0	0	15.6%
DeepSeek V3.1	100	27	2	0	0	0	0	0	0	0	12.9%
Claude Haiku 4.5	100	27	0	0	0	0	0	0	0	0	12.7%
DeepSeek-V2 Chat	98	27	0	0	0	0	0	0	0	0	12.6%
GPT-4o, May 13th (temp=0)	54	27	27	0	0	0	0	0	0	0	10.9%
Arcee AI: Trinity Mini	100	2	0	0	0	0	0	0	0	0	10.2%
Claude Opus 4.5	98	2	0	0	0	0	0	0	0	0	10.0%
Ministral 3 3B	92	0	0	0	0	0	0	0	0	0	9.2%
Claude Opus 4.6	77	0	0	0	0	0	0	0	0	0	7.8%
Mistral Small Creative	77	0	0	0	0	0	0	0	0	0	7.8%
Claude Sonnet 4	77	0	0	0	0	0	0	0	0	0	7.7%
Gemma 3 4B	54	0	0	0	0	0	0	0	0	0	5.4%
Gemini 2.5 Flash Lite	27	9	0	0	0	0	0	0	0	0	3.6%
ByteDance Seed 1.6	27	2	0	0	0	0	0	0	0	0	3.0%
Grok 4 Fast	9	9	2	0	0	0	0	0	0	0	2.0%
Claude 3.7 Sonnet	9	9	0	0	0	0	0	0	0	0	1.8%
Gemini 2.5 Flash	9	2	2	0	0	0	0	0	0	0	1.2%
Gemma 3 27B	0	0	0	0	0	0	0	0	0	0	0.0%
GPT-4.1 Mini	0	0	0	0	0	0	0	0	0	0	0.0%
ByteDance Seed 1.6 Flash	0	0	0	0	0	0	0	0	0	0	0.0%
Z.AI GLM 4.6	0	0	0	0	0	0	0	0	0	0	0.0%
Qwen 3.5 Plus (2026-02-15)	0	0	0	0	0	0	0	0	0	0	0.0%
Claude 3.5 Haiku	0	0	0	0	0	0	0	0	0	0	0.0%
Claude Sonnet 4.6	0	0	0	0	0	0	0	0	0	0	0.0%
Qwen 2.5 72B	0	0	0	0	0	0	0	0	0	0	0.0%
Claude 3 Haiku	0	0	0	0	0	0	0	0	0	0	0.0%
Rocinante 12B	0	0	0	0	0	0	0	0	0	0	0.0%
Claude 3.5 Sonnet	0	0	0	0	0	0	0	0	0	0	0.0%
Z.AI GLM 4.5	0	0	0	0	0	0	0	0	0	0	0.0%
Mistral Large 2	0	0	0	0	0	0	0	0	0	0	0.0%
Hermes 3 405B	0	0	0	0	0	0	0	0	0	0	0.0%
Llama 3.1 70B	0	0	0	0	0	0	0	0	0	0	0.0%
Llama 3.1 Nemotron 70B	0	0	0	0	0	0	0	0	0	0	0.0%
Mistral Large	0	0	0	0	0	0	0	0	0	0	0.0%
Mistral Small 3.2 24B	0	0	0	0	0	0	0	0	0	0	0.0%
Hermes 3 70B	0	0	0	0	0	0	0	0	0	0	0.0%
Llama 3.1 8B	0	0	0	0	0	0	0	0	0	0	0.0%
Mistral NeMO	0	0	0	0	0	0	0	0	0	0	0.0%
Ministral 8B	0	0	0	0	0	0	0	0	0	0	0.0%
WizardLM 2 8x22b	0	0	0	0	0	0	0	0	0	0	0.0%
Ministral 3B	0	0	0	0	0	0	0	0	0	0	0.0%

Matches word count

Overall Performance

Performance Score Distribution (Top 20)

Price-Performance Score Distribution (Top 20)

Most Stable Models (Top 20)

Top Overall Models (Top 20)

Individual Scenarios

words

10 word summary

20 word summary

50 word summary

100 word summary

200 word summary