Matches word count

Test: Dialogue tags

Avg. Score

39.3%

Scenarios

Overall Performance

Performance Score Distribution (Top 20)

Click a model name to view its detail page.

Rank ▲	Model	Score	Avg. Cost	Avg. Time	Stability
1	GPT-5 Mini	95.7%	$0.011	58.5s	63%
2	Claude Sonnet 4.6	81.1%	$0.0079	12.8s	45%
3	Claude Opus 4.6	83.6%	$0.014	15.5s	40%
4	GPT-4o Mini (temp=0)	75.7%	$0.0003	8.5s	30%
5	Claude Opus 4.5	78.8%	$0.014	14.3s	33%
6	GPT-4o, Aug. 6th (temp=0)	69.0%	$0.0053	6.3s	18%
7	Gemini 3 Flash (Preview)	64.8%	$0.0015	5.0s	18%
8	GPT-5	89.2%	$0.053	1.5m	41%
9	GPT-4o, Aug. 6th (temp=1)	61.6%	$0.0054	6.3s	10%
10	GPT-4.1	58.5%	$0.0044	7.8s	9%
11	Minimax M2.5	88.4%	$0.017	3.1m	40%
12	GPT-4o Mini (temp=1)	57.6%	$0.0003	8.4s	6%
13	o4 Mini High	86.3%	$0.050	1.9m	37%
14	Grok 4	59.0%	$0.012	27.3s	14%
15	Claude Opus 4	68.2%	$0.044	25.5s	22%
16	Claude 3.7 Sonnet	51.5%	$0.0085	11.6s	12%
17	Gemini 3.1 Pro (Preview)	98.7%	$0.157	2.1m	80%
18	Grok 4 Fast	48.8%	$0.0004	6.8s	7%
19	Claude Haiku 4.5	47.7%	$0.0026	6.6s	8%
20	o4 Mini	70.5%	$0.026	1.1m	17%
21	Grok 4.1 Fast	51.3%	$0.0004	10.3s	4%
22	Gemini 2.5 Flash Lite	42.9%	$0.0002	2.6s	5%
23	Llama 3.1 70B	40.5%	$0.0005	5.2s	4%
24	Llama 3.1 8B	39.4%	$0.0001	2.0s	1%
25	Claude 3 Haiku	37.2%	$0.0007	4.7s	1%
26	Mistral Medium 3.1	39.8%	$0.0012	13.1s	2%
27	GPT-4.1 Mini	38.9%	$0.0009	6.9s	0%
28	Arcee AI: Trinity Large (Preview)	39.1%	$0.0000	12.2s	1%
29	Stealth: Aurora Alpha	67.7%	—	9.2s	9%
30	DeepSeek V3 (2024-12-26)	38.6%	$0.0006	19.3s	3%
31	GPT-4.1 Nano	37.3%	$0.0002	6.0s	0%
32	Hermes 3 405B	37.4%	$0.0000	26.5s	4%
33	DeepSeek V3 (2025-03-24)	34.3%	$0.0006	17.8s	0%
34	Gemini 2.5 Flash	30.0%	$0.0015	4.0s	0%
35	GPT-5 Nano	59.6%	$0.0040	1.6m	3%
36	DeepSeek-V2 Chat	37.3%	$0.0002	29.9s	0%
37	Mistral Large 3	30.6%	$0.0009	12.1s	0%
38	DeepSeek V3.1	35.4%	$0.0006	28.3s	0%
39	GPT-5.2	53.0%	$0.027	38.3s	1%
40	Gemma 3 12B	27.5%	$0.0001	11.9s	0%
41	GPT-5.1	56.1%	$0.030	52.9s	3%
42	GPT-4o, May 13th (temp=1)	33.2%	$0.0088	15.6s	0%
43	Qwen 2.5 72B	27.3%	$0.0003	15.6s	0%
44	GPT-4o, May 13th (temp=0)	31.8%	$0.0090	14.3s	0%
45	Mistral Small 3.2 24B	23.8%	$0.0002	9.0s	0%
46	Mistral Large	33.7%	$0.015	13.3s	0%
47	Claude 3.5 Haiku	22.3%	$0.0020	7.4s	0%
48	Claude Sonnet 4.5	26.4%	$0.0080	11.8s	1%
49	Hermes 3 70B	25.5%	$0.0002	20.8s	0%
50	Ministral 8B	18.8%	$0.0000	4.0s	0%
51	Ministral 3 3B	17.4%	$0.0001	2.0s	0%
52	Gemini 3 Pro (Preview)	42.6%	$0.031	23.6s	1%
53	Arcee AI: Trinity Mini	17.5%	$0.0001	5.6s	0%
54	Claude Sonnet 4	22.6%	$0.0077	11.4s	0%
55	Claude 3.5 Sonnet	28.3%	$0.0092	32.1s	1%
56	DeepSeek V3.2	29.2%	$0.0005	47.8s	0%
57	Gemini 2.5 Pro	37.7%	$0.029	25.0s	1%
58	Z.AI GLM 4.5	15.4%	$0.0009	8.9s	0%
59	Ministral 3 8B	12.9%	$0.0001	3.3s	0%
60	Ministral 3B	12.4%	$0.0000	2.5s	0%
61	Ministral 3 14B	13.6%	$0.0002	6.4s	0%
62	Qwen 3.5 Plus (2026-02-15)	18.9%	$0.0013	22.1s	0%
63	ByteDance Seed 1.6 Flash	11.4%	$0.0006	12.2s	0%
64	Llama 3.1 Nemotron 70B	11.8%	$0.0002	15.7s	0%
65	Cohere Command R+ (Aug. 2024)	13.4%	$0.0054	12.4s	0%
66	Gemma 3 4B	6.8%	$0.0000	5.5s	0%
67	Mistral NeMO	7.0%	$0.0001	6.6s	0%
68	Writer: Palmyra X5	10.9%	$0.0038	12.6s	0%
69	Gemma 3 27B	7.3%	$0.0001	15.7s	0%
70	Rocinante 12B	10.5%	$0.0003	25.1s	0%
71	Mistral Small Creative	2.7%	$0.0002	3.8s	0%
72	Mistral Large 2	3.9%	$0.0031	13.0s	0%
73	Z.AI GLM 4.7 Flash	20.9%	$0.0014	1.1m	0%
74	Z.AI GLM 4.7	43.6%	$0.0069	2.4m	4%
75	ByteDance Seed 1.6	25.6%	$0.0073	1.4m	0%
76	WizardLM 2 8x22b	0.0%	$0.0007	22.8s	0%
77	Z.AI GLM 4.6	15.7%	$0.0044	1.3m	0%
78	Z.AI GLM 5	24.2%	$0.010	1.8m	0%
79	MoonshotAI: Kimi K2.5	45.0%	$0.024	3.2m	5%
80	Qwen 3.5 397B A17B	63.3%	$0.039	4.9m	7%
39.30%

Individual Scenarios

dialogue-200

▼

Write 200 words with 10% dialogue

Model	# 1	# 2	# 3	# 4	# 5	# 6	# 7	# 8	# 9	# 10	Avg ▼
Gemini 3.1 Pro (Preview)	100	100	100	100	100	100	100	100	100	100	100.0%
Stealth: Aurora Alpha	100	100	100	100	100	100	100	100	100	100	100.0%
Qwen 3.5 397B A17B	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5 Nano	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5.2	100	100	100	100	100	100	100	100	100	100	99.9%
GPT-5 Mini	100	100	100	100	100	100	100	100	100	99	99.9%
GPT-5.1	100	100	100	100	100	100	100	100	99	99	99.8%
Claude Opus 4.5	100	100	100	100	100	100	100	100	99	99	99.8%
o4 Mini	100	100	100	100	100	100	100	100	100	98	99.7%
o4 Mini High	100	100	100	100	100	100	100	100	100	96	99.6%
Claude Sonnet 4.6	100	100	100	100	100	100	100	99	99	96	99.4%
GPT-4o Mini (temp=0)	100	100	100	100	100	100	100	100	99	90	98.9%
Minimax M2.5	100	100	100	100	100	100	100	100	100	86	98.6%
GPT-4o Mini (temp=1)	100	100	100	100	100	100	99	96	90	86	97.1%
Grok 4.1 Fast	100	100	100	100	99	98	94	90	90	86	95.7%
GPT-4.1	100	100	100	100	100	99	99	99	86	68	95.2%
Claude Opus 4.6	100	100	100	100	99	98	98	90	81	81	94.7%
GPT-4o, Aug. 6th (temp=1)	100	99	99	99	99	96	94	86	86	86	94.5%
GPT-4o, Aug. 6th (temp=0)	100	100	100	100	100	99	99	98	96	52	94.4%
MoonshotAI: Kimi K2.5	100	100	100	100	100	100	98	94	75	68	93.4%
Gemini 3 Flash (Preview)	100	100	100	99	96	96	94	94	94	60	93.2%
Claude Opus 4	100	100	100	100	100	100	100	99	81	52	93.2%
Claude Sonnet 4.5	100	100	100	100	100	96	96	90	75	68	92.5%
Claude Haiku 4.5	100	100	100	99	99	98	98	98	75	27	89.3%
Grok 4	100	100	100	100	100	100	99	98	86	0	88.2%
Claude Sonnet 4	100	100	100	100	100	96	90	75	68	20	84.9%
GPT-4.1 Nano	100	100	99	99	96	90	86	68	52	43	83.3%
Llama 3.1 70B	100	100	99	98	94	86	81	75	68	27	82.8%
Grok 4 Fast	100	98	98	94	94	81	81	75	43	35	79.9%
Claude 3.5 Haiku	99	90	86	81	75	75	75	75	68	52	77.8%
Claude 3 Haiku	99	99	98	98	98	94	90	52	14	0	74.1%
Gemini 3 Pro (Preview)	100	100	100	100	94	90	90	43	14	0	73.3%
GPT-4.1 Mini	100	100	100	94	94	90	86	27	27	0	71.8%
Gemini 2.5 Pro	100	100	99	98	96	86	60	43	14	0	69.7%
Z.AI GLM 4.7	100	100	100	99	98	96	68	27	0	0	68.8%
Arcee AI: Trinity Large (Preview)	99	99	99	98	96	86	68	27	14	0	68.7%
DeepSeek V3 (2025-03-24)	100	100	99	99	86	81	75	43	0	0	68.4%
DeepSeek V3.1	100	99	94	86	81	75	68	60	14	6	68.4%
Gemma 3 12B	100	98	96	96	68	60	52	20	20	20	63.0%
Gemini 2.5 Flash	100	100	99	90	68	60	60	52	0	0	63.0%
Llama 3.1 8B	100	100	99	99	98	81	35	2	0	0	61.4%
Qwen 3.5 Plus (2026-02-15)	100	100	86	81	68	68	52	14	1	0	57.1%
GPT-4o, May 13th (temp=1)	100	100	99	96	81	81	6	0	0	0	56.4%
Z.AI GLM 4.5	99	96	96	96	75	60	35	0	0	0	55.7%
Hermes 3 405B	100	100	90	81	81	68	20	10	0	0	55.1%
Claude 3.5 Sonnet	100	99	90	75	52	43	43	10	10	0	52.2%
DeepSeek V3.2	100	100	96	96	75	43	0	0	0	0	51.1%
Ministral 3 3B	100	100	99	98	96	10	0	0	0	0	50.2%
Gemini 2.5 Flash Lite	100	100	99	99	96	0	0	0	0	0	49.4%
DeepSeek V3 (2024-12-26)	100	99	99	94	52	10	4	0	0	0	45.7%
Mistral Large	100	100	98	81	43	27	0	0	0	0	44.9%
DeepSeek-V2 Chat	99	98	94	52	52	35	10	0	0	0	43.9%
GPT-4o, May 13th (temp=0)	99	98	98	81	43	14	0	0	0	0	43.4%
Qwen 2.5 72B	100	100	90	86	43	0	0	0	0	0	42.1%
Hermes 3 70B	100	98	98	75	14	2	0	0	0	0	38.7%
Mistral Small 3.2 24B	99	86	81	52	35	14	2	0	0	0	37.0%
Mistral Large 3	100	100	90	75	0	0	0	0	0	0	36.5%
Claude 3.7 Sonnet	75	75	68	43	14	14	14	10	10	0	32.4%
Llama 3.1 Nemotron 70B	100	94	68	35	10	0	0	0	0	0	30.6%
Z.AI GLM 5	100	75	68	52	10	0	0	0	0	0	30.5%
Gemma 3 4B	100	99	60	20	6	4	1	0	0	0	29.0%
Mistral Medium 3.1	96	75	68	35	4	2	0	0	0	0	28.0%
ByteDance Seed 1.6	99	98	68	2	1	0	0	0	0	0	26.8%
Z.AI GLM 4.6	98	90	52	20	0	0	0	0	0	0	26.1%
Gemma 3 27B	94	90	43	14	2	0	0	0	0	0	24.4%
Ministral 3 8B	100	96	35	0	0	0	0	0	0	0	23.1%
Z.AI GLM 4.7 Flash	100	94	35	0	0	0	0	0	0	0	22.9%
Ministral 3B	90	35	35	35	6	0	0	0	0	0	20.2%
Mistral NeMO	96	68	0	0	0	0	0	0	0	0	16.5%
ByteDance Seed 1.6 Flash	81	68	0	0	0	0	0	0	0	0	14.9%
Rocinante 12B	98	43	0	0	0	0	0	0	0	0	14.1%
Ministral 8B	99	35	0	0	0	0	0	0	0	0	13.4%
Mistral Large 2	43	35	10	1	0	0	0	0	0	0	8.9%
Ministral 3 14B	52	4	0	0	0	0	0	0	0	0	5.6%
Writer: Palmyra X5	52	2	0	0	0	0	0	0	0	0	5.4%
Cohere Command R+ (Aug. 2024)	20	0	0	0	0	0	0	0	0	0	2.1%
Mistral Small Creative	4	0	0	0	0	0	0	0	0	0	0.4%
WizardLM 2 8x22b	0	0	0	0	0	0	0	0	0	0	0.0%
Arcee AI: Trinity Mini	0	0	0	0	0	0	0	0	0	0	0.0%

▼

Write 200 words with 50% dialogue

Model	# 1	# 2	# 3	# 4	# 5	# 6	# 7	# 8	# 9	# 10	Avg ▼
Gemini 3.1 Pro (Preview)	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5 Mini	100	100	100	100	100	100	100	100	100	100	100.0%
Minimax M2.5	100	100	100	100	100	100	100	100	100	100	100.0%
Stealth: Aurora Alpha	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5.2	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5 Nano	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5.1	100	100	100	100	100	100	100	100	100	99	99.9%
Claude Opus 4.6	100	100	100	100	100	100	100	100	100	99	99.8%
GPT-5	100	100	100	100	100	100	100	100	99	99	99.8%
o4 Mini High	100	100	100	100	100	100	100	100	100	96	99.6%
GPT-4o, Aug. 6th (temp=1)	100	100	100	100	100	100	100	100	99	96	99.4%
GPT-4o Mini (temp=1)	100	100	100	100	100	100	100	99	99	96	99.4%
o4 Mini	100	100	100	100	100	100	100	100	98	81	97.9%
Qwen 3.5 397B A17B	100	100	100	100	100	100	100	99	99	75	97.2%
Claude Opus 4.5	100	100	99	99	99	99	98	96	90	90	97.1%
Gemini 3 Pro (Preview)	100	100	100	100	96	96	96	96	90	75	95.0%
GPT-4o, Aug. 6th (temp=0)	100	100	100	100	100	99	98	98	90	43	92.8%
GPT-4.1	100	100	100	100	100	100	100	99	99	27	92.5%
Grok 4.1 Fast	100	100	100	100	100	100	100	99	98	14	91.1%
Claude Sonnet 4.6	99	99	99	96	96	94	90	86	86	60	90.6%
GPT-4o Mini (temp=0)	100	100	100	99	99	96	86	86	68	60	89.5%
DeepSeek-V2 Chat	100	100	100	100	100	100	96	96	86	0	87.8%
Gemini 3 Flash (Preview)	100	100	100	99	99	96	94	68	60	43	85.9%
Arcee AI: Trinity Large (Preview)	100	100	100	98	94	86	86	86	75	20	84.5%
GPT-4.1 Nano	100	100	100	99	99	99	94	90	60	1	84.2%
Claude 3 Haiku	100	100	99	99	81	81	75	75	43	27	78.1%
GPT-4.1 Mini	100	99	98	94	90	86	81	68	35	0	75.1%
Mistral Medium 3.1	100	100	100	100	100	99	96	14	1	1	71.1%
Z.AI GLM 4.7	100	100	100	98	98	94	90	20	10	0	70.9%
MoonshotAI: Kimi K2.5	100	99	86	86	86	75	68	52	43	0	69.7%
DeepSeek V3 (2024-12-26)	100	100	99	96	94	81	60	43	20	0	69.4%
Claude Opus 4	100	99	99	96	94	90	68	35	6	2	68.9%
Llama 3.1 70B	100	99	99	98	90	86	43	35	27	6	68.3%
Mistral Large	100	100	100	100	100	99	75	2	0	0	67.7%
Gemini 2.5 Pro	96	96	94	90	90	86	75	35	2	0	66.5%
GPT-4o, May 13th (temp=1)	100	100	100	99	98	90	75	0	0	0	66.3%
Llama 3.1 8B	100	100	99	98	96	86	68	6	0	0	65.3%
Grok 4	100	100	100	100	99	60	52	35	6	0	65.2%
Hermes 3 405B	94	81	81	81	75	68	52	52	52	4	64.0%
DeepSeek V3 (2025-03-24)	100	100	99	98	68	52	43	43	27	0	63.0%
GPT-4o, May 13th (temp=0)	100	100	99	94	81	68	68	0	0	0	61.1%
Claude Haiku 4.5	98	96	90	81	81	60	52	35	14	0	60.9%
ByteDance Seed 1.6	100	100	99	99	99	98	10	0	0	0	60.4%
DeepSeek V3.1	100	100	99	94	81	68	43	2	0	0	58.7%
Z.AI GLM 4.6	100	100	99	99	96	60	20	2	0	0	57.7%
Mistral Large 3	100	99	96	86	75	60	35	10	0	0	56.2%
DeepSeek V3.2	96	86	81	81	52	43	35	27	20	10	53.2%
Mistral Small 3.2 24B	100	100	100	90	52	52	0	0	0	0	49.4%
Qwen 2.5 72B	100	99	99	98	52	20	14	10	2	0	49.4%
Claude 3.5 Haiku	100	96	86	75	75	14	14	14	6	0	48.2%
Gemini 2.5 Flash Lite	100	98	94	86	81	0	0	0	0	0	45.9%
Z.AI GLM 4.7 Flash	100	100	100	94	27	0	0	0	0	0	42.1%
Claude 3.7 Sonnet	90	81	68	35	35	27	10	6	4	0	35.7%
Grok 4 Fast	96	96	60	35	27	14	10	0	0	0	33.8%
Hermes 3 70B	100	100	43	43	27	20	2	0	0	0	33.6%
Claude 3.5 Sonnet	86	75	68	43	35	14	10	4	0	0	33.6%
Writer: Palmyra X5	100	94	75	27	1	0	0	0	0	0	29.7%
Gemini 2.5 Flash	100	100	43	35	2	2	0	0	0	0	28.2%
Qwen 3.5 Plus (2026-02-15)	100	75	43	27	20	4	0	0	0	0	27.0%
Ministral 3B	96	81	52	27	0	0	0	0	0	0	25.6%
Claude Sonnet 4.5	90	43	43	35	20	10	6	4	4	0	25.6%
ByteDance Seed 1.6 Flash	100	100	43	4	0	0	0	0	0	0	24.7%
Z.AI GLM 5	75	68	43	14	6	0	0	0	0	0	20.7%
Ministral 8B	98	96	4	4	0	0	0	0	0	0	20.1%
Claude Sonnet 4	68	35	27	27	20	14	1	0	0	0	19.4%
Ministral 3 14B	94	86	0	0	0	0	0	0	0	0	18.0%
Z.AI GLM 4.5	68	35	20	14	6	0	0	0	0	0	14.4%
Llama 3.1 Nemotron 70B	99	27	10	0	0	0	0	0	0	0	13.6%
Gemma 3 12B	98	14	6	1	1	1	0	0	0	0	12.1%
Arcee AI: Trinity Mini	100	0	0	0	0	0	0	0	0	0	10.0%
Rocinante 12B	94	0	0	0	0	0	0	0	0	0	9.4%
Cohere Command R+ (Aug. 2024)	68	10	2	1	0	0	0	0	0	0	8.1%
Mistral NeMO	75	0	0	0	0	0	0	0	0	0	7.5%
Mistral Small Creative	60	6	4	0	0	0	0	0	0	0	7.0%
Ministral 3 3B	20	14	14	10	2	0	0	0	0	0	6.1%
Gemma 3 27B	27	2	0	0	0	0	0	0	0	0	2.9%
Ministral 3 8B	1	0	0	0	0	0	0	0	0	0	0.1%
Mistral Large 2	0	0	0	0	0	0	0	0	0	0	0.0%
Gemma 3 4B	0	0	0	0	0	0	0	0	0	0	0.0%
WizardLM 2 8x22b	0	0	0	0	0	0	0	0	0	0	0.0%

▼

Write 200 words with 90% dialogue

Model	# 1	# 2	# 3	# 4	# 5	# 6	# 7	# 8	# 9	# 10	Avg ▼
Gemini 3.1 Pro (Preview)	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5 Mini	100	100	100	100	100	100	100	100	99	98	99.7%
o4 Mini High	100	100	100	100	100	100	99	99	99	98	99.5%
GPT-5.2	100	100	100	100	100	100	100	100	100	94	99.3%
GPT-4o, Aug. 6th (temp=0)	100	100	100	100	100	100	99	99	99	96	99.1%
Minimax M2.5	100	100	100	100	100	100	100	100	99	90	99.0%
Claude Opus 4.6	100	100	100	100	99	99	99	99	98	81	97.4%
GPT-4o Mini (temp=0)	100	100	100	100	100	99	99	98	96	81	97.3%
Qwen 3.5 397B A17B	100	100	100	100	100	100	100	100	90	81	97.2%
GPT-4o Mini (temp=1)	100	100	100	100	100	100	99	99	96	52	94.6%
GPT-4.1	100	100	99	99	99	96	96	96	68	68	92.1%
GPT-4o, Aug. 6th (temp=1)	100	100	99	99	96	96	94	86	75	60	90.5%
GPT-5 Nano	100	100	100	100	100	100	100	100	100	0	90.0%
GPT-5.1	100	100	100	100	100	100	100	94	90	14	89.8%
GPT-5	100	100	100	100	100	99	99	96	90	4	88.8%
GPT-4o, May 13th (temp=0)	100	100	100	100	100	100	99	99	68	0	86.6%
Claude Opus 4	99	99	99	99	98	98	90	86	68	6	84.2%
Claude Opus 4.5	99	98	98	98	96	96	90	75	35	10	79.4%
Stealth: Aurora Alpha	100	100	100	100	100	100	100	94	0	0	79.4%
Gemini 3 Flash (Preview)	100	100	99	94	90	86	81	68	27	27	77.4%
Grok 4.1 Fast	100	100	100	99	99	98	98	35	27	6	76.1%
Z.AI GLM 4.7	100	100	99	94	90	86	81	35	0	0	68.6%
o4 Mini	100	100	100	100	96	68	52	43	10	0	66.9%
Grok 4	100	100	100	100	98	94	35	35	2	0	66.3%
Llama 3.1 70B	100	100	90	90	86	81	52	52	6	0	65.8%
MoonshotAI: Kimi K2.5	100	100	94	94	90	75	68	20	6	0	64.7%
Claude Sonnet 4.6	99	86	75	68	68	60	52	52	35	35	63.1%
DeepSeek V3.2	100	99	99	98	96	86	43	0	0	0	62.2%
Arcee AI: Trinity Large (Preview)	100	98	90	86	86	68	52	20	20	0	62.1%
Mistral Medium 3.1	100	99	96	81	75	75	60	20	10	0	61.6%
Ministral 8B	100	100	100	96	90	75	35	2	0	0	59.9%
Llama 3.1 8B	100	96	94	90	81	52	43	35	0	0	59.2%
DeepSeek V3.1	100	100	99	81	75	68	43	6	0	0	57.3%
Claude 3.5 Sonnet	100	94	86	75	75	52	43	35	4	0	56.4%
GPT-4.1 Nano	100	99	94	86	81	43	27	27	4	0	56.2%
GPT-4o, May 13th (temp=1)	100	100	96	68	68	52	52	10	10	0	55.5%
Hermes 3 405B	100	90	86	81	68	52	27	20	14	0	54.0%
Mistral Large	100	100	96	81	81	75	1	0	0	0	53.4%
Hermes 3 70B	100	100	96	90	43	43	27	27	4	0	53.1%
Gemini 2.5 Flash Lite	90	75	75	75	68	52	35	35	0	0	50.6%
GPT-4.1 Mini	100	100	99	98	52	43	10	0	0	0	50.1%
Z.AI GLM 5	100	100	100	81	60	43	10	4	1	0	49.9%
Claude Haiku 4.5	100	96	86	75	75	35	20	10	1	0	49.9%
ByteDance Seed 1.6	99	96	94	81	75	27	14	0	0	0	48.7%
DeepSeek V3 (2025-03-24)	100	100	98	98	60	10	0	0	0	0	46.6%
Claude 3 Haiku	100	99	94	75	43	35	14	0	0	0	46.0%
DeepSeek-V2 Chat	100	86	86	75	68	43	0	0	0	0	45.9%
Qwen 2.5 72B	100	100	99	99	43	6	1	0	0	0	44.9%
DeepSeek V3 (2024-12-26)	100	100	96	68	60	10	10	4	0	0	44.7%
Gemini 2.5 Flash	100	99	96	75	52	0	0	0	0	0	42.2%
Gemini 3 Pro (Preview)	100	98	94	86	10	10	6	2	0	0	40.5%
Grok 4 Fast	100	96	86	68	20	14	4	2	0	0	39.1%
Ministral 3 14B	100	90	86	52	27	10	0	0	0	0	36.7%
Mistral Small 3.2 24B	99	98	81	60	10	0	0	0	0	0	34.8%
Claude 3.7 Sonnet	90	68	35	35	27	20	10	4	4	0	29.3%
Z.AI GLM 4.7 Flash	100	90	86	10	0	0	0	0	0	0	28.7%
Qwen 3.5 Plus (2026-02-15)	68	60	60	52	27	14	2	1	0	0	28.5%
Ministral 3 3B	96	94	35	14	2	0	0	0	0	0	24.1%
Gemini 2.5 Pro	86	81	27	27	0	0	0	0	0	0	22.2%
Mistral Large 3	98	52	27	27	1	0	0	0	0	0	20.5%
Llama 3.1 Nemotron 70B	99	68	10	6	2	2	2	0	0	0	19.0%
ByteDance Seed 1.6 Flash	100	81	6	0	0	0	0	0	0	0	18.7%
Writer: Palmyra X5	86	86	6	1	1	0	0	0	0	0	18.1%
Z.AI GLM 4.5	86	52	20	0	0	0	0	0	0	0	15.9%
Ministral 3B	75	60	0	0	0	0	0	0	0	0	13.5%
Claude Sonnet 4.5	75	35	14	6	2	0	0	0	0	0	13.3%
Gemma 3 12B	86	27	4	4	0	0	0	0	0	0	12.1%
Claude Sonnet 4	52	43	6	6	4	4	2	1	0	0	11.8%
Ministral 3 8B	100	2	0	0	0	0	0	0	0	0	10.2%
Mistral Small Creative	43	35	6	0	0	0	0	0	0	0	8.4%
Claude 3.5 Haiku	35	27	10	4	2	1	1	0	0	0	8.0%
Z.AI GLM 4.6	60	4	2	2	0	0	0	0	0	0	6.8%
Rocinante 12B	43	20	0	0	0	0	0	0	0	0	6.4%
Cohere Command R+ (Aug. 2024)	20	0	0	0	0	0	0	0	0	0	2.0%
Mistral Large 2	6	0	0	0	0	0	0	0	0	0	0.6%
Arcee AI: Trinity Mini	4	0	0	0	0	0	0	0	0	0	0.4%
Gemma 3 27B	2	0	0	0	0	0	0	0	0	0	0.2%
Mistral NeMO	0	0	0	0	0	0	0	0	0	0	0.0%
Gemma 3 4B	0	0	0	0	0	0	0	0	0	0	0.0%
WizardLM 2 8x22b	0	0	0	0	0	0	0	0	0	0	0.0%

dialogue-500

▼

Write 500 words with 30% dialogue

Model	# 1	# 2	# 3	# 4	# 5	# 6	# 7	# 8	# 9	# 10	Avg ▼
Claude Sonnet 4.6	100	100	100	100	100	100	99	99	96	90	98.3%
Gemini 3.1 Pro (Preview)	100	100	100	100	100	100	100	100	100	20	92.0%
Claude Opus 4.5	100	100	100	100	99	99	96	94	90	20	89.9%
o4 Mini High	100	100	100	100	100	100	99	90	81	0	87.1%
Minimax M2.5	100	100	100	100	100	96	94	90	90	0	87.1%
GPT-5 Mini	100	100	100	100	100	99	99	98	60	0	85.6%
GPT-5	100	100	100	100	99	99	98	96	0	0	79.2%
Claude 3.7 Sonnet	100	100	99	86	86	81	75	35	0	0	66.3%
Stealth: Aurora Alpha	100	100	100	100	100	90	20	0	0	0	61.1%
o4 Mini	100	100	100	100	98	52	35	14	6	0	60.5%
GPT-4o, Aug. 6th (temp=0)	99	86	86	86	86	81	68	10	0	0	60.4%
Claude Opus 4	100	100	99	98	68	68	43	10	0	0	58.6%
Grok 4	96	81	81	75	68	60	60	43	4	0	56.9%
Gemini 3 Flash (Preview)	100	100	100	98	68	60	10	0	0	0	53.6%
Gemma 3 12B	100	100	98	98	68	27	1	0	0	0	49.1%
GPT-4o Mini (temp=0)	100	100	94	43	43	35	27	27	20	0	49.0%
Claude Haiku 4.5	100	99	81	75	68	6	0	0	0	0	42.9%
Hermes 3 405B	100	99	90	75	27	20	0	0	0	0	41.3%
Grok 4 Fast	100	99	96	52	43	20	0	0	0	0	41.0%
Qwen 3.5 397B A17B	100	99	98	96	14	0	0	0	0	0	40.7%
Claude Opus 4.6	99	99	94	35	27	27	0	0	0	0	38.1%
DeepSeek V3 (2024-12-26)	100	94	90	81	0	0	0	0	0	0	36.5%
Arcee AI: Trinity Mini	100	96	90	68	0	0	0	0	0	0	35.4%
Mistral Medium 3.1	100	100	81	68	4	0	0	0	0	0	35.3%
Gemini 2.5 Flash Lite	100	94	90	60	0	0	0	0	0	0	34.4%
GPT-5 Nano	100	99	99	10	0	0	0	0	0	0	30.8%
Mistral Large 3	98	81	52	52	20	0	0	0	0	0	30.3%
Gemini 2.5 Pro	99	94	81	27	0	0	0	0	0	0	30.2%
Z.AI GLM 4.7 Flash	100	100	90	0	0	0	0	0	0	0	29.0%
Grok 4.1 Fast	100	86	68	0	0	0	0	0	0	0	25.4%
Z.AI GLM 5	99	90	20	10	0	0	0	0	0	0	22.0%
Z.AI GLM 4.7	96	86	27	0	0	0	0	0	0	0	21.1%
MoonshotAI: Kimi K2.5	94	81	35	0	0	0	0	0	0	0	21.0%
Ministral 3 8B	100	100	10	0	0	0	0	0	0	0	21.0%
GPT-5.1	100	94	0	0	0	0	0	0	0	0	19.4%
Gemini 3 Pro (Preview)	100	86	0	0	0	0	0	0	0	0	18.6%
Claude Sonnet 4.5	90	52	14	14	10	0	0	0	0	0	18.1%
Gemma 3 27B	100	60	1	0	0	0	0	0	0	0	16.1%
DeepSeek-V2 Chat	99	52	4	2	0	0	0	0	0	0	15.6%
Cohere Command R+ (Aug. 2024)	81	60	10	0	0	0	0	0	0	0	15.1%
Claude 3 Haiku	100	43	2	0	0	0	0	0	0	0	14.6%
Gemma 3 4B	90	27	0	0	0	0	0	0	0	0	11.8%
GPT-4o, Aug. 6th (temp=1)	86	27	4	0	0	0	0	0	0	0	11.8%
Ministral 3 3B	100	14	0	0	0	0	0	0	0	0	11.4%
Claude Sonnet 4	86	10	10	1	0	0	0	0	0	0	10.7%
Gemini 2.5 Flash	100	1	0	0	0	0	0	0	0	0	10.1%
Llama 3.1 8B	100	0	0	0	0	0	0	0	0	0	10.0%
GPT-4o Mini (temp=1)	81	14	4	0	0	0	0	0	0	0	9.9%
DeepSeek V3 (2025-03-24)	98	0	0	0	0	0	0	0	0	0	9.8%
DeepSeek V3.1	98	0	0	0	0	0	0	0	0	0	9.8%
Qwen 2.5 72B	94	4	0	0	0	0	0	0	0	0	9.7%
Ministral 8B	96	0	0	0	0	0	0	0	0	0	9.6%
GPT-5.2	90	0	0	0	0	0	0	0	0	0	9.0%
GPT-4.1 Mini	90	0	0	0	0	0	0	0	0	0	9.0%
Ministral 3B	90	0	0	0	0	0	0	0	0	0	9.0%
DeepSeek V3.2	86	0	0	0	0	0	0	0	0	0	8.6%
GPT-4.1	81	1	0	0	0	0	0	0	0	0	8.2%
Llama 3.1 Nemotron 70B	75	0	0	0	0	0	0	0	0	0	7.5%
Mistral Small 3.2 24B	68	0	0	0	0	0	0	0	0	0	6.9%
ByteDance Seed 1.6	68	0	0	0	0	0	0	0	0	0	6.8%
Mistral Large	43	10	0	0	0	0	0	0	0	0	5.3%
Hermes 3 70B	52	0	0	0	0	0	0	0	0	0	5.2%
Mistral Large 2	52	0	0	0	0	0	0	0	0	0	5.2%
Llama 3.1 70B	35	14	2	0	0	0	0	0	0	0	5.1%
Z.AI GLM 4.6	35	0	0	0	0	0	0	0	0	0	3.5%
Claude 3.5 Sonnet	20	10	0	0	0	0	0	0	0	0	3.0%
Z.AI GLM 4.5	27	0	0	0	0	0	0	0	0	0	2.7%
Ministral 3 14B	20	0	0	0	0	0	0	0	0	0	2.0%
ByteDance Seed 1.6 Flash	10	0	0	0	0	0	0	0	0	0	1.0%
Mistral Small Creative	6	0	0	0	0	0	0	0	0	0	0.6%
Rocinante 12B	2	0	0	0	0	0	0	0	0	0	0.2%
Mistral NeMO	0	0	0	0	0	0	0	0	0	0	0.0%
GPT-4o, May 13th (temp=1)	0	0	0	0	0	0	0	0	0	0	0.0%
Claude 3.5 Haiku	0	0	0	0	0	0	0	0	0	0	0.0%
Writer: Palmyra X5	0	0	0	0	0	0	0	0	0	0	0.0%
WizardLM 2 8x22b	0	0	0	0	0	0	0	0	0	0	0.0%
Arcee AI: Trinity Large (Preview)	0	0	0	0	0	0	0	0	0	0	0.0%
Qwen 3.5 Plus (2026-02-15)	0	0	0	0	0	0	0	0	0	0	0.0%
GPT-4.1 Nano	0	0	0	0	0	0	0	0	0	0	0.0%
GPT-4o, May 13th (temp=0)	0	0	0	0	0	0	0	0	0	0	0.0%

▼

Write 500 words with 50% dialogue

Model	# 1	# 2	# 3	# 4	# 5	# 6	# 7	# 8	# 9	# 10	Avg ▼
Gemini 3.1 Pro (Preview)	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5 Mini	100	100	100	100	100	100	100	100	100	98	99.8%
GPT-5	100	100	100	100	100	100	100	100	99	94	99.3%
Claude Opus 4.6	100	100	100	100	100	100	99	99	99	68	96.5%
Claude Sonnet 4.6	100	98	90	90	90	90	86	81	75	0	80.3%
o4 Mini	100	100	100	99	99	98	86	81	0	0	76.4%
o4 Mini High	100	100	100	100	100	100	99	14	0	0	71.4%
Minimax M2.5	100	100	100	100	100	100	100	6	0	0	70.6%
Claude 3.7 Sonnet	100	99	98	96	81	60	52	4	2	0	59.2%
GPT-4o Mini (temp=0)	100	94	94	94	81	68	14	4	0	0	54.8%
Claude Opus 4	100	99	94	94	86	35	20	14	1	0	54.3%
Grok 4 Fast	100	100	100	100	99	20	4	0	0	0	52.3%
Claude Opus 4.5	100	100	99	81	43	35	35	20	4	0	51.7%
Grok 4	100	94	86	60	43	43	2	0	0	0	42.9%
Arcee AI: Trinity Mini	99	99	96	60	52	10	0	0	0	0	41.6%
Gemini 2.5 Flash Lite	99	99	86	81	20	14	0	0	0	0	40.0%
Stealth: Aurora Alpha	100	100	100	94	2	0	0	0	0	0	39.6%
GPT-4.1	100	96	68	52	43	6	0	0	0	0	36.6%
Qwen 3.5 397B A17B	100	94	86	68	0	0	0	0	0	0	34.8%
Claude Haiku 4.5	99	94	90	52	10	0	0	0	0	0	34.5%
Gemini 2.5 Flash	99	90	86	27	0	0	0	0	0	0	30.3%
Cohere Command R+ (Aug. 2024)	96	94	90	1	0	0	0	0	0	0	28.1%
GPT-5 Nano	100	100	68	0	0	0	0	0	0	0	26.8%
GPT-5.1	99	94	68	0	0	0	0	0	0	0	26.0%
GPT-4o Mini (temp=1)	99	81	68	1	0	0	0	0	0	0	25.0%
GPT-4o, Aug. 6th (temp=1)	100	81	52	14	1	0	0	0	0	0	24.9%
Gemini 3 Flash (Preview)	96	86	43	0	0	0	0	0	0	0	22.6%
Llama 3.1 8B	68	60	43	43	0	0	0	0	0	0	21.5%
Mistral Medium 3.1	100	100	14	0	0	0	0	0	0	0	21.4%
Mistral Large	100	99	4	0	0	0	0	0	0	0	20.3%
Gemini 2.5 Pro	100	96	0	0	0	0	0	0	0	0	19.6%
Gemini 3 Pro (Preview)	96	81	10	0	0	0	0	0	0	0	18.7%
Hermes 3 70B	75	68	35	0	0	0	0	0	0	0	17.8%
Z.AI GLM 4.7	90	43	35	0	0	0	0	0	0	0	16.9%
Llama 3.1 70B	100	68	0	0	0	0	0	0	0	0	16.8%
DeepSeek V3 (2024-12-26)	86	35	20	14	0	0	0	0	0	0	15.6%
Rocinante 12B	100	27	0	0	0	0	0	0	0	0	12.7%
Mistral Large 3	98	20	6	0	0	0	0	0	0	0	12.4%
MoonshotAI: Kimi K2.5	100	20	0	0	0	0	0	0	0	0	12.1%
Grok 4.1 Fast	100	6	1	0	0	0	0	0	0	0	10.7%
Gemma 3 12B	60	43	0	0	0	0	0	0	0	0	10.4%
DeepSeek V3 (2025-03-24)	60	43	0	0	0	0	0	0	0	0	10.4%
GPT-5.2	100	0	0	0	0	0	0	0	0	0	10.0%
Ministral 3 3B	99	0	0	0	0	0	0	0	0	0	9.9%
DeepSeek-V2 Chat	90	6	0	0	0	0	0	0	0	0	9.7%
Hermes 3 405B	96	0	0	0	0	0	0	0	0	0	9.6%
DeepSeek V3.1	60	35	0	0	0	0	0	0	0	0	9.5%
ByteDance Seed 1.6 Flash	94	0	0	0	0	0	0	0	0	0	9.4%
Arcee AI: Trinity Large (Preview)	90	0	0	0	0	0	0	0	0	0	9.0%
Ministral 3 8B	86	1	0	0	0	0	0	0	0	0	8.7%
Claude Sonnet 4	86	0	0	0	0	0	0	0	0	0	8.6%
Claude Sonnet 4.5	75	6	4	0	0	0	0	0	0	0	8.5%
GPT-4.1 Mini	75	6	0	0	0	0	0	0	0	0	8.1%
Claude 3 Haiku	75	2	0	0	0	0	0	0	0	0	7.7%
Z.AI GLM 5	68	0	0	0	0	0	0	0	0	0	6.8%
Writer: Palmyra X5	60	0	0	0	0	0	0	0	0	0	6.0%
Mistral Small 3.2 24B	60	0	0	0	0	0	0	0	0	0	6.0%
Z.AI GLM 4.5	35	0	0	0	0	0	0	0	0	0	3.5%
Z.AI GLM 4.7 Flash	27	0	0	0	0	0	0	0	0	0	2.7%
ByteDance Seed 1.6	20	0	0	0	0	0	0	0	0	0	2.0%
Mistral Large 2	20	0	0	0	0	0	0	0	0	0	2.0%
DeepSeek V3.2	1	0	0	0	0	0	0	0	0	0	0.1%
GPT-4o, Aug. 6th (temp=0)	0	0	0	0	0	0	0	0	0	0	0.0%
Claude 3.5 Sonnet	0	0	0	0	0	0	0	0	0	0	0.0%
Mistral NeMO	0	0	0	0	0	0	0	0	0	0	0.0%
Ministral 3B	0	0	0	0	0	0	0	0	0	0	0.0%
Qwen 2.5 72B	0	0	0	0	0	0	0	0	0	0	0.0%
Ministral 8B	0	0	0	0	0	0	0	0	0	0	0.0%
Ministral 3 14B	0	0	0	0	0	0	0	0	0	0	0.0%
Gemma 3 4B	0	0	0	0	0	0	0	0	0	0	0.0%
Qwen 3.5 Plus (2026-02-15)	0	0	0	0	0	0	0	0	0	0	0.0%
WizardLM 2 8x22b	0	0	0	0	0	0	0	0	0	0	0.0%
GPT-4.1 Nano	0	0	0	0	0	0	0	0	0	0	0.0%
GPT-4o, May 13th (temp=0)	0	0	0	0	0	0	0	0	0	0	0.0%
Llama 3.1 Nemotron 70B	0	0	0	0	0	0	0	0	0	0	0.0%
Gemma 3 27B	0	0	0	0	0	0	0	0	0	0	0.0%
Claude 3.5 Haiku	0	0	0	0	0	0	0	0	0	0	0.0%
GPT-4o, May 13th (temp=1)	0	0	0	0	0	0	0	0	0	0	0.0%
Mistral Small Creative	0	0	0	0	0	0	0	0	0	0	0.0%
Z.AI GLM 4.6	0	0	0	0	0	0	0	0	0	0	0.0%

▼

Write 500 words with 70% dialogue

Model	# 1	# 2	# 3	# 4	# 5	# 6	# 7	# 8	# 9	# 10	Avg ▼
Gemini 3.1 Pro (Preview)	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5 Mini	100	100	100	100	100	99	99	99	98	0	89.4%
Claude 3.7 Sonnet	100	100	100	99	98	98	90	81	52	43	86.1%
Claude Opus 4.6	100	100	100	99	90	81	60	52	35	35	75.3%
Minimax M2.5	100	100	100	100	100	99	99	52	1	0	75.0%
GPT-5	100	100	99	98	98	96	90	0	0	0	68.0%
GPT-4o, Aug. 6th (temp=0)	100	100	98	96	68	52	52	52	52	0	66.9%
GPT-4o Mini (temp=0)	100	100	100	98	81	75	68	27	0	0	64.9%
o4 Mini High	100	100	100	100	100	68	27	14	0	0	60.9%
Gemini 3 Flash (Preview)	100	100	98	94	75	35	35	27	0	0	56.4%
Claude Opus 4.5	100	100	96	90	81	27	20	20	10	6	55.1%
Claude Sonnet 4.6	100	81	75	68	60	60	43	35	20	6	55.0%
Claude Opus 4	96	86	81	75	75	35	35	14	1	0	49.9%
GPT-4o, Aug. 6th (temp=1)	100	100	98	98	86	4	2	0	0	0	48.7%
Grok 4 Fast	100	100	98	90	52	14	10	2	0	0	46.6%
Gemini 2.5 Flash Lite	94	90	86	43	35	20	0	0	0	0	36.9%
Grok 4	90	86	86	81	0	0	0	0	0	0	34.5%
Mistral Large 3	100	99	43	35	0	0	0	0	0	0	27.7%
GPT-4.1	100	86	75	2	0	0	0	0	0	0	26.3%
Stealth: Aurora Alpha	100	81	81	0	0	0	0	0	0	0	26.3%
Cohere Command R+ (Aug. 2024)	100	96	20	20	14	0	0	0	0	0	25.1%
Claude 3.5 Sonnet	98	96	52	0	0	0	0	0	0	0	24.6%
o4 Mini	100	98	20	0	0	0	0	0	0	0	21.8%
Mistral Medium 3.1	75	75	60	4	0	0	0	0	0	0	21.4%
GPT-4o, May 13th (temp=1)	99	60	52	0	0	0	0	0	0	0	21.1%
DeepSeek-V2 Chat	100	100	10	0	0	0	0	0	0	0	21.0%
Rocinante 12B	100	90	14	0	0	0	0	0	0	0	20.5%
DeepSeek V3 (2024-12-26)	75	75	27	20	0	0	0	0	0	0	19.8%
GPT-4o Mini (temp=1)	99	96	2	0	0	0	0	0	0	0	19.7%
Ministral 3 14B	100	96	0	0	0	0	0	0	0	0	19.6%
Llama 3.1 8B	90	86	14	0	0	0	0	0	0	0	19.1%
GPT-4.1 Mini	96	94	0	0	0	0	0	0	0	0	19.0%
Mistral NeMO	100	81	0	0	0	0	0	0	0	0	18.1%
Gemma 3 12B	100	43	27	10	0	0	0	0	0	0	18.0%
Qwen 2.5 72B	99	43	35	2	0	0	0	0	0	0	18.0%
Arcee AI: Trinity Mini	98	81	0	0	0	0	0	0	0	0	17.9%
Gemini 2.5 Pro	90	60	27	0	0	0	0	0	0	0	17.8%
Z.AI GLM 5	81	68	2	2	0	0	0	0	0	0	15.3%
Z.AI GLM 4.7	81	35	35	0	0	0	0	0	0	0	15.1%
Ministral 3 8B	75	52	14	2	1	0	0	0	0	0	14.5%
Mistral Large	68	35	0	0	0	0	0	0	0	0	10.3%
Arcee AI: Trinity Large (Preview)	100	0	0	0	0	0	0	0	0	0	10.0%
GPT-5 Nano	99	0	0	0	0	0	0	0	0	0	10.0%
Qwen 3.5 397B A17B	98	0	0	0	0	0	0	0	0	0	9.8%
Ministral 8B	98	0	0	0	0	0	0	0	0	0	9.8%
Gemini 3 Pro (Preview)	96	0	0	0	0	0	0	0	0	0	9.6%
MoonshotAI: Kimi K2.5	90	0	0	0	0	0	0	0	0	0	9.0%
Claude Haiku 4.5	43	35	10	0	0	0	0	0	0	0	8.8%
Grok 4.1 Fast	86	0	0	0	0	0	0	0	0	0	8.7%
ByteDance Seed 1.6	86	0	0	0	0	0	0	0	0	0	8.6%
DeepSeek V3.1	86	0	0	0	0	0	0	0	0	0	8.6%
Mistral Small 3.2 24B	86	0	0	0	0	0	0	0	0	0	8.6%
DeepSeek V3 (2025-03-24)	75	1	0	0	0	0	0	0	0	0	7.6%
Mistral Large 2	68	0	0	0	0	0	0	0	0	0	6.8%
Ministral 3B	60	0	0	0	0	0	0	0	0	0	6.0%
Gemini 2.5 Flash	60	0	0	0	0	0	0	0	0	0	6.0%
Writer: Palmyra X5	60	0	0	0	0	0	0	0	0	0	6.0%
Hermes 3 70B	43	4	1	0	0	0	0	0	0	0	4.8%
Llama 3.1 70B	43	0	0	0	0	0	0	0	0	0	4.3%
Claude 3 Haiku	27	0	0	0	0	0	0	0	0	0	2.7%
Ministral 3 3B	27	0	0	0	0	0	0	0	0	0	2.7%
GPT-5.1	14	0	0	0	0	0	0	0	0	0	1.4%
Qwen 3.5 Plus (2026-02-15)	6	0	0	0	0	0	0	0	0	0	0.6%
Hermes 3 405B	2	0	0	0	0	0	0	0	0	0	0.2%
Claude Sonnet 4.5	1	0	0	0	0	0	0	0	0	0	0.1%
GPT-4o, May 13th (temp=0)	0	0	0	0	0	0	0	0	0	0	0.0%
GPT-4.1 Nano	0	0	0	0	0	0	0	0	0	0	0.0%
Z.AI GLM 4.5	0	0	0	0	0	0	0	0	0	0	0.0%
Llama 3.1 Nemotron 70B	0	0	0	0	0	0	0	0	0	0	0.0%
Claude Sonnet 4	0	0	0	0	0	0	0	0	0	0	0.0%
DeepSeek V3.2	0	0	0	0	0	0	0	0	0	0	0.0%
Gemma 3 27B	0	0	0	0	0	0	0	0	0	0	0.0%
Z.AI GLM 4.7 Flash	0	0	0	0	0	0	0	0	0	0	0.0%
Z.AI GLM 4.6	0	0	0	0	0	0	0	0	0	0	0.0%
ByteDance Seed 1.6 Flash	0	0	0	0	0	0	0	0	0	0	0.0%
Mistral Small Creative	0	0	0	0	0	0	0	0	0	0	0.0%
WizardLM 2 8x22b	0	0	0	0	0	0	0	0	0	0	0.0%
Gemma 3 4B	0	0	0	0	0	0	0	0	0	0	0.0%
GPT-5.2	0	0	0	0	0	0	0	0	0	0	0.0%
Claude 3.5 Haiku	0	0	0	0	0	0	0	0	0	0	0.0%

Matches word count

Overall Performance

Performance Score Distribution (Top 20)

Price-Performance Score Distribution (Top 20)

Most Stable Models (Top 20)

Top Overall Models (Top 20)

Individual Scenarios

dialogue-200

Write 200 words with 10% dialogue

Write 200 words with 50% dialogue

Write 200 words with 90% dialogue

dialogue-500

Write 500 words with 30% dialogue

Write 500 words with 50% dialogue

Write 500 words with 70% dialogue