Dialogue to Total Word Ratio

Test: Dialogue tags

Avg. Score

30.3%

Scenarios

Overall Performance

Performance Score Distribution (Top 20)

Click a model name to view its detail page.

Rank ▲	Model	Score	Avg. Cost	Avg. Time	Stability
1	Claude Sonnet 4.6	55.4%	$0.0079	12.8s	11%
2	Gemini 3.1 Pro (Preview)	99.6%	$0.157	2.1m	95%
3	GPT-5 Mini	67.3%	$0.011	58.5s	12%
4	Claude Sonnet 4	44.5%	$0.0077	11.4s	7%
5	Claude Sonnet 4.5	46.4%	$0.0080	11.8s	5%
6	Claude Opus 4.6	49.3%	$0.014	15.5s	6%
7	Claude Opus 4.5	47.8%	$0.014	14.3s	5%
8	o4 Mini	61.7%	$0.026	1.1m	13%
9	GPT-4o, Aug. 6th (temp=0)	30.6%	$0.0053	6.3s	12%
10	GPT-5.2	55.8%	$0.027	38.3s	10%
11	Claude 3.5 Haiku	34.5%	$0.0020	7.4s	3%
12	Claude Haiku 4.5	36.9%	$0.0026	6.6s	0%
13	GPT-5.1	58.2%	$0.030	52.9s	11%
14	GPT-5	73.4%	$0.053	1.5m	20%
15	Ministral 3 14B	32.5%	$0.0002	6.4s	0%
16	Mistral NeMO	32.5%	$0.0001	6.6s	0%
17	Gemma 3 12B	31.1%	$0.0001	11.9s	0%
18	Gemini 2.5 Pro	46.6%	$0.029	25.0s	4%
19	Grok 4.1 Fast	28.6%	$0.0004	10.3s	0%
20	ByteDance Seed 1.6	49.1%	$0.0073	1.4m	6%
21	Ministral 3B	23.1%	$0.0000	2.5s	0%
22	Llama 3.1 70B	22.3%	$0.0005	5.2s	0%
23	Hermes 3 70B	26.1%	$0.0002	20.8s	0%
24	ByteDance Seed 1.6 Flash	23.2%	$0.0006	12.2s	0%
25	Mistral Medium 3.1	23.8%	$0.0012	13.1s	0%
26	DeepSeek V3 (2024-12-26)	25.2%	$0.0006	19.3s	0%
27	Z.AI GLM 4.6	43.6%	$0.0044	1.3m	3%
28	Grok 4 Fast	19.7%	$0.0004	6.8s	0%
29	Mistral Small 3.2 24B	20.3%	$0.0002	9.0s	0%
30	Qwen 3.5 Plus (2026-02-15)	25.2%	$0.0013	22.1s	0%
31	Ministral 3 3B	17.8%	$0.0001	2.0s	0%
32	Writer: Palmyra X5	23.6%	$0.0038	12.6s	0%
33	Mistral Small Creative	18.2%	$0.0002	3.8s	0%
34	Gemini 2.5 Flash Lite	17.8%	$0.0002	2.6s	0%
35	Ministral 8B	17.9%	$0.0000	4.0s	0%
36	DeepSeek-V2 Chat	26.4%	$0.0002	29.9s	0%
37	GPT-4o, Aug. 6th (temp=1)	21.7%	$0.0054	6.3s	0%
38	Arcee AI: Trinity Large (Preview)	19.9%	$0.0000	12.2s	0%
39	Ministral 3 8B	17.0%	$0.0001	3.3s	0%
40	Z.AI GLM 4.5	19.3%	$0.0009	8.9s	0%
41	Llama 3.1 Nemotron 70B	20.6%	$0.0002	15.7s	0%
42	Claude 3.5 Sonnet	29.0%	$0.0092	32.1s	2%
43	GPT-4o, May 13th (temp=0)	23.7%	$0.0090	14.3s	1%
44	DeepSeek V3 (2025-03-24)	19.7%	$0.0006	17.8s	0%
45	Llama 3.1 8B	14.3%	$0.0001	2.0s	0%
46	GPT-4o Mini (temp=0)	16.5%	$0.0003	8.5s	0%
47	Gemma 3 4B	15.3%	$0.0000	5.5s	0%
48	Rocinante 12B	21.6%	$0.0003	25.1s	0%
49	Mistral Large 2	19.2%	$0.0031	13.0s	0%
50	Gemini 3 Flash (Preview)	15.4%	$0.0015	5.0s	0%
51	DeepSeek V3.1	22.4%	$0.0006	28.3s	0%
52	Claude 3.7 Sonnet	21.3%	$0.0085	11.6s	0%
53	Qwen 2.5 72B	17.1%	$0.0003	15.6s	0%
54	Claude 3 Haiku	13.5%	$0.0007	4.7s	0%
55	Cohere Command R+ (Aug. 2024)	18.7%	$0.0054	12.4s	0%
56	o4 Mini High	64.0%	$0.050	1.9m	16%
57	GPT-4.1 Nano	13.0%	$0.0002	6.0s	0%
58	Hermes 3 405B	19.5%	$0.0000	26.5s	0%
59	Mistral Large	23.6%	$0.015	13.3s	0%
60	Stealth: Aurora Alpha	48.9%	—	9.2s	10%
61	GPT-4.1 Mini	12.8%	$0.0009	6.9s	0%
62	WizardLM 2 8x22b	17.2%	$0.0007	22.8s	0%
63	GPT-4o, May 13th (temp=1)	19.6%	$0.0088	15.6s	0%
64	Z.AI GLM 5	47.3%	$0.010	1.8m	3%
65	Arcee AI: Trinity Mini	10.8%	$0.0001	5.6s	0%
66	Mistral Large 3	13.2%	$0.0009	12.1s	0%
67	Gemma 3 27B	13.9%	$0.0001	15.7s	0%
68	Gemini 2.5 Flash	10.0%	$0.0015	4.0s	0%
69	GPT-4o Mini (temp=1)	9.5%	$0.0003	8.4s	0%
70	MoonshotAI: Kimi K2.5	66.1%	$0.024	3.2m	18%
71	DeepSeek V3.2	21.3%	$0.0005	47.8s	0%
72	Grok 4	21.3%	$0.012	27.3s	0%
73	Z.AI GLM 4.7 Flash	26.9%	$0.0014	1.1m	0%
74	Z.AI GLM 4.7	47.5%	$0.0069	2.4m	4%
75	GPT-4.1	4.3%	$0.0044	7.8s	0%
76	Gemini 3 Pro (Preview)	25.4%	$0.031	23.6s	0%
77	GPT-5 Nano	32.6%	$0.0040	1.6m	0%
78	Claude Opus 4	25.1%	$0.044	25.5s	0%
79	Minimax M2.5	53.9%	$0.017	3.1m	6%
80	Qwen 3.5 397B A17B	56.2%	$0.039	4.9m	6%
30.33%

Individual Scenarios

dialogue-200

▼

Write 200 words with 10% dialogue

Model	# 1	# 2	# 3	# 4	# 5	# 6	# 7	# 8	# 9	# 10	Avg ▼
Gemini 3.1 Pro (Preview)	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5 Mini	100	100	100	100	100	100	100	100	100	99	99.9%
GPT-5.1	100	100	100	100	100	100	100	100	100	99	99.9%
Z.AI GLM 4.7	100	100	100	100	100	100	100	100	100	99	99.9%
Qwen 3.5 397B A17B	100	100	100	100	100	100	100	100	100	97	99.7%
GPT-5.2	100	100	100	100	100	100	100	100	99	96	99.4%
o4 Mini High	100	100	100	100	100	100	100	100	100	93	99.3%
Z.AI GLM 5	100	100	100	100	100	100	100	95	94	82	97.1%
Claude Sonnet 4	100	100	100	99	98	98	94	92	92	91	96.5%
MoonshotAI: Kimi K2.5	100	100	100	100	100	100	100	100	100	55	95.5%
GPT-5 Nano	100	100	100	100	100	100	100	100	100	37	93.7%
o4 Mini	100	100	100	100	100	100	100	100	100	32	93.2%
Claude Opus 4.5	100	100	100	100	100	100	95	94	79	65	93.2%
ByteDance Seed 1.6	100	100	100	100	100	100	98	98	57	37	88.9%
Claude Sonnet 4.5	100	99	97	96	95	93	92	59	52	45	82.9%
Gemini 2.5 Pro	100	100	100	100	100	99	99	99	28	0	82.3%
Claude 3.5 Haiku	100	100	100	100	94	93	79	71	40	13	79.0%
Stealth: Aurora Alpha	100	100	100	100	100	100	100	52	37	1	78.9%
Claude Sonnet 4.6	98	98	96	88	85	73	73	60	52	52	77.5%
Z.AI GLM 4.7 Flash	100	100	100	97	95	90	84	61	0	0	72.7%
Claude Opus 4	100	100	94	92	90	78	70	40	34	0	69.7%
Claude Haiku 4.5	100	100	100	97	96	89	55	49	0	0	68.5%
Gemini 3 Pro (Preview)	100	100	100	100	100	37	37	37	37	37	68.4%
Claude Opus 4.6	100	100	100	99	99	98	35	17	8	0	65.7%
Z.AI GLM 4.6	100	100	100	100	100	99	21	21	0	0	64.0%
Gemma 3 12B	100	100	98	90	88	82	70	4	0	0	63.3%
Minimax M2.5	100	100	100	99	52	37	37	13	3	0	54.0%
Gemini 3 Flash (Preview)	99	96	37	37	37	37	37	37	37	37	49.0%
Qwen 3.5 Plus (2026-02-15)	58	58	57	44	37	37	37	37	37	37	43.8%
Ministral 3 3B	100	96	84	69	41	19	10	0	0	0	41.9%
Writer: Palmyra X5	100	98	94	72	45	1	0	0	0	0	40.9%
DeepSeek V3.2	100	100	99	83	1	0	0	0	0	0	38.3%
Claude 3.5 Sonnet	100	96	58	52	13	1	0	0	0	0	32.0%
Rocinante 12B	100	99	90	0	0	0	0	0	0	0	28.9%
Z.AI GLM 4.5	100	96	80	0	0	0	0	0	0	0	27.6%
Mistral NeMO	100	99	41	0	0	0	0	0	0	0	24.0%
Mistral Large	94	83	20	15	14	4	0	0	0	0	23.1%
Ministral 3 14B	100	45	0	0	0	0	0	0	0	0	14.4%
Arcee AI: Trinity Large (Preview)	85	46	0	0	0	0	0	0	0	0	13.1%
Grok 4.1 Fast	100	0	0	0	0	0	0	0	0	0	10.0%
DeepSeek V3 (2024-12-26)	49	35	0	0	0	0	0	0	0	0	8.4%
Claude 3.7 Sonnet	82	0	0	0	0	0	0	0	0	0	8.2%
GPT-4o, May 13th (temp=1)	66	0	0	0	0	0	0	0	0	0	6.6%
GPT-4o, Aug. 6th (temp=1)	45	8	0	0	0	0	0	0	0	0	5.3%
Hermes 3 70B	51	0	0	0	0	0	0	0	0	0	5.1%
DeepSeek V3 (2025-03-24)	19	0	0	0	0	0	0	0	0	0	2.0%
Llama 3.1 8B	5	0	0	0	0	0	0	0	0	0	0.5%
GPT-4.1 Mini	3	0	0	0	0	0	0	0	0	0	0.3%
GPT-4.1	1	1	0	0	0	0	0	0	0	0	0.2%
WizardLM 2 8x22b	0	0	0	0	0	0	0	0	0	0	0.0%
Mistral Small Creative	0	0	0	0	0	0	0	0	0	0	0.0%
Grok 4	0	0	0	0	0	0	0	0	0	0	0.0%
Mistral Large 2	0	0	0	0	0	0	0	0	0	0	0.0%
Ministral 8B	0	0	0	0	0	0	0	0	0	0	0.0%
GPT-4o, May 13th (temp=0)	0	0	0	0	0	0	0	0	0	0	0.0%
Hermes 3 405B	0	0	0	0	0	0	0	0	0	0	0.0%
ByteDance Seed 1.6 Flash	0	0	0	0	0	0	0	0	0	0	0.0%
Mistral Large 3	0	0	0	0	0	0	0	0	0	0	0.0%
Ministral 3B	0	0	0	0	0	0	0	0	0	0	0.0%
Claude 3 Haiku	0	0	0	0	0	0	0	0	0	0	0.0%
Ministral 3 8B	0	0	0	0	0	0	0	0	0	0	0.0%
Grok 4 Fast	0	0	0	0	0	0	0	0	0	0	0.0%
Llama 3.1 Nemotron 70B	0	0	0	0	0	0	0	0	0	0	0.0%
Qwen 2.5 72B	0	0	0	0	0	0	0	0	0	0	0.0%
Gemma 3 27B	0	0	0	0	0	0	0	0	0	0	0.0%
Mistral Medium 3.1	0	0	0	0	0	0	0	0	0	0	0.0%
Llama 3.1 70B	0	0	0	0	0	0	0	0	0	0	0.0%
Mistral Small 3.2 24B	0	0	0	0	0	0	0	0	0	0	0.0%
DeepSeek V3.1	0	0	0	0	0	0	0	0	0	0	0.0%
Cohere Command R+ (Aug. 2024)	0	0	0	0	0	0	0	0	0	0	0.0%
GPT-4o, Aug. 6th (temp=0)	0	0	0	0	0	0	0	0	0	0	0.0%
DeepSeek-V2 Chat	0	0	0	0	0	0	0	0	0	0	0.0%
Gemma 3 4B	0	0	0	0	0	0	0	0	0	0	0.0%
Gemini 2.5 Flash	0	0	0	0	0	0	0	0	0	0	0.0%
Gemini 2.5 Flash Lite	0	0	0	0	0	0	0	0	0	0	0.0%
GPT-4o Mini (temp=1)	0	0	0	0	0	0	0	0	0	0	0.0%
Arcee AI: Trinity Mini	0	0	0	0	0	0	0	0	0	0	0.0%
GPT-4o Mini (temp=0)	0	0	0	0	0	0	0	0	0	0	0.0%
GPT-4.1 Nano	0	0	0	0	0	0	0	0	0	0	0.0%

▼

Write 200 words with 50% dialogue

Model	# 1	# 2	# 3	# 4	# 5	# 6	# 7	# 8	# 9	# 10	Avg ▼
Gemini 3.1 Pro (Preview)	100	100	100	100	100	100	100	100	100	100	100.0%
Qwen 3.5 397B A17B	100	100	100	100	100	100	100	100	100	99	99.9%
MoonshotAI: Kimi K2.5	100	100	100	100	100	100	100	100	98	61	95.8%
Minimax M2.5	100	100	100	100	100	100	100	100	100	52	95.2%
GPT-5	100	100	100	100	100	100	100	100	100	0	90.0%
Gemini 2.5 Pro	100	100	100	100	99	97	94	88	71	45	89.2%
GPT-5.1	100	100	100	100	100	100	100	100	92	0	89.2%
GPT-5.2	100	100	100	100	100	100	99	64	41	0	80.3%
GPT-5 Mini	100	100	100	100	100	100	100	100	0	0	80.0%
Z.AI GLM 4.6	100	100	100	100	99	98	86	77	37	0	79.7%
Z.AI GLM 5	100	100	100	100	99	97	87	81	32	0	79.5%
o4 Mini	100	100	100	100	100	100	100	88	0	0	78.8%
Z.AI GLM 4.7	100	100	100	100	100	96	94	94	2	0	78.5%
GPT-4o, May 13th (temp=0)	100	100	100	98	83	82	62	61	44	2	73.1%
GPT-4o, Aug. 6th (temp=0)	100	100	97	90	79	72	59	41	41	31	71.1%
o4 Mini High	100	100	100	100	100	99	97	0	0	0	69.6%
Stealth: Aurora Alpha	100	100	100	100	99	99	96	0	0	0	69.3%
Ministral 3 14B	100	100	100	97	96	79	79	21	8	1	68.0%
Claude Sonnet 4.6	100	100	100	100	100	90	54	32	2	0	67.8%
ByteDance Seed 1.6 Flash	100	99	99	99	97	90	81	8	4	1	67.8%
Cohere Command R+ (Aug. 2024)	100	100	98	85	73	71	63	4	0	0	59.3%
Hermes 3 70B	100	100	94	83	80	60	50	9	1	1	57.8%
Claude Opus 4.6	100	100	100	100	87	86	1	1	0	0	57.5%
Mistral Large	100	100	100	99	73	59	18	14	0	0	56.3%
Gemini 3 Pro (Preview)	100	100	100	100	86	65	0	0	0	0	55.1%
ByteDance Seed 1.6	100	97	94	94	83	40	40	1	0	0	55.0%
Mistral Small Creative	100	100	99	98	92	1	0	0	0	0	49.1%
Claude Haiku 4.5	100	100	94	85	59	18	0	0	0	0	45.7%
Mistral Large 3	100	100	91	76	32	23	4	0	0	0	42.6%
Hermes 3 405B	98	97	96	64	28	28	0	0	0	0	41.0%
Claude Opus 4.5	100	93	92	68	40	3	0	0	0	0	39.5%
Llama 3.1 8B	100	99	97	64	24	1	0	0	0	0	38.5%
Claude Sonnet 4	100	99	80	45	38	11	3	1	0	0	37.6%
Ministral 3B	100	92	73	66	37	0	0	0	0	0	36.8%
DeepSeek V3 (2025-03-24)	100	89	86	35	26	21	2	0	0	0	35.8%
Ministral 3 8B	100	78	68	66	14	13	11	2	0	0	35.2%
Grok 4.1 Fast	97	87	62	38	35	20	7	0	0	0	34.7%
Mistral Medium 3.1	100	98	70	27	12	2	0	0	0	0	31.0%
Qwen 3.5 Plus (2026-02-15)	100	100	100	3	3	0	0	0	0	0	30.5%
Rocinante 12B	89	80	50	46	33	0	0	0	0	0	29.7%
DeepSeek V3 (2024-12-26)	92	85	54	37	22	3	0	0	0	0	29.3%
GPT-5 Nano	100	100	92	0	0	0	0	0	0	0	29.2%
GPT-4o, Aug. 6th (temp=1)	100	89	65	1	0	0	0	0	0	0	25.6%
Mistral NeMO	100	79	39	31	2	1	0	0	0	0	25.2%
WizardLM 2 8x22b	80	56	41	41	16	6	2	0	0	0	24.2%
Z.AI GLM 4.7 Flash	80	64	55	28	0	0	0	0	0	0	22.7%
Claude Sonnet 4.5	99	95	13	11	1	0	0	0	0	0	22.0%
Claude 3.5 Haiku	100	87	24	5	2	0	0	0	0	0	21.9%
Grok 4 Fast	92	71	15	11	7	0	0	0	0	0	19.5%
Llama 3.1 70B	86	64	33	3	2	0	0	0	0	0	18.8%
GPT-4o, May 13th (temp=1)	99	76	13	0	0	0	0	0	0	0	18.8%
Llama 3.1 Nemotron 70B	71	68	33	3	2	0	0	0	0	0	17.9%
Ministral 3 3B	100	68	0	0	0	0	0	0	0	0	16.8%
Claude 3 Haiku	48	46	41	2	0	0	0	0	0	0	13.8%
Mistral Large 2	98	27	6	2	0	0	0	0	0	0	13.3%
Arcee AI: Trinity Large (Preview)	80	37	0	0	0	0	0	0	0	0	11.7%
Claude 3.5 Sonnet	65	20	17	10	2	0	0	0	0	0	11.5%
GPT-4.1 Mini	99	14	0	0	0	0	0	0	0	0	11.4%
DeepSeek V3.1	40	23	8	4	0	0	0	0	0	0	7.5%
Gemini 2.5 Flash Lite	64	9	0	0	0	0	0	0	0	0	7.2%
Ministral 8B	33	17	3	0	0	0	0	0	0	0	5.3%
Z.AI GLM 4.5	24	4	1	0	0	0	0	0	0	0	2.9%
Qwen 2.5 72B	25	0	0	0	0	0	0	0	0	0	2.5%
Gemini 3 Flash (Preview)	7	0	0	0	0	0	0	0	0	0	0.7%
Writer: Palmyra X5	6	1	0	0	0	0	0	0	0	0	0.7%
Claude 3.7 Sonnet	2	2	0	0	0	0	0	0	0	0	0.3%
Gemma 3 12B	2	1	0	0	0	0	0	0	0	0	0.3%
Mistral Small 3.2 24B	1	0	0	0	0	0	0	0	0	0	0.1%
DeepSeek-V2 Chat	0	0	0	0	0	0	0	0	0	0	0.0%
GPT-4o Mini (temp=1)	0	0	0	0	0	0	0	0	0	0	0.0%
DeepSeek V3.2	0	0	0	0	0	0	0	0	0	0	0.0%
Grok 4	0	0	0	0	0	0	0	0	0	0	0.0%
Gemini 2.5 Flash	0	0	0	0	0	0	0	0	0	0	0.0%
Claude Opus 4	0	0	0	0	0	0	0	0	0	0	0.0%
Arcee AI: Trinity Mini	0	0	0	0	0	0	0	0	0	0	0.0%
Gemma 3 27B	0	0	0	0	0	0	0	0	0	0	0.0%
GPT-4.1	0	0	0	0	0	0	0	0	0	0	0.0%
GPT-4.1 Nano	0	0	0	0	0	0	0	0	0	0	0.0%
GPT-4o Mini (temp=0)	0	0	0	0	0	0	0	0	0	0	0.0%
Gemma 3 4B	0	0	0	0	0	0	0	0	0	0	0.0%

▼

Write 200 words with 90% dialogue

Model	# 1	# 2	# 3	# 4	# 5	# 6	# 7	# 8	# 9	# 10	Avg ▼
Claude 3.7 Sonnet	100	100	100	100	100	100	100	100	100	98	99.7%
Gemini 2.5 Flash Lite	100	100	100	100	100	100	99	99	99	97	99.4%
GPT-4o Mini (temp=0)	100	100	100	100	100	100	100	99	99	95	99.2%
DeepSeek-V2 Chat	100	100	99	99	99	98	98	98	97	97	98.6%
Mistral NeMO	100	100	100	100	100	100	99	98	95	92	98.3%
Gemini 3.1 Pro (Preview)	100	100	100	100	100	100	100	100	100	79	97.9%
Claude Sonnet 4.6	100	100	100	100	100	99	98	98	93	86	97.4%
Claude Haiku 4.5	100	100	100	100	100	99	99	99	89	69	95.5%
Claude Opus 4.6	100	100	100	100	99	99	98	94	80	73	94.2%
Claude Sonnet 4.5	100	99	99	99	98	97	97	91	87	73	94.2%
Gemma 3 12B	100	100	100	100	100	100	100	98	89	31	91.7%
Gemma 3 4B	100	100	100	100	100	100	99	96	85	37	91.6%
Writer: Palmyra X5	100	100	100	100	100	100	100	99	98	0	89.6%
Z.AI GLM 5	100	100	99	97	97	94	92	82	69	67	89.6%
MoonshotAI: Kimi K2.5	100	100	100	100	100	100	94	86	81	9	87.0%
Claude Opus 4.5	100	99	99	99	99	97	97	94	85	0	86.9%
Grok 4	100	100	100	99	97	89	80	74	68	47	85.4%
Z.AI GLM 4.6	100	100	100	100	96	96	93	87	37	37	84.6%
DeepSeek V3.2	100	100	100	100	99	97	95	75	37	37	83.9%
Gemma 3 27B	100	100	100	98	98	98	89	78	37	37	83.4%
DeepSeek V3.1	100	100	100	100	100	98	94	65	37	37	82.9%
GPT-5.2	99	97	97	96	96	93	78	66	37	37	79.6%
Claude Opus 4	100	100	98	93	92	80	74	37	37	37	74.7%
Qwen 3.5 397B A17B	100	100	100	99	99	96	66	66	0	0	72.7%
Z.AI GLM 4.5	100	100	100	100	100	97	37	37	37	20	72.6%
Gemini 2.5 Pro	100	100	100	98	90	56	53	37	37	37	70.6%
Llama 3.1 Nemotron 70B	100	100	100	99	97	95	42	37	37	1	70.6%
Grok 4.1 Fast	99	98	89	79	78	73	57	57	41	28	70.0%
Qwen 2.5 72B	100	100	100	100	100	100	59	38	0	0	69.6%
Qwen 3.5 Plus (2026-02-15)	100	100	97	96	95	37	37	37	37	37	67.3%
GPT-5.1	100	99	97	80	78	70	37	37	37	37	67.1%
GPT-4.1 Nano	100	99	99	98	98	89	37	0	0	0	62.0%
ByteDance Seed 1.6	100	100	100	99	97	97	6	0	0	0	59.9%
Mistral Small 3.2 24B	99	97	97	95	87	83	26	1	0	0	58.5%
DeepSeek V3 (2024-12-26)	100	100	100	99	90	50	41	3	0	0	58.4%
Z.AI GLM 4.7 Flash	100	100	100	95	37	37	37	37	37	0	57.9%
Arcee AI: Trinity Large (Preview)	100	100	94	91	91	68	34	0	0	0	57.6%
Gemini 2.5 Flash	100	99	97	58	37	37	37	37	37	37	57.6%
Z.AI GLM 4.7	100	98	96	95	37	37	37	37	37	0	57.3%
Llama 3.1 70B	100	98	93	92	37	37	37	37	37	5	57.1%
Claude 3.5 Sonnet	96	95	84	37	37	37	37	37	37	37	53.2%
Ministral 8B	99	99	97	95	56	37	13	0	0	0	49.6%
o4 Mini High	98	96	78	63	53	52	37	7	0	0	48.3%
DeepSeek V3 (2025-03-24)	100	94	73	65	49	45	42	0	0	0	46.7%
Arcee AI: Trinity Mini	99	93	78	66	55	24	23	13	11	0	46.1%
Ministral 3B	100	93	92	60	43	37	30	0	0	0	45.4%
o4 Mini	100	100	92	65	46	28	9	1	0	0	44.0%
Mistral Large 2	100	99	98	73	48	15	3	1	1	0	43.8%
Claude Sonnet 4	96	37	37	37	37	37	37	37	37	37	42.8%
GPT-4o Mini (temp=1)	92	37	37	37	37	37	37	37	37	37	42.3%
Gemini 3 Flash (Preview)	88	37	37	37	37	37	37	37	37	37	41.9%
Mistral Medium 3.1	100	99	83	61	32	29	6	6	0	0	41.6%
GPT-4o, May 13th (temp=0)	37	37	37	37	37	37	37	37	37	37	36.8%
GPT-4o, Aug. 6th (temp=1)	37	37	37	37	37	37	37	37	37	37	36.8%
GPT-4o, Aug. 6th (temp=0)	37	37	37	37	37	37	37	37	37	37	36.8%
GPT-4o, May 13th (temp=1)	37	37	37	37	37	37	37	37	37	37	36.8%
GPT-4.1 Mini	37	37	37	37	37	37	37	37	37	37	36.8%
GPT-5	100	94	78	37	37	1	0	0	0	0	34.6%
Stealth: Aurora Alpha	96	88	53	44	24	17	13	0	0	0	33.6%
GPT-5 Nano	96	96	96	26	0	0	0	0	0	0	31.5%
Rocinante 12B	100	98	93	9	1	0	0	0	0	0	30.0%
Hermes 3 70B	100	94	74	29	1	0	0	0	0	0	29.8%
Claude 3.5 Haiku	99	72	53	38	14	11	5	4	0	0	29.6%
GPT-4.1	37	37	37	37	37	37	37	0	0	0	25.8%
Minimax M2.5	100	100	37	17	0	0	0	0	0	0	25.4%
GPT-5 Mini	100	100	44	1	0	0	0	0	0	0	24.5%
Hermes 3 405B	96	90	30	20	2	0	0	0	0	0	23.9%
Grok 4 Fast	94	63	36	12	7	3	2	1	1	0	21.9%
WizardLM 2 8x22b	100	88	12	9	1	1	0	0	0	0	21.0%
ByteDance Seed 1.6 Flash	28	28	26	25	0	0	0	0	0	0	10.8%
Mistral Small Creative	94	7	4	2	1	0	0	0	0	0	10.6%
Claude 3 Haiku	100	1	1	0	0	0	0	0	0	0	10.2%
Gemini 3 Pro (Preview)	98	0	0	0	0	0	0	0	0	0	9.8%
Cohere Command R+ (Aug. 2024)	63	20	1	0	0	0	0	0	0	0	8.4%
Ministral 3 3B	43	35	1	0	0	0	0	0	0	0	7.8%
Ministral 3 14B	35	13	4	3	0	0	0	0	0	0	5.5%
Mistral Large 3	44	0	0	0	0	0	0	0	0	0	4.4%
Llama 3.1 8B	31	1	0	0	0	0	0	0	0	0	3.2%
Mistral Large	25	0	0	0	0	0	0	0	0	0	2.5%
Ministral 3 8B	9	0	0	0	0	0	0	0	0	0	0.9%

dialogue-500

▼

Write 500 words with 30% dialogue

Model	# 1	# 2	# 3	# 4	# 5	# 6	# 7	# 8	# 9	# 10	Avg ▼
Gemini 3.1 Pro (Preview)	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5 Mini	100	100	100	99	94	92	92	86	85	79	92.6%
GPT-5	100	100	100	100	100	100	100	90	77	10	87.7%
o4 Mini	100	100	100	100	96	95	87	72	63	21	83.3%
o4 Mini High	100	100	100	100	98	79	79	50	0	0	70.6%
Minimax M2.5	100	99	99	98	98	97	4	2	0	0	59.8%
MoonshotAI: Kimi K2.5	100	94	77	75	55	53	1	0	0	0	45.6%
Claude Sonnet 4	100	99	88	85	33	19	15	0	0	0	44.0%
Mistral Large	98	89	88	73	70	12	0	0	0	0	43.0%
Stealth: Aurora Alpha	88	84	60	57	55	50	16	1	0	0	41.0%
Z.AI GLM 4.7	100	86	57	39	38	6	0	0	0	0	32.6%
GPT-5.1	100	95	70	42	4	3	0	0	0	0	31.5%
Claude Opus 4.6	100	86	54	44	9	2	2	1	1	0	29.9%
Ministral 3 14B	100	86	81	21	3	0	0	0	0	0	29.1%
Claude Opus 4.5	97	92	40	35	20	4	0	0	0	0	28.7%
GPT-4o, May 13th (temp=0)	90	45	43	32	30	20	15	5	2	0	28.4%
Qwen 3.5 397B A17B	96	95	35	30	5	0	0	0	0	0	26.1%
ByteDance Seed 1.6	90	71	48	19	9	5	4	4	0	0	25.0%
GPT-4o, May 13th (temp=1)	93	61	26	11	8	0	0	0	0	0	20.1%
Gemini 2.5 Pro	98	93	3	1	0	0	0	0	0	0	19.5%
Claude 3 Haiku	98	59	30	6	1	0	0	0	0	0	19.3%
Ministral 8B	99	81	1	0	0	0	0	0	0	0	18.1%
Mistral NeMO	89	53	12	3	1	0	0	0	0	0	15.8%
GPT-5 Nano	54	49	40	3	1	0	0	0	0	0	14.7%
Hermes 3 70B	82	63	1	0	0	0	0	0	0	0	14.7%
Gemini 3 Pro (Preview)	91	54	0	0	0	0	0	0	0	0	14.4%
Claude Sonnet 4.6	87	25	16	10	6	0	0	0	0	0	14.4%
Claude Sonnet 4.5	73	23	22	12	3	0	0	0	0	0	13.3%
Z.AI GLM 5	81	45	4	0	0	0	0	0	0	0	13.1%
GPT-5.2	88	34	0	0	0	0	0	0	0	0	12.2%
Ministral 3 3B	93	12	5	5	3	0	0	0	0	0	11.8%
WizardLM 2 8x22b	98	4	3	1	0	0	0	0	0	0	10.6%
Z.AI GLM 4.6	99	7	1	0	0	0	0	0	0	0	10.6%
Claude 3.5 Haiku	41	37	18	3	0	0	0	0	0	0	10.0%
Rocinante 12B	86	0	0	0	0	0	0	0	0	0	8.6%
Arcee AI: Trinity Large (Preview)	86	0	0	0	0	0	0	0	0	0	8.6%
Qwen 3.5 Plus (2026-02-15)	52	33	0	0	0	0	0	0	0	0	8.6%
Hermes 3 405B	61	0	0	0	0	0	0	0	0	0	6.1%
GPT-4o, Aug. 6th (temp=1)	57	0	0	0	0	0	0	0	0	0	5.8%
Mistral Small 3.2 24B	52	3	0	0	0	0	0	0	0	0	5.5%
Ministral 3B	43	5	1	0	0	0	0	0	0	0	5.0%
Mistral Medium 3.1	48	0	0	0	0	0	0	0	0	0	4.8%
GPT-4.1 Mini	22	14	0	0	0	0	0	0	0	0	3.6%
DeepSeek V3 (2025-03-24)	24	0	0	0	0	0	0	0	0	0	2.4%
Llama 3.1 8B	6	4	0	0	0	0	0	0	0	0	1.0%
Llama 3.1 70B	3	1	0	0	0	0	0	0	0	0	0.4%
Claude 3.5 Sonnet	2	1	0	0	0	0	0	0	0	0	0.3%
Z.AI GLM 4.7 Flash	2	0	0	0	0	0	0	0	0	0	0.2%
Claude Haiku 4.5	2	0	0	0	0	0	0	0	0	0	0.2%
Qwen 2.5 72B	1	1	0	0	0	0	0	0	0	0	0.2%
ByteDance Seed 1.6 Flash	0	0	0	0	0	0	0	0	0	0	0.0%
Writer: Palmyra X5	0	0	0	0	0	0	0	0	0	0	0.0%
GPT-4.1	0	0	0	0	0	0	0	0	0	0	0.0%
Claude Opus 4	0	0	0	0	0	0	0	0	0	0	0.0%
Arcee AI: Trinity Mini	0	0	0	0	0	0	0	0	0	0	0.0%
DeepSeek V3.1	0	0	0	0	0	0	0	0	0	0	0.0%
Mistral Large 2	0	0	0	0	0	0	0	0	0	0	0.0%
Mistral Small Creative	0	0	0	0	0	0	0	0	0	0	0.0%
Grok 4	0	0	0	0	0	0	0	0	0	0	0.0%
GPT-4.1 Nano	0	0	0	0	0	0	0	0	0	0	0.0%
Ministral 3 8B	0	0	0	0	0	0	0	0	0	0	0.0%
Cohere Command R+ (Aug. 2024)	0	0	0	0	0	0	0	0	0	0	0.0%
DeepSeek V3 (2024-12-26)	0	0	0	0	0	0	0	0	0	0	0.0%
Grok 4 Fast	0	0	0	0	0	0	0	0	0	0	0.0%
Llama 3.1 Nemotron 70B	0	0	0	0	0	0	0	0	0	0	0.0%
Grok 4.1 Fast	0	0	0	0	0	0	0	0	0	0	0.0%
DeepSeek V3.2	0	0	0	0	0	0	0	0	0	0	0.0%
Gemma 3 12B	0	0	0	0	0	0	0	0	0	0	0.0%
Mistral Large 3	0	0	0	0	0	0	0	0	0	0	0.0%
Z.AI GLM 4.5	0	0	0	0	0	0	0	0	0	0	0.0%
GPT-4o, Aug. 6th (temp=0)	0	0	0	0	0	0	0	0	0	0	0.0%
Gemma 3 4B	0	0	0	0	0	0	0	0	0	0	0.0%
Claude 3.7 Sonnet	0	0	0	0	0	0	0	0	0	0	0.0%
DeepSeek-V2 Chat	0	0	0	0	0	0	0	0	0	0	0.0%
Gemini 3 Flash (Preview)	0	0	0	0	0	0	0	0	0	0	0.0%
GPT-4o Mini (temp=0)	0	0	0	0	0	0	0	0	0	0	0.0%
Gemini 2.5 Flash Lite	0	0	0	0	0	0	0	0	0	0	0.0%
GPT-4o Mini (temp=1)	0	0	0	0	0	0	0	0	0	0	0.0%
Gemini 2.5 Flash	0	0	0	0	0	0	0	0	0	0	0.0%
Gemma 3 27B	0	0	0	0	0	0	0	0	0	0	0.0%

▼

Write 500 words with 50% dialogue

Model	# 1	# 2	# 3	# 4	# 5	# 6	# 7	# 8	# 9	# 10	Avg ▼
Gemini 3.1 Pro (Preview)	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5	100	100	100	100	100	100	100	99	97	0	89.5%
GPT-5 Mini	100	100	100	99	71	58	43	0	0	0	57.1%
Minimax M2.5	100	100	100	99	88	51	26	0	0	0	56.3%
MoonshotAI: Kimi K2.5	99	99	90	79	50	49	47	32	15	0	56.0%
o4 Mini	100	100	99	90	75	42	32	0	0	0	53.8%
Ministral 3 14B	100	97	95	93	81	58	1	0	0	0	52.7%
Claude Opus 4.6	88	85	83	78	47	43	28	1	0	0	45.5%
o4 Mini High	100	90	82	82	44	23	0	0	0	0	42.1%
Stealth: Aurora Alpha	84	72	62	51	45	42	23	21	2	0	40.1%
Claude Opus 4.5	98	97	64	55	41	33	0	0	0	0	38.7%
Claude Sonnet 4	96	94	89	45	9	8	3	2	0	0	34.6%
Ministral 8B	96	78	71	59	39	2	0	0	0	0	34.6%
Claude Sonnet 4.6	97	88	59	30	26	20	6	6	4	3	33.8%
ByteDance Seed 1.6 Flash	87	79	47	36	32	26	26	1	0	0	33.4%
GPT-5.1	100	98	81	30	3	0	0	0	0	0	31.2%
Claude Sonnet 4.5	96	92	90	27	1	0	0	0	0	0	30.6%
WizardLM 2 8x22b	100	83	65	42	7	6	1	0	0	0	30.3%
GPT-4o, Aug. 6th (temp=0)	88	76	74	60	0	0	0	0	0	0	29.9%
Ministral 3 3B	96	87	51	44	6	0	0	0	0	0	28.5%
GPT-5 Nano	100	77	50	42	0	0	0	0	0	0	26.9%
Hermes 3 70B	93	83	44	26	2	0	0	0	0	0	25.0%
Hermes 3 405B	98	76	62	9	2	1	1	0	0	0	24.9%
Ministral 3B	97	96	32	6	6	2	0	0	0	0	23.9%
GPT-4o, May 13th (temp=1)	94	88	37	16	0	0	0	0	0	0	23.5%
Ministral 3 8B	93	80	59	2	0	0	0	0	0	0	23.4%
ByteDance Seed 1.6	97	65	44	13	5	3	3	1	0	0	23.0%
Rocinante 12B	100	65	47	7	4	3	0	0	0	0	22.6%
Mistral Large 2	100	95	9	9	7	0	0	0	0	0	21.9%
Mistral NeMO	64	62	44	40	5	3	0	0	0	0	21.7%
Llama 3.1 8B	100	60	50	0	0	0	0	0	0	0	21.1%
GPT-5.2	98	74	34	5	0	0	0	0	0	0	21.0%
Arcee AI: Trinity Large (Preview)	85	84	30	7	3	0	0	0	0	0	21.0%
DeepSeek V3 (2024-12-26)	97	93	4	0	0	0	0	0	0	0	19.5%
Qwen 3.5 397B A17B	84	78	24	1	0	0	0	0	0	0	18.7%
Mistral Small 3.2 24B	86	75	10	3	0	0	0	0	0	0	17.4%
Claude 3.5 Haiku	82	55	16	6	5	3	1	0	0	0	16.8%
Z.AI GLM 4.7	97	32	30	7	0	0	0	0	0	0	16.7%
Mistral Large	53	48	31	17	6	2	1	1	0	0	15.8%
Cohere Command R+ (Aug. 2024)	79	65	5	1	0	0	0	0	0	0	14.9%
GPT-4o, Aug. 6th (temp=1)	93	30	10	2	0	0	0	0	0	0	13.5%
GPT-4.1 Mini	87	15	11	4	3	0	0	0	0	0	11.9%
Gemini 2.5 Pro	67	34	13	3	0	0	0	0	0	0	11.9%
Claude 3.5 Sonnet	62	39	8	5	1	1	1	0	0	0	11.7%
Z.AI GLM 4.5	93	0	0	0	0	0	0	0	0	0	9.3%
Mistral Large 3	50	31	0	0	0	0	0	0	0	0	8.2%
DeepSeek V3 (2025-03-24)	64	13	1	1	0	0	0	0	0	0	8.0%
Llama 3.1 70B	67	8	0	0	0	0	0	0	0	0	7.5%
Qwen 2.5 72B	27	25	10	0	0	0	0	0	0	0	6.2%
Mistral Medium 3.1	48	1	0	0	0	0	0	0	0	0	4.9%
Z.AI GLM 5	22	15	8	1	0	0	0	0	0	0	4.6%
Claude Opus 4	32	0	0	0	0	0	0	0	0	0	3.2%
Llama 3.1 Nemotron 70B	21	2	0	0	0	0	0	0	0	0	2.5%
GPT-4.1 Nano	23	0	0	0	0	0	0	0	0	0	2.4%
Grok 4 Fast	18	2	2	0	0	0	0	0	0	0	2.2%
GPT-4o, May 13th (temp=0)	14	0	0	0	0	0	0	0	0	0	1.4%
Qwen 3.5 Plus (2026-02-15)	7	1	0	0	0	0	0	0	0	0	0.8%
Claude Haiku 4.5	5	1	0	0	0	0	0	0	0	0	0.6%
Z.AI GLM 4.7 Flash	4	0	0	0	0	0	0	0	0	0	0.4%
Grok 4	3	0	0	0	0	0	0	0	0	0	0.3%
Z.AI GLM 4.6	2	1	0	0	0	0	0	0	0	0	0.3%
Claude 3 Haiku	3	0	0	0	0	0	0	0	0	0	0.3%
Mistral Small Creative	2	0	0	0	0	0	0	0	0	0	0.2%
Grok 4.1 Fast	1	0	0	0	0	0	0	0	0	0	0.2%
Writer: Palmyra X5	0	0	0	0	0	0	0	0	0	0	0.0%
Gemini 3 Pro (Preview)	0	0	0	0	0	0	0	0	0	0	0.0%
DeepSeek V3.1	0	0	0	0	0	0	0	0	0	0	0.0%
DeepSeek-V2 Chat	0	0	0	0	0	0	0	0	0	0	0.0%
Gemma 3 12B	0	0	0	0	0	0	0	0	0	0	0.0%
GPT-4.1	0	0	0	0	0	0	0	0	0	0	0.0%
Claude 3.7 Sonnet	0	0	0	0	0	0	0	0	0	0	0.0%
Arcee AI: Trinity Mini	0	0	0	0	0	0	0	0	0	0	0.0%
GPT-4o Mini (temp=0)	0	0	0	0	0	0	0	0	0	0	0.0%
Gemini 2.5 Flash Lite	0	0	0	0	0	0	0	0	0	0	0.0%
DeepSeek V3.2	0	0	0	0	0	0	0	0	0	0	0.0%
GPT-4o Mini (temp=1)	0	0	0	0	0	0	0	0	0	0	0.0%
Gemma 3 27B	0	0	0	0	0	0	0	0	0	0	0.0%
Gemma 3 4B	0	0	0	0	0	0	0	0	0	0	0.0%
Gemini 3 Flash (Preview)	0	0	0	0	0	0	0	0	0	0	0.0%
Gemini 2.5 Flash	0	0	0	0	0	0	0	0	0	0	0.0%

▼

Write 500 words with 70% dialogue

Model	# 1	# 2	# 3	# 4	# 5	# 6	# 7	# 8	# 9	# 10	Avg ▼
Gemini 3.1 Pro (Preview)	100	100	100	100	100	100	100	100	100	99	99.9%
Grok 4 Fast	99	97	95	94	88	85	84	65	34	8	74.8%
Claude 3.5 Sonnet	99	99	95	92	87	87	82	6	5	0	65.3%
Mistral Medium 3.1	100	95	91	91	89	46	42	38	14	0	60.5%
DeepSeek-V2 Chat	100	87	80	79	79	68	38	33	21	10	59.6%
Grok 4.1 Fast	100	96	82	75	61	54	50	30	14	6	56.9%
o4 Mini High	100	100	91	74	66	57	23	20	11	0	54.3%
Llama 3.1 70B	99	95	94	91	91	23	5	2	0	0	49.9%
GPT-5 Mini	100	100	100	99	99	0	0	0	0	0	49.8%
Claude 3.5 Haiku	99	99	96	89	75	20	16	1	0	0	49.7%
Mistral Small Creative	100	99	89	78	54	28	23	23	1	0	49.5%
GPT-4o, Aug. 6th (temp=0)	100	93	67	40	40	40	40	35	1	1	45.6%
DeepSeek V3.1	99	98	89	79	42	19	8	7	0	0	44.2%
GPT-4o, Aug. 6th (temp=1)	100	89	88	85	71	0	0	0	0	0	43.3%
ByteDance Seed 1.6	100	97	86	81	54	10	0	0	0	0	43.0%
Ministral 3 8B	98	81	55	54	42	42	24	20	10	1	42.8%
GPT-5.2	92	90	85	81	53	10	6	5	1	0	42.2%
Grok 4	93	58	57	54	47	43	26	25	10	8	41.9%
Claude Sonnet 4.6	100	100	84	54	32	22	15	3	2	0	41.2%
Mistral Small 3.2 24B	98	92	76	71	56	5	3	0	0	0	40.0%
GPT-5	100	85	71	58	38	24	10	0	0	0	38.5%
Claude 3 Haiku	97	88	60	50	44	27	2	0	0	0	37.0%
Mistral Large 2	99	98	89	34	17	9	8	5	0	0	35.9%
Claude Sonnet 4.5	93	84	75	35	34	33	2	0	0	0	35.6%
DeepSeek V3 (2024-12-26)	96	59	57	38	32	31	27	11	5	0	35.5%
Minimax M2.5	97	80	67	54	16	13	2	0	0	0	32.7%
Llama 3.1 Nemotron 70B	98	87	76	45	9	4	4	1	1	0	32.6%
Gemma 3 12B	77	72	69	41	37	10	6	3	1	0	31.5%
GPT-5.1	99	82	68	34	10	7	4	1	0	0	30.4%
Stealth: Aurora Alpha	96	87	61	47	11	2	0	0	0	0	30.4%
Cohere Command R+ (Aug. 2024)	88	62	61	49	25	8	0	0	0	0	29.5%
Ministral 3B	86	74	48	36	30	1	0	0	0	0	27.5%
ByteDance Seed 1.6 Flash	97	90	72	12	0	0	0	0	0	0	27.2%
Ministral 3 14B	93	77	48	21	13	0	0	0	0	0	25.2%
Mistral Large 3	53	51	47	42	40	10	0	0	0	0	24.3%
Qwen 2.5 72B	93	70	31	24	23	1	0	0	0	0	24.3%
Hermes 3 70B	89	79	46	15	9	0	0	0	0	0	23.9%
DeepSeek V3 (2025-03-24)	98	98	12	11	10	5	2	0	0	0	23.5%
Z.AI GLM 4.6	81	60	41	29	10	1	0	0	0	0	22.1%
Llama 3.1 8B	74	71	37	20	8	5	0	0	0	0	21.4%
Hermes 3 405B	88	71	31	21	0	0	0	0	0	0	21.1%
Qwen 3.5 397B A17B	94	81	15	7	1	0	0	0	0	0	19.9%
Claude 3.7 Sonnet	50	45	34	28	20	19	2	1	0	0	19.8%
Arcee AI: Trinity Mini	98	75	8	5	1	0	0	0	0	0	18.7%
o4 Mini	89	57	12	12	1	0	0	0	0	0	17.1%
WizardLM 2 8x22b	98	38	26	6	0	0	0	0	0	0	16.8%
MoonshotAI: Kimi K2.5	95	29	16	15	11	0	0	0	0	0	16.7%
GPT-4o Mini (temp=1)	99	48	0	0	0	0	0	0	0	0	14.7%
GPT-4.1 Nano	48	30	29	25	2	1	0	0	0	0	13.5%
GPT-4.1 Mini	96	23	4	3	2	1	0	0	0	0	12.9%
GPT-4o, May 13th (temp=1)	82	29	9	0	0	0	0	0	0	0	12.1%
Claude Sonnet 4	99	11	6	2	0	0	0	0	0	0	11.8%
Claude Haiku 4.5	84	13	7	3	2	1	1	0	0	0	11.1%
Writer: Palmyra X5	97	3	0	0	0	0	0	0	0	0	10.1%
Mistral NeMO	87	10	0	0	0	0	0	0	0	0	9.7%
Rocinante 12B	35	30	17	13	2	0	0	0	0	0	9.7%
Z.AI GLM 4.7 Flash	76	0	0	0	0	0	0	0	0	0	7.6%
Arcee AI: Trinity Large (Preview)	75	0	0	0	0	0	0	0	0	0	7.5%
Gemini 2.5 Pro	34	27	0	0	0	0	0	0	0	0	6.2%
DeepSeek V3.2	32	12	5	2	1	1	1	0	0	0	5.4%
Gemini 3 Pro (Preview)	45	2	0	0	0	0	0	0	0	0	4.7%
Z.AI GLM 4.5	28	8	0	0	0	0	0	0	0	0	3.6%
Claude Opus 4.6	32	1	1	0	0	0	0	0	0	0	3.3%
Claude Opus 4	19	13	0	0	0	0	0	0	0	0	3.1%
Gemini 2.5 Flash	26	0	0	0	0	0	0	0	0	0	2.7%
GPT-4o, May 13th (temp=0)	26	0	0	0	0	0	0	0	0	0	2.7%
Mistral Large	9	0	0	0	0	0	0	0	0	0	0.9%
Gemini 3 Flash (Preview)	7	1	0	0	0	0	0	0	0	0	0.9%
Gemma 3 27B	3	0	0	0	0	0	0	0	0	0	0.3%
Ministral 3 3B	2	0	0	0	0	0	0	0	0	0	0.2%
Gemini 2.5 Flash Lite	1	1	0	0	0	0	0	0	0	0	0.2%
Claude Opus 4.5	1	0	0	0	0	0	0	0	0	0	0.1%
Z.AI GLM 4.7	0	0	0	0	0	0	0	0	0	0	0.0%
Z.AI GLM 5	0	0	0	0	0	0	0	0	0	0	0.0%
Qwen 3.5 Plus (2026-02-15)	0	0	0	0	0	0	0	0	0	0	0.0%
Ministral 8B	0	0	0	0	0	0	0	0	0	0	0.0%
GPT-4.1	0	0	0	0	0	0	0	0	0	0	0.0%
Gemma 3 4B	0	0	0	0	0	0	0	0	0	0	0.0%
GPT-4o Mini (temp=0)	0	0	0	0	0	0	0	0	0	0	0.0%
GPT-5 Nano	0	0	0	0	0	0	0	0	0	0	0.0%

Dialogue to Total Word Ratio

Overall Performance

Performance Score Distribution (Top 20)

Price-Performance Score Distribution (Top 20)

Most Stable Models (Top 20)

Top Overall Models (Top 20)

Individual Scenarios

dialogue-200

Write 200 words with 10% dialogue

Write 200 words with 50% dialogue

Write 200 words with 90% dialogue

dialogue-500

Write 500 words with 30% dialogue

Write 500 words with 50% dialogue

Write 500 words with 70% dialogue