Passive voice overuse

Test: Bad Writing Habits

Avg. Score

96.7%

Scenarios

Overall Performance

Performance Score Distribution (Top 20)

Click a model name to view its detail page.

Rank ▲	Model	Score	Avg. Cost	Avg. Time	Stability
1	Grok 4.1 Fast	99.9%	$0.0018	37.8s	99%
2	Grok 4 Fast	99.6%	$0.0017	24.1s	96%
3	o4 Mini High	99.8%	$0.025	47.2s	99%
4	o4 Mini	99.5%	$0.015	25.7s	97%
5	GPT-4o Mini (temp=1)	99.0%	$0.0012	34.8s	96%
6	Writer: Palmyra X5	98.8%	$0.011	22.0s	96%
7	DeepSeek V3 (2025-03-24)	98.8%	$0.0014	39.4s	94%
8	GPT-4.1	99.3%	$0.018	44.7s	95%
9	GPT-4.1 Mini	98.1%	$0.0027	19.0s	91%
10	GPT-4o, May 13th (temp=1)	98.2%	$0.033	14.4s	93%
11	Mistral Small Creative	97.3%	$0.0007	9.1s	92%
12	Hermes 3 405B	97.9%	$0.0032	53.2s	93%
13	Ministral 3 3B	97.3%	$0.0005	11.1s	90%
14	DeepSeek V3 (2024-12-26)	97.8%	$0.0021	54.6s	92%
15	GPT-5.1	99.5%	$0.054	1.8m	96%
16	GPT-4o Mini (temp=0)	97.4%	$0.0012	34.8s	91%
17	Stealth: Aurora Alpha	97.0%	$0.0000	9.8s	90%
18	Qwen 3.5 Plus (2026-02-15)	97.6%	$0.0060	31.5s	90%
19	Mistral Medium 3.1	97.5%	$0.0048	36.5s	91%
20	Claude Sonnet 4.5	98.1%	$0.035	38.1s	92%
21	GPT-4o, Aug. 6th (temp=1)	97.9%	$0.018	24.4s	90%
22	GPT-4.1 Nano	97.0%	$0.0007	13.3s	90%
23	DeepSeek-V2 Chat	97.5%	$0.0021	53.3s	91%
24	Gemini 2.5 Flash	97.2%	$0.0052	10.6s	89%
25	Gemma 3 27B	97.2%	$0.0006	52.6s	91%
26	Gemma 3 12B	97.1%	$0.0004	41.3s	91%
27	Gemma 3 4B	96.7%	$0.0002	20.0s	90%
28	Claude 3.7 Sonnet	98.0%	$0.042	46.7s	93%
29	Grok 4	99.1%	$0.048	1.7m	94%
30	Ministral 3B	96.5%	$0.0001	8.1s	89%
31	ByteDance Seed 1.6 Flash	96.6%	$0.0013	27.3s	90%
32	GPT-5.2	98.7%	$0.056	1.5m	94%
33	Ministral 3 14B	96.5%	$0.0007	11.7s	89%
34	Claude Haiku 4.5	96.9%	$0.011	21.6s	90%
35	Z.AI GLM 4.5	97.1%	$0.0051	42.1s	90%
36	Ministral 3 8B	96.3%	$0.0008	19.6s	90%
37	Mistral Large	96.8%	$0.014	30.9s	90%
38	Z.AI GLM 5	97.1%	$0.0084	1.2m	91%
39	Claude 3.5 Haiku	96.7%	$0.0035	10.8s	87%
40	Mistral NeMO	95.9%	$0.0005	10.1s	88%
41	Minimax M2.5	96.5%	$0.0034	1.3m	91%
42	GPT-5 Nano	96.7%	$0.0042	1.4m	91%
43	Arcee AI: Trinity Large (Preview)	96.1%	$0.0000	43.6s	89%
44	Claude 3 Haiku	95.9%	$0.0025	14.9s	88%
45	Claude 3.5 Sonnet	97.2%	$0.048	35.5s	90%
46	GPT-4o, May 13th (temp=0)	96.1%	$0.035	14.1s	89%
47	Ministral 8B	95.6%	$0.0004	10.4s	86%
48	Gemini 2.5 Flash Lite	95.4%	$0.0009	9.5s	87%
49	Claude Sonnet 4	96.6%	$0.032	43.7s	89%
50	GPT-5	98.8%	$0.065	2.8m	95%
51	Gemini 3 Pro (Preview)	96.9%	$0.055	54.4s	91%
52	Rocinante 12B	96.0%	$0.0014	38.4s	86%
53	Mistral Large 2	96.2%	$0.013	29.4s	86%
54	Mistral Large 3	95.5%	$0.0033	30.3s	87%
55	Qwen 3.5 397B A17B	98.2%	$0.014	3.0m	91%
56	Arcee AI: Trinity Mini	95.3%	$0.0003	9.2s	85%
57	Claude Opus 4.5	97.0%	$0.070	53.4s	90%
58	Z.AI GLM 4.7	96.0%	$0.010	1.4m	88%
59	Hermes 3 70B	95.6%	$0.0010	1.2m	86%
60	GPT-4o, Aug. 6th (temp=0)	95.5%	$0.023	22.7s	85%
61	GPT-5 Mini	95.3%	$0.0100	57.4s	86%
62	MoonshotAI: Kimi K2.5	97.9%	$0.019	3.2m	89%
63	Gemini 3.1 Pro (Preview)	98.3%	$0.107	1.8m	91%
64	Cohere Command R+ (Aug. 2024)	95.4%	$0.020	52.5s	86%
65	Llama 3.1 8B	95.2%	$0.0003	1.3m	85%
66	Gemini 3 Flash (Preview)	94.0%	$0.0078	19.6s	84%
67	DeepSeek V3.2	95.2%	$0.0014	1.9m	86%
68	Z.AI GLM 4.7 Flash	94.5%	$0.0017	1.2m	85%
69	Claude Opus 4.6	96.4%	$0.078	1.2m	88%
70	Claude Opus 4	98.5%	$0.209	1.4m	94%
71	Gemini 2.5 Pro	94.1%	$0.036	36.2s	84%
72	Z.AI GLM 4.6	93.7%	$0.0065	51.5s	83%
73	Qwen 2.5 72B	93.4%	$0.0010	36.7s	81%
74	Claude Sonnet 4.6	93.7%	$0.031	39.3s	83%
75	Llama 3.1 Nemotron 70B	93.2%	$0.0038	31.7s	80%
76	Llama 3.1 70B	92.5%	$0.0015	29.4s	78%
77	DeepSeek V3.1	93.2%	$0.0020	1.8m	81%
78	WizardLM 2 8x22b	94.3%	$0.0026	1.8m	76%
79	Mistral Small 3.2 24B	95.8%	$0.0069	5.7m	84%
80	ByteDance Seed 1.6	92.1%	$0.013	2.5m	76%
96.69%

Individual Scenarios

Detailed Writing Rules

▼

Fantasy: entering an ancient ruin

Model	# 1	# 2	# 3	# 4	# 5	Avg ▼
Gemini 3.1 Pro (Preview)	100	100	100	100	100	100.0%
GPT-5.1	100	100	100	100	100	100.0%
o4 Mini High	100	100	100	100	100	100.0%
Claude Opus 4.5	100	100	100	100	100	100.0%
GPT-5	100	100	100	100	100	100.0%
o4 Mini	100	100	100	100	100	100.0%
GPT-5.2	100	100	100	100	100	100.0%
Grok 4	100	100	100	100	100	100.0%
Grok 4.1 Fast	100	100	100	100	100	100.0%
GPT-4.1	100	100	100	100	100	100.0%
DeepSeek V3 (2025-03-24)	100	100	100	100	100	100.0%
DeepSeek V3 (2024-12-26)	100	100	100	100	100	100.0%
DeepSeek-V2 Chat	100	100	100	100	100	100.0%
Z.AI GLM 4.5	100	100	100	100	100	100.0%
GPT-4o, Aug. 6th (temp=1)	100	100	100	100	100	100.0%
GPT-4o Mini (temp=1)	100	100	100	100	100	100.0%
GPT-4o Mini (temp=0)	100	100	100	100	100	99.9%
Writer: Palmyra X5	100	100	100	100	99	99.9%
GPT-4.1 Nano	100	100	100	100	99	99.9%
Grok 4 Fast	100	100	100	100	99	99.9%
Claude Sonnet 4.5	100	100	100	100	99	99.7%
Claude Opus 4.6	100	100	100	100	98	99.7%
Qwen 3.5 Plus (2026-02-15)	100	100	100	100	98	99.6%
Claude Sonnet 4	100	100	100	99	99	99.6%
Claude Haiku 4.5	100	100	100	100	98	99.5%
Claude 3.7 Sonnet	100	100	100	100	97	99.5%
Gemini 2.5 Flash	100	100	100	100	97	99.5%
Arcee AI: Trinity Mini	100	100	100	99	98	99.5%
Z.AI GLM 4.7	100	100	100	99	98	99.4%
Mistral Medium 3.1	100	100	100	100	96	99.3%
Qwen 3.5 397B A17B	100	100	100	98	98	99.3%
Rocinante 12B	100	100	100	99	98	99.2%
GPT-4o, May 13th (temp=1)	100	100	100	100	96	99.2%
MoonshotAI: Kimi K2.5	100	100	100	100	96	99.2%
GPT-4.1 Mini	100	100	100	100	95	99.1%
GPT-5 Nano	100	100	100	99	96	99.0%
Ministral 8B	100	100	100	100	95	99.0%
Ministral 3 14B	100	100	100	99	96	99.0%
Stealth: Aurora Alpha	100	100	100	100	94	98.9%
Z.AI GLM 5	100	100	100	100	94	98.8%
Gemma 3 27B	100	100	100	100	94	98.7%
GPT-5 Mini	100	100	99	99	95	98.6%
Gemma 3 4B	100	100	100	96	96	98.5%
Llama 3.1 8B	100	100	100	97	95	98.5%
Mistral Large	100	100	100	99	93	98.5%
Hermes 3 405B	100	100	100	98	93	98.3%
Ministral 3B	100	100	100	96	95	98.2%
GPT-4o, Aug. 6th (temp=0)	100	100	100	99	92	98.2%
Ministral 3 8B	100	100	100	96	94	98.1%
WizardLM 2 8x22b	100	100	100	98	92	98.0%
Minimax M2.5	100	100	100	95	93	97.6%
ByteDance Seed 1.6	100	100	100	98	90	97.5%
Gemma 3 12B	100	100	100	94	93	97.5%
Gemini 3 Pro (Preview)	100	100	100	94	93	97.5%
DeepSeek V3.2	100	99	98	97	93	97.4%
Claude 3.5 Sonnet	100	100	100	98	89	97.3%
Mistral Small Creative	100	100	100	99	88	97.2%
Mistral Large 3	100	99	96	95	93	96.8%
Claude Opus 4	100	97	96	95	95	96.6%
Arcee AI: Trinity Large (Preview)	100	100	100	95	87	96.5%
Gemini 2.5 Pro	100	100	96	94	93	96.5%
ByteDance Seed 1.6 Flash	100	98	96	95	93	96.4%
Gemini 3 Flash (Preview)	100	100	98	95	90	96.4%
Claude 3.5 Haiku	100	100	100	100	82	96.4%
GPT-4o, May 13th (temp=0)	100	100	100	100	81	96.2%
Hermes 3 70B	100	100	95	94	91	96.1%
Ministral 3 3B	100	100	100	96	84	96.0%
Mistral Large 2	100	99	96	96	88	95.6%
DeepSeek V3.1	100	96	96	95	91	95.6%
Z.AI GLM 4.6	100	100	96	93	88	95.6%
Claude Sonnet 4.6	100	100	96	94	84	94.9%
Claude 3 Haiku	100	100	97	91	85	94.7%
Llama 3.1 Nemotron 70B	100	100	96	94	83	94.6%
Cohere Command R+ (Aug. 2024)	100	100	100	88	84	94.4%
Gemini 2.5 Flash Lite	100	96	93	91	89	94.0%
Mistral NeMO	100	99	98	95	78	93.9%
Z.AI GLM 4.7 Flash	100	100	92	91	84	93.5%
Qwen 2.5 72B	100	100	99	96	71	93.1%
Mistral Small 3.2 24B	100	97	92	89	87	92.8%
Llama 3.1 70B	100	97	96	83	70	89.2%

▼

Horror: alone in an eerie place at night

Model	# 1	# 2	# 3	# 4	# 5	Avg ▼
Gemini 3.1 Pro (Preview)	100	100	100	100	100	100.0%
GPT-5.1	100	100	100	100	100	100.0%
o4 Mini High	100	100	100	100	100	100.0%
MoonshotAI: Kimi K2.5	100	100	100	100	100	100.0%
GPT-5	100	100	100	100	100	100.0%
o4 Mini	100	100	100	100	100	100.0%
GPT-5.2	100	100	100	100	100	100.0%
Claude Opus 4	100	100	100	100	100	100.0%
Claude Sonnet 4	100	100	100	100	100	100.0%
Grok 4	100	100	100	100	100	100.0%
Grok 4.1 Fast	100	100	100	100	100	100.0%
GPT-4.1	100	100	100	100	100	100.0%
Qwen 3.5 Plus (2026-02-15)	100	100	100	100	100	100.0%
Grok 4 Fast	100	100	100	100	100	100.0%
GPT-4o, Aug. 6th (temp=1)	100	100	100	100	100	100.0%
Mistral Small 3.2 24B	100	100	100	100	100	100.0%
Ministral 3 14B	100	100	100	100	100	100.0%
Claude 3.7 Sonnet	100	100	100	100	100	99.9%
Writer: Palmyra X5	100	100	100	100	100	99.9%
Qwen 3.5 397B A17B	100	100	100	100	99	99.8%
Z.AI GLM 5	100	100	100	100	99	99.8%
Claude Sonnet 4.5	100	100	100	100	99	99.8%
DeepSeek V3 (2025-03-24)	100	100	100	100	99	99.8%
Ministral 3 3B	100	100	100	100	99	99.8%
Mistral Large 3	100	100	100	100	98	99.6%
GPT-5 Mini	100	100	100	100	99	99.6%
Minimax M2.5	100	100	100	100	99	99.6%
Mistral Large 2	100	100	100	100	98	99.6%
Claude Opus 4.6	100	100	100	100	98	99.6%
GPT-4.1 Mini	100	100	100	100	97	99.4%
Claude 3.5 Sonnet	100	100	100	100	97	99.4%
GPT-4o, May 13th (temp=1)	100	100	100	99	98	99.4%
Claude Opus 4.5	100	100	100	98	98	99.3%
Hermes 3 405B	100	100	100	100	96	99.2%
Gemini 2.5 Flash	100	100	100	98	97	99.1%
Mistral Small Creative	100	100	100	97	97	98.9%
Rocinante 12B	100	100	100	98	97	98.9%
Gemma 3 12B	100	100	99	99	96	98.9%
Claude Haiku 4.5	100	100	100	97	96	98.7%
GPT-4o Mini (temp=1)	100	100	100	100	93	98.7%
Gemma 3 27B	100	99	99	97	96	98.3%
Arcee AI: Trinity Large (Preview)	100	100	100	100	91	98.1%
DeepSeek V3 (2024-12-26)	100	100	100	95	95	98.1%
DeepSeek V3.2	100	100	99	97	95	98.0%
Arcee AI: Trinity Mini	100	100	100	100	90	97.9%
Mistral Medium 3.1	100	100	99	98	93	97.9%
Claude 3.5 Haiku	100	100	100	100	89	97.9%
GPT-4o Mini (temp=0)	100	100	100	100	89	97.7%
DeepSeek-V2 Chat	100	100	100	100	88	97.5%
Mistral Large	100	100	100	96	92	97.5%
Gemini 3 Pro (Preview)	100	100	98	98	91	97.3%
WizardLM 2 8x22b	100	97	97	96	95	97.3%
Stealth: Aurora Alpha	100	100	98	94	93	97.0%
Z.AI GLM 4.5	100	100	96	95	92	96.7%
Cohere Command R+ (Aug. 2024)	100	100	96	93	93	96.5%
GPT-4o, May 13th (temp=0)	100	100	99	93	90	96.4%
Gemini 2.5 Pro	100	97	96	96	93	96.3%
Z.AI GLM 4.7	100	99	98	96	87	96.1%
GPT-5 Nano	100	99	98	94	90	96.1%
Ministral 3 8B	100	100	95	93	92	96.0%
Llama 3.1 70B	100	100	96	93	90	95.9%
ByteDance Seed 1.6 Flash	100	98	95	93	92	95.8%
Z.AI GLM 4.7 Flash	100	99	97	93	89	95.6%
Gemini 3 Flash (Preview)	100	100	96	93	89	95.6%
Ministral 3B	100	100	100	100	78	95.5%
Ministral 8B	100	99	97	95	86	95.1%
Gemma 3 4B	100	98	97	91	90	95.1%
Claude 3 Haiku	100	100	99	94	83	95.1%
Claude Sonnet 4.6	100	95	94	94	90	94.3%
Hermes 3 70B	100	100	100	100	70	94.0%
GPT-4o, Aug. 6th (temp=0)	100	100	96	90	83	93.9%
GPT-4.1 Nano	100	100	97	97	75	93.9%
Mistral NeMO	100	99	93	89	88	93.9%
Qwen 2.5 72B	100	100	93	90	86	93.8%
Z.AI GLM 4.6	97	96	95	93	86	93.4%
DeepSeek V3.1	100	100	98	97	72	93.3%
ByteDance Seed 1.6	100	100	94	90	80	92.6%
Llama 3.1 8B	100	100	99	93	67	91.9%
Gemini 2.5 Flash Lite	100	98	91	91	79	91.8%
Llama 3.1 Nemotron 70B	97	92	92	85	76	88.5%

▼

Literary fiction: old friends reunite

Model	# 1	# 2	# 3	# 4	# 5	Avg ▼
Gemini 3.1 Pro (Preview)	100	100	100	100	100	100.0%
Qwen 3.5 397B A17B	100	100	100	100	100	100.0%
GPT-5.1	100	100	100	100	100	100.0%
o4 Mini High	100	100	100	100	100	100.0%
GPT-5	100	100	100	100	100	100.0%
o4 Mini	100	100	100	100	100	100.0%
Claude Opus 4	100	100	100	100	100	100.0%
Grok 4	100	100	100	100	100	100.0%
Grok 4.1 Fast	100	100	100	100	100	100.0%
GPT-4.1	100	100	100	100	100	100.0%
Stealth: Aurora Alpha	100	100	100	100	100	100.0%
Grok 4 Fast	100	100	100	100	100	100.0%
Claude 3.7 Sonnet	100	100	100	100	100	100.0%
Z.AI GLM 4.5	100	100	100	100	100	100.0%
GPT-4o Mini (temp=0)	100	100	100	100	100	100.0%
GPT-4o, May 13th (temp=0)	100	100	100	100	100	100.0%
Arcee AI: Trinity Large (Preview)	100	100	100	100	100	99.9%
Mistral NeMO	100	100	100	100	100	99.9%
GPT-4o, May 13th (temp=1)	100	100	100	100	99	99.9%
GPT-4o, Aug. 6th (temp=1)	100	100	100	100	99	99.8%
GPT-4o, Aug. 6th (temp=0)	100	100	100	100	99	99.8%
DeepSeek-V2 Chat	100	100	100	100	98	99.6%
Writer: Palmyra X5	100	100	100	100	98	99.6%
Z.AI GLM 4.7	100	100	100	99	99	99.6%
Mistral Large 2	100	100	100	100	98	99.6%
Z.AI GLM 5	100	100	100	99	99	99.6%
Gemini 2.5 Flash	100	100	100	100	98	99.5%
DeepSeek V3.2	100	99	99	99	99	99.4%
Qwen 3.5 Plus (2026-02-15)	100	100	100	98	98	99.3%
Mistral Small Creative	100	100	100	100	96	99.2%
Gemini 3 Pro (Preview)	100	100	100	99	97	99.1%
Ministral 3 14B	100	100	100	100	96	99.1%
Claude Opus 4.5	100	100	100	100	96	99.1%
GPT-4.1 Mini	100	100	100	98	98	99.1%
GPT-5.2	100	100	100	100	95	99.1%
Claude 3.5 Sonnet	100	100	100	98	97	99.1%
GPT-4o Mini (temp=1)	100	100	100	100	96	99.1%
MoonshotAI: Kimi K2.5	100	100	100	100	95	99.0%
Ministral 3 3B	100	100	99	98	97	98.9%
DeepSeek V3 (2024-12-26)	100	100	100	99	95	98.9%
Minimax M2.5	100	100	100	100	94	98.9%
GPT-4.1 Nano	100	100	100	99	95	98.9%
DeepSeek V3 (2025-03-24)	100	100	100	98	95	98.6%
Gemma 3 27B	100	100	100	98	94	98.5%
WizardLM 2 8x22b	100	100	100	99	93	98.5%
ByteDance Seed 1.6 Flash	100	100	98	98	96	98.4%
Hermes 3 405B	100	100	100	100	92	98.4%
Claude Sonnet 4.5	100	100	100	96	95	98.2%
GPT-5 Mini	100	100	100	96	94	98.0%
Mistral Large	100	100	100	95	94	97.9%
Gemini 2.5 Flash Lite	100	100	100	96	93	97.9%
Ministral 3 8B	100	100	99	96	94	97.9%
Qwen 2.5 72B	100	100	100	100	90	97.9%
Claude Sonnet 4	100	100	100	96	93	97.7%
Ministral 8B	100	100	100	95	94	97.7%
Arcee AI: Trinity Mini	100	100	100	100	89	97.7%
Hermes 3 70B	100	100	100	96	93	97.7%
Claude Opus 4.6	100	99	97	97	95	97.6%
GPT-5 Nano	100	100	100	97	90	97.5%
Claude 3 Haiku	100	100	99	95	93	97.4%
Claude Haiku 4.5	100	100	98	94	94	97.2%
Gemini 2.5 Pro	100	100	100	97	87	96.8%
Z.AI GLM 4.7 Flash	100	99	97	95	92	96.6%
Mistral Medium 3.1	100	100	100	100	83	96.6%
Llama 3.1 8B	100	100	100	94	89	96.5%
ByteDance Seed 1.6	100	100	96	96	91	96.5%
Claude 3.5 Haiku	100	100	100	92	90	96.4%
Llama 3.1 Nemotron 70B	100	100	96	96	89	96.0%
Mistral Large 3	100	100	100	90	88	95.7%
Mistral Small 3.2 24B	100	100	100	100	76	95.2%
Cohere Command R+ (Aug. 2024)	100	100	96	93	86	95.1%
Gemma 3 12B	100	97	96	91	90	94.9%
Z.AI GLM 4.6	100	100	93	92	90	94.8%
DeepSeek V3.1	100	99	96	86	85	93.3%
Gemma 3 4B	100	95	92	91	87	93.1%
Ministral 3B	100	100	88	88	86	92.5%
Gemini 3 Flash (Preview)	100	99	94	85	82	91.9%
Claude Sonnet 4.6	97	93	91	90	88	91.9%
Rocinante 12B	100	100	95	93	55	88.7%
Llama 3.1 70B	100	89	88	80	62	83.7%

▼

Mystery: examining a crime scene

Model	# 1	# 2	# 3	# 4	# 5	Avg ▼
Gemini 3.1 Pro (Preview)	100	100	100	100	100	100.0%
GPT-5.1	100	100	100	100	100	100.0%
o4 Mini	100	100	100	100	100	100.0%
Grok 4	100	100	100	100	100	100.0%
Grok 4.1 Fast	100	100	100	100	100	100.0%
GPT-4.1	100	100	100	100	100	100.0%
Stealth: Aurora Alpha	100	100	100	100	100	100.0%
Grok 4 Fast	100	100	100	100	100	100.0%
GPT-4o, Aug. 6th (temp=1)	100	100	100	100	100	100.0%
GPT-4.1 Mini	100	100	100	100	100	99.9%
o4 Mini High	100	100	100	100	98	99.7%
Qwen 3.5 397B A17B	100	100	100	99	98	99.6%
Writer: Palmyra X5	100	100	100	100	97	99.4%
MoonshotAI: Kimi K2.5	100	100	100	100	96	99.2%
Claude 3 Haiku	100	100	100	99	96	99.1%
Rocinante 12B	100	100	100	100	95	99.0%
DeepSeek-V2 Chat	100	100	100	98	97	98.9%
Qwen 3.5 Plus (2026-02-15)	100	100	100	100	95	98.9%
GPT-5	100	100	100	97	97	98.8%
Claude Opus 4	100	100	100	100	94	98.8%
Z.AI GLM 5	100	100	99	98	96	98.7%
GPT-5.2	100	100	97	97	97	98.4%
Claude Sonnet 4.5	100	100	98	97	96	98.3%
Hermes 3 405B	100	100	100	98	93	98.2%
DeepSeek V3 (2025-03-24)	100	100	97	97	96	98.1%
Claude 3.5 Sonnet	100	100	100	99	91	97.9%
Gemini 2.5 Flash	100	98	97	97	97	97.9%
GPT-4o Mini (temp=1)	100	100	100	99	91	97.9%
Hermes 3 70B	100	100	97	96	96	97.9%
Llama 3.1 8B	100	100	99	97	93	97.8%
GPT-4o Mini (temp=0)	100	100	99	96	94	97.7%
Claude Haiku 4.5	100	99	97	96	93	97.0%
Llama 3.1 Nemotron 70B	100	100	95	95	94	96.7%
Claude Sonnet 4	100	98	96	96	93	96.6%
DeepSeek V3 (2024-12-26)	100	100	100	100	83	96.6%
Ministral 3B	100	100	100	99	84	96.5%
Claude 3.7 Sonnet	100	99	99	94	88	96.1%
Claude Opus 4.5	100	100	100	93	87	96.0%
Gemini 3 Pro (Preview)	100	97	96	96	91	95.8%
ByteDance Seed 1.6 Flash	100	99	94	93	92	95.6%
Ministral 3 3B	100	100	98	94	84	95.1%
Mistral NeMO	100	100	100	89	86	95.1%
GPT-5 Nano	98	98	94	92	92	94.9%
Mistral Small Creative	98	97	96	94	88	94.7%
Gemma 3 27B	100	100	94	93	86	94.6%
GPT-5 Mini	100	98	98	96	81	94.6%
GPT-4o, May 13th (temp=1)	99	96	96	93	88	94.6%
Gemma 3 12B	100	96	95	94	87	94.4%
Claude 3.5 Haiku	100	100	100	94	78	94.4%
Claude Opus 4.6	100	97	96	90	89	94.4%
Mistral Small 3.2 24B	100	100	100	97	74	94.3%
Z.AI GLM 4.7 Flash	100	98	96	94	82	93.9%
Ministral 8B	99	97	96	91	87	93.8%
Cohere Command R+ (Aug. 2024)	100	100	100	98	70	93.6%
GPT-4.1 Nano	100	97	90	90	90	93.3%
Arcee AI: Trinity Large (Preview)	100	100	92	91	84	93.1%
Z.AI GLM 4.5	100	100	90	90	85	93.0%
Ministral 3 8B	100	98	92	88	87	92.8%
Arcee AI: Trinity Mini	100	100	92	88	84	92.8%
GPT-4o, May 13th (temp=0)	94	94	94	92	89	92.6%
GPT-4o, Aug. 6th (temp=0)	100	96	95	91	82	92.6%
Z.AI GLM 4.7	100	95	95	86	85	92.3%
Mistral Medium 3.1	96	95	94	88	86	91.9%
Gemma 3 4B	100	96	91	90	82	91.7%
DeepSeek V3.2	98	95	90	89	83	91.1%
Minimax M2.5	96	95	93	88	82	90.9%
ByteDance Seed 1.6	100	90	89	89	87	90.9%
Ministral 3 14B	96	94	93	90	81	90.8%
Llama 3.1 70B	100	99	96	94	61	89.9%
WizardLM 2 8x22b	95	94	92	84	84	89.8%
Gemini 2.5 Pro	100	95	92	89	72	89.5%
Mistral Large 2	100	99	98	83	65	88.8%
Gemini 2.5 Flash Lite	98	97	91	81	76	88.7%
Mistral Large 3	96	91	88	87	78	88.0%
DeepSeek V3.1	99	92	88	86	75	88.0%
Claude Sonnet 4.6	100	95	88	78	74	87.2%
Z.AI GLM 4.6	100	96	83	81	75	87.0%
Mistral Large	96	93	86	84	76	86.8%
Gemini 3 Flash (Preview)	95	89	85	85	79	86.5%
Qwen 2.5 72B	96	89	85	79	69	83.5%

▼

Romance: separated couple reunites

Model	# 1	# 2	# 3	# 4	# 5	Avg ▼
Gemini 3.1 Pro (Preview)	100	100	100	100	100	100.0%
Claude Opus 4.6	100	100	100	100	100	100.0%
GPT-5.1	100	100	100	100	100	100.0%
o4 Mini High	100	100	100	100	100	100.0%
MoonshotAI: Kimi K2.5	100	100	100	100	100	100.0%
GPT-5	100	100	100	100	100	100.0%
o4 Mini	100	100	100	100	100	100.0%
Z.AI GLM 5	100	100	100	100	100	100.0%
GPT-5.2	100	100	100	100	100	100.0%
Claude Opus 4	100	100	100	100	100	100.0%
Minimax M2.5	100	100	100	100	100	100.0%
Grok 4	100	100	100	100	100	100.0%
Claude Sonnet 4.5	100	100	100	100	100	100.0%
Grok 4.1 Fast	100	100	100	100	100	100.0%
GPT-4.1	100	100	100	100	100	100.0%
Qwen 3.5 Plus (2026-02-15)	100	100	100	100	100	100.0%
Grok 4 Fast	100	100	100	100	100	100.0%
Claude 3.5 Sonnet	100	100	100	100	100	100.0%
DeepSeek V3 (2024-12-26)	100	100	100	100	100	100.0%
Claude 3.7 Sonnet	100	100	100	100	100	100.0%
Claude 3.5 Haiku	100	100	100	100	100	100.0%
DeepSeek V3.1	100	100	100	100	100	100.0%
Writer: Palmyra X5	100	100	100	100	100	100.0%
Mistral Small Creative	100	100	100	100	100	100.0%
Ministral 3 14B	100	100	100	100	100	100.0%
WizardLM 2 8x22b	100	100	100	100	100	100.0%
GPT-4o Mini (temp=1)	100	100	100	100	100	99.9%
Claude Sonnet 4	100	100	100	100	99	99.9%
Mistral Small 3.2 24B	100	100	100	100	99	99.9%
GPT-4o, May 13th (temp=1)	100	100	100	100	99	99.8%
Hermes 3 405B	100	100	100	100	99	99.8%
Z.AI GLM 4.5	100	100	100	100	99	99.8%
DeepSeek-V2 Chat	100	100	100	100	99	99.8%
Claude Opus 4.5	100	100	100	100	99	99.7%
DeepSeek V3 (2025-03-24)	100	100	100	100	98	99.6%
Mistral NeMO	100	100	100	100	98	99.6%
Qwen 3.5 397B A17B	100	100	100	100	98	99.6%
Arcee AI: Trinity Mini	100	100	100	99	99	99.6%
Gemini 2.5 Flash	100	100	100	100	97	99.5%
Mistral Large 2	100	100	100	100	96	99.3%
Z.AI GLM 4.7	100	100	100	100	96	99.2%
Mistral Medium 3.1	100	100	99	99	98	99.2%
GPT-5 Mini	100	100	100	99	97	99.2%
GPT-4.1 Mini	100	100	100	100	96	99.1%
Z.AI GLM 4.6	100	100	100	100	96	99.1%
Gemini 3 Flash (Preview)	100	100	100	99	96	99.1%
Mistral Large	100	100	100	99	96	99.0%
Z.AI GLM 4.7 Flash	100	100	99	98	98	99.0%
ByteDance Seed 1.6 Flash	100	100	100	100	95	99.0%
Gemma 3 12B	100	100	100	98	96	98.9%
Stealth: Aurora Alpha	100	100	100	98	96	98.8%
Gemma 3 4B	100	100	100	100	94	98.8%
GPT-4.1 Nano	100	100	100	99	95	98.7%
Claude Haiku 4.5	100	100	100	97	96	98.6%
Ministral 3B	100	100	100	98	95	98.5%
Gemini 2.5 Flash Lite	100	99	99	98	96	98.3%
Mistral Large 3	100	100	100	100	91	98.3%
GPT-5 Nano	100	100	99	96	96	98.2%
GPT-4o Mini (temp=0)	100	100	99	99	93	98.1%
Gemini 3 Pro (Preview)	100	100	98	97	93	97.8%
GPT-4o, May 13th (temp=0)	100	100	100	99	90	97.8%
Claude 3 Haiku	100	100	99	95	94	97.6%
Qwen 2.5 72B	100	100	100	95	93	97.6%
DeepSeek V3.2	99	98	98	97	96	97.5%
Ministral 3 3B	100	100	96	95	95	97.4%
Arcee AI: Trinity Large (Preview)	100	100	97	96	94	97.3%
ByteDance Seed 1.6	100	100	99	97	91	97.3%
Ministral 3 8B	100	100	100	100	86	97.2%
GPT-4o, Aug. 6th (temp=0)	100	100	100	100	85	97.1%
Cohere Command R+ (Aug. 2024)	100	100	100	100	85	96.9%
Gemma 3 27B	100	100	96	95	93	96.7%
Ministral 8B	100	98	98	94	92	96.5%
GPT-4o, Aug. 6th (temp=1)	100	100	100	99	79	95.7%
Llama 3.1 70B	100	100	96	92	86	94.8%
Llama 3.1 8B	100	100	96	89	89	94.7%
Rocinante 12B	100	100	98	88	86	94.2%
Claude Sonnet 4.6	100	100	96	94	82	94.2%
Gemini 2.5 Pro	100	96	92	90	90	93.7%
Hermes 3 70B	100	100	100	97	70	93.5%
Llama 3.1 Nemotron 70B	100	99	97	93	49	87.5%

▼

Thriller: chase through city streets

Model	# 1	# 2	# 3	# 4	# 5	Avg ▼
Gemini 3.1 Pro (Preview)	100	100	100	100	100	100.0%
GPT-5.1	100	100	100	100	100	100.0%
o4 Mini High	100	100	100	100	100	100.0%
MoonshotAI: Kimi K2.5	100	100	100	100	100	100.0%
GPT-5	100	100	100	100	100	100.0%
o4 Mini	100	100	100	100	100	100.0%
Grok 4	100	100	100	100	100	100.0%
Claude Sonnet 4.5	100	100	100	100	100	100.0%
Grok 4.1 Fast	100	100	100	100	100	100.0%
GPT-4.1	100	100	100	100	100	100.0%
Grok 4 Fast	100	100	100	100	100	100.0%
GPT-4.1 Mini	100	100	100	100	100	100.0%
Writer: Palmyra X5	100	100	100	100	100	100.0%
Hermes 3 405B	100	100	100	100	100	100.0%
GPT-4o, Aug. 6th (temp=1)	100	100	100	100	100	100.0%
Stealth: Aurora Alpha	100	100	100	100	100	99.9%
GPT-4.1 Nano	100	100	100	100	100	99.9%
Claude Opus 4	100	100	100	100	99	99.8%
Qwen 3.5 397B A17B	100	100	100	100	99	99.8%
Qwen 3.5 Plus (2026-02-15)	100	100	100	100	99	99.8%
DeepSeek V3 (2024-12-26)	100	100	100	100	98	99.6%
Claude Sonnet 4	100	100	100	100	98	99.6%
Claude 3.5 Haiku	100	100	100	100	98	99.6%
GPT-5.2	100	100	100	100	97	99.3%
Gemini 2.5 Flash	100	100	100	100	97	99.3%
Mistral Small 3.2 24B	100	100	100	100	96	99.3%
DeepSeek-V2 Chat	100	100	100	100	96	99.3%
Claude Opus 4.6	100	100	100	99	97	99.1%
Claude Opus 4.5	100	100	100	98	97	99.1%
Rocinante 12B	100	100	100	98	97	99.1%
Claude 3.5 Sonnet	100	100	100	99	96	99.0%
GPT-4o Mini (temp=1)	100	100	100	100	95	98.9%
DeepSeek V3 (2025-03-24)	100	100	100	100	94	98.8%
Gemini 3 Pro (Preview)	100	100	98	98	97	98.6%
Ministral 3 14B	100	100	100	98	95	98.5%
DeepSeek V3.2	100	100	99	97	96	98.4%
Z.AI GLM 4.7	100	99	98	97	97	98.4%
Minimax M2.5	100	100	100	97	95	98.3%
WizardLM 2 8x22b	100	100	100	99	92	98.2%
Mistral Medium 3.1	100	100	100	100	90	97.9%
GPT-5 Mini	100	100	99	97	94	97.9%
Z.AI GLM 4.5	100	100	99	98	93	97.9%
Llama 3.1 70B	100	100	100	99	91	97.8%
Ministral 3 3B	100	100	100	100	89	97.8%
Gemma 3 12B	100	99	99	98	93	97.8%
ByteDance Seed 1.6 Flash	100	100	100	97	92	97.7%
GPT-4o Mini (temp=0)	100	100	100	97	91	97.6%
Cohere Command R+ (Aug. 2024)	100	100	99	99	89	97.5%
Claude 3 Haiku	100	100	100	97	90	97.4%
Arcee AI: Trinity Large (Preview)	100	100	100	100	87	97.4%
GPT-4o, May 13th (temp=1)	100	100	98	97	92	97.3%
Gemma 3 4B	100	100	97	96	93	97.3%
Mistral Large	100	99	99	99	90	97.3%
GPT-5 Nano	100	100	99	96	91	97.2%
Claude Sonnet 4.6	100	100	98	97	90	97.1%
Ministral 3B	100	100	99	96	90	97.0%
Claude Haiku 4.5	100	100	100	98	87	97.0%
Mistral Small Creative	100	98	97	96	92	96.8%
Z.AI GLM 4.7 Flash	100	100	96	94	94	96.8%
Claude 3.7 Sonnet	100	100	98	97	89	96.8%
Hermes 3 70B	100	100	100	99	83	96.4%
ByteDance Seed 1.6	100	98	95	95	93	96.2%
GPT-4o, May 13th (temp=0)	100	97	96	94	93	96.0%
Arcee AI: Trinity Mini	100	100	100	92	88	95.9%
Z.AI GLM 5	100	100	95	94	90	95.7%
Llama 3.1 Nemotron 70B	100	100	96	96	85	95.2%
DeepSeek V3.1	100	97	95	94	89	95.2%
Mistral Large 3	99	98	95	94	89	94.9%
Gemini 2.5 Pro	100	100	97	91	87	94.8%
Ministral 3 8B	99	97	96	94	86	94.4%
Qwen 2.5 72B	98	96	94	92	91	94.3%
Gemma 3 27B	100	100	93	92	85	94.1%
Ministral 8B	100	97	95	92	86	94.0%
Mistral Large 2	100	93	93	92	90	93.7%
Llama 3.1 8B	100	98	93	88	87	93.3%
Gemini 3 Flash (Preview)	99	99	94	88	86	93.2%
Z.AI GLM 4.6	100	99	94	86	86	93.1%
GPT-4o, Aug. 6th (temp=0)	100	100	100	89	73	92.5%
Gemini 2.5 Flash Lite	94	93	92	89	87	91.0%
Mistral NeMO	98	93	85	85	78	87.9%

genre

▼

Fantasy: entering an ancient ruin

Model	# 1	# 2	# 3	# 4	# 5	Avg ▼
o4 Mini	100	100	100	100	100	100.0%
Claude Opus 4	100	100	100	100	100	100.0%
Grok 4.1 Fast	100	100	100	100	100	100.0%
DeepSeek V3 (2025-03-24)	100	100	100	100	100	100.0%
Grok 4 Fast	100	100	100	100	100	100.0%
Claude Haiku 4.5	100	100	100	100	100	100.0%
Claude 3.5 Haiku	100	100	100	100	100	100.0%
GPT-4o Mini (temp=1)	100	100	100	100	100	100.0%
GPT-4.1 Mini	100	100	100	100	100	99.9%
GPT-4.1 Nano	100	100	100	100	99	99.9%
Writer: Palmyra X5	100	100	100	100	99	99.8%
GPT-4o, Aug. 6th (temp=0)	100	100	100	99	99	99.6%
Grok 4	100	100	100	100	98	99.6%
o4 Mini High	100	100	100	100	98	99.5%
Claude 3.7 Sonnet	100	100	100	99	99	99.5%
GPT-4o, Aug. 6th (temp=1)	100	100	100	99	98	99.3%
Mistral Large 3	100	100	100	100	95	99.1%
GPT-4o Mini (temp=0)	100	100	100	100	96	99.0%
Minimax M2.5	100	100	100	100	95	99.0%
Z.AI GLM 4.7	100	100	100	99	96	99.0%
Qwen 3.5 Plus (2026-02-15)	100	100	100	97	97	98.8%
Z.AI GLM 5	100	100	100	97	96	98.7%
Mistral Small Creative	100	100	98	98	97	98.7%
GPT-5.1	100	100	99	97	97	98.6%
Mistral Large 2	100	100	100	97	96	98.6%
Ministral 3B	100	100	98	97	97	98.6%
Gemma 3 27B	100	100	100	100	93	98.5%
Gemini 3 Pro (Preview)	100	100	100	100	92	98.4%
Claude Opus 4.6	100	99	99	99	94	98.3%
ByteDance Seed 1.6 Flash	100	100	100	99	93	98.3%
Claude Sonnet 4	100	100	100	99	93	98.3%
Qwen 3.5 397B A17B	100	100	100	100	90	98.1%
GPT-4.1	100	100	100	100	90	98.1%
Claude Opus 4.5	100	100	100	97	93	98.1%
Claude 3 Haiku	100	100	99	99	93	98.1%
Mistral Large	100	100	100	99	91	98.1%
Claude Sonnet 4.5	100	100	100	100	90	98.0%
GPT-5.2	100	99	99	96	96	98.0%
MoonshotAI: Kimi K2.5	100	100	100	95	94	97.9%
GPT-4o, May 13th (temp=1)	100	100	100	97	92	97.8%
Arcee AI: Trinity Mini	100	100	100	100	89	97.7%
DeepSeek-V2 Chat	100	100	100	95	94	97.7%
Mistral NeMO	100	100	100	98	90	97.7%
GPT-5	100	100	100	96	93	97.6%
ByteDance Seed 1.6	100	100	100	96	91	97.5%
Gemini 2.5 Flash	100	100	99	96	92	97.3%
Claude 3.5 Sonnet	100	100	100	98	87	97.0%
Rocinante 12B	100	100	97	94	94	96.9%
Gemma 3 4B	99	99	99	94	93	96.9%
Gemini 2.5 Flash Lite	100	100	98	94	92	96.8%
Hermes 3 70B	100	100	98	93	93	96.6%
Mistral Medium 3.1	100	100	100	94	89	96.6%
Cohere Command R+ (Aug. 2024)	100	100	99	93	92	96.6%
GPT-5 Nano	100	99	97	95	91	96.4%
Gemini 3.1 Pro (Preview)	100	100	97	95	89	96.3%
Z.AI GLM 4.7 Flash	100	100	98	94	89	96.3%
Arcee AI: Trinity Large (Preview)	100	100	100	96	85	96.2%
Ministral 3 3B	100	100	100	93	88	96.1%
Z.AI GLM 4.5	100	100	100	96	84	96.1%
Ministral 8B	99	98	95	93	93	95.6%
GPT-4o, May 13th (temp=0)	100	100	98	92	87	95.4%
Ministral 3 8B	100	100	97	91	89	95.4%
DeepSeek V3.2	100	99	97	95	86	95.3%
Hermes 3 405B	100	99	95	92	90	95.2%
Stealth: Aurora Alpha	100	100	96	92	89	95.2%
Ministral 3 14B	98	96	95	94	92	95.1%
Gemini 2.5 Pro	100	98	93	92	90	94.7%
DeepSeek V3 (2024-12-26)	100	100	100	88	81	93.9%
Gemini 3 Flash (Preview)	97	97	96	90	89	93.7%
Llama 3.1 8B	100	100	100	85	82	93.3%
Z.AI GLM 4.6	97	94	93	91	91	92.9%
Mistral Small 3.2 24B	100	100	100	82	79	92.2%
GPT-5 Mini	100	96	93	89	83	92.2%
Claude Sonnet 4.6	98	95	91	88	86	91.4%
Gemma 3 12B	93	92	92	91	83	89.9%
Llama 3.1 Nemotron 70B	100	97	93	84	75	89.8%
DeepSeek V3.1	95	94	90	90	72	87.9%
Qwen 2.5 72B	94	90	86	82	80	86.6%
WizardLM 2 8x22b	100	99	97	73	60	86.0%
Llama 3.1 70B	96	85	83	78	74	83.1%

▼

Horror: alone in an eerie place at night

Model	# 1	# 2	# 3	# 4	# 5	Avg ▼
o4 Mini High	100	100	100	100	100	100.0%
Claude Sonnet 4.5	100	100	100	100	100	100.0%
Grok 4.1 Fast	100	100	100	100	100	100.0%
Claude 3.5 Haiku	100	100	100	100	100	100.0%
Grok 4 Fast	100	100	100	100	99	99.9%
Ministral 3 3B	100	100	100	100	97	99.5%
Claude Opus 4.5	100	100	100	98	98	99.4%
Claude Opus 4	100	100	100	100	96	99.3%
Claude Haiku 4.5	100	100	99	99	98	99.2%
GPT-4o Mini (temp=1)	100	100	100	100	95	99.1%
Mistral Small Creative	100	100	99	99	97	99.0%
GPT-4o, Aug. 6th (temp=1)	100	100	100	100	95	99.0%
Gemma 3 27B	100	100	99	99	97	99.0%
DeepSeek V3 (2024-12-26)	100	100	99	98	98	98.9%
GPT-5.1	100	100	99	98	97	98.8%
Cohere Command R+ (Aug. 2024)	100	100	100	99	94	98.6%
Writer: Palmyra X5	100	100	99	98	95	98.6%
GPT-4.1	100	100	100	96	95	98.3%
Qwen 3.5 397B A17B	100	100	99	98	94	98.1%
GPT-5	100	98	97	97	97	98.0%
MoonshotAI: Kimi K2.5	100	100	99	96	94	97.8%
Ministral 3 8B	100	100	99	98	91	97.7%
Claude Opus 4.6	100	99	97	96	96	97.6%
Mistral Medium 3.1	100	100	100	99	88	97.4%
DeepSeek V3 (2025-03-24)	100	100	100	94	93	97.4%
GPT-5.2	100	100	97	95	95	97.4%
Claude 3.5 Sonnet	100	100	99	94	93	97.3%
Ministral 3B	100	100	99	94	93	97.2%
o4 Mini	100	100	99	98	88	97.2%
Claude 3.7 Sonnet	100	100	100	97	89	97.1%
Claude Sonnet 4.6	99	99	97	96	94	97.1%
DeepSeek-V2 Chat	100	100	100	95	90	97.0%
Mistral Small 3.2 24B	100	100	100	95	90	96.9%
Gemma 3 12B	100	100	95	95	93	96.5%
Hermes 3 405B	100	99	98	97	88	96.4%
GPT-4.1 Nano	100	100	96	95	90	96.3%
Gemini 2.5 Flash	100	100	97	96	89	96.2%
DeepSeek V3.2	100	99	94	94	93	96.2%
Gemini 3 Pro (Preview)	99	97	96	96	93	96.2%
GPT-4.1 Mini	100	100	95	94	92	96.1%
GPT-4o, Aug. 6th (temp=0)	100	100	100	94	85	95.8%
Qwen 3.5 Plus (2026-02-15)	100	97	97	95	89	95.8%
GPT-4o Mini (temp=0)	100	100	96	92	90	95.7%
Arcee AI: Trinity Large (Preview)	100	100	94	94	91	95.6%
Arcee AI: Trinity Mini	99	99	96	92	90	95.3%
Minimax M2.5	100	100	96	94	87	95.3%
Mistral Large	100	97	96	91	91	95.1%
Mistral Large 2	100	98	95	93	90	95.1%
Llama 3.1 8B	100	100	96	90	89	94.9%
Z.AI GLM 4.7	99	99	94	92	91	94.9%
GPT-4o, May 13th (temp=1)	100	100	98	96	81	94.9%
Claude Sonnet 4	100	96	94	93	91	94.8%
Grok 4	100	100	100	94	79	94.6%
Mistral Large 3	100	100	100	98	74	94.5%
Llama 3.1 70B	100	99	98	92	83	94.4%
Ministral 8B	100	94	94	93	91	94.4%
WizardLM 2 8x22b	100	100	99	87	86	94.4%
Gemini 3.1 Pro (Preview)	100	98	93	90	90	94.3%
Claude 3 Haiku	100	100	100	94	77	94.2%
Hermes 3 70B	100	98	95	92	86	94.1%
ByteDance Seed 1.6 Flash	100	100	92	89	89	94.0%
Ministral 3 14B	100	100	97	87	86	94.0%
Z.AI GLM 5	99	97	94	92	87	93.7%
GPT-4o, May 13th (temp=0)	98	97	94	91	87	93.4%
Gemma 3 4B	100	98	92	89	85	92.9%
Mistral NeMO	100	92	92	91	89	92.6%
Z.AI GLM 4.5	100	95	95	94	78	92.3%
DeepSeek V3.1	98	94	92	89	88	92.2%
Gemini 2.5 Flash Lite	94	93	91	91	91	92.0%
Qwen 2.5 72B	100	100	91	88	81	91.9%
GPT-5 Mini	98	98	93	92	78	91.7%
Z.AI GLM 4.6	100	94	90	87	84	91.0%
Llama 3.1 Nemotron 70B	98	97	92	88	80	91.0%
Gemini 2.5 Pro	97	97	93	86	82	91.0%
GPT-5 Nano	99	91	91	88	84	90.8%
Rocinante 12B	100	100	95	89	70	90.8%
Gemini 3 Flash (Preview)	96	94	91	88	80	89.8%
Z.AI GLM 4.7 Flash	95	93	88	88	84	89.6%
Stealth: Aurora Alpha	89	88	87	86	81	86.2%
ByteDance Seed 1.6	91	89	70	70	41	72.5%

▼

Literary fiction: old friends reunite

Model	# 1	# 2	# 3	# 4	# 5	Avg ▼
o4 Mini High	100	100	100	100	100	100.0%
Grok 4.1 Fast	100	100	100	100	100	100.0%
GPT-4o, May 13th (temp=0)	100	100	100	100	100	100.0%
GPT-4o, Aug. 6th (temp=0)	100	100	100	100	100	100.0%
GPT-4o Mini (temp=0)	100	100	100	100	100	100.0%
Grok 4 Fast	100	100	100	100	100	100.0%
Mistral NeMO	100	100	100	100	100	99.9%
Mistral Medium 3.1	100	100	100	100	99	99.8%
GPT-5.1	100	100	100	100	99	99.8%
Claude 3.7 Sonnet	100	100	100	100	98	99.7%
Gemini 2.5 Flash	100	100	100	100	98	99.6%
Mistral Large 2	100	100	100	99	99	99.6%
Claude Sonnet 4.5	100	100	100	100	97	99.4%
Rocinante 12B	100	100	100	100	97	99.3%
DeepSeek V3 (2025-03-24)	100	100	100	99	97	99.2%
Gemma 3 4B	100	100	100	100	96	99.2%
GPT-4.1	100	100	100	98	98	99.2%
Claude 3.5 Sonnet	100	100	100	99	97	99.1%
Mistral Small 3.2 24B	100	100	100	100	95	99.0%
Arcee AI: Trinity Large (Preview)	100	100	99	98	97	99.0%
GPT-4o Mini (temp=1)	100	100	100	100	95	98.9%
DeepSeek-V2 Chat	100	100	100	100	94	98.8%
Qwen 2.5 72B	100	100	100	100	94	98.7%
GPT-4o, May 13th (temp=1)	100	100	100	99	94	98.7%
GPT-5.2	100	99	99	98	98	98.6%
Grok 4	100	100	100	99	94	98.6%
Hermes 3 405B	100	100	100	97	95	98.5%
Ministral 8B	100	100	99	98	95	98.4%
Writer: Palmyra X5	100	100	100	100	92	98.3%
Claude Opus 4	100	100	100	100	91	98.2%
o4 Mini	100	100	100	99	92	98.2%
Llama 3.1 70B	100	100	99	96	96	98.1%
DeepSeek V3 (2024-12-26)	100	100	100	97	94	98.1%
GPT-5 Nano	100	100	100	97	93	97.9%
Z.AI GLM 4.6	100	100	100	95	94	97.7%
Hermes 3 70B	100	100	100	96	92	97.7%
Claude 3 Haiku	100	100	99	98	91	97.7%
ByteDance Seed 1.6 Flash	100	100	100	100	88	97.6%
Gemini 2.5 Flash Lite	100	100	97	96	94	97.5%
Claude Haiku 4.5	100	100	100	100	87	97.4%
Ministral 3 14B	100	100	98	95	94	97.4%
Claude 3.5 Haiku	100	100	99	95	92	97.1%
Z.AI GLM 4.7 Flash	100	100	96	96	93	97.0%
DeepSeek V3.2	100	99	98	95	92	97.0%
Gemini 3.1 Pro (Preview)	100	100	97	96	92	96.9%
Z.AI GLM 4.5	100	100	100	100	85	96.9%
Ministral 3B	100	100	98	96	90	96.8%
Mistral Small Creative	100	100	99	97	88	96.8%
DeepSeek V3.1	100	99	99	97	89	96.7%
Gemini 3 Pro (Preview)	100	100	96	96	91	96.7%
Qwen 3.5 397B A17B	100	100	97	96	89	96.3%
Z.AI GLM 4.7	100	98	96	95	92	96.1%
Mistral Large	100	100	96	96	89	96.1%
Mistral Large 3	100	100	95	93	92	96.0%
Gemini 2.5 Pro	100	98	96	94	92	95.9%
Minimax M2.5	100	100	98	94	86	95.6%
Claude Opus 4.6	100	100	97	95	86	95.5%
Ministral 3 8B	100	100	99	90	89	95.5%
Gemma 3 12B	100	100	97	91	89	95.4%
Cohere Command R+ (Aug. 2024)	100	100	99	92	85	95.2%
GPT-4.1 Nano	100	99	99	91	87	95.2%
MoonshotAI: Kimi K2.5	100	100	99	94	82	95.1%
GPT-5	100	96	94	93	91	94.9%
Llama 3.1 Nemotron 70B	99	98	98	91	89	94.8%
Z.AI GLM 5	100	100	97	89	88	94.7%
GPT-5 Mini	100	99	95	92	87	94.7%
Gemini 3 Flash (Preview)	100	98	93	93	87	94.2%
Llama 3.1 8B	100	100	95	93	83	94.2%
Stealth: Aurora Alpha	100	96	92	91	90	93.9%
ByteDance Seed 1.6	100	100	92	91	85	93.7%
Claude Opus 4.5	96	95	95	94	89	93.6%
Claude Sonnet 4	100	100	92	90	82	92.9%
Qwen 3.5 Plus (2026-02-15)	100	100	96	90	78	92.6%
Gemma 3 27B	99	98	97	85	84	92.5%
GPT-4o, Aug. 6th (temp=1)	100	100	100	88	74	92.4%
GPT-4.1 Mini	100	99	98	91	73	92.3%
Ministral 3 3B	100	100	100	87	73	92.2%
Claude Sonnet 4.6	98	92	92	89	87	91.7%
Arcee AI: Trinity Mini	100	91	91	81	71	86.9%
WizardLM 2 8x22b	100	100	100	100	7	81.4%

▼

Mystery: examining a crime scene

Model	# 1	# 2	# 3	# 4	# 5	Avg ▼
Grok 4.1 Fast	100	100	100	100	98	99.7%
Hermes 3 405B	100	100	100	100	96	99.3%
DeepSeek V3 (2025-03-24)	100	100	99	98	97	98.7%
Llama 3.1 8B	100	100	98	97	97	98.5%
o4 Mini High	100	100	100	98	95	98.4%
o4 Mini	100	98	98	97	95	97.8%
GPT-4o Mini (temp=1)	100	100	99	94	94	97.3%
GPT-4o, May 13th (temp=1)	100	100	96	95	95	97.1%
Gemma 3 12B	100	100	100	93	91	96.8%
Grok 4	100	100	98	98	85	96.3%
Writer: Palmyra X5	100	96	96	95	93	96.0%
Arcee AI: Trinity Large (Preview)	100	100	97	91	90	95.6%
Claude 3.7 Sonnet	100	98	98	93	88	95.6%
Gemma 3 4B	100	100	100	95	82	95.4%
GPT-5 Nano	100	98	95	94	89	95.0%
GPT-4.1	100	100	98	94	83	94.9%
Claude Opus 4	100	98	98	92	86	94.8%
Claude 3.5 Sonnet	98	98	93	93	92	94.8%
Claude Sonnet 4.5	98	97	95	94	90	94.7%
Gemini 2.5 Flash Lite	100	100	99	98	76	94.7%
GPT-4o, May 13th (temp=0)	100	96	95	94	89	94.7%
Hermes 3 70B	100	100	99	88	85	94.3%
Grok 4 Fast	100	100	93	91	87	94.3%
GPT-5.1	100	97	97	90	87	94.2%
Claude 3 Haiku	100	100	94	90	86	93.9%
Llama 3.1 70B	100	98	97	90	85	93.9%
Stealth: Aurora Alpha	100	100	95	92	83	93.8%
Z.AI GLM 5	99	97	97	90	85	93.7%
Mistral Small Creative	100	100	92	90	85	93.4%
Ministral 3 3B	100	100	94	89	84	93.3%
GPT-5	100	95	95	93	83	93.3%
GPT-4.1 Mini	100	99	95	90	82	93.2%
Mistral Large	100	100	96	86	83	92.8%
Gemma 3 27B	98	98	94	88	85	92.7%
DeepSeek V3.1	96	94	92	91	90	92.5%
Z.AI GLM 4.7	100	93	91	89	88	92.2%
DeepSeek V3 (2024-12-26)	96	95	94	91	85	92.1%
Z.AI GLM 4.5	100	94	91	90	85	92.0%
Gemini 3 Pro (Preview)	100	98	90	88	84	92.0%
Claude Sonnet 4	100	100	100	85	74	91.8%
Gemini 2.5 Flash	100	95	93	85	84	91.6%
Rocinante 12B	100	95	92	91	79	91.3%
GPT-4o, Aug. 6th (temp=1)	100	100	92	85	80	91.2%
Minimax M2.5	94	93	90	89	87	90.9%
Mistral NeMO	97	95	92	87	83	90.9%
Ministral 3 8B	100	92	91	90	81	90.9%
GPT-4.1 Nano	100	97	94	85	78	90.8%
Mistral Medium 3.1	100	98	97	82	76	90.6%
Ministral 3B	100	94	91	86	82	90.5%
GPT-5.2	99	90	88	87	87	90.3%
Gemini 2.5 Pro	96	96	95	87	76	90.1%
Llama 3.1 Nemotron 70B	100	97	96	79	77	89.7%
ByteDance Seed 1.6 Flash	99	95	92	87	75	89.6%
DeepSeek-V2 Chat	99	93	89	84	81	89.3%
GPT-4o Mini (temp=0)	92	89	89	87	86	88.7%
Claude Sonnet 4.6	91	90	89	87	85	88.6%
Mistral Large 3	92	91	88	88	83	88.5%
WizardLM 2 8x22b	95	94	90	88	76	88.4%
Cohere Command R+ (Aug. 2024)	100	96	84	81	80	88.0%
Gemini 3.1 Pro (Preview)	98	98	89	77	76	87.8%
Claude 3.5 Haiku	100	94	88	81	75	87.6%
Z.AI GLM 4.6	93	93	89	86	75	87.2%
Qwen 3.5 Plus (2026-02-15)	100	86	85	84	81	87.2%
Claude Opus 4.5	98	97	91	78	72	87.1%
Arcee AI: Trinity Mini	100	98	95	78	63	86.7%
Claude Haiku 4.5	100	98	81	79	76	86.7%
MoonshotAI: Kimi K2.5	96	92	92	83	71	86.6%
Z.AI GLM 4.7 Flash	95	88	87	83	79	86.4%
Mistral Small 3.2 24B	100	92	82	79	79	86.1%
Ministral 3 14B	93	93	93	83	69	86.0%
Gemini 3 Flash (Preview)	92	87	87	86	77	85.9%
Claude Opus 4.6	96	89	84	78	76	84.9%
GPT-5 Mini	94	91	83	81	74	84.6%
GPT-4o, Aug. 6th (temp=0)	90	90	88	86	67	84.4%
Qwen 2.5 72B	89	89	85	85	72	84.2%
Qwen 3.5 397B A17B	95	94	84	76	70	84.0%
DeepSeek V3.2	100	86	82	80	71	83.9%
Mistral Large 2	96	92	84	83	63	83.6%
ByteDance Seed 1.6	100	100	78	72	64	82.8%
Ministral 8B	97	84	84	77	67	81.8%

▼

Romance: separated couple reunites

Model	# 1	# 2	# 3	# 4	# 5	Avg ▼
o4 Mini High	100	100	100	100	100	100.0%
Claude Opus 4.5	100	100	100	100	100	100.0%
DeepSeek V3 (2025-03-24)	100	100	100	100	100	100.0%
Grok 4 Fast	100	100	100	100	100	100.0%
GPT-4o, May 13th (temp=0)	100	100	100	100	100	100.0%
Gemma 3 12B	100	100	100	100	100	100.0%
Gemma 3 27B	100	100	100	100	100	100.0%
Claude 3 Haiku	100	100	100	100	100	100.0%
Ministral 3 3B	100	100	100	100	100	100.0%
GPT-5.1	100	100	100	100	100	99.9%
GPT-4o, May 13th (temp=1)	100	100	100	100	99	99.8%
Grok 4.1 Fast	100	100	100	100	99	99.8%
Hermes 3 405B	100	100	100	100	98	99.6%
Ministral 3B	100	100	100	99	98	99.5%
GPT-4.1	100	100	100	100	97	99.4%
Mistral Medium 3.1	100	100	100	99	98	99.3%
Claude 3.5 Sonnet	100	100	99	99	98	99.3%
Mistral Large 2	100	100	100	99	97	99.2%
GPT-4.1 Mini	100	100	100	99	97	99.2%
GPT-5	100	100	99	99	98	99.2%
DeepSeek-V2 Chat	100	100	100	100	96	99.2%
o4 Mini	100	100	100	100	95	99.1%
Gemini 3 Pro (Preview)	100	100	99	99	98	99.1%
Claude Opus 4.6	100	99	99	98	98	99.0%
GPT-4o Mini (temp=1)	100	100	100	100	96	99.0%
MoonshotAI: Kimi K2.5	100	100	100	99	96	99.0%
Writer: Palmyra X5	100	100	100	98	97	98.9%
Gemini 2.5 Flash	100	100	100	100	95	98.9%
Llama 3.1 70B	100	100	98	98	98	98.9%
Mistral Large 3	100	100	100	100	94	98.7%
Claude Opus 4	100	100	100	100	94	98.7%
Grok 4	100	100	99	98	97	98.7%
Minimax M2.5	100	100	100	100	94	98.7%
Mistral Large	100	100	99	98	96	98.6%
GPT-5.2	100	99	98	98	97	98.5%
Gemma 3 4B	100	100	100	99	93	98.4%
Claude Sonnet 4	100	100	100	100	92	98.4%
Claude Sonnet 4.5	100	100	100	97	94	98.4%
Claude Sonnet 4.6	100	100	100	100	92	98.3%
DeepSeek V3 (2024-12-26)	100	100	100	97	95	98.3%
Ministral 3 8B	100	100	100	98	93	98.3%
GPT-4.1 Nano	100	100	100	97	94	98.0%
Ministral 8B	100	100	100	100	90	97.9%
GPT-4o, Aug. 6th (temp=0)	100	100	100	100	90	97.9%
Mistral Small Creative	100	100	100	95	93	97.7%
Hermes 3 70B	100	100	100	99	90	97.7%
GPT-4o Mini (temp=0)	100	100	100	94	94	97.5%
Llama 3.1 8B	100	100	99	99	89	97.5%
Ministral 3 14B	100	100	100	95	93	97.5%
Claude 3.7 Sonnet	100	100	96	96	94	97.4%
Z.AI GLM 4.7	100	100	97	96	94	97.4%
ByteDance Seed 1.6 Flash	100	100	100	94	93	97.4%
Claude 3.5 Haiku	100	100	100	100	87	97.4%
GPT-5 Nano	100	100	99	99	88	97.2%
Qwen 2.5 72B	100	100	100	100	87	97.2%
Arcee AI: Trinity Mini	100	100	98	96	92	97.2%
Rocinante 12B	100	100	100	100	86	97.2%
Gemini 3 Flash (Preview)	100	100	98	97	90	97.1%
GPT-4o, Aug. 6th (temp=1)	100	99	99	98	89	97.0%
Qwen 3.5 397B A17B	100	98	97	95	94	97.0%
Z.AI GLM 4.7 Flash	100	100	98	94	93	97.0%
Gemini 3.1 Pro (Preview)	100	100	99	98	88	96.8%
Stealth: Aurora Alpha	100	100	96	94	93	96.6%
Mistral NeMO	100	100	100	92	89	96.2%
Arcee AI: Trinity Large (Preview)	100	100	97	92	92	96.1%
Llama 3.1 Nemotron 70B	100	100	97	95	87	96.0%
Gemini 2.5 Flash Lite	100	100	96	93	90	95.9%
Claude Haiku 4.5	100	100	100	97	81	95.6%
DeepSeek V3.2	100	100	98	90	90	95.5%
Mistral Small 3.2 24B	100	100	100	93	84	95.4%
Qwen 3.5 Plus (2026-02-15)	100	100	100	95	82	95.4%
Z.AI GLM 5	100	98	98	96	84	95.3%
Gemini 2.5 Pro	100	100	96	96	84	95.2%
Cohere Command R+ (Aug. 2024)	100	100	100	98	77	95.1%
WizardLM 2 8x22b	100	100	94	91	90	94.9%
Z.AI GLM 4.6	100	99	98	89	88	94.9%
ByteDance Seed 1.6	100	100	92	91	90	94.5%
DeepSeek V3.1	100	98	96	95	82	94.2%
GPT-5 Mini	98	98	98	92	83	93.9%
Z.AI GLM 4.5	100	97	93	92	77	91.7%

▼

Thriller: chase through city streets

Model	# 1	# 2	# 3	# 4	# 5	Avg ▼
o4 Mini High	100	100	100	100	98	99.5%
Grok 4.1 Fast	100	100	100	100	98	99.5%
Grok 4 Fast	100	100	100	100	96	99.3%
Writer: Palmyra X5	100	100	100	99	97	99.2%
GPT-5.1	100	100	100	98	97	99.0%
o4 Mini	100	100	100	100	95	99.0%
DeepSeek V3 (2025-03-24)	100	100	100	100	95	99.0%
Ministral 3 3B	100	99	99	98	98	98.9%
GPT-5	100	100	99	98	96	98.6%
GPT-4.1	100	100	100	98	95	98.4%
DeepSeek V3 (2024-12-26)	100	100	100	96	96	98.4%
Mistral Small Creative	100	100	100	98	92	98.0%
Hermes 3 405B	100	100	100	96	93	97.9%
DeepSeek V3.1	100	100	99	96	94	97.8%
Mistral Medium 3.1	100	99	97	96	95	97.7%
Ministral 3 14B	100	100	99	98	91	97.6%
Gemma 3 12B	100	99	99	98	91	97.5%
Gemma 3 27B	100	100	100	95	93	97.4%
Llama 3.1 8B	100	100	100	100	87	97.3%
Claude 3.7 Sonnet	100	99	99	98	90	97.2%
GPT-5.2	100	98	98	98	92	97.2%
Z.AI GLM 4.5	100	100	100	94	92	97.2%
Grok 4	100	100	100	95	91	97.1%
DeepSeek-V2 Chat	99	98	98	95	95	96.9%
GPT-4o, May 13th (temp=1)	100	100	98	93	92	96.5%
Ministral 3B	100	100	96	94	92	96.5%
Claude 3 Haiku	100	100	98	93	92	96.5%
Gemma 3 4B	99	99	96	96	92	96.4%
Gemini 3.1 Pro (Preview)	99	97	97	95	94	96.4%
Arcee AI: Trinity Large (Preview)	100	100	97	93	91	96.4%
Claude Opus 4	100	100	97	94	90	96.3%
Qwen 3.5 397B A17B	100	100	98	93	90	96.1%
GPT-4o, May 13th (temp=0)	100	100	99	94	87	96.0%
Rocinante 12B	100	98	96	96	90	96.0%
GPT-4.1 Nano	100	100	97	95	88	96.0%
Claude Haiku 4.5	100	100	97	92	90	95.8%
GPT-4o, Aug. 6th (temp=1)	100	99	93	93	92	95.4%
Mistral Small 3.2 24B	100	100	96	91	88	95.1%
Mistral Large 2	100	100	98	92	85	95.0%
GPT-4o, Aug. 6th (temp=0)	99	95	94	94	92	95.0%
Claude Sonnet 4.6	100	97	97	91	89	94.9%
GPT-4o Mini (temp=1)	100	96	95	94	89	94.9%
Z.AI GLM 5	100	96	94	93	90	94.8%
Gemini 2.5 Pro	100	99	97	95	82	94.7%
Gemini 2.5 Flash Lite	100	100	93	91	89	94.7%
GPT-4.1 Mini	100	100	97	95	82	94.7%
Hermes 3 70B	100	98	97	91	85	94.3%
Ministral 8B	100	96	96	92	84	93.6%
Qwen 3.5 Plus (2026-02-15)	100	99	94	89	87	93.6%
GPT-5 Nano	100	94	94	90	89	93.5%
Minimax M2.5	100	96	93	90	88	93.4%
Mistral Large	100	96	91	89	89	93.2%
Z.AI GLM 4.7	100	96	95	89	86	93.2%
Ministral 3 8B	100	100	89	89	87	93.1%
Mistral NeMO	98	97	92	90	89	93.0%
ByteDance Seed 1.6 Flash	96	95	92	92	90	93.0%
Z.AI GLM 4.6	97	96	93	90	87	92.7%
Gemini 3 Pro (Preview)	97	97	91	91	87	92.6%
Llama 3.1 Nemotron 70B	100	97	96	88	82	92.5%
Claude Opus 4.6	100	97	96	85	82	92.2%
Mistral Large 3	99	95	94	89	84	92.1%
ByteDance Seed 1.6	99	96	96	93	77	92.1%
WizardLM 2 8x22b	100	100	100	90	70	92.0%
Gemini 3 Flash (Preview)	100	98	94	92	75	92.0%
DeepSeek V3.2	98	96	95	88	80	91.2%
Z.AI GLM 4.7 Flash	98	92	92	89	86	91.2%
Claude Opus 4.5	97	92	90	89	88	91.1%
Claude Sonnet 4.5	97	94	91	87	85	91.0%
Arcee AI: Trinity Mini	98	97	93	91	73	90.5%
MoonshotAI: Kimi K2.5	100	98	97	91	65	90.2%
Cohere Command R+ (Aug. 2024)	96	92	92	89	77	89.1%
Stealth: Aurora Alpha	100	94	90	83	78	89.1%
Gemini 2.5 Flash	100	94	92	86	72	88.8%
Claude 3.5 Sonnet	98	93	89	88	75	88.5%
Qwen 2.5 72B	100	97	92	80	74	88.5%
GPT-5 Mini	96	89	88	87	81	88.3%
Claude Sonnet 4	96	94	87	82	82	88.0%
Claude 3.5 Haiku	98	96	96	82	64	87.3%
GPT-4o Mini (temp=0)	92	90	88	84	80	86.9%
Llama 3.1 70B	100	99	83	75	75	86.4%

Novelcrafter Default Prompt

▼

Fantasy: entering an ancient ruin

Model	# 1	# 2	# 3	# 4	# 5	Avg ▼
Gemini 3.1 Pro (Preview)	100	100	100	100	100	100.0%
Qwen 3.5 397B A17B	100	100	100	100	100	100.0%
GPT-5.1	100	100	100	100	100	100.0%
o4 Mini High	100	100	100	100	100	100.0%
o4 Mini	100	100	100	100	100	100.0%
GPT-5.2	100	100	100	100	100	100.0%
Grok 4	100	100	100	100	100	100.0%
Claude Sonnet 4.5	100	100	100	100	100	100.0%
Grok 4.1 Fast	100	100	100	100	100	100.0%
GPT-4.1	100	100	100	100	100	100.0%
Qwen 3.5 Plus (2026-02-15)	100	100	100	100	100	100.0%
Grok 4 Fast	100	100	100	100	100	100.0%
Claude 3.5 Sonnet	100	100	100	100	100	100.0%
Claude Haiku 4.5	100	100	100	100	100	100.0%
Claude 3.5 Haiku	100	100	100	100	100	100.0%
GPT-4o Mini (temp=0)	100	100	100	100	100	100.0%
Llama 3.1 70B	100	100	100	100	100	100.0%
Mistral Medium 3.1	100	100	100	100	100	100.0%
Z.AI GLM 4.5	100	100	100	100	100	100.0%
Gemini 2.5 Flash Lite	100	100	100	100	100	99.9%
MoonshotAI: Kimi K2.5	100	100	100	100	99	99.9%
DeepSeek V3 (2025-03-24)	100	100	100	100	99	99.8%
Rocinante 12B	100	100	100	100	99	99.7%
GPT-4o, Aug. 6th (temp=0)	100	100	100	100	99	99.7%
Mistral Large	100	100	100	100	98	99.6%
Mistral NeMO	100	100	100	100	98	99.6%
Mistral Small 3.2 24B	100	100	100	100	97	99.5%
Stealth: Aurora Alpha	100	100	100	100	97	99.5%
Gemini 2.5 Flash	100	100	100	100	98	99.4%
Mistral Small Creative	100	100	100	100	96	99.2%
Ministral 3 3B	100	100	100	99	98	99.2%
GPT-4o, May 13th (temp=1)	100	100	100	100	96	99.2%
Claude Opus 4.5	100	100	100	100	96	99.1%
Claude Sonnet 4.6	100	100	100	100	96	99.0%
GPT-4o Mini (temp=1)	100	100	100	100	95	99.0%
Ministral 8B	100	100	100	98	97	99.0%
GPT-4.1 Mini	100	100	100	100	94	98.9%
Claude Sonnet 4	100	100	100	99	95	98.7%
GPT-4.1 Nano	100	100	100	99	94	98.7%
Claude 3.7 Sonnet	100	100	100	97	96	98.7%
Mistral Large 2	100	100	98	98	97	98.6%
Cohere Command R+ (Aug. 2024)	100	100	98	98	97	98.6%
GPT-4o, Aug. 6th (temp=1)	100	100	100	99	93	98.4%
DeepSeek V3 (2024-12-26)	100	100	100	97	95	98.4%
Mistral Large 3	100	100	99	97	96	98.4%
ByteDance Seed 1.6 Flash	100	100	100	96	95	98.3%
Claude Opus 4.6	100	100	99	98	95	98.3%
Z.AI GLM 4.7	100	100	100	98	93	98.2%
Gemma 3 12B	100	100	100	97	94	98.1%
GPT-5 Nano	100	100	99	98	93	98.1%
GPT-5 Mini	100	100	98	97	95	98.0%
GPT-4o, May 13th (temp=0)	100	100	100	97	93	98.0%
Writer: Palmyra X5	100	100	100	96	94	98.0%
Hermes 3 405B	100	100	100	100	90	97.9%
Minimax M2.5	100	100	100	100	89	97.8%
Z.AI GLM 4.6	100	100	99	96	94	97.8%
Ministral 3 8B	100	100	100	99	90	97.8%
GPT-5	100	100	100	96	93	97.7%
Arcee AI: Trinity Large (Preview)	100	100	100	96	92	97.5%
Gemini 3 Pro (Preview)	100	100	98	97	93	97.5%
Ministral 3B	100	100	97	97	93	97.3%
DeepSeek V3.2	100	99	98	97	93	97.3%
Z.AI GLM 5	100	100	100	98	88	97.3%
Arcee AI: Trinity Mini	100	100	97	97	92	97.3%
Gemma 3 27B	100	100	96	96	95	97.2%
Claude Opus 4	100	100	100	96	88	96.8%
DeepSeek-V2 Chat	100	100	99	93	92	96.7%
Ministral 3 14B	100	100	99	95	90	96.7%
Hermes 3 70B	100	100	99	94	89	96.4%
Claude 3 Haiku	100	100	96	95	91	96.3%
WizardLM 2 8x22b	100	100	95	95	90	95.9%
Gemma 3 4B	100	100	94	92	90	95.3%
Gemini 3 Flash (Preview)	100	100	96	95	84	94.9%
Z.AI GLM 4.7 Flash	98	95	95	93	88	93.7%
Qwen 2.5 72B	100	94	92	92	90	93.6%
ByteDance Seed 1.6	100	100	97	96	74	93.3%
Llama 3.1 Nemotron 70B	100	96	94	92	82	92.7%
Llama 3.1 8B	100	96	95	85	83	92.0%
Gemini 2.5 Pro	96	96	95	89	81	91.2%
DeepSeek V3.1	95	91	86	79	76	85.4%

▼

Horror: alone in an eerie place at night

Model	# 1	# 2	# 3	# 4	# 5	Avg ▼
Gemini 3.1 Pro (Preview)	100	100	100	100	100	100.0%
Qwen 3.5 397B A17B	100	100	100	100	100	100.0%
GPT-5.1	100	100	100	100	100	100.0%
o4 Mini High	100	100	100	100	100	100.0%
MoonshotAI: Kimi K2.5	100	100	100	100	100	100.0%
GPT-5	100	100	100	100	100	100.0%
o4 Mini	100	100	100	100	100	100.0%
GPT-5.2	100	100	100	100	100	100.0%
Grok 4	100	100	100	100	100	100.0%
Claude Sonnet 4.5	100	100	100	100	100	100.0%
Grok 4.1 Fast	100	100	100	100	100	100.0%
Grok 4 Fast	100	100	100	100	100	100.0%
Claude 3.5 Sonnet	100	100	100	100	100	100.0%
Claude 3.5 Haiku	100	100	100	100	100	100.0%
GPT-4o Mini (temp=1)	100	100	100	100	100	100.0%
Ministral 3 8B	100	100	100	100	100	100.0%
Gemma 3 12B	100	100	100	100	100	99.9%
Stealth: Aurora Alpha	100	100	100	100	99	99.8%
GPT-4.1	100	100	100	100	98	99.6%
Claude Haiku 4.5	100	100	100	100	98	99.6%
Gemma 3 27B	100	100	100	99	99	99.6%
Mistral Large 3	100	100	100	100	98	99.6%
Qwen 3.5 Plus (2026-02-15)	100	100	100	100	98	99.5%
Mistral Large	100	100	100	100	98	99.5%
GPT-4.1 Nano	100	100	100	100	98	99.5%
Ministral 8B	100	100	100	100	98	99.5%
Claude Opus 4	100	100	100	100	97	99.4%
GPT-4.1 Mini	100	100	100	100	97	99.3%
Mistral Medium 3.1	100	100	99	99	98	99.3%
Claude Sonnet 4	100	100	100	100	96	99.3%
Z.AI GLM 4.5	100	100	100	98	97	99.2%
Claude 3.7 Sonnet	100	100	100	99	97	99.0%
Claude Opus 4.6	100	100	100	100	94	98.8%
Writer: Palmyra X5	100	100	100	99	95	98.8%
Gemini 2.5 Pro	100	100	100	99	94	98.6%
Gemma 3 4B	100	100	99	98	96	98.5%
Claude Opus 4.5	100	100	100	97	95	98.5%
DeepSeek V3 (2024-12-26)	100	100	100	97	95	98.4%
Rocinante 12B	100	100	100	97	95	98.4%
Mistral Small Creative	100	100	100	98	95	98.4%
Cohere Command R+ (Aug. 2024)	100	100	100	100	92	98.3%
Ministral 3 3B	100	100	100	100	92	98.3%
Ministral 3 14B	100	100	100	97	95	98.3%
DeepSeek V3 (2025-03-24)	100	100	100	97	94	98.2%
Gemini 3 Pro (Preview)	100	100	100	98	92	98.1%
Z.AI GLM 5	100	99	98	97	97	98.1%
GPT-4o, Aug. 6th (temp=0)	100	100	100	96	94	98.1%
GPT-5 Mini	100	100	99	99	92	98.0%
GPT-4o Mini (temp=0)	100	100	100	97	92	97.8%
Qwen 2.5 72B	100	100	97	96	96	97.7%
Ministral 3B	100	100	98	95	94	97.5%
Z.AI GLM 4.7 Flash	100	100	99	98	90	97.2%
Mistral Large 2	100	100	100	93	93	97.2%
DeepSeek-V2 Chat	100	100	97	94	94	97.1%
ByteDance Seed 1.6 Flash	100	100	100	95	91	97.1%
ByteDance Seed 1.6	100	100	98	97	89	96.9%
WizardLM 2 8x22b	100	100	98	93	92	96.8%
Arcee AI: Trinity Large (Preview)	100	100	98	93	92	96.6%
GPT-5 Nano	100	99	95	95	94	96.5%
Claude Sonnet 4.6	100	100	100	100	82	96.3%
Gemini 2.5 Flash	100	100	96	93	92	96.2%
GPT-4o, May 13th (temp=0)	100	100	99	95	87	96.1%
GPT-4o, May 13th (temp=1)	100	100	98	97	84	95.8%
Gemini 2.5 Flash Lite	100	99	97	95	87	95.6%
Z.AI GLM 4.6	100	99	96	94	89	95.5%
GPT-4o, Aug. 6th (temp=1)	100	100	100	95	83	95.5%
Hermes 3 405B	100	100	96	92	89	95.5%
Gemini 3 Flash (Preview)	97	97	96	94	91	95.1%
DeepSeek V3.2	100	100	94	92	89	95.0%
Arcee AI: Trinity Mini	100	100	100	97	78	95.0%
Minimax M2.5	100	100	96	88	87	94.3%
Z.AI GLM 4.7	100	100	92	90	89	94.2%
Mistral NeMO	100	99	97	90	85	94.0%
Claude 3 Haiku	100	99	94	89	78	92.0%
Hermes 3 70B	100	98	93	89	78	91.5%
Llama 3.1 8B	100	100	99	96	59	91.0%
Llama 3.1 Nemotron 70B	99	90	89	89	87	90.8%
Mistral Small 3.2 24B	100	100	100	94	57	90.3%
DeepSeek V3.1	100	100	93	88	61	88.5%
Llama 3.1 70B	98	96	91	86	62	86.5%

▼

Literary fiction: old friends reunite

Model	# 1	# 2	# 3	# 4	# 5	Avg ▼
Gemini 3.1 Pro (Preview)	100	100	100	100	100	100.0%
Qwen 3.5 397B A17B	100	100	100	100	100	100.0%
GPT-5.1	100	100	100	100	100	100.0%
o4 Mini High	100	100	100	100	100	100.0%
o4 Mini	100	100	100	100	100	100.0%
GPT-5.2	100	100	100	100	100	100.0%
Grok 4	100	100	100	100	100	100.0%
Grok 4.1 Fast	100	100	100	100	100	100.0%
GPT-4.1	100	100	100	100	100	100.0%
Stealth: Aurora Alpha	100	100	100	100	100	100.0%
Qwen 3.5 Plus (2026-02-15)	100	100	100	100	100	100.0%
DeepSeek V3 (2025-03-24)	100	100	100	100	100	100.0%
Grok 4 Fast	100	100	100	100	100	100.0%
GPT-4o, May 13th (temp=0)	100	100	100	100	100	100.0%
Z.AI GLM 4.5	100	100	100	100	100	100.0%
GPT-4o, Aug. 6th (temp=0)	100	100	100	100	100	100.0%
Mistral Medium 3.1	100	100	100	100	100	100.0%
GPT-5	100	100	100	100	100	100.0%
GPT-4o Mini (temp=1)	100	100	100	100	100	100.0%
Claude Opus 4	100	100	100	100	100	100.0%
Mistral Small Creative	100	100	100	100	100	100.0%
Mistral Small 3.2 24B	100	100	100	100	100	99.9%
DeepSeek-V2 Chat	100	100	100	100	100	99.9%
Mistral Large 2	100	100	100	100	99	99.9%
GPT-4.1 Mini	100	100	100	100	99	99.8%
MoonshotAI: Kimi K2.5	100	100	100	100	99	99.7%
GPT-4o Mini (temp=0)	100	100	100	100	99	99.7%
Z.AI GLM 4.6	100	100	100	100	98	99.6%
Arcee AI: Trinity Mini	100	100	100	100	98	99.6%
GPT-4o, Aug. 6th (temp=1)	100	100	100	99	98	99.5%
Gemini 2.5 Flash	100	100	100	100	97	99.4%
Gemma 3 4B	100	100	100	100	97	99.4%
Claude Opus 4.5	100	100	100	98	98	99.2%
Claude Sonnet 4	100	100	100	98	98	99.2%
Z.AI GLM 4.7	100	100	100	98	97	99.1%
DeepSeek V3 (2024-12-26)	100	100	99	98	98	99.0%
GPT-4o, May 13th (temp=1)	100	100	100	100	94	98.9%
Ministral 3 3B	100	100	100	99	95	98.8%
Gemini 3 Flash (Preview)	100	100	100	100	94	98.8%
Ministral 8B	100	100	99	98	97	98.8%
GPT-4.1 Nano	100	100	100	99	95	98.8%
Hermes 3 405B	100	100	98	98	97	98.7%
ByteDance Seed 1.6 Flash	100	100	100	98	96	98.7%
Writer: Palmyra X5	100	100	100	99	94	98.7%
Mistral NeMO	100	100	100	99	94	98.4%
Claude Sonnet 4.5	100	100	100	100	92	98.4%
Claude 3.7 Sonnet	100	100	100	97	94	98.4%
Minimax M2.5	100	100	100	100	91	98.2%
Gemma 3 27B	100	100	100	96	95	98.1%
Ministral 3 8B	100	100	99	97	94	98.0%
Ministral 3 14B	100	100	100	97	92	97.8%
Gemini 3 Pro (Preview)	99	99	98	98	94	97.6%
Qwen 2.5 72B	100	100	100	94	93	97.5%
GPT-5 Nano	100	100	98	96	94	97.5%
Mistral Large	100	100	100	96	91	97.3%
GPT-5 Mini	100	100	97	96	91	97.0%
DeepSeek V3.2	100	99	98	97	90	96.9%
WizardLM 2 8x22b	100	100	100	99	86	96.9%
Claude 3.5 Sonnet	100	100	100	96	89	96.8%
Claude Sonnet 4.6	100	100	99	95	89	96.7%
Arcee AI: Trinity Large (Preview)	100	98	97	96	91	96.6%
Rocinante 12B	100	100	100	95	86	96.2%
Gemini 2.5 Flash Lite	100	100	100	94	87	96.1%
Hermes 3 70B	100	100	100	91	89	95.8%
Claude Opus 4.6	98	98	97	95	91	95.6%
Ministral 3B	100	100	99	93	86	95.6%
Z.AI GLM 4.7 Flash	100	100	99	90	89	95.6%
Llama 3.1 8B	100	100	100	100	78	95.5%
Z.AI GLM 5	100	97	97	95	88	95.4%
Gemma 3 12B	100	100	98	97	82	95.3%
Mistral Large 3	100	100	98	96	82	95.3%
Gemini 2.5 Pro	100	100	96	90	89	95.0%
Claude Haiku 4.5	100	96	94	93	91	94.7%
Claude 3.5 Haiku	100	100	100	90	83	94.7%
ByteDance Seed 1.6	100	98	96	91	88	94.3%
DeepSeek V3.1	100	100	94	89	87	94.0%
Cohere Command R+ (Aug. 2024)	100	98	96	90	85	93.8%
Llama 3.1 Nemotron 70B	100	100	98	96	73	93.5%
Claude 3 Haiku	100	100	97	90	78	93.0%
Llama 3.1 70B	100	94	93	88	82	91.5%

▼

Mystery: examining a crime scene

Model	# 1	# 2	# 3	# 4	# 5	Avg ▼
Gemini 3.1 Pro (Preview)	100	100	100	100	100	100.0%
GPT-5.1	100	100	100	100	100	100.0%
o4 Mini	100	100	100	100	100	100.0%
Grok 4.1 Fast	100	100	100	100	100	100.0%
Grok 4 Fast	100	100	100	100	100	100.0%
GPT-5.2	100	100	100	100	99	99.8%
Claude Opus 4	100	100	100	100	99	99.8%
o4 Mini High	100	100	100	100	99	99.8%
GPT-5	100	100	100	100	98	99.7%
GPT-4o, Aug. 6th (temp=1)	100	100	100	100	98	99.7%
Qwen 3.5 397B A17B	100	100	100	100	98	99.5%
GPT-4o Mini (temp=1)	100	100	100	99	99	99.5%
GPT-4.1	100	100	100	100	97	99.4%
MoonshotAI: Kimi K2.5	100	100	100	100	97	99.4%
GPT-4o, May 13th (temp=1)	100	100	100	100	95	99.0%
Mistral NeMO	100	100	99	99	96	98.9%
Grok 4	100	100	100	98	97	98.8%
GPT-4.1 Mini	100	100	100	100	93	98.5%
Stealth: Aurora Alpha	100	100	100	96	93	97.8%
GPT-4o Mini (temp=0)	100	100	100	100	86	97.2%
Z.AI GLM 5	100	100	97	95	94	97.1%
GPT-5 Nano	100	100	96	95	93	97.0%
Claude 3 Haiku	100	100	99	95	92	97.0%
Llama 3.1 Nemotron 70B	100	100	96	95	94	96.9%
Gemini 2.5 Flash Lite	100	100	97	94	92	96.6%
Qwen 3.5 Plus (2026-02-15)	100	97	95	95	95	96.6%
Gemma 3 4B	100	100	96	94	92	96.4%
Hermes 3 405B	100	100	100	95	86	96.2%
Gemma 3 12B	100	100	98	97	84	95.7%
ByteDance Seed 1.6 Flash	100	99	95	94	90	95.6%
Gemma 3 27B	100	98	96	93	91	95.6%
Mistral Large	100	99	96	94	88	95.5%
Rocinante 12B	100	100	100	91	86	95.4%
Writer: Palmyra X5	100	100	94	92	91	95.4%
Ministral 3 3B	100	99	93	92	92	95.1%
Z.AI GLM 4.5	100	100	100	90	85	95.1%
Mistral Small 3.2 24B	100	100	100	99	76	95.0%
Ministral 3 8B	100	99	94	92	90	94.9%
Qwen 2.5 72B	99	98	97	92	88	94.6%
Gemini 3 Flash (Preview)	99	98	96	94	86	94.4%
Ministral 3 14B	100	100	96	93	82	94.3%
DeepSeek V3 (2024-12-26)	100	99	97	91	83	94.1%
Claude 3.5 Haiku	100	94	94	94	87	93.9%
Claude 3.7 Sonnet	100	100	95	91	83	93.9%
Gemini 2.5 Flash	98	96	93	91	91	93.8%
Cohere Command R+ (Aug. 2024)	100	97	93	91	87	93.6%
Minimax M2.5	100	96	96	89	87	93.6%
Gemini 3 Pro (Preview)	100	99	93	91	84	93.6%
GPT-4.1 Nano	100	100	95	90	82	93.5%
Hermes 3 70B	100	100	95	91	81	93.5%
Mistral Medium 3.1	97	95	94	93	88	93.4%
DeepSeek V3 (2025-03-24)	100	99	95	91	80	93.0%
Claude Haiku 4.5	96	96	94	94	85	93.0%
Llama 3.1 70B	100	100	97	88	78	92.5%
WizardLM 2 8x22b	100	95	93	92	80	92.2%
DeepSeek V3.2	100	99	94	85	83	92.1%
Llama 3.1 8B	100	95	94	89	81	92.0%
Ministral 3B	100	96	91	90	82	91.7%
DeepSeek V3.1	100	96	96	89	78	91.7%
Arcee AI: Trinity Mini	100	100	87	86	85	91.7%
Arcee AI: Trinity Large (Preview)	100	94	89	89	87	91.5%
Claude Opus 4.5	98	95	95	91	79	91.5%
GPT-5 Mini	99	94	90	88	86	91.3%
Mistral Large 2	100	99	92	85	81	91.3%
Z.AI GLM 4.7 Flash	100	98	91	84	82	91.2%
Ministral 8B	100	94	91	86	84	91.0%
Claude Sonnet 4	100	90	88	87	87	90.5%
DeepSeek-V2 Chat	100	97	89	89	78	90.5%
Claude Sonnet 4.5	97	96	90	85	82	89.9%
Claude 3.5 Sonnet	100	97	90	86	73	89.1%
Claude Opus 4.6	95	92	92	84	81	88.8%
Mistral Small Creative	94	92	87	85	84	88.5%
Gemini 2.5 Pro	99	91	88	86	77	88.5%
ByteDance Seed 1.6	100	91	89	87	75	88.4%
Mistral Large 3	100	88	85	83	81	87.4%
Claude Sonnet 4.6	96	92	90	76	74	85.5%
GPT-4o, May 13th (temp=0)	95	86	85	83	78	85.5%
Z.AI GLM 4.7	96	89	87	84	71	85.3%
Z.AI GLM 4.6	96	94	82	77	75	84.8%
GPT-4o, Aug. 6th (temp=0)	100	98	86	70	66	83.8%

▼

Romance: separated couple reunites

Model	# 1	# 2	# 3	# 4	# 5	Avg ▼
Gemini 3.1 Pro (Preview)	100	100	100	100	100	100.0%
Qwen 3.5 397B A17B	100	100	100	100	100	100.0%
GPT-5.1	100	100	100	100	100	100.0%
o4 Mini High	100	100	100	100	100	100.0%
MoonshotAI: Kimi K2.5	100	100	100	100	100	100.0%
o4 Mini	100	100	100	100	100	100.0%
GPT-5.2	100	100	100	100	100	100.0%
Grok 4	100	100	100	100	100	100.0%
Grok 4.1 Fast	100	100	100	100	100	100.0%
GPT-4.1	100	100	100	100	100	100.0%
Qwen 3.5 Plus (2026-02-15)	100	100	100	100	100	100.0%
Grok 4 Fast	100	100	100	100	100	100.0%
Claude 3.5 Sonnet	100	100	100	100	100	100.0%
DeepSeek-V2 Chat	100	100	100	100	100	100.0%
GPT-4o, Aug. 6th (temp=1)	100	100	100	100	100	100.0%
Claude 3.5 Haiku	100	100	100	100	100	100.0%
Gemini 2.5 Flash	100	100	100	100	100	100.0%
Gemma 3 12B	100	100	100	100	100	100.0%
Mistral Large	100	100	100	100	100	100.0%
Llama 3.1 8B	100	100	100	100	100	100.0%
Gemma 3 4B	100	100	100	100	100	100.0%
WizardLM 2 8x22b	100	100	100	100	100	100.0%
Claude Sonnet 4.5	100	100	100	100	100	100.0%
GPT-4o Mini (temp=1)	100	100	100	100	100	99.9%
Ministral 3 14B	100	100	100	100	100	99.9%
GPT-5	100	100	100	100	99	99.9%
DeepSeek V3 (2025-03-24)	100	100	100	100	99	99.9%
GPT-4o Mini (temp=0)	100	100	100	100	99	99.8%
GPT-5 Nano	100	100	100	100	99	99.8%
Stealth: Aurora Alpha	100	100	100	100	99	99.8%
Mistral Medium 3.1	100	100	100	100	99	99.7%
Ministral 3B	100	100	100	100	98	99.7%
Claude Opus 4.5	100	100	100	100	98	99.6%
Claude Sonnet 4	100	100	100	100	98	99.6%
Gemini 3 Flash (Preview)	100	100	100	100	98	99.6%
Hermes 3 405B	100	100	100	100	98	99.6%
GPT-4o, May 13th (temp=1)	100	100	100	99	99	99.6%
Hermes 3 70B	100	100	100	100	98	99.6%
Minimax M2.5	100	100	100	100	98	99.6%
GPT-4.1 Mini	100	100	100	100	98	99.6%
Z.AI GLM 5	100	100	100	99	99	99.6%
Writer: Palmyra X5	100	100	100	100	98	99.5%
Z.AI GLM 4.5	100	100	100	100	97	99.5%
Ministral 3 3B	100	100	100	99	97	99.3%
Claude 3.7 Sonnet	100	100	100	100	96	99.3%
GPT-5 Mini	100	100	100	100	96	99.3%
DeepSeek V3 (2024-12-26)	100	100	100	100	96	99.3%
Cohere Command R+ (Aug. 2024)	100	100	100	99	98	99.3%
ByteDance Seed 1.6 Flash	100	100	100	99	97	99.2%
Mistral Small Creative	100	100	100	100	95	99.0%
Claude Opus 4.6	100	100	100	99	96	98.9%
Claude Opus 4	100	100	100	97	97	98.9%
Gemma 3 27B	100	100	100	97	97	98.9%
Mistral Large 3	100	100	100	100	94	98.7%
Ministral 8B	100	100	100	100	93	98.7%
Mistral Small 3.2 24B	100	100	99	99	95	98.6%
Arcee AI: Trinity Mini	100	100	99	99	95	98.5%
Claude Haiku 4.5	100	100	100	100	93	98.5%
Claude Sonnet 4.6	100	100	99	98	94	98.2%
GPT-4o, May 13th (temp=0)	100	100	100	99	91	98.1%
Gemini 2.5 Flash Lite	100	99	99	96	96	98.1%
Gemini 3 Pro (Preview)	100	100	97	97	95	98.0%
Mistral Large 2	100	100	100	98	91	97.7%
Qwen 2.5 72B	100	99	98	97	93	97.3%
Z.AI GLM 4.7 Flash	100	100	96	95	95	97.2%
Mistral NeMO	100	100	100	94	92	97.2%
GPT-4.1 Nano	100	100	100	95	91	97.2%
Z.AI GLM 4.7	100	100	100	96	90	97.1%
Z.AI GLM 4.6	100	100	98	95	91	96.8%
Ministral 3 8B	100	100	100	95	88	96.7%
DeepSeek V3.1	100	98	97	95	93	96.6%
DeepSeek V3.2	100	100	100	96	84	96.1%
Gemini 2.5 Pro	100	100	97	92	90	95.7%
Llama 3.1 70B	100	100	100	98	74	94.4%
Llama 3.1 Nemotron 70B	100	100	100	100	71	94.3%
Rocinante 12B	100	100	94	93	83	94.2%
Arcee AI: Trinity Large (Preview)	97	96	95	93	88	93.6%
GPT-4o, Aug. 6th (temp=0)	100	100	93	87	87	93.2%
Claude 3 Haiku	100	99	89	88	84	92.0%
ByteDance Seed 1.6	100	92	91	88	82	90.7%

▼

Thriller: chase through city streets

Model	# 1	# 2	# 3	# 4	# 5	Avg ▼
Gemini 3.1 Pro (Preview)	100	100	100	100	100	100.0%
Qwen 3.5 397B A17B	100	100	100	100	100	100.0%
GPT-5.1	100	100	100	100	100	100.0%
o4 Mini High	100	100	100	100	100	100.0%
MoonshotAI: Kimi K2.5	100	100	100	100	100	100.0%
o4 Mini	100	100	100	100	100	100.0%
GPT-5.2	100	100	100	100	100	100.0%
Grok 4	100	100	100	100	100	100.0%
Claude Sonnet 4.5	100	100	100	100	100	100.0%
Grok 4.1 Fast	100	100	100	100	100	100.0%
Qwen 3.5 Plus (2026-02-15)	100	100	100	100	100	100.0%
Grok 4 Fast	100	100	100	100	100	100.0%
GPT-4o Mini (temp=1)	100	100	100	100	100	100.0%
Gemma 3 27B	100	100	100	100	100	100.0%
Z.AI GLM 4.5	100	100	100	100	100	100.0%
GPT-5	100	100	100	100	100	99.9%
GPT-4o, Aug. 6th (temp=1)	100	100	100	100	99	99.8%
Stealth: Aurora Alpha	100	100	100	99	99	99.7%
GPT-4o Mini (temp=0)	100	100	100	100	98	99.6%
GPT-4o, May 13th (temp=1)	100	100	100	100	98	99.5%
Gemma 3 12B	100	100	100	100	98	99.5%
GPT-4.1	100	100	100	100	97	99.4%
GPT-5 Mini	100	100	100	100	96	99.2%
Mistral Large 2	100	100	100	100	95	99.0%
Mistral Large	100	100	100	100	95	99.0%
Writer: Palmyra X5	100	100	100	100	95	99.0%
DeepSeek V3 (2025-03-24)	100	100	99	99	96	98.7%
GPT-4.1 Nano	100	100	100	97	94	98.3%
Gemini 2.5 Flash Lite	100	100	100	100	91	98.3%
DeepSeek V3 (2024-12-26)	100	100	100	96	95	98.0%
Ministral 3 8B	100	100	100	100	90	98.0%
GPT-4o, Aug. 6th (temp=0)	100	100	97	97	96	98.0%
Mistral Medium 3.1	100	100	99	96	95	98.0%
Gemini 3 Pro (Preview)	100	100	98	97	95	98.0%
Claude 3.5 Haiku	100	100	100	100	89	97.9%
Ministral 3B	100	100	100	95	94	97.8%
GPT-5 Nano	100	100	98	97	95	97.7%
Mistral Large 3	100	100	100	95	93	97.7%
Mistral NeMO	100	100	100	94	94	97.6%
Gemma 3 4B	100	98	98	96	94	97.4%
Cohere Command R+ (Aug. 2024)	100	100	100	94	93	97.4%
GPT-4.1 Mini	100	100	100	95	92	97.3%
Llama 3.1 Nemotron 70B	100	97	97	96	96	97.3%
ByteDance Seed 1.6 Flash	100	100	100	94	92	97.2%
DeepSeek-V2 Chat	100	100	100	96	90	97.2%
WizardLM 2 8x22b	100	100	100	100	85	97.0%
Z.AI GLM 5	100	100	99	98	88	96.9%
Z.AI GLM 4.7	100	100	100	96	88	96.9%
Ministral 8B	100	100	100	100	83	96.6%
Claude 3.7 Sonnet	100	100	100	96	87	96.6%
Claude Opus 4	100	100	97	96	90	96.5%
Claude Opus 4.5	100	100	100	92	91	96.4%
Claude Opus 4.6	100	100	97	95	89	96.4%
Gemini 2.5 Pro	100	100	98	97	86	96.2%
Minimax M2.5	100	100	98	95	87	96.0%
DeepSeek V3.2	100	100	97	93	90	95.9%
Mistral Small Creative	100	100	96	92	91	95.7%
Ministral 3 3B	100	100	99	94	85	95.6%
Claude Haiku 4.5	99	99	96	93	90	95.5%
Arcee AI: Trinity Mini	100	100	96	94	88	95.5%
DeepSeek V3.1	99	99	96	90	90	94.8%
Ministral 3 14B	100	100	93	90	90	94.7%
Llama 3.1 8B	100	100	93	91	89	94.7%
Claude 3.5 Sonnet	100	100	96	90	86	94.5%
GPT-4o, May 13th (temp=0)	100	100	96	93	83	94.5%
Mistral Small 3.2 24B	100	100	99	86	86	94.3%
Gemini 2.5 Flash	100	100	100	100	70	94.0%
Rocinante 12B	100	100	96	87	87	94.0%
Gemini 3 Flash (Preview)	100	98	96	93	82	93.8%
Claude 3 Haiku	100	100	100	85	84	93.6%
Claude Sonnet 4	100	100	95	94	78	93.5%
Llama 3.1 70B	100	100	91	90	85	93.3%
Hermes 3 405B	100	99	95	91	82	93.3%
Z.AI GLM 4.7 Flash	100	97	94	88	87	93.2%
Arcee AI: Trinity Large (Preview)	100	99	96	89	82	93.1%
Qwen 2.5 72B	100	98	94	93	80	92.7%
Hermes 3 70B	100	95	94	91	84	92.7%
Z.AI GLM 4.6	100	93	91	90	87	92.0%
ByteDance Seed 1.6	94	92	89	89	87	90.1%
Claude Sonnet 4.6	100	93	89	89	78	89.7%

Passive voice overuse

Overall Performance

Performance Score Distribution (Top 20)

Price-Performance Score Distribution (Top 20)

Most Stable Models (Top 20)

Top Overall Models (Top 20)

Individual Scenarios

Detailed Writing Rules

Fantasy: entering an ancient ruin

Horror: alone in an eerie place at night

Literary fiction: old friends reunite

Mystery: examining a crime scene

Romance: separated couple reunites

Thriller: chase through city streets

genre

Fantasy: entering an ancient ruin

Horror: alone in an eerie place at night

Literary fiction: old friends reunite

Mystery: examining a crime scene

Romance: separated couple reunites

Thriller: chase through city streets

Novelcrafter Default Prompt

Fantasy: entering an ancient ruin

Horror: alone in an eerie place at night

Literary fiction: old friends reunite

Mystery: examining a crime scene

Romance: separated couple reunites

Thriller: chase through city streets