Purple prose (modifier overload)

Test: Bad Writing Habits

Avg. Score

95.7%

Scenarios

Overall Performance

Performance Score Distribution (Top 20)

Click a model name to view its detail page.

Rank ▲	Model	Score	Avg. Cost	Avg. Time	Stability
1	Stealth: Aurora Alpha	99.3%	$0.0000	9.8s	95%
2	ByteDance Seed 1.6 Flash	99.1%	$0.0013	27.3s	95%
3	GPT-4o Mini (temp=0)	99.0%	$0.0012	34.8s	95%
4	Grok 4 Fast	98.3%	$0.0017	24.1s	94%
5	Mistral NeMO	97.8%	$0.0005	10.1s	93%
6	GPT-4o, Aug. 6th (temp=0)	98.6%	$0.023	22.7s	95%
7	Ministral 3B	97.7%	$0.0001	8.1s	91%
8	Qwen 2.5 72B	98.0%	$0.0010	36.7s	92%
9	Mistral Large	98.0%	$0.014	30.9s	93%
10	o4 Mini	97.8%	$0.015	25.7s	93%
11	Arcee AI: Trinity Mini	96.6%	$0.0003	9.2s	91%
12	Grok 4.1 Fast	97.5%	$0.0018	37.8s	92%
13	GPT-4o Mini (temp=1)	97.6%	$0.0012	34.8s	91%
14	Hermes 3 70B	97.6%	$0.0010	1.2m	93%
15	GPT-5 Mini	97.6%	$0.0100	57.4s	93%
16	Arcee AI: Trinity Large (Preview)	97.0%	$0.0000	43.6s	91%
17	Cohere Command R+ (Aug. 2024)	97.9%	$0.020	52.5s	92%
18	Mistral Large 3	97.0%	$0.0033	30.3s	90%
19	o4 Mini High	97.8%	$0.025	47.2s	93%
20	DeepSeek V3 (2025-03-24)	97.0%	$0.0014	39.4s	90%
21	Ministral 8B	96.0%	$0.0004	10.4s	89%
22	Mistral Small Creative	95.9%	$0.0007	9.1s	89%
23	Qwen 3.5 Plus (2026-02-15)	96.3%	$0.0060	31.5s	90%
24	Mistral Large 2	96.7%	$0.013	29.4s	90%
25	Claude 3 Haiku	96.6%	$0.0025	14.9s	87%
26	Ministral 3 14B	96.0%	$0.0007	11.7s	87%
27	GPT-4o, Aug. 6th (temp=1)	96.9%	$0.018	24.4s	88%
28	Llama 3.1 Nemotron 70B	96.0%	$0.0038	31.7s	88%
29	Grok 4	99.0%	$0.048	1.7m	94%
30	Z.AI GLM 5	97.2%	$0.0084	1.2m	89%
31	Ministral 3 3B	95.9%	$0.0005	11.1s	86%
32	Ministral 3 8B	95.6%	$0.0008	19.6s	87%
33	Mistral Medium 3.1	95.8%	$0.0048	36.5s	89%
34	Hermes 3 405B	96.5%	$0.0032	53.2s	88%
35	GPT-4o, May 13th (temp=0)	96.4%	$0.035	14.1s	89%
36	DeepSeek V3 (2024-12-26)	96.1%	$0.0021	54.6s	88%
37	DeepSeek-V2 Chat	95.9%	$0.0021	53.3s	88%
38	WizardLM 2 8x22b	96.9%	$0.0026	1.8m	91%
39	GPT-4.1	96.2%	$0.018	44.7s	88%
40	Claude 3.5 Sonnet	97.2%	$0.048	35.5s	89%
41	Rocinante 12B	95.9%	$0.0014	38.4s	86%
42	Z.AI GLM 4.7 Flash	96.2%	$0.0017	1.2m	88%
43	Claude Haiku 4.5	95.1%	$0.011	21.6s	87%
44	Writer: Palmyra X5	95.4%	$0.011	22.0s	86%
45	Claude Sonnet 4.5	96.0%	$0.035	38.1s	89%
46	Minimax M2.5	95.9%	$0.0034	1.3m	88%
47	Qwen 3.5 397B A17B	97.6%	$0.014	3.0m	94%
48	ByteDance Seed 1.6	97.4%	$0.013	2.5m	91%
49	Claude Sonnet 4	95.8%	$0.032	43.7s	87%
50	Claude Opus 4.6	97.2%	$0.078	1.2m	92%
51	MoonshotAI: Kimi K2.5	97.8%	$0.019	3.2m	92%
52	Z.AI GLM 4.7	95.9%	$0.010	1.4m	86%
53	Z.AI GLM 4.6	94.8%	$0.0065	51.5s	85%
54	Llama 3.1 70B	95.5%	$0.0015	29.4s	80%
55	GPT-5 Nano	95.0%	$0.0042	1.4m	86%
56	Z.AI GLM 4.5	94.6%	$0.0051	42.1s	83%
57	GPT-4o, May 13th (temp=1)	94.9%	$0.033	14.4s	83%
58	GPT-5.2	96.3%	$0.056	1.5m	90%
59	GPT-4.1 Mini	93.3%	$0.0027	19.0s	83%
60	Gemini 2.5 Flash Lite	93.7%	$0.0009	9.5s	81%
61	Gemini 3 Flash (Preview)	94.0%	$0.0078	19.6s	81%
62	Gemini 3 Pro (Preview)	95.5%	$0.055	54.4s	85%
63	Claude Sonnet 4.6	94.1%	$0.031	39.3s	83%
64	DeepSeek V3.2	94.9%	$0.0014	1.9m	83%
65	Gemini 2.5 Pro	94.3%	$0.036	36.2s	82%
66	Claude 3.5 Haiku	93.3%	$0.0035	10.8s	77%
67	GPT-5	97.2%	$0.065	2.8m	91%
68	Gemma 3 12B	92.9%	$0.0004	41.3s	79%
69	Gemini 2.5 Flash	91.5%	$0.0052	10.6s	80%
70	Claude Opus 4.5	94.8%	$0.070	53.4s	84%
71	Claude 3.7 Sonnet	93.4%	$0.042	46.7s	82%
72	DeepSeek V3.1	93.2%	$0.0020	1.8m	81%
73	GPT-5.1	94.4%	$0.054	1.8m	82%
74	Gemma 3 27B	91.7%	$0.0006	52.6s	75%
75	Claude Opus 4	96.7%	$0.209	1.4m	90%
76	Gemma 3 4B	88.7%	$0.0002	20.0s	71%
77	GPT-4.1 Nano	87.5%	$0.0007	13.3s	73%
78	Mistral Small 3.2 24B	95.3%	$0.0069	5.7m	83%
79	Llama 3.1 8B	87.7%	$0.0003	1.3m	66%
80	Gemini 3.1 Pro (Preview)	86.8%	$0.107	1.8m	73%
95.73%

Individual Scenarios

Detailed Writing Rules

▼

Fantasy: entering an ancient ruin

Model	# 1	# 2	# 3	# 4	# 5	Avg ▼
Grok 4	100	100	100	100	100	100.0%
Grok 4.1 Fast	100	100	100	100	100	100.0%
Grok 4 Fast	100	100	100	100	100	100.0%
Claude 3.5 Sonnet	100	100	100	100	100	100.0%
GPT-4o, Aug. 6th (temp=0)	100	100	100	100	100	100.0%
GPT-4o Mini (temp=1)	100	100	100	100	100	100.0%
Claude 3 Haiku	100	100	100	100	100	100.0%
Arcee AI: Trinity Mini	100	100	100	100	100	100.0%
Mistral Large	100	100	100	98	97	99.0%
Z.AI GLM 4.5	100	100	99	98	97	98.9%
o4 Mini High	100	100	100	100	94	98.8%
DeepSeek-V2 Chat	100	100	100	100	94	98.8%
GPT-4o, Aug. 6th (temp=1)	100	100	100	100	94	98.8%
GPT-4o Mini (temp=0)	100	100	100	100	94	98.8%
Ministral 3 14B	100	100	100	100	94	98.8%
Mistral Small 3.2 24B	100	100	100	100	94	98.8%
Mistral NeMO	100	100	100	100	94	98.8%
Mistral Medium 3.1	100	100	100	99	94	98.6%
Claude Opus 4	100	100	100	98	94	98.5%
GPT-4o, May 13th (temp=1)	100	100	100	96	94	98.0%
Arcee AI: Trinity Large (Preview)	100	100	100	96	94	98.0%
Ministral 8B	100	100	100	100	89	97.9%
Ministral 3B	100	100	100	99	90	97.8%
Mistral Large 3	100	100	100	94	94	97.7%
GPT-5 Mini	100	100	100	94	94	97.6%
Claude Opus 4.6	100	100	100	94	94	97.6%
MoonshotAI: Kimi K2.5	100	100	100	100	88	97.6%
GPT-5	100	100	100	94	94	97.6%
DeepSeek V3 (2024-12-26)	100	100	100	100	88	97.6%
Cohere Command R+ (Aug. 2024)	100	100	100	94	94	97.6%
Hermes 3 70B	100	100	100	94	90	96.8%
Llama 3.1 8B	100	100	96	95	92	96.5%
o4 Mini	100	100	94	94	94	96.4%
GPT-5.2	100	100	94	94	94	96.4%
Z.AI GLM 4.7	100	100	100	94	88	96.4%
ByteDance Seed 1.6	100	100	94	94	94	96.4%
Stealth: Aurora Alpha	100	100	100	100	82	96.4%
DeepSeek V3 (2025-03-24)	100	100	94	94	94	96.4%
ByteDance Seed 1.6 Flash	100	100	100	94	88	96.4%
GPT-4.1	100	100	96	94	92	96.3%
Ministral 3 8B	100	100	100	94	87	96.2%
Llama 3.1 Nemotron 70B	100	100	100	94	86	96.1%
Hermes 3 405B	100	100	100	100	80	96.0%
Writer: Palmyra X5	100	100	100	94	83	95.5%
Gemma 3 12B	100	95	94	94	94	95.4%
Gemini 3 Pro (Preview)	100	94	94	94	94	95.2%
Z.AI GLM 4.7 Flash	100	94	94	94	94	95.2%
Qwen 3.5 Plus (2026-02-15)	100	94	94	94	94	95.2%
Mistral Large 2	100	94	94	94	94	95.2%
Claude Sonnet 4.5	99	97	97	94	88	95.0%
Gemma 3 27B	100	100	100	88	87	95.0%
Claude Sonnet 4.6	100	100	98	88	88	94.8%
Claude Sonnet 4	100	100	94	93	85	94.4%
Mistral Small Creative	100	100	94	94	82	94.0%
Qwen 3.5 397B A17B	100	94	94	94	88	94.0%
Qwen 2.5 72B	100	100	94	88	88	94.0%
Gemini 2.5 Flash Lite	100	98	94	90	88	93.9%
Claude 3.7 Sonnet	100	100	100	89	78	93.4%
Claude Haiku 4.5	100	95	94	91	87	93.4%
Gemini 2.5 Flash	100	94	93	92	88	93.4%
GPT-4.1 Nano	100	94	93	91	89	93.4%
GPT-4.1 Mini	94	94	94	94	90	93.1%
Minimax M2.5	100	98	97	92	77	92.9%
DeepSeek V3.2	100	100	100	82	82	92.8%
Claude Opus 4.5	100	96	94	92	78	92.0%
Llama 3.1 70B	100	100	100	100	60	92.0%
WizardLM 2 8x22b	94	94	94	90	87	91.7%
Z.AI GLM 4.6	100	100	88	88	82	91.6%
Z.AI GLM 5	100	98	97	96	66	91.5%
GPT-5 Nano	100	100	99	82	76	91.4%
GPT-4o, May 13th (temp=0)	100	100	100	94	60	90.8%
Ministral 3 3B	100	100	94	88	70	90.4%
Claude 3.5 Haiku	100	100	100	78	73	90.2%
GPT-5.1	100	94	88	88	76	89.2%
Gemini 2.5 Pro	100	88	88	88	82	89.2%
Gemini 3 Flash (Preview)	100	94	88	82	76	88.0%
DeepSeek V3.1	100	88	88	88	70	86.8%
Gemini 3.1 Pro (Preview)	94	94	82	82	76	85.6%
Gemma 3 4B	92	92	86	83	74	85.4%
Rocinante 12B	100	94	87	68	67	83.2%

▼

Horror: alone in an eerie place at night

Model	# 1	# 2	# 3	# 4	# 5	Avg ▼
GPT-5 Mini	100	100	100	100	100	100.0%
GPT-5 Nano	100	100	100	100	100	100.0%
ByteDance Seed 1.6 Flash	100	100	100	100	100	100.0%
Hermes 3 405B	100	100	100	100	100	100.0%
Ministral 8B	100	100	100	100	100	100.0%
Ministral 3B	100	100	100	100	100	100.0%
Arcee AI: Trinity Mini	100	100	100	100	98	99.5%
Claude 3 Haiku	100	100	100	98	98	99.1%
Ministral 3 8B	100	100	100	100	96	99.1%
Claude Opus 4.6	100	100	100	100	94	98.8%
Stealth: Aurora Alpha	100	100	100	100	94	98.8%
GPT-4o Mini (temp=0)	100	100	100	100	94	98.8%
Grok 4 Fast	100	100	100	100	94	98.7%
Mistral Large	100	100	100	100	93	98.6%
Ministral 3 14B	100	100	100	98	91	97.9%
ByteDance Seed 1.6	100	100	100	95	94	97.8%
GPT-4o, Aug. 6th (temp=1)	100	100	100	96	93	97.7%
Qwen 3.5 397B A17B	100	100	100	94	94	97.6%
GPT-5	100	100	100	94	94	97.6%
o4 Mini	100	100	100	94	94	97.6%
Z.AI GLM 4.7	100	100	100	94	94	97.6%
Qwen 3.5 Plus (2026-02-15)	100	100	100	94	94	97.6%
GPT-4o, May 13th (temp=0)	100	100	100	94	94	97.6%
GPT-4o, Aug. 6th (temp=0)	100	100	100	94	94	97.6%
Cohere Command R+ (Aug. 2024)	100	100	100	100	88	97.6%
Mistral Medium 3.1	100	100	100	94	93	97.5%
Hermes 3 70B	100	100	99	94	94	97.3%
Claude Opus 4	100	100	99	98	89	97.2%
Arcee AI: Trinity Large (Preview)	100	100	96	94	94	96.9%
Rocinante 12B	100	100	100	96	88	96.8%
DeepSeek V3.1	100	100	100	94	89	96.6%
MoonshotAI: Kimi K2.5	100	100	100	94	88	96.4%
Grok 4.1 Fast	100	100	94	94	94	96.4%
Z.AI GLM 4.7 Flash	100	100	100	94	88	96.4%
Llama 3.1 70B	100	100	100	100	82	96.4%
Qwen 2.5 72B	100	100	100	94	88	96.4%
Claude Sonnet 4	100	100	97	94	91	96.3%
Mistral Small 3.2 24B	100	100	100	94	87	96.2%
Mistral NeMO	100	100	100	100	81	96.2%
Mistral Small Creative	100	100	98	92	91	96.2%
GPT-4o Mini (temp=1)	100	99	95	94	91	95.9%
Claude Opus 4.5	100	98	96	94	91	95.8%
Mistral Large 2	100	100	95	94	89	95.6%
GPT-5.1	100	100	94	94	90	95.6%
Z.AI GLM 5	100	100	100	98	80	95.6%
o4 Mini High	100	100	94	94	88	95.2%
Gemini 3 Pro (Preview)	100	100	100	88	88	95.2%
Writer: Palmyra X5	100	100	100	94	81	95.0%
WizardLM 2 8x22b	100	97	95	94	88	94.7%
Claude 3.5 Haiku	100	100	100	88	85	94.6%
DeepSeek V3 (2025-03-24)	100	100	100	100	73	94.5%
Claude 3.7 Sonnet	100	95	95	93	89	94.4%
Minimax M2.5	100	100	94	93	85	94.2%
Claude Haiku 4.5	100	100	92	90	89	94.2%
DeepSeek V3 (2024-12-26)	100	100	97	90	84	94.1%
Grok 4	100	100	100	94	77	94.1%
DeepSeek V3.2	100	100	94	94	82	94.0%
Llama 3.1 Nemotron 70B	99	99	94	93	82	93.6%
Z.AI GLM 4.6	100	94	93	92	88	93.4%
Claude Sonnet 4.5	100	99	95	86	86	93.2%
Claude Sonnet 4.6	100	100	95	94	77	93.1%
GPT-4o, May 13th (temp=1)	100	94	93	91	88	93.1%
Claude 3.5 Sonnet	100	99	94	94	77	92.8%
Gemini 2.5 Pro	100	94	94	88	87	92.6%
Gemini 3 Flash (Preview)	94	94	94	92	88	92.5%
GPT-5.2	100	94	94	88	83	91.8%
Gemini 2.5 Flash Lite	100	100	96	89	70	91.1%
GPT-4.1 Nano	94	94	93	92	81	91.0%
Mistral Large 3	95	93	92	89	84	90.7%
GPT-4.1	100	94	94	91	74	90.6%
GPT-4.1 Mini	96	94	94	86	82	90.4%
Z.AI GLM 4.5	95	94	93	87	83	90.2%
Gemma 3 4B	100	98	96	80	76	89.9%
Llama 3.1 8B	100	100	100	70	67	87.4%
DeepSeek-V2 Chat	94	89	88	84	81	87.1%
Gemma 3 12B	100	96	94	76	64	86.2%
Gemma 3 27B	100	91	90	75	71	85.6%
Ministral 3 3B	100	99	82	78	68	85.5%
Gemini 2.5 Flash	91	89	86	81	77	84.6%
Gemini 3.1 Pro (Preview)	100	88	82	82	70	84.4%

▼

Literary fiction: old friends reunite

Model	# 1	# 2	# 3	# 4	# 5	Avg ▼
Grok 4	100	100	100	100	100	100.0%
Stealth: Aurora Alpha	100	100	100	100	100	100.0%
ByteDance Seed 1.6 Flash	100	100	100	100	100	100.0%
DeepSeek-V2 Chat	100	100	100	100	100	99.9%
Mistral Large 2	100	100	100	100	99	99.8%
Cohere Command R+ (Aug. 2024)	100	100	100	100	97	99.3%
Mistral Small Creative	100	100	100	100	96	99.3%
Mistral Large 3	100	100	100	99	97	99.2%
DeepSeek V3 (2025-03-24)	100	100	100	100	96	99.2%
Z.AI GLM 5	100	100	100	100	94	98.9%
Qwen 3.5 397B A17B	100	100	100	100	94	98.8%
GPT-5 Mini	100	100	100	100	94	98.8%
GPT-5	100	100	100	100	94	98.8%
Grok 4.1 Fast	100	100	100	100	94	98.8%
Z.AI GLM 4.7 Flash	100	100	100	100	94	98.8%
Grok 4 Fast	100	100	100	100	94	98.8%
Claude 3.5 Sonnet	100	100	100	100	94	98.8%
DeepSeek V3 (2024-12-26)	100	100	100	100	94	98.8%
GPT-4o Mini (temp=0)	100	100	100	100	94	98.8%
Arcee AI: Trinity Mini	100	100	100	100	94	98.8%
Mistral NeMO	100	100	100	100	94	98.8%
WizardLM 2 8x22b	100	100	100	99	94	98.7%
Claude Sonnet 4.5	100	100	100	99	94	98.5%
Ministral 3B	100	100	100	100	92	98.5%
Ministral 8B	100	100	100	100	91	98.2%
GPT-5 Nano	100	100	99	97	95	98.2%
Arcee AI: Trinity Large (Preview)	100	100	100	97	93	98.1%
Mistral Large	100	100	100	100	90	97.9%
Claude Sonnet 4.6	100	100	98	98	93	97.9%
Ministral 3 3B	100	100	100	100	89	97.7%
MoonshotAI: Kimi K2.5	100	100	100	94	94	97.6%
o4 Mini	100	100	100	94	94	97.6%
GPT-5.2	100	100	100	94	94	97.6%
ByteDance Seed 1.6	100	100	100	100	88	97.6%
GPT-4.1	100	100	100	94	94	97.6%
Gemini 2.5 Flash	100	100	100	99	90	97.6%
Qwen 3.5 Plus (2026-02-15)	100	100	99	94	94	97.4%
Z.AI GLM 4.5	100	100	99	94	94	97.4%
Mistral Medium 3.1	100	100	100	94	93	97.3%
Hermes 3 405B	100	100	100	94	93	97.3%
Claude 3.7 Sonnet	100	100	100	99	88	97.2%
GPT-4.1 Mini	100	100	100	94	93	97.2%
Z.AI GLM 4.7	100	100	97	94	94	97.0%
o4 Mini High	100	100	94	94	94	96.4%
Claude Opus 4.6	100	100	94	94	94	96.4%
GPT-5.1	100	100	94	94	94	96.4%
GPT-4o, Aug. 6th (temp=0)	100	100	94	94	94	96.4%
Qwen 2.5 72B	100	100	100	94	88	96.4%
Claude Sonnet 4	100	100	100	94	87	96.2%
Hermes 3 70B	100	98	94	94	94	96.0%
Claude Opus 4	100	100	96	92	90	95.7%
Rocinante 12B	100	100	100	91	87	95.5%
Writer: Palmyra X5	100	95	94	94	94	95.4%
Claude 3.5 Haiku	100	94	94	94	94	95.2%
Z.AI GLM 4.6	100	94	94	94	94	95.2%
DeepSeek V3.2	100	100	100	94	82	95.2%
Llama 3.1 8B	100	100	100	91	84	95.0%
Llama 3.1 70B	100	100	100	88	86	94.7%
Gemma 3 12B	100	100	98	91	85	94.6%
Gemini 3 Pro (Preview)	100	100	94	88	88	94.0%
Ministral 3 8B	99	95	94	94	87	93.9%
Gemini 2.5 Flash Lite	100	95	94	93	88	93.9%
GPT-4o, May 13th (temp=0)	100	94	94	94	87	93.7%
Ministral 3 14B	100	99	96	93	77	93.1%
Minimax M2.5	98	95	92	90	90	93.1%
DeepSeek V3.1	100	94	94	89	88	93.0%
Gemini 3 Flash (Preview)	100	100	100	88	76	92.8%
GPT-4o, May 13th (temp=1)	99	96	96	94	77	92.5%
GPT-4o, Aug. 6th (temp=1)	100	100	98	82	74	90.8%
Claude Opus 4.5	98	92	92	90	79	90.5%
Gemini 2.5 Pro	100	100	94	82	76	90.4%
Llama 3.1 Nemotron 70B	99	94	94	94	71	90.3%
Claude 3 Haiku	100	100	94	88	65	89.5%
GPT-4o Mini (temp=1)	100	94	94	84	72	88.8%
Claude Haiku 4.5	99	95	86	82	78	88.0%
GPT-4.1 Nano	91	90	85	81	75	84.3%
Gemini 3.1 Pro (Preview)	88	88	82	82	76	83.2%
Gemma 3 27B	93	92	83	78	54	80.0%
Gemma 3 4B	92	84	82	79	50	77.4%
Mistral Small 3.2 24B	100	82	66	62	59	73.7%

▼

Mystery: examining a crime scene

Model	# 1	# 2	# 3	# 4	# 5	Avg ▼
Claude Opus 4.6	100	100	100	100	100	100.0%
MoonshotAI: Kimi K2.5	100	100	100	100	100	100.0%
o4 Mini	100	100	100	100	100	100.0%
Z.AI GLM 5	100	100	100	100	100	100.0%
GPT-5.2	100	100	100	100	100	100.0%
Stealth: Aurora Alpha	100	100	100	100	100	100.0%
Claude 3.5 Sonnet	100	100	100	100	100	100.0%
DeepSeek-V2 Chat	100	100	100	100	100	100.0%
ByteDance Seed 1.6 Flash	100	100	100	100	100	100.0%
GPT-4o Mini (temp=0)	100	100	100	100	100	100.0%
Mistral Large	100	100	100	100	100	100.0%
Mistral Small Creative	100	100	100	100	100	100.0%
Mistral NeMO	100	100	100	100	100	100.0%
Ministral 3B	100	100	100	100	100	100.0%
GPT-4o, Aug. 6th (temp=1)	100	100	100	100	99	99.9%
GPT-4o, Aug. 6th (temp=0)	100	100	100	100	99	99.9%
Z.AI GLM 4.5	100	100	100	99	99	99.6%
GPT-4o Mini (temp=1)	100	100	100	100	97	99.5%
GPT-4o, May 13th (temp=1)	100	100	100	100	97	99.4%
Claude Haiku 4.5	100	100	100	99	98	99.3%
Claude Opus 4	100	100	100	100	94	98.9%
GPT-5 Mini	100	100	100	100	94	98.8%
o4 Mini High	100	100	100	100	94	98.8%
GPT-5	100	100	100	100	94	98.8%
Gemini 2.5 Pro	100	100	100	100	94	98.8%
Gemini 3 Pro (Preview)	100	100	100	100	94	98.8%
Grok 4	100	100	100	100	94	98.8%
Llama 3.1 70B	100	100	100	100	94	98.8%
Qwen 2.5 72B	100	100	100	100	94	98.8%
Mistral Small 3.2 24B	100	100	100	100	94	98.8%
Hermes 3 70B	100	100	100	99	94	98.6%
Mistral Large 3	100	100	100	98	94	98.3%
Minimax M2.5	100	100	100	100	91	98.1%
Ministral 3 3B	100	100	100	95	94	97.8%
Claude Sonnet 4.6	100	100	100	95	94	97.7%
Gemini 2.5 Flash Lite	100	100	100	100	89	97.7%
Qwen 3.5 397B A17B	100	100	100	94	94	97.6%
GPT-5.1	100	100	100	94	94	97.6%
Grok 4.1 Fast	100	100	100	94	94	97.6%
Qwen 3.5 Plus (2026-02-15)	100	100	100	94	94	97.6%
WizardLM 2 8x22b	100	100	100	94	94	97.6%
Cohere Command R+ (Aug. 2024)	100	100	100	97	91	97.6%
Writer: Palmyra X5	100	100	98	96	94	97.5%
Claude Opus 4.5	100	100	100	94	94	97.5%
Mistral Large 2	100	100	100	94	93	97.5%
Claude Sonnet 4.5	100	100	100	96	91	97.5%
Llama 3.1 Nemotron 70B	100	100	100	94	92	97.2%
Mistral Medium 3.1	100	100	99	95	91	96.9%
Ministral 8B	100	100	97	94	92	96.8%
Rocinante 12B	100	100	100	94	90	96.7%
Claude 3 Haiku	100	100	97	94	92	96.5%
DeepSeek V3 (2024-12-26)	100	99	99	94	90	96.4%
Z.AI GLM 4.7	100	100	94	94	94	96.4%
ByteDance Seed 1.6	100	100	94	94	94	96.4%
GPT-5 Nano	100	100	94	94	94	96.4%
Grok 4 Fast	100	100	94	94	94	96.4%
GPT-4o, May 13th (temp=0)	100	100	94	94	94	96.4%
DeepSeek V3.1	100	100	94	94	94	96.4%
Arcee AI: Trinity Mini	100	100	100	94	88	96.4%
Ministral 3 14B	100	100	98	92	91	96.3%
Llama 3.1 8B	100	100	100	100	81	96.2%
Claude Sonnet 4	100	100	96	93	88	95.5%
Z.AI GLM 4.6	100	100	94	94	88	95.2%
GPT-4.1	100	100	94	94	88	95.2%
DeepSeek V3.2	100	100	94	94	88	95.2%
Arcee AI: Trinity Large (Preview)	100	98	98	94	85	95.0%
Gemma 3 12B	100	100	99	92	83	95.0%
Claude 3.7 Sonnet	100	100	95	94	85	94.9%
DeepSeek V3 (2025-03-24)	100	98	94	93	88	94.6%
Z.AI GLM 4.7 Flash	100	97	94	94	87	94.5%
Hermes 3 405B	100	100	99	95	78	94.3%
Claude 3.5 Haiku	100	100	100	99	70	93.9%
Ministral 3 8B	100	100	94	88	87	93.7%
GPT-4.1 Mini	100	97	94	88	87	93.2%
Gemini 2.5 Flash	100	100	93	89	85	93.1%
Gemma 3 27B	100	100	96	85	81	92.4%
GPT-4.1 Nano	93	93	91	88	82	89.3%
Gemini 3 Flash (Preview)	100	94	94	82	76	89.2%
Gemini 3.1 Pro (Preview)	94	88	82	82	64	82.0%
Gemma 3 4B	92	90	84	75	69	81.9%

▼

Romance: separated couple reunites

Model	# 1	# 2	# 3	# 4	# 5	Avg ▼
Qwen 3.5 397B A17B	100	100	100	100	100	100.0%
MoonshotAI: Kimi K2.5	100	100	100	100	100	100.0%
Stealth: Aurora Alpha	100	100	100	100	100	100.0%
Qwen 3.5 Plus (2026-02-15)	100	100	100	100	100	100.0%
GPT-4o Mini (temp=0)	100	100	100	100	100	100.0%
Qwen 2.5 72B	100	100	100	100	100	100.0%
Grok 4	100	100	100	100	100	100.0%
DeepSeek-V2 Chat	100	100	100	100	99	99.9%
Mistral Large	100	100	100	100	99	99.8%
ByteDance Seed 1.6 Flash	100	100	100	100	98	99.6%
Minimax M2.5	100	100	100	100	98	99.5%
o4 Mini High	100	100	100	100	94	98.8%
GPT-5	100	100	100	100	94	98.8%
o4 Mini	100	100	100	100	94	98.8%
Z.AI GLM 5	100	100	100	100	94	98.8%
Grok 4 Fast	100	100	100	100	94	98.8%
GPT-4o, May 13th (temp=0)	100	100	100	100	94	98.8%
Cohere Command R+ (Aug. 2024)	100	100	100	100	94	98.8%
GPT-4o, Aug. 6th (temp=0)	100	100	100	100	93	98.6%
GPT-4o Mini (temp=1)	100	100	100	96	96	98.4%
Claude 3 Haiku	100	100	100	98	93	98.3%
Hermes 3 70B	100	100	100	100	91	98.3%
Claude Opus 4.6	100	100	100	97	94	98.2%
Ministral 3 14B	100	100	100	96	94	97.9%
Ministral 3B	100	100	100	96	94	97.9%
GPT-5.1	100	100	100	94	94	97.6%
ByteDance Seed 1.6	100	100	100	100	88	97.6%
Z.AI GLM 4.7 Flash	100	100	100	94	94	97.6%
Claude 3.5 Sonnet	100	100	100	94	94	97.6%
DeepSeek V3.2	100	100	100	100	88	97.6%
Mistral NeMO	100	100	99	94	94	97.5%
DeepSeek V3 (2024-12-26)	100	100	99	94	94	97.3%
Claude Opus 4	100	100	99	93	93	97.0%
DeepSeek V3 (2025-03-24)	100	100	100	97	88	96.9%
Claude Sonnet 4	100	100	100	94	90	96.8%
GPT-5 Nano	100	100	98	94	92	96.8%
GPT-4.1	100	100	100	95	88	96.5%
Arcee AI: Trinity Large (Preview)	100	100	100	91	91	96.5%
Z.AI GLM 4.7	100	100	94	94	94	96.4%
Gemini 3 Pro (Preview)	100	100	100	94	88	96.4%
Grok 4.1 Fast	100	100	94	94	94	96.4%
Mistral Small Creative	100	100	97	93	92	96.4%
Claude Sonnet 4.5	100	100	100	94	88	96.3%
GPT-4o, May 13th (temp=1)	100	100	94	94	92	96.1%
Writer: Palmyra X5	100	100	100	94	85	95.9%
GPT-5 Mini	100	100	98	94	88	95.9%
Mistral Large 3	100	100	95	94	90	95.7%
GPT-4o, Aug. 6th (temp=1)	100	100	100	94	84	95.7%
Hermes 3 405B	100	100	96	94	88	95.5%
Gemini 2.5 Pro	100	100	94	94	88	95.2%
GPT-5.2	100	100	94	94	88	95.2%
Z.AI GLM 4.6	100	94	94	94	94	95.2%
Mistral Small 3.2 24B	100	94	94	94	94	95.2%
Arcee AI: Trinity Mini	100	100	94	94	88	95.2%
Gemini 3 Flash (Preview)	100	100	100	88	88	95.1%
Llama 3.1 Nemotron 70B	100	98	95	92	90	94.9%
DeepSeek V3.1	100	94	94	94	92	94.7%
Rocinante 12B	100	100	95	94	84	94.5%
Mistral Large 2	100	100	100	90	82	94.5%
WizardLM 2 8x22b	100	100	96	89	88	94.4%
Ministral 3 8B	100	100	94	94	84	94.4%
GPT-4.1 Mini	100	100	94	87	85	93.1%
Mistral Medium 3.1	97	96	95	92	85	93.0%
Gemini 2.5 Flash Lite	100	100	94	85	85	92.8%
Claude Opus 4.5	99	96	93	88	87	92.6%
Claude Sonnet 4.6	99	97	92	88	87	92.6%
Ministral 3 3B	100	100	100	90	67	91.4%
Llama 3.1 70B	100	93	90	90	83	91.0%
Gemini 2.5 Flash	96	94	90	88	85	90.8%
Gemma 3 27B	100	93	93	85	80	90.2%
Claude Haiku 4.5	96	91	90	90	80	89.4%
Gemma 3 12B	100	94	92	81	79	89.0%
Ministral 8B	100	99	87	86	73	88.9%
GPT-4.1 Nano	99	87	86	86	83	88.3%
Claude 3.7 Sonnet	100	98	84	81	79	88.2%
Z.AI GLM 4.5	94	93	91	88	67	86.7%
Llama 3.1 8B	100	100	92	77	60	85.7%
Gemini 3.1 Pro (Preview)	94	88	83	82	82	85.7%
Claude 3.5 Haiku	100	97	89	85	40	82.3%
Gemma 3 4B	77	73	71	66	58	69.1%

▼

Thriller: chase through city streets

Model	# 1	# 2	# 3	# 4	# 5	Avg ▼
GPT-5 Mini	100	100	100	100	100	100.0%
Claude Opus 4	100	100	100	100	100	100.0%
Grok 4	100	100	100	100	100	100.0%
Claude Sonnet 4.6	100	100	100	100	100	100.0%
Claude Sonnet 4.5	100	100	100	100	100	100.0%
Stealth: Aurora Alpha	100	100	100	100	100	100.0%
DeepSeek V3 (2025-03-24)	100	100	100	100	100	100.0%
GPT-4o, May 13th (temp=0)	100	100	100	100	100	100.0%
GPT-4o, Aug. 6th (temp=0)	100	100	100	100	100	100.0%
Qwen 2.5 72B	100	100	100	100	100	100.0%
Mistral Small 3.2 24B	100	100	100	100	100	100.0%
Ministral 3 3B	100	100	100	100	100	100.0%
WizardLM 2 8x22b	100	100	100	100	100	100.0%
Ministral 3B	100	100	100	100	100	100.0%
DeepSeek V3 (2024-12-26)	100	100	100	100	100	99.9%
Claude 3.5 Sonnet	100	100	100	100	99	99.9%
Claude Haiku 4.5	100	100	100	100	99	99.8%
Claude Opus 4.5	100	100	100	100	99	99.8%
Arcee AI: Trinity Large (Preview)	100	100	100	100	97	99.5%
Rocinante 12B	100	100	100	100	97	99.4%
Z.AI GLM 5	100	100	100	100	94	98.8%
Claude Sonnet 4	100	100	100	100	94	98.8%
GPT-4.1	100	100	100	100	94	98.8%
GPT-4o, Aug. 6th (temp=1)	100	100	100	100	94	98.8%
Mistral Large 2	100	100	100	100	94	98.8%
GPT-4o Mini (temp=0)	100	100	100	100	94	98.8%
Llama 3.1 70B	100	100	100	100	94	98.8%
Ministral 3 14B	100	100	100	100	94	98.8%
Hermes 3 70B	100	100	100	100	94	98.8%
Claude 3 Haiku	100	100	100	100	94	98.8%
Ministral 3 8B	100	100	100	100	94	98.8%
Arcee AI: Trinity Mini	100	100	100	100	94	98.8%
Mistral NeMO	100	100	100	100	94	98.8%
Cohere Command R+ (Aug. 2024)	100	100	100	100	94	98.8%
Z.AI GLM 4.5	100	100	100	100	93	98.7%
GPT-4o, May 13th (temp=1)	100	100	100	99	94	98.5%
DeepSeek-V2 Chat	100	100	100	96	94	98.0%
Mistral Large 3	100	100	100	96	94	97.9%
Claude 3.7 Sonnet	100	100	100	100	90	97.9%
Qwen 3.5 397B A17B	100	100	100	94	94	97.6%
Claude Opus 4.6	100	100	100	94	94	97.6%
o4 Mini	100	100	100	100	88	97.6%
Z.AI GLM 4.7	100	100	100	100	88	97.6%
Grok 4 Fast	100	100	100	94	94	97.6%
DeepSeek V3.2	100	100	100	94	94	97.6%
ByteDance Seed 1.6 Flash	100	100	100	94	94	97.6%
Llama 3.1 Nemotron 70B	100	100	100	100	88	97.6%
o4 Mini High	100	100	99	94	94	97.4%
Mistral Large	100	100	100	94	91	97.0%
GPT-4.1 Nano	100	100	100	97	88	96.9%
GPT-5.1	100	100	100	94	88	96.4%
Gemini 2.5 Pro	100	100	100	94	88	96.4%
GPT-5.2	100	100	94	94	94	96.4%
ByteDance Seed 1.6	100	100	100	94	88	96.4%
Z.AI GLM 4.6	100	100	100	94	88	96.4%
Qwen 3.5 Plus (2026-02-15)	100	100	94	94	94	96.4%
GPT-5 Nano	100	100	100	94	88	96.4%
GPT-4.1 Mini	100	100	100	94	88	96.4%
Ministral 8B	100	100	94	94	94	96.4%
Writer: Palmyra X5	100	100	94	94	93	96.2%
Hermes 3 405B	100	100	94	94	93	96.2%
Claude 3.5 Haiku	100	100	100	95	85	96.0%
Gemini 2.5 Flash Lite	100	100	100	99	81	95.9%
GPT-4o Mini (temp=1)	100	100	100	94	85	95.9%
Gemma 3 4B	100	100	96	94	88	95.6%
MoonshotAI: Kimi K2.5	100	94	94	94	94	95.2%
GPT-5	100	100	94	94	88	95.2%
Gemini 3 Pro (Preview)	100	100	94	94	88	95.2%
Minimax M2.5	100	100	94	94	88	95.2%
Gemini 3 Flash (Preview)	100	100	94	94	88	95.2%
Z.AI GLM 4.7 Flash	100	100	94	94	88	95.2%
Gemma 3 12B	100	100	100	96	73	93.9%
Gemma 3 27B	100	100	100	100	69	93.7%
DeepSeek V3.1	94	94	94	94	88	92.8%
Mistral Medium 3.1	100	100	94	88	81	92.6%
Mistral Small Creative	100	94	94	92	82	92.4%
Llama 3.1 8B	100	100	91	88	82	92.1%
Grok 4.1 Fast	100	94	94	88	82	91.6%
Gemini 2.5 Flash	100	96	94	84	82	91.1%
Gemini 3.1 Pro (Preview)	94	88	88	70	70	82.0%

genre

▼

Fantasy: entering an ancient ruin

Model	# 1	# 2	# 3	# 4	# 5	Avg ▼
Grok 4	100	100	100	100	100	100.0%
Stealth: Aurora Alpha	100	100	100	100	100	100.0%
Mistral Small 3.2 24B	100	100	100	100	100	100.0%
Arcee AI: Trinity Large (Preview)	100	100	100	100	100	100.0%
Hermes 3 405B	100	100	100	100	99	99.9%
Ministral 3B	100	100	100	100	98	99.6%
GPT-4o Mini (temp=1)	100	100	100	100	96	99.3%
Claude Opus 4.6	100	100	100	98	97	99.1%
Mistral Large 3	100	100	100	100	95	99.0%
Grok 4.1 Fast	100	100	100	100	94	98.8%
GPT-4o Mini (temp=0)	100	100	100	100	94	98.8%
Cohere Command R+ (Aug. 2024)	100	100	100	100	94	98.8%
WizardLM 2 8x22b	100	100	100	100	94	98.8%
GPT-4o, Aug. 6th (temp=1)	100	100	100	99	94	98.7%
Llama 3.1 70B	100	100	100	99	93	98.5%
Mistral Large	100	100	100	99	94	98.5%
Claude 3 Haiku	100	100	100	98	94	98.4%
Ministral 3 3B	100	100	100	97	94	98.3%
Hermes 3 70B	100	100	100	97	94	98.2%
GPT-4.1 Mini	100	100	98	97	94	97.8%
GPT-4o, Aug. 6th (temp=0)	100	100	100	94	94	97.6%
ByteDance Seed 1.6 Flash	100	100	100	94	94	97.6%
Mistral NeMO	100	100	100	100	88	97.6%
MoonshotAI: Kimi K2.5	100	100	100	94	94	97.6%
DeepSeek V3 (2025-03-24)	100	100	100	99	89	97.5%
Z.AI GLM 4.7 Flash	100	100	100	94	93	97.5%
Claude 3.5 Sonnet	100	100	99	95	90	96.8%
Z.AI GLM 5	100	100	100	94	90	96.8%
Ministral 3 8B	100	100	100	94	90	96.7%
Mistral Large 2	100	100	100	95	88	96.6%
Ministral 8B	100	100	100	99	84	96.6%
Writer: Palmyra X5	100	98	98	94	92	96.4%
Gemma 3 4B	100	100	98	94	90	96.4%
ByteDance Seed 1.6	100	100	94	94	94	96.4%
Llama 3.1 Nemotron 70B	100	100	100	94	88	96.4%
Qwen 2.5 72B	100	100	100	94	88	96.4%
Arcee AI: Trinity Mini	100	100	94	94	94	96.4%
Claude Sonnet 4	100	100	97	96	89	96.4%
Rocinante 12B	100	99	98	94	90	96.3%
Gemma 3 27B	100	99	98	94	91	96.3%
Claude Opus 4	100	99	96	94	90	95.9%
Z.AI GLM 4.6	100	100	100	94	86	95.9%
Z.AI GLM 4.7	100	98	94	94	93	95.9%
Gemma 3 12B	100	100	95	93	88	95.3%
Qwen 3.5 397B A17B	100	94	94	94	94	95.2%
GPT-5 Mini	100	100	94	94	88	95.2%
o4 Mini High	100	100	94	94	88	95.2%
o4 Mini	100	100	94	94	88	95.2%
Grok 4 Fast	100	100	94	94	88	95.2%
DeepSeek V3.2	100	100	94	94	88	95.2%
Claude Opus 4.5	97	97	95	94	93	94.9%
Mistral Small Creative	100	100	94	93	84	94.3%
Claude Haiku 4.5	100	100	94	93	84	94.2%
DeepSeek V3 (2024-12-26)	100	99	93	93	86	94.1%
Qwen 3.5 Plus (2026-02-15)	100	94	94	94	88	94.0%
Ministral 3 14B	98	98	95	95	83	93.8%
Claude 3.7 Sonnet	100	99	96	86	86	93.3%
GPT-5.2	100	97	96	92	81	93.2%
DeepSeek-V2 Chat	100	100	89	87	87	92.6%
GPT-5	100	94	94	94	76	91.6%
Gemini 3 Flash (Preview)	100	100	100	82	76	91.6%
Mistral Medium 3.1	100	100	94	88	76	91.6%
GPT-4.1	94	94	93	93	82	91.2%
Z.AI GLM 4.5	100	92	89	88	86	91.0%
Claude Sonnet 4.5	100	93	93	85	81	90.6%
Gemini 3 Pro (Preview)	100	94	88	88	82	90.4%
GPT-5 Nano	100	94	88	88	82	90.4%
GPT-4o, May 13th (temp=0)	94	94	88	88	88	90.4%
GPT-4o, May 13th (temp=1)	100	100	98	78	71	89.3%
Gemini 2.5 Pro	94	94	92	82	82	88.7%
Claude 3.5 Haiku	99	91	88	83	77	87.6%
GPT-5.1	93	88	88	85	82	87.3%
Gemini 2.5 Flash	88	88	87	87	85	86.8%
GPT-4.1 Nano	92	92	89	80	80	86.6%
Minimax M2.5	96	94	87	83	71	86.1%
Gemini 2.5 Flash Lite	88	88	87	86	78	85.3%
Claude Sonnet 4.6	92	87	86	80	78	84.7%
DeepSeek V3.1	94	88	88	82	70	84.4%
Llama 3.1 8B	100	94	74	67	63	79.5%
Gemini 3.1 Pro (Preview)	94	86	81	74	62	79.5%

▼

Horror: alone in an eerie place at night

Model	# 1	# 2	# 3	# 4	# 5	Avg ▼
Grok 4 Fast	100	100	100	100	100	100.0%
Qwen 2.5 72B	100	100	100	100	100	100.0%
WizardLM 2 8x22b	100	100	100	100	100	100.0%
GPT-4o Mini (temp=0)	100	100	100	100	100	99.9%
Claude 3 Haiku	100	100	100	100	99	99.9%
GPT-4o, Aug. 6th (temp=1)	100	100	100	100	99	99.8%
Llama 3.1 70B	100	100	100	98	98	99.2%
Rocinante 12B	100	100	100	100	94	98.9%
ByteDance Seed 1.6	100	100	100	100	94	98.8%
ByteDance Seed 1.6 Flash	100	100	100	100	94	98.8%
Hermes 3 70B	100	100	100	100	94	98.8%
Mistral Large	100	100	100	98	95	98.5%
Ministral 3 3B	100	100	100	99	92	98.3%
Ministral 3B	100	99	98	97	95	97.9%
GPT-4o, May 13th (temp=0)	100	100	98	97	94	97.8%
Stealth: Aurora Alpha	100	100	100	100	88	97.6%
GPT-4o, Aug. 6th (temp=0)	100	100	100	100	88	97.6%
Mistral NeMO	100	100	100	94	94	97.6%
Hermes 3 405B	100	100	100	99	89	97.5%
Minimax M2.5	100	99	97	96	95	97.3%
Mistral Large 3	100	100	99	98	89	97.2%
GPT-4o Mini (temp=1)	100	100	97	94	94	97.0%
Gemini 2.5 Flash Lite	100	99	96	96	94	96.7%
GPT-4.1	100	99	97	94	94	96.7%
Ministral 3 14B	100	100	98	94	92	96.7%
Grok 4.1 Fast	100	100	100	94	88	96.4%
Qwen 3.5 397B A17B	100	100	94	94	94	96.4%
Cohere Command R+ (Aug. 2024)	100	100	100	94	88	96.4%
Grok 4	100	100	97	92	91	96.1%
Gemini 3 Flash (Preview)	100	100	98	94	88	96.0%
o4 Mini	100	100	94	94	89	95.5%
GPT-4o, May 13th (temp=1)	100	100	100	94	83	95.3%
Llama 3.1 Nemotron 70B	98	98	97	93	90	95.3%
Mistral Small 3.2 24B	100	94	94	94	94	95.2%
Arcee AI: Trinity Mini	100	98	95	94	88	95.1%
Claude Haiku 4.5	100	99	94	91	90	94.7%
Z.AI GLM 5	100	100	97	97	79	94.7%
Arcee AI: Trinity Large (Preview)	100	94	94	92	92	94.3%
Mistral Small Creative	100	98	94	90	89	94.2%
GPT-5.2	100	96	94	92	88	94.1%
o4 Mini High	100	100	94	94	82	94.0%
GPT-5	100	100	100	94	76	94.0%
GPT-5 Mini	100	94	94	94	88	94.0%
Claude Opus 4.6	100	97	92	91	88	93.4%
Ministral 3 8B	100	95	93	90	89	93.4%
Gemma 3 4B	100	94	93	89	89	93.1%
Ministral 8B	100	95	93	89	89	93.1%
DeepSeek V3 (2025-03-24)	100	95	93	91	87	93.1%
Claude Opus 4	100	100	94	91	79	92.9%
Z.AI GLM 4.7 Flash	100	100	94	88	82	92.8%
DeepSeek V3.2	100	100	94	88	82	92.8%
Z.AI GLM 4.7	94	94	94	94	88	92.8%
Mistral Medium 3.1	100	94	91	89	87	92.3%
Writer: Palmyra X5	100	96	90	89	86	92.3%
Claude Opus 4.5	97	94	94	88	87	92.0%
Z.AI GLM 4.6	100	95	94	88	82	91.8%
MoonshotAI: Kimi K2.5	100	94	88	88	88	91.6%
Gemini 3 Pro (Preview)	100	94	94	88	82	91.6%
Claude Sonnet 4.5	100	99	88	86	85	91.6%
Mistral Large 2	95	94	90	87	86	90.4%
GPT-5 Nano	100	94	88	85	82	89.7%
Qwen 3.5 Plus (2026-02-15)	94	94	94	82	82	89.2%
Gemini 2.5 Pro	100	94	88	82	82	89.2%
DeepSeek V3 (2024-12-26)	95	94	93	86	73	88.1%
GPT-4.1 Mini	92	90	90	88	79	87.9%
Z.AI GLM 4.5	96	94	93	81	75	87.8%
Claude Sonnet 4.6	94	92	88	84	79	87.6%
Claude 3.5 Sonnet	95	89	88	84	78	87.2%
Claude Sonnet 4	93	90	89	85	77	86.8%
Claude 3.7 Sonnet	94	94	86	82	77	86.6%
DeepSeek-V2 Chat	95	89	89	85	70	85.5%
Gemma 3 12B	97	88	87	83	72	85.3%
Gemma 3 27B	100	89	86	84	65	84.8%
Gemini 3.1 Pro (Preview)	100	94	81	76	72	84.5%
DeepSeek V3.1	96	88	86	82	70	84.4%
Gemini 2.5 Flash	94	89	81	79	74	83.2%
GPT-5.1	91	85	82	78	69	81.2%
Claude 3.5 Haiku	94	94	85	83	43	79.6%
GPT-4.1 Nano	88	87	86	74	62	79.4%
Llama 3.1 8B	100	78	75	60	59	74.3%

▼

Literary fiction: old friends reunite

Model	# 1	# 2	# 3	# 4	# 5	Avg ▼
Grok 4	100	100	100	100	100	100.0%
Stealth: Aurora Alpha	100	100	100	100	100	100.0%
MoonshotAI: Kimi K2.5	100	100	100	100	99	99.8%
Mistral Large 2	100	100	100	100	98	99.6%
Ministral 8B	100	100	100	99	95	98.9%
Claude Sonnet 4	100	100	100	100	94	98.8%
Grok 4 Fast	100	100	100	100	94	98.8%
Claude 3.5 Sonnet	100	100	100	99	94	98.6%
Qwen 2.5 72B	100	100	100	100	92	98.4%
ByteDance Seed 1.6	100	100	100	100	89	97.9%
Mistral Large 3	100	100	100	98	91	97.8%
Qwen 3.5 397B A17B	100	100	100	94	94	97.6%
o4 Mini High	100	100	100	94	94	97.6%
o4 Mini	100	100	100	94	94	97.6%
Claude 3 Haiku	100	100	100	94	94	97.6%
GPT-4.1	100	100	100	100	88	97.5%
DeepSeek V3 (2024-12-26)	100	100	99	94	93	97.3%
Claude Opus 4.6	100	100	100	95	91	97.3%
Arcee AI: Trinity Mini	100	100	100	94	92	97.2%
Claude Sonnet 4.5	100	100	100	94	91	97.0%
ByteDance Seed 1.6 Flash	100	100	97	94	94	97.0%
GPT-5	100	100	100	97	88	96.9%
Ministral 3 14B	100	100	98	95	91	96.8%
Mistral Large	100	100	99	94	91	96.8%
Mistral Medium 3.1	100	100	96	95	92	96.5%
Grok 4.1 Fast	100	100	100	94	88	96.4%
WizardLM 2 8x22b	100	100	94	94	94	96.4%
Hermes 3 70B	100	100	98	94	88	96.1%
Llama 3.1 Nemotron 70B	99	99	94	94	94	96.0%
GPT-4o, Aug. 6th (temp=1)	100	100	100	100	79	95.9%
Z.AI GLM 5	100	100	98	94	88	95.9%
Mistral Small 3.2 24B	100	100	94	94	91	95.8%
DeepSeek-V2 Chat	100	100	98	90	90	95.6%
DeepSeek V3 (2025-03-24)	100	100	100	89	88	95.4%
Minimax M2.5	100	99	94	94	90	95.4%
GPT-5 Mini	100	94	94	94	94	95.2%
Gemini 3 Flash (Preview)	100	94	94	94	94	95.2%
GPT-4o, Aug. 6th (temp=0)	100	94	94	94	94	95.2%
GPT-4o Mini (temp=1)	100	100	94	94	88	95.2%
Cohere Command R+ (Aug. 2024)	100	100	94	94	88	95.2%
Mistral NeMO	100	94	94	94	94	95.2%
Arcee AI: Trinity Large (Preview)	100	100	96	94	85	94.9%
Ministral 3 3B	100	99	98	93	85	94.8%
Claude Opus 4	100	100	97	89	88	94.8%
Gemini 3 Pro (Preview)	100	94	94	94	88	94.0%
Qwen 3.5 Plus (2026-02-15)	100	94	94	94	88	94.0%
GPT-4o Mini (temp=0)	94	94	94	94	94	94.0%
Claude Haiku 4.5	100	99	96	87	87	93.8%
Z.AI GLM 4.7	100	100	93	88	88	93.8%
Z.AI GLM 4.5	100	95	92	92	91	93.8%
GPT-4o, May 13th (temp=0)	100	94	94	94	86	93.6%
GPT-5.2	99	98	96	94	80	93.5%
Claude Opus 4.5	100	94	94	91	89	93.5%
Claude 3.7 Sonnet	99	94	94	93	85	93.2%
Gemini 2.5 Flash Lite	100	100	95	93	78	93.1%
Gemma 3 27B	100	97	94	93	81	92.9%
Z.AI GLM 4.7 Flash	94	94	94	94	88	92.8%
Claude Sonnet 4.6	100	96	92	91	84	92.5%
Ministral 3 8B	100	97	95	94	76	92.4%
Writer: Palmyra X5	100	96	93	91	81	92.3%
DeepSeek V3.1	100	100	94	85	82	92.3%
Ministral 3B	100	92	90	88	87	91.5%
GPT-4.1 Mini	94	94	93	90	86	91.5%
Gemma 3 12B	98	94	91	88	87	91.5%
GPT-4o, May 13th (temp=1)	100	94	94	92	77	91.4%
Z.AI GLM 4.6	94	94	92	88	88	91.3%
DeepSeek V3.2	100	94	88	88	86	91.2%
Mistral Small Creative	100	94	88	87	85	91.0%
Gemini 2.5 Pro	100	94	94	82	82	90.4%
GPT-5 Nano	100	94	92	89	76	90.1%
GPT-5.1	97	93	91	87	82	90.0%
Claude 3.5 Haiku	96	94	89	86	84	89.9%
Rocinante 12B	100	100	88	87	75	89.8%
Hermes 3 405B	100	100	94	89	66	89.8%
Gemma 3 4B	99	96	92	82	79	89.5%
Gemini 2.5 Flash	100	94	84	84	82	88.8%
Gemini 3.1 Pro (Preview)	99	94	91	84	67	87.1%
Llama 3.1 8B	100	94	82	77	54	81.4%
GPT-4.1 Nano	97	75	75	67	66	75.9%
Llama 3.1 70B	100	97	76	52	35	71.9%

▼

Mystery: examining a crime scene

Model	# 1	# 2	# 3	# 4	# 5	Avg ▼
o4 Mini High	100	100	100	100	100	100.0%
MoonshotAI: Kimi K2.5	100	100	100	100	100	100.0%
Minimax M2.5	100	100	100	100	100	100.0%
Mistral Large 3	100	100	100	100	100	100.0%
GPT-4o, May 13th (temp=0)	100	100	100	100	100	100.0%
ByteDance Seed 1.6 Flash	100	100	100	100	100	100.0%
GPT-4o Mini (temp=0)	100	100	100	100	100	100.0%
Mistral Large	100	100	100	100	100	100.0%
Mistral Small 3.2 24B	100	100	100	100	100	100.0%
WizardLM 2 8x22b	100	100	100	100	100	100.0%
Qwen 2.5 72B	100	100	100	100	100	100.0%
GPT-4o, Aug. 6th (temp=0)	100	100	100	100	100	99.9%
Z.AI GLM 5	100	100	100	100	99	99.8%
Ministral 3B	100	100	100	100	98	99.6%
DeepSeek V3 (2024-12-26)	100	100	100	100	96	99.2%
Qwen 3.5 397B A17B	100	100	100	100	94	98.8%
Grok 4	100	100	100	100	94	98.8%
Grok 4.1 Fast	100	100	100	100	94	98.8%
Z.AI GLM 4.6	100	100	100	100	94	98.8%
Stealth: Aurora Alpha	100	100	100	100	94	98.8%
Grok 4 Fast	100	100	100	100	94	98.8%
DeepSeek V3.1	100	100	100	100	94	98.8%
Hermes 3 405B	100	100	100	100	94	98.8%
Llama 3.1 70B	100	100	100	100	94	98.8%
Arcee AI: Trinity Large (Preview)	100	100	100	100	94	98.8%
Arcee AI: Trinity Mini	100	100	100	100	94	98.8%
Rocinante 12B	100	100	100	100	94	98.8%
Claude 3.5 Haiku	100	100	100	100	92	98.4%
GPT-5	100	100	100	98	94	98.3%
Mistral Large 2	100	100	100	98	94	98.3%
Gemma 3 27B	100	100	100	100	91	98.3%
Z.AI GLM 4.5	100	100	99	98	94	98.1%
Writer: Palmyra X5	100	100	100	98	92	98.0%
DeepSeek V3 (2025-03-24)	100	100	100	95	94	97.8%
Claude Sonnet 4.5	100	100	100	94	94	97.7%
Claude Opus 4.5	100	100	100	94	94	97.6%
o4 Mini	100	100	100	94	94	97.6%
ByteDance Seed 1.6	100	100	100	94	94	97.6%
Qwen 3.5 Plus (2026-02-15)	100	100	100	100	88	97.6%
GPT-5 Nano	100	100	100	94	94	97.6%
Llama 3.1 Nemotron 70B	100	100	100	94	94	97.6%
Hermes 3 70B	100	100	100	94	94	97.6%
Mistral NeMO	100	100	100	94	94	97.6%
Cohere Command R+ (Aug. 2024)	100	100	100	100	87	97.4%
Gemini 2.5 Flash	100	100	99	94	94	97.3%
DeepSeek-V2 Chat	100	100	100	94	93	97.3%
Ministral 3 3B	100	100	100	94	91	97.0%
Claude 3.7 Sonnet	100	100	100	93	92	96.8%
Gemini 2.5 Flash Lite	100	100	100	94	90	96.8%
GPT-5 Mini	100	100	94	94	94	96.4%
Gemini 2.5 Pro	100	100	100	94	88	96.4%
Gemini 3 Pro (Preview)	100	100	94	94	94	96.4%
GPT-4.1	100	100	94	94	94	96.4%
DeepSeek V3.2	100	100	100	94	88	96.4%
Mistral Small Creative	100	100	94	94	94	96.4%
Claude Sonnet 4.6	100	99	99	95	88	96.3%
GPT-4o Mini (temp=1)	100	99	94	94	94	96.3%
Mistral Medium 3.1	100	100	100	90	88	95.5%
Z.AI GLM 4.7 Flash	100	94	94	94	94	95.2%
GPT-5.2	100	100	94	94	88	95.1%
Ministral 3 14B	98	98	96	94	89	95.0%
Claude Opus 4	100	100	97	95	81	94.7%
Z.AI GLM 4.7	100	100	94	88	88	94.0%
GPT-4o, Aug. 6th (temp=1)	100	100	93	91	85	93.9%
Claude 3.5 Sonnet	100	100	100	86	84	93.9%
Claude Opus 4.6	99	94	94	94	88	93.8%
Ministral 8B	100	96	93	89	88	93.2%
Claude Sonnet 4	100	94	94	94	82	92.9%
Claude Haiku 4.5	95	94	94	90	87	92.2%
Claude 3 Haiku	100	100	97	94	69	92.1%
Gemini 3 Flash (Preview)	100	94	88	88	88	91.6%
Llama 3.1 8B	100	100	88	88	82	91.5%
GPT-5.1	94	94	92	88	88	91.1%
Ministral 3 8B	100	94	93	89	79	90.9%
Gemini 3.1 Pro (Preview)	98	94	91	88	80	90.1%
Gemma 3 12B	100	97	94	79	78	89.7%
GPT-4o, May 13th (temp=1)	100	100	87	84	76	89.3%
GPT-4.1 Mini	97	90	88	87	80	88.5%
Gemma 3 4B	95	94	89	82	71	86.1%
GPT-4.1 Nano	94	85	84	81	76	84.0%

▼

Romance: separated couple reunites

Model	# 1	# 2	# 3	# 4	# 5	Avg ▼
Grok 4	100	100	100	100	100	100.0%
Grok 4.1 Fast	100	100	100	100	100	100.0%
Stealth: Aurora Alpha	100	100	100	100	100	100.0%
Ministral 8B	100	100	100	100	100	100.0%
GPT-4o Mini (temp=0)	100	100	100	100	100	99.9%
GPT-4o Mini (temp=1)	100	100	100	100	98	99.6%
o4 Mini	100	100	100	100	94	98.8%
ByteDance Seed 1.6	100	100	100	100	94	98.8%
Grok 4 Fast	100	100	100	100	94	98.8%
Mistral Medium 3.1	100	100	100	100	94	98.7%
MoonshotAI: Kimi K2.5	100	100	100	99	94	98.7%
Mistral Large 2	100	100	100	97	96	98.5%
Cohere Command R+ (Aug. 2024)	100	100	100	100	92	98.3%
Rocinante 12B	100	100	100	100	91	98.2%
Qwen 3.5 Plus (2026-02-15)	100	99	99	98	94	98.1%
Hermes 3 70B	100	100	100	100	90	98.0%
Ministral 3B	100	100	100	97	93	98.0%
Z.AI GLM 5	100	100	97	97	94	97.7%
Qwen 3.5 397B A17B	100	100	100	94	94	97.6%
ByteDance Seed 1.6 Flash	100	100	100	94	94	97.6%
Llama 3.1 70B	100	100	100	94	94	97.6%
Qwen 2.5 72B	100	100	100	94	94	97.6%
Claude Opus 4	100	100	100	96	92	97.5%
Mistral NeMO	100	100	99	94	94	97.4%
GPT-5.2	100	99	99	95	91	96.9%
DeepSeek-V2 Chat	100	100	96	94	94	96.7%
Z.AI GLM 4.7	100	100	94	94	94	96.4%
GPT-4o, Aug. 6th (temp=0)	100	100	94	94	94	96.4%
WizardLM 2 8x22b	100	100	94	94	94	96.4%
Ministral 3 8B	100	100	100	99	83	96.3%
o4 Mini High	100	100	99	94	88	96.2%
GPT-5 Mini	100	100	98	94	88	96.1%
DeepSeek V3 (2025-03-24)	100	100	100	100	80	95.9%
GPT-5	100	100	97	94	88	95.8%
Claude Opus 4.6	100	100	99	96	84	95.7%
Mistral Large	100	100	98	91	89	95.6%
Mistral Small Creative	100	100	96	91	90	95.4%
Arcee AI: Trinity Mini	100	100	94	92	88	94.7%
GPT-4o, May 13th (temp=1)	100	95	94	93	91	94.6%
Llama 3.1 Nemotron 70B	100	96	94	94	88	94.5%
Mistral Large 3	100	100	98	94	80	94.4%
Z.AI GLM 4.7 Flash	100	100	94	88	88	94.0%
GPT-4o, May 13th (temp=0)	94	94	94	94	94	94.0%
DeepSeek V3.2	100	94	94	93	88	93.8%
GPT-4.1	96	96	95	94	88	93.8%
Z.AI GLM 4.6	100	100	92	88	88	93.7%
Claude Haiku 4.5	100	100	93	89	85	93.4%
Gemini 3 Pro (Preview)	100	94	94	88	88	92.8%
GPT-5 Nano	98	95	94	89	88	92.7%
Claude Sonnet 4.6	100	96	91	91	86	92.7%
Mistral Small 3.2 24B	100	99	94	93	77	92.7%
Claude 3.5 Haiku	100	99	94	88	82	92.6%
Ministral 3 14B	98	94	94	92	84	92.5%
Gemini 2.5 Pro	100	94	94	91	83	92.5%
Gemini 3 Flash (Preview)	100	94	94	88	86	92.4%
Claude Sonnet 4.5	100	96	93	88	84	92.2%
GPT-4o, Aug. 6th (temp=1)	100	100	94	91	75	92.0%
Minimax M2.5	99	96	92	87	85	92.0%
Claude Sonnet 4	100	97	90	88	85	91.9%
Claude 3.5 Sonnet	100	100	91	89	76	91.2%
Ministral 3 3B	99	94	90	90	83	91.1%
Gemma 3 12B	100	98	88	84	83	90.6%
Claude Opus 4.5	100	100	94	85	73	90.3%
Arcee AI: Trinity Large (Preview)	97	92	90	87	85	90.1%
Hermes 3 405B	100	94	92	85	78	90.0%
Writer: Palmyra X5	95	95	93	91	75	89.8%
Gemini 2.5 Flash	100	94	90	85	79	89.7%
GPT-5.1	96	96	91	89	75	89.5%
DeepSeek V3 (2024-12-26)	100	100	87	81	79	89.3%
Z.AI GLM 4.5	93	92	90	89	78	88.7%
Claude 3 Haiku	94	94	89	79	77	86.5%
GPT-4.1 Mini	99	92	83	82	76	86.5%
DeepSeek V3.1	94	88	86	82	82	86.4%
Gemini 3.1 Pro (Preview)	93	93	90	77	76	85.7%
Claude 3.7 Sonnet	93	86	84	83	79	85.0%
Gemini 2.5 Flash Lite	94	94	84	78	70	84.1%
Gemma 3 27B	92	88	86	78	67	82.2%
Gemma 3 4B	93	91	88	81	40	78.6%
GPT-4.1 Nano	89	89	81	75	59	78.4%
Llama 3.1 8B	93	72	55	52	50	64.7%

▼

Thriller: chase through city streets

Model	# 1	# 2	# 3	# 4	# 5	Avg ▼
Claude Opus 4.6	100	100	100	100	100	100.0%
Claude Opus 4.5	100	100	100	100	100	100.0%
Claude Sonnet 4	100	100	100	100	100	100.0%
Gemini 3 Flash (Preview)	100	100	100	100	100	100.0%
Z.AI GLM 4.7 Flash	100	100	100	100	100	100.0%
Stealth: Aurora Alpha	100	100	100	100	100	100.0%
Claude 3.5 Sonnet	100	100	100	100	100	100.0%
DeepSeek V3 (2024-12-26)	100	100	100	100	100	100.0%
Mistral Large 3	100	100	100	100	100	100.0%
DeepSeek-V2 Chat	100	100	100	100	100	100.0%
ByteDance Seed 1.6 Flash	100	100	100	100	100	100.0%
GPT-4o Mini (temp=1)	100	100	100	100	100	100.0%
GPT-4o Mini (temp=0)	100	100	100	100	100	100.0%
Ministral 3 3B	100	100	100	100	100	100.0%
Ministral 8B	100	100	100	100	100	100.0%
Claude Opus 4	100	100	100	100	100	99.9%
Claude 3.5 Haiku	100	100	100	100	97	99.3%
Qwen 3.5 397B A17B	100	100	100	100	94	98.8%
GPT-5.1	100	100	100	100	94	98.8%
Minimax M2.5	100	100	100	100	94	98.8%
DeepSeek V3 (2025-03-24)	100	100	100	100	94	98.8%
Llama 3.1 Nemotron 70B	100	100	100	100	94	98.8%
Qwen 2.5 72B	100	100	100	100	94	98.8%
Arcee AI: Trinity Large (Preview)	100	100	100	100	94	98.8%
Hermes 3 70B	100	100	100	100	94	98.8%
Ministral 3B	100	100	100	100	94	98.8%
Ministral 3 8B	100	100	100	100	93	98.7%
Gemma 3 12B	100	100	100	98	94	98.5%
Hermes 3 405B	100	100	100	98	94	98.4%
Ministral 3 14B	100	100	100	97	94	98.1%
Claude Haiku 4.5	100	100	100	99	91	98.0%
Writer: Palmyra X5	100	100	100	94	94	97.6%
GPT-5 Mini	100	100	100	94	94	97.6%
o4 Mini High	100	100	100	100	88	97.6%
o4 Mini	100	100	100	94	94	97.6%
Z.AI GLM 5	100	100	100	94	94	97.6%
Grok 4	100	100	100	94	94	97.6%
Claude Sonnet 4.5	100	100	100	94	94	97.6%
ByteDance Seed 1.6	100	100	100	94	94	97.6%
GPT-4o, May 13th (temp=0)	100	100	100	94	94	97.6%
Z.AI GLM 4.5	100	100	100	94	94	97.6%
GPT-4o, Aug. 6th (temp=0)	100	100	100	94	94	97.6%
Llama 3.1 70B	100	100	100	100	88	97.6%
Mistral Large	100	100	100	94	94	97.6%
Mistral Small Creative	100	100	100	94	94	97.6%
Claude 3 Haiku	100	100	100	94	94	97.6%
Cohere Command R+ (Aug. 2024)	100	100	100	94	94	97.6%
Rocinante 12B	100	100	100	94	94	97.6%
GPT-4o, May 13th (temp=1)	100	100	100	94	94	97.6%
Gemma 3 4B	100	99	99	96	89	96.5%
Mistral NeMO	100	100	99	95	88	96.4%
GPT-4.1 Nano	100	100	96	94	92	96.4%
Claude Sonnet 4.6	100	100	96	94	92	96.4%
GPT-5	100	100	100	94	88	96.4%
Gemini 2.5 Pro	100	100	94	94	94	96.4%
Grok 4.1 Fast	100	100	94	94	94	96.4%
Qwen 3.5 Plus (2026-02-15)	100	100	100	94	88	96.4%
GPT-4o, Aug. 6th (temp=1)	100	100	100	94	88	96.4%
GPT-4.1 Mini	100	100	94	94	94	96.4%
Mistral Medium 3.1	100	100	100	94	88	96.4%
DeepSeek V3.1	100	100	100	94	88	96.4%
Mistral Large 2	100	100	100	94	88	96.4%
Gemini 2.5 Flash	100	100	94	94	94	96.4%
Mistral Small 3.2 24B	100	100	94	94	94	96.4%
WizardLM 2 8x22b	100	100	100	100	79	95.8%
Claude 3.7 Sonnet	100	100	100	94	84	95.6%
MoonshotAI: Kimi K2.5	100	100	94	94	88	95.2%
Z.AI GLM 4.6	100	94	94	94	94	95.2%
GPT-4.1	100	94	94	94	94	95.2%
Grok 4 Fast	100	100	100	88	88	95.2%
Arcee AI: Trinity Mini	100	100	94	94	88	95.2%
Gemini 2.5 Flash Lite	100	100	100	88	88	95.1%
Gemma 3 27B	100	96	94	94	88	94.4%
DeepSeek V3.2	100	100	100	94	76	94.0%
Z.AI GLM 4.7	100	94	94	94	88	94.0%
Gemini 3 Pro (Preview)	100	94	94	94	88	94.0%
GPT-5.2	100	94	94	94	82	92.7%
Gemini 3.1 Pro (Preview)	95	94	94	88	82	90.5%
GPT-5 Nano	100	88	88	88	88	90.4%
Llama 3.1 8B	100	79	76	73	62	78.1%

Novelcrafter Default Prompt

▼

Fantasy: entering an ancient ruin

Model	# 1	# 2	# 3	# 4	# 5	Avg ▼
o4 Mini High	100	100	100	100	100	100.0%
Grok 4	100	100	100	100	100	100.0%
Stealth: Aurora Alpha	100	100	100	100	100	100.0%
Grok 4 Fast	100	100	100	100	100	100.0%
Claude 3.5 Sonnet	100	100	100	100	100	100.0%
GPT-4o, Aug. 6th (temp=0)	100	100	100	100	100	100.0%
ByteDance Seed 1.6 Flash	100	100	100	100	100	100.0%
GPT-4o Mini (temp=0)	100	100	100	100	100	100.0%
Cohere Command R+ (Aug. 2024)	100	100	100	100	100	100.0%
Mistral NeMO	100	100	100	100	100	100.0%
Rocinante 12B	100	100	100	100	99	99.8%
Llama 3.1 70B	100	100	100	100	96	99.3%
GPT-4o Mini (temp=1)	100	100	100	100	96	99.1%
Ministral 3 8B	100	100	100	100	95	99.1%
Grok 4.1 Fast	100	100	100	100	94	98.8%
ByteDance Seed 1.6	100	100	100	100	94	98.8%
GPT-4.1	100	100	100	100	94	98.8%
Claude 3.5 Haiku	100	100	100	100	94	98.8%
Llama 3.1 Nemotron 70B	100	100	100	100	94	98.8%
Mistral Large	100	100	100	100	94	98.8%
Ministral 3 3B	100	100	100	100	94	98.8%
Claude 3 Haiku	100	100	100	100	94	98.8%
Mistral Small Creative	100	100	100	100	92	98.5%
Claude Opus 4	100	100	100	97	95	98.5%
Claude Sonnet 4	100	100	100	98	94	98.4%
Mistral Large 3	100	100	100	98	94	98.4%
Writer: Palmyra X5	100	100	100	98	93	98.3%
Mistral Medium 3.1	100	100	100	100	90	98.1%
GPT-5	100	100	100	94	94	97.6%
Z.AI GLM 4.7	100	100	100	94	94	97.6%
Z.AI GLM 4.7 Flash	100	100	100	94	94	97.6%
WizardLM 2 8x22b	100	100	100	94	94	97.6%
Ministral 3B	100	100	100	94	94	97.6%
Mistral Small 3.2 24B	100	100	100	100	88	97.5%
Arcee AI: Trinity Large (Preview)	100	100	100	100	87	97.5%
Gemma 3 27B	100	100	100	99	88	97.4%
GPT-5.1	100	100	99	94	94	97.3%
DeepSeek V3 (2025-03-24)	100	100	98	94	94	97.2%
Claude Sonnet 4.5	100	100	99	94	93	97.1%
Mistral Large 2	100	100	100	97	88	97.0%
Gemma 3 4B	100	100	96	94	94	96.9%
Gemini 2.5 Flash Lite	100	100	100	93	90	96.7%
GPT-5 Mini	100	100	94	94	94	96.4%
MoonshotAI: Kimi K2.5	100	100	100	94	88	96.4%
o4 Mini	100	100	94	94	94	96.4%
GPT-5.2	100	100	94	94	94	96.4%
Qwen 3.5 Plus (2026-02-15)	100	100	100	94	88	96.4%
GPT-4o, May 13th (temp=1)	100	100	94	94	94	96.4%
Hermes 3 405B	100	100	100	94	88	96.4%
Qwen 2.5 72B	100	100	100	94	88	96.4%
GPT-4o, Aug. 6th (temp=1)	100	100	94	94	94	96.4%
Gemma 3 12B	100	100	94	94	94	96.2%
Minimax M2.5	100	100	99	91	91	96.2%
GPT-4.1 Mini	100	100	95	94	87	95.3%
Llama 3.1 8B	100	99	95	94	88	95.3%
Qwen 3.5 397B A17B	100	100	94	94	88	95.2%
Z.AI GLM 4.6	100	100	94	94	88	95.2%
DeepSeek V3.2	100	94	94	94	94	95.2%
Z.AI GLM 4.5	100	100	94	93	88	94.9%
DeepSeek V3.1	100	98	94	94	88	94.9%
DeepSeek V3 (2024-12-26)	100	99	94	92	89	94.8%
Claude Haiku 4.5	100	100	96	91	85	94.5%
DeepSeek-V2 Chat	100	100	97	91	83	94.0%
Ministral 8B	100	94	94	92	90	94.0%
GPT-5 Nano	100	100	94	88	87	93.8%
Ministral 3 14B	100	99	95	89	83	93.0%
Gemini 2.5 Pro	100	94	94	94	82	92.8%
Gemini 3 Pro (Preview)	94	94	94	94	88	92.8%
GPT-4o, May 13th (temp=0)	100	94	94	88	88	92.8%
Claude Sonnet 4.6	100	100	94	85	84	92.5%
Claude Opus 4.5	100	100	94	88	81	92.5%
Claude 3.7 Sonnet	99	96	92	89	85	92.3%
Hermes 3 70B	94	94	93	89	88	91.7%
Gemini 2.5 Flash	100	94	94	88	82	91.6%
Z.AI GLM 5	95	94	91	89	88	91.5%
GPT-4.1 Nano	95	94	94	89	81	90.6%
Gemini 3 Flash (Preview)	100	100	94	82	76	90.4%
Arcee AI: Trinity Mini	100	94	88	88	82	90.4%
Claude Opus 4.6	94	93	92	88	84	90.3%
Gemini 3.1 Pro (Preview)	94	82	76	76	76	80.8%

▼

Horror: alone in an eerie place at night

Model	# 1	# 2	# 3	# 4	# 5	Avg ▼
o4 Mini	100	100	100	100	100	100.0%
Z.AI GLM 5	100	100	100	100	100	100.0%
Grok 4 Fast	100	100	100	100	100	100.0%
GPT-4o, Aug. 6th (temp=0)	100	100	100	100	100	100.0%
GPT-4o Mini (temp=0)	100	100	100	100	100	100.0%
Claude 3 Haiku	100	100	100	100	100	100.0%
GPT-5.2	100	100	100	100	100	99.9%
ByteDance Seed 1.6 Flash	100	100	100	100	99	99.9%
GPT-5 Mini	100	100	100	100	94	98.8%
GPT-5	100	100	100	100	94	98.8%
Gemini 3 Pro (Preview)	100	100	100	100	94	98.8%
Grok 4.1 Fast	100	100	100	100	94	98.8%
Stealth: Aurora Alpha	100	100	100	100	94	98.8%
Mistral Small 3.2 24B	100	100	100	100	94	98.8%
Hermes 3 70B	100	100	100	100	94	98.8%
Mistral NeMO	100	100	100	99	94	98.7%
Llama 3.1 70B	100	100	100	99	94	98.6%
Z.AI GLM 4.7 Flash	100	100	100	100	92	98.5%
Mistral Medium 3.1	100	100	100	98	94	98.3%
Hermes 3 405B	100	100	100	98	94	98.3%
GPT-4.1	100	100	99	98	93	98.1%
Z.AI GLM 4.5	100	100	98	98	94	98.0%
GPT-4o, Aug. 6th (temp=1)	100	100	100	100	89	97.9%
GPT-4o, May 13th (temp=0)	100	100	100	94	94	97.6%
Claude Opus 4.6	100	100	100	94	94	97.6%
GPT-5.1	100	100	100	94	94	97.6%
o4 Mini High	100	100	100	94	94	97.6%
MoonshotAI: Kimi K2.5	100	100	100	94	94	97.6%
ByteDance Seed 1.6	100	100	100	94	94	97.6%
Rocinante 12B	100	100	100	98	88	97.3%
Gemini 2.5 Flash Lite	100	100	100	95	92	97.3%
Cohere Command R+ (Aug. 2024)	100	100	100	100	86	97.2%
Ministral 3 14B	100	100	99	94	92	96.9%
Grok 4	100	100	100	94	90	96.9%
Minimax M2.5	100	100	97	94	93	96.8%
Gemini 3 Flash (Preview)	100	100	94	94	94	96.4%
DeepSeek V3 (2025-03-24)	100	99	97	94	91	96.2%
Qwen 2.5 72B	100	100	99	94	88	96.1%
Claude 3.5 Sonnet	100	100	96	94	91	96.1%
Llama 3.1 Nemotron 70B	100	100	100	92	88	96.1%
Gemma 3 4B	100	100	96	93	88	95.5%
Claude Sonnet 4.5	99	97	96	94	90	95.3%
Qwen 3.5 397B A17B	100	94	94	94	94	95.2%
GPT-4o Mini (temp=1)	100	100	95	94	86	95.0%
Ministral 3B	100	100	95	92	88	95.0%
GPT-4o, May 13th (temp=1)	100	100	94	94	87	94.9%
GPT-5 Nano	100	100	100	94	81	94.9%
Claude Opus 4.5	100	98	94	94	88	94.8%
Ministral 3 3B	100	97	97	91	88	94.8%
Arcee AI: Trinity Mini	99	94	94	94	93	94.7%
Arcee AI: Trinity Large (Preview)	100	100	100	87	85	94.5%
DeepSeek-V2 Chat	100	99	96	89	88	94.3%
Gemini 2.5 Pro	100	94	94	94	88	94.0%
Z.AI GLM 4.7	100	94	94	94	88	94.0%
GPT-4.1 Mini	100	94	93	92	91	94.0%
Claude Haiku 4.5	100	100	93	89	88	93.8%
Gemma 3 12B	100	100	97	92	79	93.7%
Writer: Palmyra X5	100	100	92	90	85	93.5%
Mistral Large	100	98	94	88	84	92.8%
Qwen 3.5 Plus (2026-02-15)	100	100	100	82	82	92.8%
Claude Sonnet 4.6	100	93	93	90	88	92.7%
DeepSeek V3.1	100	100	88	88	87	92.4%
Mistral Small Creative	100	94	94	93	81	92.3%
DeepSeek V3 (2024-12-26)	100	94	94	93	80	92.2%
Z.AI GLM 4.6	100	97	88	88	87	92.0%
Claude 3.5 Haiku	100	100	94	87	78	91.7%
Claude 3.7 Sonnet	98	95	91	86	86	91.1%
WizardLM 2 8x22b	100	94	94	88	79	91.0%
Claude Sonnet 4	100	96	94	88	76	90.7%
DeepSeek V3.2	94	94	94	88	82	90.4%
Claude Opus 4	100	94	92	87	78	90.2%
GPT-4.1 Nano	95	93	89	87	82	89.5%
Gemini 3.1 Pro (Preview)	94	88	88	88	82	88.0%
Ministral 8B	97	88	85	85	84	87.9%
Ministral 3 8B	100	95	89	85	65	86.8%
Mistral Large 2	94	94	90	79	77	86.8%
Llama 3.1 8B	94	94	85	82	76	86.1%
Gemini 2.5 Flash	100	88	88	83	69	85.6%
Mistral Large 3	94	88	87	81	76	85.3%
Gemma 3 27B	100	93	92	81	59	84.9%

▼

Literary fiction: old friends reunite

Model	# 1	# 2	# 3	# 4	# 5	Avg ▼
GPT-5.1	100	100	100	100	100	100.0%
o4 Mini High	100	100	100	100	100	100.0%
GPT-5	100	100	100	100	100	100.0%
o4 Mini	100	100	100	100	100	100.0%
Gemini 3 Pro (Preview)	100	100	100	100	100	100.0%
Grok 4	100	100	100	100	100	100.0%
Grok 4.1 Fast	100	100	100	100	100	100.0%
GPT-4o, Aug. 6th (temp=0)	100	100	100	100	100	100.0%
ByteDance Seed 1.6 Flash	100	100	100	100	100	100.0%
Claude Opus 4.6	100	100	100	100	99	99.9%
Claude 3.5 Sonnet	100	100	100	100	95	98.9%
GPT-5 Mini	100	100	100	100	94	98.8%
GPT-5.2	100	100	100	100	94	98.8%
ByteDance Seed 1.6	100	100	100	100	94	98.8%
Stealth: Aurora Alpha	100	100	100	100	94	98.8%
Grok 4 Fast	100	100	100	100	94	98.8%
Claude 3.5 Haiku	100	100	100	100	94	98.8%
DeepSeek V3.1	100	100	100	100	94	98.8%
GPT-4o Mini (temp=1)	100	100	100	100	94	98.8%
Mistral Small Creative	100	100	100	100	94	98.8%
Qwen 2.5 72B	100	100	100	100	94	98.8%
GPT-5 Nano	100	100	100	99	94	98.7%
DeepSeek-V2 Chat	100	100	100	100	93	98.6%
Rocinante 12B	100	100	100	99	94	98.6%
Mistral Large	100	100	100	99	94	98.6%
Mistral Large 2	100	100	99	98	95	98.5%
GPT-4.1	100	100	100	98	94	98.4%
Claude Sonnet 4.5	100	100	100	100	92	98.4%
DeepSeek V3 (2025-03-24)	100	100	100	97	94	98.3%
Hermes 3 70B	100	100	100	96	95	98.1%
Gemma 3 27B	100	100	99	95	94	97.7%
Qwen 3.5 397B A17B	100	100	100	94	94	97.6%
MoonshotAI: Kimi K2.5	100	100	100	100	88	97.6%
Gemini 2.5 Pro	100	100	100	100	88	97.6%
GPT-4o, May 13th (temp=0)	100	100	100	94	94	97.6%
DeepSeek V3.2	100	100	100	94	94	97.6%
Gemini 3 Flash (Preview)	100	100	100	94	94	97.6%
Llama 3.1 Nemotron 70B	100	100	100	94	94	97.6%
Claude Haiku 4.5	100	100	100	97	91	97.5%
DeepSeek V3 (2024-12-26)	100	100	100	99	88	97.4%
Arcee AI: Trinity Mini	100	100	98	96	91	97.1%
Mistral Large 3	100	100	100	94	91	97.1%
GPT-4o, May 13th (temp=1)	100	100	97	94	94	97.0%
Gemma 3 12B	100	100	99	94	91	97.0%
Cohere Command R+ (Aug. 2024)	100	100	100	96	88	96.9%
Ministral 3 8B	100	100	98	97	89	96.9%
Claude 3 Haiku	100	100	100	96	88	96.8%
Ministral 3 3B	100	100	100	94	89	96.5%
GPT-4o, Aug. 6th (temp=1)	100	100	100	98	85	96.5%
Arcee AI: Trinity Large (Preview)	100	100	100	94	88	96.5%
Z.AI GLM 5	100	100	99	96	87	96.4%
Z.AI GLM 4.7 Flash	100	100	94	94	94	96.4%
WizardLM 2 8x22b	100	100	94	94	94	96.4%
Llama 3.1 8B	100	100	100	100	81	96.2%
Z.AI GLM 4.6	100	98	94	94	94	96.0%
Claude Opus 4	100	100	94	94	91	95.8%
Mistral NeMO	100	97	94	94	94	95.8%
Z.AI GLM 4.5	100	100	100	90	88	95.6%
Mistral Medium 3.1	100	100	100	90	89	95.6%
Writer: Palmyra X5	100	97	95	94	90	95.2%
Qwen 3.5 Plus (2026-02-15)	100	94	94	94	94	95.2%
Mistral Small 3.2 24B	100	94	94	94	94	95.2%
Claude Opus 4.5	100	100	98	94	84	95.1%
GPT-4o Mini (temp=0)	100	94	94	94	93	95.0%
Claude Sonnet 4	100	100	96	91	86	94.6%
Hermes 3 405B	100	98	94	91	90	94.6%
Minimax M2.5	100	99	99	88	86	94.3%
Gemini 3.1 Pro (Preview)	100	94	94	94	88	94.0%
Z.AI GLM 4.7	100	94	94	94	88	94.0%
Ministral 8B	100	100	91	89	89	93.8%
Llama 3.1 70B	100	94	94	92	88	93.6%
Ministral 3B	100	100	100	87	80	93.5%
Gemini 2.5 Flash	100	94	94	90	80	91.6%
Claude 3.7 Sonnet	100	99	95	84	78	91.2%
Claude Sonnet 4.6	95	93	90	89	88	90.9%
Gemma 3 4B	100	94	93	86	79	90.7%
Ministral 3 14B	100	100	97	86	65	89.5%
GPT-4.1 Mini	100	90	90	86	77	88.7%
Gemini 2.5 Flash Lite	100	98	94	78	69	87.7%
GPT-4.1 Nano	91	89	80	78	70	81.6%

▼

Mystery: examining a crime scene

Model	# 1	# 2	# 3	# 4	# 5	Avg ▼
Qwen 3.5 397B A17B	100	100	100	100	100	100.0%
MoonshotAI: Kimi K2.5	100	100	100	100	100	100.0%
Gemini 2.5 Pro	100	100	100	100	100	100.0%
Minimax M2.5	100	100	100	100	100	100.0%
Grok 4	100	100	100	100	100	100.0%
Claude Sonnet 4.6	100	100	100	100	100	100.0%
Stealth: Aurora Alpha	100	100	100	100	100	100.0%
Claude 3.5 Sonnet	100	100	100	100	100	100.0%
ByteDance Seed 1.6 Flash	100	100	100	100	100	100.0%
GPT-4o Mini (temp=0)	100	100	100	100	100	100.0%
Arcee AI: Trinity Large (Preview)	100	100	100	100	100	100.0%
WizardLM 2 8x22b	100	100	100	100	100	100.0%
Ministral 3B	100	100	100	100	100	100.0%
GPT-4o Mini (temp=1)	100	100	100	100	99	99.8%
Writer: Palmyra X5	100	100	100	100	99	99.8%
Ministral 3 3B	100	100	100	100	99	99.8%
Ministral 3 14B	100	100	100	100	97	99.4%
Hermes 3 405B	100	100	100	100	96	99.3%
Ministral 8B	100	100	100	99	96	98.9%
Llama 3.1 8B	100	100	100	100	94	98.9%
GPT-5 Mini	100	100	100	100	94	98.8%
o4 Mini High	100	100	100	100	94	98.8%
GPT-5	100	100	100	100	94	98.8%
Z.AI GLM 5	100	100	100	100	94	98.8%
Claude Opus 4	100	100	100	100	94	98.8%
GPT-4.1	100	100	100	100	94	98.8%
GPT-5 Nano	100	100	100	100	94	98.8%
Grok 4 Fast	100	100	100	100	94	98.8%
Mistral Large 3	100	100	100	100	94	98.8%
GPT-4o, May 13th (temp=0)	100	100	100	100	94	98.8%
GPT-4o, Aug. 6th (temp=1)	100	100	100	100	94	98.8%
GPT-4o, Aug. 6th (temp=0)	100	100	100	100	94	98.8%
o4 Mini	100	100	100	99	94	98.7%
Qwen 2.5 72B	100	100	100	99	94	98.6%
Mistral Large	100	100	100	100	93	98.6%
Mistral NeMO	100	100	100	100	93	98.6%
Ministral 3 8B	100	100	100	97	94	98.2%
Claude Sonnet 4	100	100	98	98	94	98.1%
Z.AI GLM 4.6	100	100	100	100	90	98.1%
Z.AI GLM 4.5	100	100	100	100	90	98.0%
Rocinante 12B	100	100	100	100	89	97.9%
Claude Opus 4.5	100	100	100	94	94	97.6%
GPT-5.2	100	100	100	94	94	97.6%
Gemini 3 Flash (Preview)	100	100	100	94	94	97.6%
Qwen 3.5 Plus (2026-02-15)	100	100	100	94	94	97.6%
DeepSeek V3.1	100	100	100	94	94	97.6%
Mistral Large 2	100	100	100	94	94	97.6%
Cohere Command R+ (Aug. 2024)	100	100	100	94	94	97.6%
Claude 3.7 Sonnet	100	100	100	95	93	97.6%
Llama 3.1 Nemotron 70B	100	100	100	99	88	97.4%
Claude Haiku 4.5	100	100	100	94	93	97.4%
Claude 3.5 Haiku	100	100	100	100	87	97.3%
GPT-4o, May 13th (temp=1)	100	100	98	94	94	97.2%
Hermes 3 70B	100	100	100	94	91	97.1%
Llama 3.1 70B	100	100	100	94	90	96.8%
Claude Sonnet 4.5	100	100	100	94	89	96.6%
Claude Opus 4.6	100	100	94	94	94	96.4%
GPT-5.1	100	100	100	94	88	96.4%
Z.AI GLM 4.7	100	100	100	94	88	96.4%
Z.AI GLM 4.7 Flash	100	100	100	94	88	96.4%
GPT-4.1 Mini	100	100	95	94	93	96.4%
DeepSeek V3 (2024-12-26)	100	99	94	94	94	96.1%
Gemini 2.5 Flash Lite	100	100	97	94	89	95.9%
Mistral Small Creative	100	100	100	93	86	95.8%
Claude 3 Haiku	100	100	96	94	88	95.7%
DeepSeek V3 (2025-03-24)	100	100	94	93	91	95.6%
Gemma 3 27B	100	100	95	95	88	95.6%
Arcee AI: Trinity Mini	100	98	94	94	90	95.3%
Gemini 3 Pro (Preview)	100	100	94	94	88	95.2%
Grok 4.1 Fast	100	100	94	94	88	95.2%
Mistral Medium 3.1	100	100	94	93	89	95.1%
DeepSeek-V2 Chat	99	96	94	94	88	94.2%
Gemini 3.1 Pro (Preview)	100	94	94	94	88	94.0%
DeepSeek V3.2	100	100	94	88	88	94.0%
ByteDance Seed 1.6	100	100	100	88	76	92.8%
Gemini 2.5 Flash	100	94	91	91	88	92.7%
GPT-4.1 Nano	100	97	90	88	86	92.0%
Gemma 3 4B	97	95	94	87	82	91.2%
Gemma 3 12B	100	100	94	79	76	89.8%
Mistral Small 3.2 24B	100	100	88	88	59	87.0%

▼

Romance: separated couple reunites

Model	# 1	# 2	# 3	# 4	# 5	Avg ▼
Qwen 3.5 397B A17B	100	100	100	100	100	100.0%
GPT-5 Mini	100	100	100	100	100	100.0%
GPT-5.1	100	100	100	100	100	100.0%
o4 Mini High	100	100	100	100	100	100.0%
MoonshotAI: Kimi K2.5	100	100	100	100	100	100.0%
GPT-5	100	100	100	100	100	100.0%
Grok 4	100	100	100	100	100	100.0%
Grok 4.1 Fast	100	100	100	100	100	100.0%
ByteDance Seed 1.6	100	100	100	100	100	100.0%
Mistral Large 3	100	100	100	100	100	100.0%
DeepSeek V3.2	100	100	100	100	100	100.0%
GPT-4o, Aug. 6th (temp=0)	100	100	100	100	100	100.0%
ByteDance Seed 1.6 Flash	100	100	100	100	100	100.0%
GPT-4o Mini (temp=0)	100	100	100	100	100	100.0%
Qwen 3.5 Plus (2026-02-15)	100	100	100	100	99	99.9%
Claude 3.5 Sonnet	100	100	100	100	99	99.8%
Mistral Large 2	100	100	100	100	99	99.8%
GPT-4o Mini (temp=1)	100	100	100	100	99	99.7%
DeepSeek V3 (2024-12-26)	100	100	100	100	98	99.5%
Claude Sonnet 4	100	100	100	99	98	99.5%
Claude Haiku 4.5	100	100	100	99	98	99.3%
Z.AI GLM 5	100	100	100	100	95	99.1%
Hermes 3 70B	100	100	100	98	96	98.9%
o4 Mini	100	100	100	100	94	98.8%
Gemini 2.5 Pro	100	100	100	100	94	98.8%
Gemini 3 Pro (Preview)	100	100	100	100	94	98.8%
Grok 4 Fast	100	100	100	100	94	98.8%
WizardLM 2 8x22b	100	100	100	100	94	98.8%
GPT-5.2	100	100	100	99	95	98.7%
Arcee AI: Trinity Large (Preview)	100	100	100	100	93	98.6%
Cohere Command R+ (Aug. 2024)	100	100	100	100	92	98.5%
DeepSeek V3 (2025-03-24)	100	100	100	100	92	98.3%
Arcee AI: Trinity Mini	100	100	100	99	92	98.1%
Minimax M2.5	100	100	98	97	95	98.0%
Claude Opus 4.6	100	100	100	95	94	97.9%
Qwen 2.5 72B	100	100	100	100	88	97.7%
Mistral Small Creative	100	100	100	97	91	97.7%
Mistral Large	100	100	99	95	94	97.7%
Gemini 3 Flash (Preview)	100	100	100	100	88	97.6%
Stealth: Aurora Alpha	100	100	100	94	94	97.6%
GPT-4o, May 13th (temp=0)	100	100	100	94	93	97.4%
Ministral 3 14B	100	100	99	94	89	96.5%
Z.AI GLM 4.7	100	100	100	94	88	96.4%
Mistral NeMO	100	100	94	94	94	96.4%
Ministral 3 8B	100	100	94	93	93	96.0%
Claude Opus 4	100	100	95	94	91	96.0%
Claude Sonnet 4.5	100	100	100	94	85	95.7%
Hermes 3 405B	100	100	100	94	85	95.7%
GPT-4o, Aug. 6th (temp=1)	100	100	100	100	78	95.7%
Llama 3.1 70B	100	100	94	94	90	95.6%
Gemini 2.5 Flash	100	100	94	92	92	95.6%
Claude 3.5 Haiku	100	100	96	96	85	95.5%
Z.AI GLM 4.7 Flash	100	100	94	94	88	95.2%
Llama 3.1 Nemotron 70B	100	94	94	94	93	95.1%
Mistral Small 3.2 24B	95	95	94	94	94	94.5%
DeepSeek-V2 Chat	100	100	94	93	85	94.4%
GPT-5 Nano	100	100	94	92	86	94.3%
Mistral Medium 3.1	100	100	97	91	83	94.1%
Gemini 3.1 Pro (Preview)	100	94	94	94	88	94.0%
GPT-4.1 Mini	100	100	99	86	84	93.8%
Claude 3 Haiku	100	93	93	92	91	93.7%
Claude Sonnet 4.6	100	100	96	93	79	93.6%
Ministral 3 3B	100	96	95	94	83	93.5%
Claude Opus 4.5	100	97	94	90	86	93.5%
Z.AI GLM 4.6	100	100	94	91	82	93.4%
Ministral 8B	100	94	94	93	85	93.2%
Ministral 3B	100	100	100	88	77	93.1%
Claude 3.7 Sonnet	100	95	93	91	87	93.0%
DeepSeek V3.1	98	94	94	92	87	93.0%
Gemini 2.5 Flash Lite	100	94	94	88	88	92.7%
GPT-4.1	100	94	94	94	80	92.5%
Gemma 3 12B	98	97	95	94	77	92.4%
Writer: Palmyra X5	100	100	89	88	79	91.2%
Z.AI GLM 4.5	94	94	88	88	86	90.0%
GPT-4o, May 13th (temp=1)	100	100	94	84	72	90.0%
Gemma 3 27B	98	94	94	90	73	89.8%
Rocinante 12B	98	98	89	89	71	89.0%
Llama 3.1 8B	100	100	93	86	40	83.8%
Gemma 3 4B	100	99	76	72	68	83.1%
GPT-4.1 Nano	97	79	78	77	75	81.2%

▼

Thriller: chase through city streets

Model	# 1	# 2	# 3	# 4	# 5	Avg ▼
Claude Opus 4.6	100	100	100	100	100	100.0%
Gemini 3 Pro (Preview)	100	100	100	100	100	100.0%
Stealth: Aurora Alpha	100	100	100	100	100	100.0%
DeepSeek V3 (2025-03-24)	100	100	100	100	100	100.0%
GPT-4o, May 13th (temp=0)	100	100	100	100	100	100.0%
GPT-4o, Aug. 6th (temp=1)	100	100	100	100	100	100.0%
GPT-4o, Aug. 6th (temp=0)	100	100	100	100	100	100.0%
GPT-4.1 Mini	100	100	100	100	100	100.0%
Llama 3.1 70B	100	100	100	100	100	100.0%
Ministral 3 8B	100	100	100	100	100	100.0%
Ministral 3 3B	100	100	100	100	100	100.0%
Gemma 3 4B	100	100	100	100	100	100.0%
Ministral 8B	100	100	100	100	100	100.0%
Ministral 3B	100	100	100	100	100	100.0%
Claude 3.7 Sonnet	100	100	100	100	99	99.8%
Claude Haiku 4.5	100	100	100	100	98	99.6%
Hermes 3 70B	100	100	100	100	97	99.5%
Qwen 3.5 397B A17B	100	100	100	100	94	98.8%
o4 Mini High	100	100	100	100	94	98.8%
MoonshotAI: Kimi K2.5	100	100	100	100	94	98.8%
GPT-5.2	100	100	100	100	94	98.8%
Z.AI GLM 4.7	100	100	100	100	94	98.8%
Claude Opus 4	100	100	100	100	94	98.8%
Minimax M2.5	100	100	100	100	94	98.8%
Grok 4	100	100	100	100	94	98.8%
Z.AI GLM 4.6	100	100	100	100	94	98.8%
GPT-4.1	100	100	100	100	94	98.8%
Qwen 3.5 Plus (2026-02-15)	100	100	100	100	94	98.8%
GPT-5 Nano	100	100	100	100	94	98.8%
Mistral Large 3	100	100	100	100	94	98.8%
DeepSeek-V2 Chat	100	100	100	100	94	98.8%
ByteDance Seed 1.6 Flash	100	100	100	100	94	98.8%
DeepSeek V3.1	100	100	100	100	94	98.8%
Mistral Large 2	100	100	100	100	94	98.8%
GPT-4o Mini (temp=1)	100	100	100	100	94	98.8%
GPT-4o Mini (temp=0)	100	100	100	100	94	98.8%
Gemini 2.5 Flash Lite	100	100	100	100	94	98.8%
Mistral Large	100	100	100	100	94	98.8%
Gemma 3 27B	100	100	100	100	94	98.8%
Qwen 2.5 72B	100	100	100	100	94	98.8%
Mistral Small 3.2 24B	100	100	100	100	94	98.8%
Claude 3 Haiku	100	100	100	100	94	98.8%
Mistral NeMO	100	100	100	100	94	98.8%
Gemma 3 12B	100	100	100	100	94	98.7%
Hermes 3 405B	100	100	100	100	93	98.5%
Cohere Command R+ (Aug. 2024)	100	100	100	100	92	98.5%
Arcee AI: Trinity Large (Preview)	100	100	100	100	90	97.9%
Claude Sonnet 4.6	100	100	100	98	91	97.9%
GPT-5 Mini	100	100	100	94	94	97.6%
GPT-5.1	100	100	100	94	94	97.6%
Z.AI GLM 5	100	100	100	94	94	97.6%
Gemini 2.5 Pro	100	100	100	94	94	97.6%
Claude Sonnet 4	100	100	100	94	94	97.6%
Claude Sonnet 4.5	100	100	100	94	94	97.6%
Z.AI GLM 4.7 Flash	100	100	100	94	94	97.6%
Claude 3.5 Sonnet	100	100	100	94	94	97.6%
DeepSeek V3 (2024-12-26)	100	100	100	94	94	97.6%
Z.AI GLM 4.5	100	100	100	94	94	97.6%
GPT-4o, May 13th (temp=1)	100	100	100	94	94	97.6%
Writer: Palmyra X5	100	100	100	94	94	97.6%
Arcee AI: Trinity Mini	100	100	100	94	94	97.6%
Rocinante 12B	100	100	100	100	88	97.6%
Ministral 3 14B	100	100	100	100	86	97.2%
Claude 3.5 Haiku	100	100	100	98	86	96.9%
Llama 3.1 8B	100	100	96	94	93	96.5%
GPT-4.1 Nano	100	100	99	97	86	96.5%
o4 Mini	100	100	100	94	88	96.4%
Grok 4 Fast	100	100	94	94	94	96.4%
Gemini 2.5 Flash	100	100	94	94	94	96.4%
Mistral Small Creative	100	100	94	94	94	96.4%
WizardLM 2 8x22b	100	100	100	94	88	96.4%
Mistral Medium 3.1	100	100	94	94	92	96.0%
Claude Opus 4.5	100	100	98	94	88	96.0%
ByteDance Seed 1.6	100	100	100	88	88	95.2%
DeepSeek V3.2	100	94	94	94	94	95.2%
Llama 3.1 Nemotron 70B	100	100	97	94	85	95.2%
GPT-5	94	94	94	94	94	94.0%
Grok 4.1 Fast	100	100	94	88	88	94.0%
Gemini 3 Flash (Preview)	100	94	94	88	88	92.8%
Gemini 3.1 Pro (Preview)	100	94	94	88	82	91.6%

Purple prose (modifier overload)

Overall Performance

Performance Score Distribution (Top 20)

Price-Performance Score Distribution (Top 20)

Most Stable Models (Top 20)

Top Overall Models (Top 20)

Individual Scenarios

Detailed Writing Rules

Fantasy: entering an ancient ruin

Horror: alone in an eerie place at night

Literary fiction: old friends reunite

Mystery: examining a crime scene

Romance: separated couple reunites

Thriller: chase through city streets

genre

Fantasy: entering an ancient ruin

Horror: alone in an eerie place at night

Literary fiction: old friends reunite

Mystery: examining a crime scene

Romance: separated couple reunites

Thriller: chase through city streets

Novelcrafter Default Prompt

Fantasy: entering an ancient ruin

Horror: alone in an eerie place at night

Literary fiction: old friends reunite

Mystery: examining a crime scene

Romance: separated couple reunites

Thriller: chase through city streets