AI-ism adverb frequency

Test: Bad Writing Habits

Avg. Score

86.6%

Scenarios

Overall Performance

Performance Score Distribution (Top 20)

Click a model name to view its detail page.

Rank ▲	Model	Score	Avg. Cost	Avg. Time	Stability
1	Grok 4.1 Fast	97.8%	$0.0018	37.8s	93%
2	ByteDance Seed 1.6 Flash	97.0%	$0.0013	27.3s	91%
3	Grok 4 Fast	94.2%	$0.0017	24.1s	86%
4	o4 Mini	95.4%	$0.015	25.7s	86%
5	Stealth: Aurora Alpha	92.6%	$0.0000	9.8s	84%
6	o4 Mini High	95.8%	$0.025	47.2s	87%
7	Gemini 3 Flash (Preview)	92.3%	$0.0078	19.6s	84%
8	GPT-5 Mini	94.0%	$0.0100	57.4s	86%
9	GPT-4.1	93.4%	$0.018	44.7s	85%
10	Mistral Medium 3.1	91.9%	$0.0048	36.5s	81%
11	Mistral Large 3	90.8%	$0.0033	30.3s	80%
12	ByteDance Seed 1.6	96.3%	$0.013	2.5m	89%
13	GPT-5 Nano	90.9%	$0.0042	1.4m	85%
14	Qwen 3.5 Plus (2026-02-15)	89.6%	$0.0060	31.5s	78%
15	Mistral Large	90.6%	$0.014	30.9s	78%
16	Ministral 3 14B	88.8%	$0.0007	11.7s	75%
17	Ministral 8B	88.5%	$0.0004	10.4s	75%
18	Mistral Small Creative	87.9%	$0.0007	9.1s	75%
19	Arcee AI: Trinity Mini	88.3%	$0.0003	9.2s	73%
20	Qwen 2.5 72B	88.7%	$0.0010	36.7s	76%
21	Z.AI GLM 5	90.4%	$0.0084	1.2m	80%
22	Mistral Large 2	89.4%	$0.013	29.4s	76%
23	Ministral 3 8B	86.9%	$0.0008	19.6s	75%
24	Z.AI GLM 4.7 Flash	89.3%	$0.0017	1.2m	79%
25	Ministral 3B	87.9%	$0.0001	8.1s	70%
26	Grok 4	93.4%	$0.048	1.7m	86%
27	DeepSeek V3 (2025-03-24)	88.8%	$0.0014	39.4s	73%
28	Ministral 3 3B	87.5%	$0.0005	11.1s	70%
29	GPT-5.2	93.6%	$0.056	1.5m	83%
30	Qwen 3.5 397B A17B	93.6%	$0.014	3.0m	84%
31	Llama 3.1 8B	87.9%	$0.0003	1.3m	75%
32	Writer: Palmyra X5	86.4%	$0.011	22.0s	71%
33	Llama 3.1 70B	86.7%	$0.0015	29.4s	69%
34	Gemini 3 Pro (Preview)	89.5%	$0.055	54.4s	79%
35	Z.AI GLM 4.6	85.4%	$0.0065	51.5s	74%
36	Gemini 2.5 Pro	87.8%	$0.036	36.2s	74%
37	Mistral NeMO	83.8%	$0.0005	10.1s	68%
38	GPT-4o, Aug. 6th (temp=0)	85.8%	$0.023	22.7s	72%
39	Claude Opus 4.6	92.2%	$0.078	1.2m	82%
40	Claude Sonnet 4.5	88.3%	$0.035	38.1s	73%
41	MoonshotAI: Kimi K2.5	93.5%	$0.019	3.2m	83%
42	Minimax M2.5	86.1%	$0.0034	1.3m	75%
43	Z.AI GLM 4.7	87.1%	$0.010	1.4m	76%
44	Rocinante 12B	86.3%	$0.0014	38.4s	68%
45	GPT-5	95.4%	$0.065	2.8m	87%
46	Cohere Command R+ (Aug. 2024)	86.5%	$0.020	52.5s	73%
47	WizardLM 2 8x22b	88.0%	$0.0026	1.8m	74%
48	Claude Haiku 4.5	83.4%	$0.011	21.6s	70%
49	GPT-5.1	91.3%	$0.054	1.8m	78%
50	DeepSeek V3.2	85.9%	$0.0014	1.9m	74%
51	GPT-4o, Aug. 6th (temp=1)	83.4%	$0.018	24.4s	69%
52	GPT-4o Mini (temp=0)	82.7%	$0.0012	34.8s	66%
53	Llama 3.1 Nemotron 70B	82.9%	$0.0038	31.7s	66%
54	Gemini 2.5 Flash Lite	80.4%	$0.0009	9.5s	66%
55	Gemini 2.5 Flash	80.8%	$0.0052	10.6s	66%
56	Gemma 3 27B	82.6%	$0.0006	52.6s	66%
57	DeepSeek V3.1	84.8%	$0.0020	1.8m	71%
58	GPT-4o, May 13th (temp=0)	83.6%	$0.035	14.1s	66%
59	DeepSeek V3 (2024-12-26)	82.6%	$0.0021	54.6s	66%
60	Claude Sonnet 4	83.5%	$0.032	43.7s	70%
61	GPT-4o Mini (temp=1)	80.9%	$0.0012	34.8s	65%
62	DeepSeek-V2 Chat	82.2%	$0.0021	53.3s	64%
63	Claude Opus 4.5	86.0%	$0.070	53.4s	73%
64	Hermes 3 405B	82.0%	$0.0032	53.2s	63%
65	Arcee AI: Trinity Large (Preview)	80.8%	$0.0000	43.6s	63%
66	Claude 3.5 Sonnet	85.1%	$0.048	35.5s	66%
67	GPT-4o, May 13th (temp=1)	81.2%	$0.033	14.4s	64%
68	Hermes 3 70B	82.2%	$0.0010	1.2m	63%
69	Gemma 3 12B	79.0%	$0.0004	41.3s	62%
70	GPT-4.1 Mini	78.4%	$0.0027	19.0s	60%
71	Z.AI GLM 4.5	78.3%	$0.0051	42.1s	62%
72	Claude Sonnet 4.6	80.3%	$0.031	39.3s	61%
73	Gemma 3 4B	74.1%	$0.0002	20.0s	57%
74	Gemini 3.1 Pro (Preview)	88.5%	$0.107	1.8m	70%
75	Claude 3 Haiku	74.3%	$0.0025	14.9s	54%
76	Claude 3.7 Sonnet	76.7%	$0.042	46.7s	61%
77	Claude 3.5 Haiku	76.9%	$0.0035	10.8s	44%
78	GPT-4.1 Nano	67.5%	$0.0007	13.3s	50%
79	Claude Opus 4	85.6%	$0.209	1.4m	73%
80	Mistral Small 3.2 24B	79.3%	$0.0069	5.7m	49%
86.62%

Individual Scenarios

Detailed Writing Rules

▼

Fantasy: entering an ancient ruin

Model	# 1	# 2	# 3	# 4	# 5	Avg ▼
Grok 4.1 Fast	100	100	100	100	93	98.5%
ByteDance Seed 1.6 Flash	100	100	100	97	94	98.1%
ByteDance Seed 1.6	100	100	96	96	95	97.5%
GPT-5.2	98	98	98	98	96	97.5%
o4 Mini High	100	97	96	96	96	97.1%
Grok 4	100	100	96	96	93	96.8%
o4 Mini	100	100	100	97	84	96.1%
GPT-5 Mini	98	96	96	95	94	95.8%
Claude Opus 4.6	100	97	94	94	94	95.7%
Qwen 3.5 397B A17B	100	100	93	93	92	95.5%
GPT-5	100	97	96	93	89	95.2%
Arcee AI: Trinity Mini	100	100	93	91	89	94.5%
Gemini 3 Pro (Preview)	100	97	93	92	90	94.5%
Mistral Large	97	97	96	93	89	94.5%
Grok 4 Fast	97	96	93	93	93	94.5%
Mistral Large 3	100	95	95	92	91	94.4%
GPT-5.1	98	94	94	94	92	94.4%
DeepSeek V3 (2024-12-26)	100	100	100	89	82	94.2%
Mistral Large 2	100	95	95	91	86	93.5%
Ministral 3 8B	100	95	95	92	85	93.2%
Qwen 3.5 Plus (2026-02-15)	100	93	93	91	88	92.9%
GPT-4.1	100	96	92	89	84	92.4%
Claude Sonnet 4.5	100	100	93	86	83	92.2%
Gemini 3.1 Pro (Preview)	100	96	90	87	85	91.7%
GPT-4o, May 13th (temp=0)	100	98	95	92	74	91.7%
DeepSeek V3 (2025-03-24)	100	100	89	87	81	91.3%
Gemini 2.5 Pro	100	96	92	87	81	91.1%
DeepSeek-V2 Chat	100	100	92	89	73	90.7%
Cohere Command R+ (Aug. 2024)	100	100	94	91	68	90.6%
Mistral Medium 3.1	93	92	90	90	88	90.5%
GPT-5 Nano	93	92	92	89	87	90.3%
Gemini 3 Flash (Preview)	97	94	89	88	83	90.1%
MoonshotAI: Kimi K2.5	100	92	88	86	85	90.1%
Z.AI GLM 5	100	93	92	84	80	89.9%
DeepSeek V3.2	93	93	91	91	79	89.4%
GPT-4o, Aug. 6th (temp=1)	95	94	88	86	81	88.9%
Stealth: Aurora Alpha	91	90	88	88	87	88.9%
Writer: Palmyra X5	95	90	88	87	84	88.8%
Mistral Small Creative	100	95	92	83	74	88.7%
Claude Opus 4	92	90	90	86	86	88.7%
DeepSeek V3.1	93	92	90	87	80	88.5%
Llama 3.1 8B	95	91	91	85	80	88.3%
Ministral 8B	94	92	91	90	72	87.7%
Ministral 3 3B	100	100	88	85	65	87.6%
Z.AI GLM 4.7 Flash	93	88	87	85	83	87.4%
Claude Opus 4.5	94	92	86	84	73	86.0%
Claude 3 Haiku	95	93	85	83	71	85.6%
GPT-4o, Aug. 6th (temp=0)	89	86	85	85	83	85.5%
Z.AI GLM 4.7	96	91	83	79	73	84.5%
Claude 3.5 Sonnet	100	100	86	69	67	84.5%
WizardLM 2 8x22b	93	84	82	82	80	84.3%
Qwen 2.5 72B	96	89	85	76	76	84.2%
Rocinante 12B	100	89	84	84	64	84.0%
Ministral 3 14B	100	92	78	75	73	83.7%
Claude Sonnet 4.6	92	91	90	76	68	83.5%
Ministral 3B	100	100	92	64	61	83.4%
Arcee AI: Trinity Large (Preview)	97	89	83	74	72	83.0%
Minimax M2.5	92	91	84	78	67	82.4%
Hermes 3 70B	93	84	81	78	74	81.9%
Gemma 3 27B	96	91	77	75	68	81.4%
Claude 3.5 Haiku	100	100	85	72	46	80.7%
GPT-4.1 Nano	90	87	81	77	68	80.7%
Claude Haiku 4.5	93	80	79	75	72	79.8%
GPT-4.1 Mini	91	86	74	73	73	79.6%
Claude Sonnet 4	95	83	80	76	61	79.3%
Gemini 2.5 Flash	83	83	82	75	68	78.3%
Z.AI GLM 4.6	90	83	76	74	69	78.2%
Gemma 3 12B	91	78	75	72	70	77.2%
Gemini 2.5 Flash Lite	81	79	76	75	73	76.8%
Llama 3.1 70B	90	80	78	70	63	76.3%
Z.AI GLM 4.5	89	83	75	70	61	75.6%
Hermes 3 405B	100	83	76	70	49	75.6%
GPT-4o Mini (temp=0)	83	83	81	68	63	75.3%
Claude 3.7 Sonnet	83	76	75	71	70	75.0%
GPT-4o Mini (temp=1)	86	81	75	73	60	75.0%
Mistral NeMO	97	82	74	62	55	74.2%
GPT-4o, May 13th (temp=1)	79	76	74	72	69	74.1%
Llama 3.1 Nemotron 70B	85	76	74	72	58	72.9%
Gemma 3 4B	87	73	73	67	62	72.4%
Mistral Small 3.2 24B	81	75	66	66	61	69.7%

▼

Horror: alone in an eerie place at night

Model	# 1	# 2	# 3	# 4	# 5	Avg ▼
o4 Mini High	100	100	100	100	100	100.0%
Qwen 3.5 397B A17B	100	100	98	96	95	97.8%
Grok 4.1 Fast	100	100	96	96	95	97.3%
ByteDance Seed 1.6 Flash	100	100	97	96	93	97.2%
DeepSeek V3 (2025-03-24)	100	100	100	100	85	97.0%
GPT-5	100	100	98	94	91	96.7%
Claude Opus 4.6	100	100	95	94	94	96.7%
ByteDance Seed 1.6	100	100	100	96	86	96.5%
Grok 4	100	96	96	95	92	96.1%
GPT-5.2	100	98	97	93	91	95.8%
Gemini 3.1 Pro (Preview)	96	96	96	96	90	94.8%
o4 Mini	100	96	96	96	85	94.7%
Mistral Small 3.2 24B	100	100	100	92	80	94.4%
MoonshotAI: Kimi K2.5	100	95	94	90	90	93.9%
Qwen 3.5 Plus (2026-02-15)	97	95	94	92	91	93.9%
GPT-5 Mini	98	97	95	93	87	93.9%
GPT-5.1	98	98	96	94	83	93.8%
Mistral Medium 3.1	100	97	95	95	79	93.3%
Writer: Palmyra X5	100	95	95	91	85	93.3%
Ministral 3 8B	100	95	94	90	87	93.2%
Ministral 3B	100	100	100	87	79	93.1%
Z.AI GLM 4.7 Flash	100	96	95	89	85	92.9%
Z.AI GLM 4.7	96	94	93	92	90	92.8%
Ministral 8B	100	95	93	90	86	92.7%
Mistral Large 2	100	95	94	87	86	92.6%
Mistral Large 3	100	100	91	87	85	92.5%
Mistral Small Creative	96	96	94	90	85	92.5%
GPT-4.1	96	95	91	91	87	92.2%
Stealth: Aurora Alpha	93	92	91	91	91	91.7%
Arcee AI: Trinity Large (Preview)	100	97	91	87	83	91.5%
Claude Sonnet 4.5	100	95	92	91	79	91.4%
Z.AI GLM 5	96	93	92	90	85	91.1%
GPT-5 Nano	95	93	90	90	86	91.0%
Ministral 3 14B	100	94	93	85	83	91.0%
Arcee AI: Trinity Mini	100	92	92	91	80	90.9%
WizardLM 2 8x22b	96	96	93	88	82	90.8%
GPT-4o, May 13th (temp=0)	97	96	94	85	80	90.4%
Mistral Large	96	94	91	90	80	90.2%
Claude Opus 4.5	92	92	91	91	82	89.7%
Claude 3.5 Sonnet	100	94	88	87	79	89.5%
Claude Sonnet 4	100	90	89	88	79	89.2%
Grok 4 Fast	100	96	92	81	76	88.9%
Cohere Command R+ (Aug. 2024)	94	92	91	85	83	88.9%
Claude Opus 4	96	93	91	86	77	88.3%
Minimax M2.5	100	93	91	83	74	88.3%
Gemini 3 Pro (Preview)	97	89	88	86	80	88.2%
Gemini 3 Flash (Preview)	94	91	90	89	77	88.2%
GPT-4o, Aug. 6th (temp=0)	100	90	85	85	81	88.1%
DeepSeek V3.1	100	96	93	84	64	87.5%
Qwen 2.5 72B	100	89	89	79	77	86.9%
Llama 3.1 70B	99	94	89	84	68	86.7%
DeepSeek V3.2	89	89	86	85	83	86.2%
GPT-4o Mini (temp=0)	100	87	83	82	74	85.1%
Rocinante 12B	100	92	88	79	65	84.7%
Claude Haiku 4.5	87	87	86	83	78	83.9%
Llama 3.1 8B	92	90	86	84	66	83.5%
Hermes 3 405B	100	91	88	80	59	83.5%
Mistral NeMO	93	88	85	84	67	83.4%
Z.AI GLM 4.6	92	88	86	77	70	82.6%
GPT-4.1 Mini	91	83	83	80	75	82.6%
Gemini 2.5 Flash	94	91	86	86	55	82.5%
DeepSeek V3 (2024-12-26)	100	100	89	67	55	82.1%
Gemini 2.5 Flash Lite	92	85	84	78	71	82.1%
Gemma 3 27B	95	82	80	77	74	81.7%
Gemma 3 12B	92	91	85	74	66	81.5%
Claude Sonnet 4.6	95	86	76	75	75	81.4%
GPT-4o, May 13th (temp=1)	86	83	83	82	73	81.2%
Gemma 3 4B	93	81	78	77	76	81.0%
Gemini 2.5 Pro	86	84	82	80	73	80.9%
GPT-4o, Aug. 6th (temp=1)	96	90	79	78	60	80.8%
Ministral 3 3B	100	91	75	73	65	80.8%
Hermes 3 70B	100	97	83	73	49	80.4%
DeepSeek-V2 Chat	91	87	79	73	72	80.4%
GPT-4o Mini (temp=1)	79	78	76	76	76	77.3%
Z.AI GLM 4.5	87	87	69	67	65	75.1%
Claude 3.7 Sonnet	86	72	71	70	67	73.1%
GPT-4.1 Nano	83	75	68	67	65	71.8%
Claude 3.5 Haiku	100	82	75	52	38	69.4%
Claude 3 Haiku	90	84	76	59	34	68.9%
Llama 3.1 Nemotron 70B	93	71	68	56	54	68.4%

▼

Literary fiction: old friends reunite

Model	# 1	# 2	# 3	# 4	# 5	Avg ▼
Grok 4.1 Fast	100	100	100	100	100	100.0%
Claude Opus 4.6	100	100	100	97	92	97.9%
GPT-5	98	98	98	97	96	97.4%
ByteDance Seed 1.6 Flash	100	100	97	95	91	96.6%
Gemini 3.1 Pro (Preview)	100	100	100	92	88	96.1%
GPT-5.2	98	96	96	95	94	95.7%
ByteDance Seed 1.6	100	100	95	94	88	95.6%
GPT-5.1	100	98	95	92	92	95.3%
Mistral Medium 3.1	100	100	97	91	88	95.1%
Qwen 3.5 397B A17B	97	96	95	92	90	94.2%
Grok 4 Fast	97	97	97	88	86	92.8%
Stealth: Aurora Alpha	97	97	97	91	81	92.8%
Mistral Small Creative	100	96	96	93	77	92.5%
GPT-4.1 Mini	100	94	92	88	86	92.1%
DeepSeek V3 (2025-03-24)	95	92	91	91	90	91.8%
Llama 3.1 70B	100	100	93	84	81	91.5%
MoonshotAI: Kimi K2.5	96	96	95	86	85	91.4%
Arcee AI: Trinity Mini	100	96	90	86	85	91.4%
GPT-5 Nano	98	92	92	91	83	91.0%
GPT-5 Mini	98	94	92	86	84	90.8%
Mistral Large 2	100	97	91	87	79	90.8%
Grok 4	94	93	89	89	88	90.6%
o4 Mini	96	93	92	87	85	90.5%
Ministral 8B	100	100	100	79	74	90.5%
Claude 3.5 Sonnet	94	93	92	88	84	90.3%
Writer: Palmyra X5	96	93	93	89	80	90.2%
GPT-4.1	100	93	91	87	79	90.1%
Z.AI GLM 5	97	95	88	88	82	90.1%
Ministral 3 3B	100	100	88	86	76	90.0%
o4 Mini High	100	93	89	86	82	90.0%
Gemini 3 Flash (Preview)	94	94	88	87	87	89.9%
Mistral Large	96	95	90	88	81	89.8%
Llama 3.1 8B	94	90	88	86	86	88.8%
Ministral 3B	93	89	88	88	86	88.7%
DeepSeek V3.1	100	93	89	84	77	88.7%
Claude Sonnet 4.6	96	89	89	86	81	88.2%
Cohere Command R+ (Aug. 2024)	95	94	91	86	75	88.2%
Qwen 2.5 72B	96	89	87	86	81	88.1%
Claude Opus 4	96	92	84	84	77	86.6%
Claude Sonnet 4.5	90	89	87	86	80	86.4%
Z.AI GLM 4.7 Flash	94	86	85	85	82	86.4%
Qwen 3.5 Plus (2026-02-15)	93	91	87	85	76	86.3%
GPT-4o Mini (temp=1)	93	87	87	82	82	86.2%
Ministral 3 14B	94	90	87	82	79	86.2%
Rocinante 12B	100	95	82	80	73	85.9%
Claude Sonnet 4	94	87	87	83	79	85.9%
Hermes 3 405B	96	93	90	84	65	85.7%
Gemini 3 Pro (Preview)	90	88	86	82	81	85.5%
DeepSeek V3.2	90	87	85	84	79	85.2%
Z.AI GLM 4.6	90	88	85	81	81	85.1%
Claude Opus 4.5	94	89	89	85	68	85.0%
Claude 3.5 Haiku	100	100	85	72	68	85.0%
GPT-4o Mini (temp=0)	91	89	88	86	72	85.0%
DeepSeek-V2 Chat	100	95	83	77	67	84.5%
Gemini 2.5 Pro	96	91	86	78	72	84.4%
WizardLM 2 8x22b	93	89	84	82	73	84.4%
Claude 3 Haiku	100	94	81	76	70	84.3%
Ministral 3 8B	95	90	90	79	66	84.0%
Llama 3.1 Nemotron 70B	95	89	83	75	75	83.3%
Z.AI GLM 4.7	90	90	89	74	72	83.0%
Mistral Large 3	86	85	85	84	75	82.8%
GPT-4o, May 13th (temp=1)	95	80	80	79	78	82.5%
GPT-4o, Aug. 6th (temp=0)	95	88	80	75	73	82.1%
Claude 3.7 Sonnet	88	87	85	84	63	81.5%
DeepSeek V3 (2024-12-26)	100	90	84	76	57	81.4%
Minimax M2.5	96	87	83	76	64	81.1%
Mistral NeMO	94	84	82	73	70	80.8%
Hermes 3 70B	91	89	76	74	67	79.4%
Gemini 2.5 Flash Lite	89	84	82	77	60	78.8%
GPT-4o, May 13th (temp=0)	94	83	83	69	63	78.3%
Claude Haiku 4.5	86	80	77	74	72	77.8%
GPT-4o, Aug. 6th (temp=1)	85	85	84	66	64	76.9%
Gemma 3 27B	84	81	70	69	69	74.3%
Mistral Small 3.2 24B	100	100	80	75	14	73.7%
Gemini 2.5 Flash	85	82	79	68	44	71.7%
Arcee AI: Trinity Large (Preview)	92	88	74	53	51	71.4%
Gemma 3 12B	79	74	74	65	64	71.1%
Gemma 3 4B	74	71	67	62	59	66.4%
Z.AI GLM 4.5	79	76	64	63	51	66.3%
GPT-4.1 Nano	73	68	66	65	44	63.2%

▼

Mystery: examining a crime scene

Model	# 1	# 2	# 3	# 4	# 5	Avg ▼
Grok 4.1 Fast	100	100	100	100	95	99.0%
GPT-5	100	100	100	98	95	98.6%
Qwen 3.5 397B A17B	100	100	100	95	95	98.0%
Mistral Small 3.2 24B	100	99	98	97	93	97.5%
Claude Opus 4.6	100	97	97	96	96	97.3%
ByteDance Seed 1.6 Flash	100	100	96	95	91	96.5%
Qwen 3.5 Plus (2026-02-15)	100	97	97	94	93	96.1%
o4 Mini High	97	97	96	95	94	95.7%
Grok 4 Fast	100	97	96	96	89	95.7%
Gemini 3.1 Pro (Preview)	100	97	95	93	93	95.6%
GPT-5.2	100	96	94	94	93	95.5%
DeepSeek-V2 Chat	100	100	96	91	89	95.3%
GPT-4.1	96	96	96	96	93	95.3%
Gemini 3 Flash (Preview)	97	96	95	94	94	95.2%
GPT-5 Mini	98	96	94	94	93	95.1%
ByteDance Seed 1.6	100	100	95	88	88	94.3%
Stealth: Aurora Alpha	100	96	95	90	89	94.2%
GPT-5.1	98	96	95	93	88	93.9%
MoonshotAI: Kimi K2.5	100	95	95	89	89	93.7%
Mistral Medium 3.1	100	95	94	91	87	93.6%
GPT-4o, Aug. 6th (temp=1)	100	95	94	90	89	93.6%
o4 Mini	100	97	93	90	87	93.5%
Writer: Palmyra X5	96	96	95	91	88	93.2%
Qwen 2.5 72B	100	100	94	89	82	93.2%
Grok 4	100	97	95	90	83	93.0%
GPT-4o, Aug. 6th (temp=0)	100	100	100	95	70	92.9%
Ministral 8B	95	95	92	92	91	92.8%
Ministral 3 14B	100	100	91	87	84	92.4%
Z.AI GLM 5	97	93	92	90	88	92.1%
Rocinante 12B	94	94	92	90	88	91.8%
Claude Sonnet 4.5	100	96	91	87	83	91.6%
Z.AI GLM 4.7 Flash	100	92	91	89	86	91.5%
GPT-5 Nano	95	93	91	90	87	91.4%
Ministral 3 8B	100	95	92	86	84	91.3%
Ministral 3 3B	100	90	89	87	86	90.6%
DeepSeek V3.1	100	96	86	85	85	90.3%
Gemini 3 Pro (Preview)	100	92	91	90	78	90.1%
Llama 3.1 70B	100	100	92	83	74	89.8%
GPT-4o, May 13th (temp=0)	100	100	95	78	75	89.7%
Claude Sonnet 4.6	100	95	91	81	81	89.7%
Gemini 2.5 Pro	96	95	90	87	80	89.6%
Claude 3.5 Sonnet	93	92	92	87	82	89.4%
Z.AI GLM 4.7	100	94	91	82	78	89.2%
Arcee AI: Trinity Mini	100	92	92	82	79	89.1%
DeepSeek V3 (2025-03-24)	100	100	91	84	69	89.0%
Mistral NeMO	92	90	88	85	85	87.9%
Ministral 3B	91	91	90	88	79	87.8%
Mistral Small Creative	95	94	91	86	73	87.7%
Hermes 3 70B	96	94	87	83	78	87.6%
Mistral Large	95	93	84	83	83	87.6%
Claude Opus 4	92	91	88	87	80	87.4%
WizardLM 2 8x22b	96	93	88	81	77	86.9%
GPT-4o, May 13th (temp=1)	91	91	89	87	76	86.7%
GPT-4o Mini (temp=0)	100	91	84	79	79	86.5%
Claude 3 Haiku	95	95	85	81	73	85.8%
Llama 3.1 Nemotron 70B	93	92	85	84	71	85.2%
Claude Haiku 4.5	100	90	85	79	70	84.8%
DeepSeek V3.2	91	86	85	83	77	84.5%
Mistral Large 3	91	89	88	84	70	84.4%
Claude Opus 4.5	96	96	83	81	66	84.2%
Cohere Command R+ (Aug. 2024)	95	89	86	78	73	84.1%
Gemini 2.5 Flash	92	86	85	80	76	83.9%
Llama 3.1 8B	94	93	90	75	67	83.6%
Gemini 2.5 Flash Lite	100	92	78	74	71	82.9%
Z.AI GLM 4.6	95	89	83	78	65	82.0%
Mistral Large 2	91	86	84	82	64	81.4%
Claude Sonnet 4	88	83	82	77	75	81.1%
Arcee AI: Trinity Large (Preview)	100	90	75	75	66	81.1%
Minimax M2.5	88	87	82	78	65	80.1%
Gemma 3 4B	91	86	76	74	73	79.8%
DeepSeek V3 (2024-12-26)	84	83	81	79	70	79.6%
Gemma 3 27B	87	84	80	77	67	78.9%
Gemma 3 12B	88	80	79	78	67	78.2%
GPT-4o Mini (temp=1)	100	82	76	69	64	78.1%
Claude 3.7 Sonnet	94	76	74	72	71	77.4%
GPT-4.1 Mini	90	77	71	71	69	75.8%
Hermes 3 405B	87	84	77	69	60	75.2%
Z.AI GLM 4.5	82	77	76	71	66	74.3%
Claude 3.5 Haiku	82	79	57	56	47	64.2%
GPT-4.1 Nano	75	70	67	55	52	64.0%

▼

Romance: separated couple reunites

Model	# 1	# 2	# 3	# 4	# 5	Avg ▼
Grok 4.1 Fast	100	100	100	100	100	100.0%
o4 Mini	100	100	100	100	97	99.4%
ByteDance Seed 1.6 Flash	100	100	100	97	96	98.4%
GPT-5.2	100	98	96	96	94	96.7%
Grok 4 Fast	100	97	96	96	94	96.6%
ByteDance Seed 1.6	100	100	95	92	91	95.6%
GPT-5	100	100	96	94	87	95.5%
GPT-4.1	100	100	96	95	87	95.5%
Claude Opus 4.6	97	96	95	94	94	95.4%
Qwen 3.5 Plus (2026-02-15)	100	97	95	92	92	95.3%
o4 Mini High	100	97	96	92	85	94.0%
Grok 4	97	94	93	92	90	93.2%
GPT-5.1	97	95	94	90	88	92.5%
Gemini 3 Flash (Preview)	97	97	95	87	85	92.2%
Arcee AI: Trinity Mini	95	94	94	89	89	92.1%
Qwen 2.5 72B	100	100	87	86	86	91.8%
Qwen 3.5 397B A17B	97	95	92	88	87	91.8%
Mistral Large	100	91	90	90	89	91.7%
Stealth: Aurora Alpha	100	97	89	88	83	91.1%
Ministral 3B	100	100	90	84	79	90.8%
Z.AI GLM 4.7 Flash	96	95	94	86	81	90.5%
MoonshotAI: Kimi K2.5	100	94	88	86	83	90.3%
GPT-5 Nano	92	92	91	88	86	89.8%
DeepSeek V3 (2025-03-24)	100	100	94	82	73	89.8%
Ministral 3 14B	100	93	88	87	79	89.5%
GPT-5 Mini	93	93	91	87	81	89.2%
DeepSeek V3.2	93	93	88	87	85	89.0%
Mistral Large 3	96	94	94	81	79	89.0%
Z.AI GLM 5	96	94	88	83	79	88.1%
Llama 3.1 8B	96	95	93	88	68	88.1%
GPT-4o, Aug. 6th (temp=0)	95	94	88	86	76	88.1%
Claude Opus 4	90	90	90	87	83	87.9%
Gemini 2.5 Pro	92	88	87	87	85	87.9%
Z.AI GLM 4.7	92	92	90	84	79	87.6%
Ministral 8B	100	96	95	74	73	87.6%
Hermes 3 405B	100	100	89	81	68	87.5%
Gemini 3.1 Pro (Preview)	100	93	90	82	69	86.9%
Llama 3.1 Nemotron 70B	94	89	88	82	81	86.9%
Claude Sonnet 4.5	96	93	86	84	74	86.6%
GPT-4o, Aug. 6th (temp=1)	91	90	89	86	77	86.5%
Claude 3.5 Sonnet	93	88	86	85	79	86.0%
Mistral Medium 3.1	96	88	85	83	78	85.9%
Rocinante 12B	91	89	86	81	80	85.6%
DeepSeek V3 (2024-12-26)	100	95	90	80	63	85.5%
Mistral Small Creative	96	91	89	76	75	85.3%
Writer: Palmyra X5	96	89	87	79	75	85.2%
Hermes 3 70B	94	85	84	83	80	85.1%
GPT-4o, May 13th (temp=1)	100	92	90	76	64	84.4%
Minimax M2.5	93	86	86	79	78	84.4%
Mistral Large 2	96	90	84	77	72	84.0%
Cohere Command R+ (Aug. 2024)	100	88	78	78	76	84.0%
GPT-4o Mini (temp=0)	88	88	87	78	77	83.8%
Gemini 3 Pro (Preview)	94	88	86	76	75	83.7%
Ministral 3 3B	90	89	89	76	74	83.7%
DeepSeek-V2 Chat	100	90	79	75	73	83.5%
DeepSeek V3.1	88	87	86	78	77	83.2%
GPT-4.1 Mini	100	87	86	85	57	83.0%
Ministral 3 8B	96	92	84	73	70	82.9%
Claude Sonnet 4	89	88	87	76	72	82.4%
Claude Haiku 4.5	93	82	80	79	78	82.4%
Llama 3.1 70B	100	82	80	75	74	82.2%
Mistral NeMO	94	85	82	75	74	82.0%
WizardLM 2 8x22b	92	85	80	77	69	80.7%
Claude 3.7 Sonnet	90	86	80	76	69	80.1%
Claude Sonnet 4.6	87	85	80	77	72	80.0%
GPT-4o, May 13th (temp=0)	89	81	80	75	73	79.8%
Claude Opus 4.5	86	85	77	74	72	78.8%
Z.AI GLM 4.6	90	78	75	74	70	77.4%
Gemini 2.5 Flash	86	84	81	77	58	77.2%
GPT-4o Mini (temp=1)	85	82	76	72	71	77.2%
Gemini 2.5 Flash Lite	85	82	82	73	63	77.0%
Z.AI GLM 4.5	89	86	77	67	65	77.0%
Mistral Small 3.2 24B	99	82	78	77	49	77.0%
Gemma 3 27B	88	82	75	75	65	76.9%
Claude 3 Haiku	82	78	73	71	66	73.9%
Gemma 3 12B	81	77	74	67	65	72.9%
GPT-4.1 Nano	79	72	69	62	54	67.4%
Arcee AI: Trinity Large (Preview)	88	82	63	58	45	67.1%
Claude 3.5 Haiku	78	75	69	54	0	55.2%
Gemma 3 4B	70	66	46	42	40	52.6%

▼

Thriller: chase through city streets

Model	# 1	# 2	# 3	# 4	# 5	Avg ▼
Grok 4.1 Fast	100	100	100	100	100	100.0%
Ministral 3 3B	100	100	100	100	100	100.0%
o4 Mini	100	100	100	100	97	99.4%
o4 Mini High	100	100	100	100	97	99.4%
Arcee AI: Trinity Mini	100	100	100	100	95	98.9%
GPT-5	100	100	99	98	97	98.9%
Claude Opus 4.6	100	100	100	97	97	98.7%
GPT-5.1	100	98	98	98	98	98.6%
DeepSeek V3 (2025-03-24)	100	100	100	100	93	98.5%
Grok 4 Fast	100	100	97	97	97	98.2%
GPT-5.2	100	100	98	98	95	98.1%
ByteDance Seed 1.6	100	100	100	100	90	98.1%
GPT-4.1	100	100	100	96	93	97.8%
GPT-5 Mini	98	98	98	96	94	96.8%
ByteDance Seed 1.6 Flash	100	100	96	96	92	96.7%
Ministral 3B	100	100	100	93	90	96.7%
MoonshotAI: Kimi K2.5	100	100	96	95	92	96.6%
Ministral 8B	100	100	100	92	90	96.4%
Z.AI GLM 5	100	100	100	93	89	96.3%
Mistral Large 2	100	100	96	95	89	96.0%
Qwen 3.5 Plus (2026-02-15)	100	97	96	93	92	95.7%
Claude Sonnet 4	100	96	95	95	92	95.7%
Claude Opus 4.5	100	100	96	96	86	95.5%
GPT-5 Nano	97	97	94	94	94	95.2%
Hermes 3 70B	100	100	100	94	81	95.0%
Writer: Palmyra X5	100	96	96	94	89	95.0%
Gemini 3 Flash (Preview)	100	97	97	92	90	95.0%
Claude Sonnet 4.5	100	96	96	95	87	95.0%
Grok 4	97	97	96	94	90	94.8%
Stealth: Aurora Alpha	97	96	96	96	87	94.5%
WizardLM 2 8x22b	100	96	96	91	90	94.4%
Ministral 3 14B	100	96	95	93	88	94.3%
Mistral Medium 3.1	100	97	95	90	90	94.2%
Qwen 3.5 397B A17B	100	93	93	93	92	94.2%
Z.AI GLM 4.7 Flash	100	100	92	89	88	93.8%
Gemini 3 Pro (Preview)	97	96	96	94	86	93.8%
Claude Sonnet 4.6	100	100	100	91	77	93.7%
Z.AI GLM 4.6	100	96	96	95	79	93.2%
DeepSeek-V2 Chat	95	95	94	93	88	92.9%
Gemini 2.5 Pro	100	95	94	91	84	92.8%
Rocinante 12B	100	100	94	90	80	92.8%
Gemma 3 27B	100	95	94	92	81	92.5%
Gemini 3.1 Pro (Preview)	100	97	96	92	77	92.4%
Llama 3.1 Nemotron 70B	100	100	94	84	83	92.3%
DeepSeek V3.2	96	93	91	91	88	91.9%
Minimax M2.5	96	92	91	90	90	91.9%
Claude 3.5 Sonnet	100	100	94	86	78	91.5%
Ministral 3 8B	97	96	92	86	86	91.4%
Llama 3.1 70B	100	92	92	88	84	91.2%
GPT-4o Mini (temp=1)	100	91	88	87	87	90.9%
Llama 3.1 8B	100	95	92	90	77	90.8%
Mistral Small Creative	95	95	90	88	82	90.2%
Claude Opus 4	96	94	90	87	82	89.9%
Cohere Command R+ (Aug. 2024)	95	94	94	89	76	89.7%
Z.AI GLM 4.7	97	89	88	87	86	89.3%
GPT-4o, Aug. 6th (temp=0)	95	90	87	86	86	88.7%
Claude Haiku 4.5	93	92	87	86	85	88.7%
Claude 3.5 Haiku	100	100	86	86	70	88.4%
Mistral Large 3	91	90	88	87	84	88.0%
Mistral Large	100	94	84	81	81	88.0%
GPT-4o Mini (temp=0)	96	96	86	81	78	87.5%
Arcee AI: Trinity Large (Preview)	94	92	86	82	80	86.8%
GPT-4.1 Mini	100	90	89	85	70	86.7%
DeepSeek V3 (2024-12-26)	92	88	87	87	79	86.5%
DeepSeek V3.1	93	89	86	83	81	86.5%
Gemini 2.5 Flash	91	89	89	85	79	86.4%
Mistral Small 3.2 24B	100	97	93	80	62	86.2%
Gemini 2.5 Flash Lite	95	91	85	83	77	86.1%
GPT-4o, May 13th (temp=1)	92	91	88	81	78	86.0%
Qwen 2.5 72B	94	91	88	82	76	86.0%
Mistral NeMO	100	93	86	82	62	84.4%
Gemma 3 4B	92	92	89	78	69	83.9%
Z.AI GLM 4.5	96	89	88	78	61	82.6%
GPT-4o, Aug. 6th (temp=1)	96	91	84	72	70	82.6%
Gemma 3 12B	96	89	79	77	71	82.2%
Claude 3 Haiku	90	88	87	73	69	81.5%
GPT-4o, May 13th (temp=0)	100	88	84	77	59	81.3%
Hermes 3 405B	87	85	82	79	69	80.2%
GPT-4.1 Nano	90	87	76	70	69	78.6%
Claude 3.7 Sonnet	87	82	73	69	59	74.2%

genre

▼

Fantasy: entering an ancient ruin

Model	# 1	# 2	# 3	# 4	# 5	Avg ▼
ByteDance Seed 1.6	100	100	100	100	100	100.0%
o4 Mini High	100	100	97	96	93	97.2%
GPT-5 Mini	100	100	96	95	94	97.0%
ByteDance Seed 1.6 Flash	100	98	95	94	91	95.4%
o4 Mini	100	100	93	93	89	94.9%
Grok 4.1 Fast	100	97	97	94	85	94.7%
Grok 4 Fast	97	95	94	94	87	93.5%
Gemini 3 Flash (Preview)	100	97	93	91	87	93.4%
Gemini 2.5 Pro	100	94	93	89	89	93.1%
MoonshotAI: Kimi K2.5	97	97	95	92	78	91.8%
Mistral Large	100	100	91	86	82	91.6%
GPT-5	99	94	92	90	82	91.3%
Stealth: Aurora Alpha	96	95	89	89	87	91.1%
GPT-5 Nano	95	93	91	90	86	91.0%
Mistral Large 3	96	96	91	86	86	90.8%
Mistral Small 3.2 24B	100	100	99	79	74	90.4%
Z.AI GLM 5	94	94	89	88	86	90.2%
Mistral Large 2	100	96	91	88	75	89.9%
Gemma 3 27B	95	91	90	87	85	89.7%
Qwen 3.5 397B A17B	96	92	89	87	83	89.5%
Claude Opus 4.6	100	95	93	81	77	89.0%
Gemini 3 Pro (Preview)	94	91	91	86	83	89.0%
Grok 4	92	91	89	88	80	88.1%
GPT-4.1	93	91	89	85	83	88.0%
Ministral 3 3B	94	91	88	84	81	87.7%
Claude Sonnet 4.5	100	92	92	85	68	87.3%
Qwen 2.5 72B	95	93	85	82	76	86.2%
Z.AI GLM 4.7 Flash	89	88	87	86	81	86.1%
WizardLM 2 8x22b	100	86	86	85	71	85.6%
Llama 3.1 Nemotron 70B	92	88	88	85	72	84.8%
Ministral 3 14B	96	95	89	82	61	84.8%
Ministral 8B	92	87	87	84	73	84.7%
Ministral 3B	100	93	92	86	52	84.5%
Qwen 3.5 Plus (2026-02-15)	94	85	85	81	76	84.3%
GPT-5.2	89	88	82	82	80	84.1%
Minimax M2.5	89	86	86	83	75	83.8%
DeepSeek V3 (2025-03-24)	92	90	88	78	71	83.8%
Claude Haiku 4.5	93	91	84	78	73	83.7%
Claude Opus 4.5	94	89	81	79	75	83.6%
Mistral Medium 3.1	94	88	84	78	74	83.5%
Ministral 3 8B	92	87	83	80	75	83.3%
Rocinante 12B	100	89	88	71	69	83.3%
GPT-5.1	88	86	83	80	78	83.0%
DeepSeek V3.2	93	84	81	80	75	82.9%
GPT-4o, Aug. 6th (temp=0)	87	85	82	81	78	82.7%
GPT-4o, Aug. 6th (temp=1)	92	91	90	77	62	82.2%
Gemini 2.5 Flash Lite	90	87	85	82	68	82.1%
Llama 3.1 8B	92	89	88	74	66	81.8%
Mistral Small Creative	95	84	79	78	73	81.8%
GPT-4o, May 13th (temp=1)	92	84	80	78	74	81.8%
Gemma 3 4B	90	85	85	77	71	81.7%
Arcee AI: Trinity Mini	95	84	83	73	73	81.6%
Cohere Command R+ (Aug. 2024)	89	87	80	80	71	81.3%
Gemma 3 12B	91	83	82	80	69	81.2%
Claude Sonnet 4.6	96	86	77	76	70	81.2%
Arcee AI: Trinity Large (Preview)	89	85	80	76	74	80.9%
Z.AI GLM 4.6	88	87	84	74	71	80.8%
Claude 3.5 Haiku	100	81	80	77	67	80.8%
GPT-4o, May 13th (temp=0)	91	87	82	80	61	80.2%
Hermes 3 405B	89	83	82	73	73	80.0%
Claude Opus 4	87	81	77	76	76	79.5%
Hermes 3 70B	95	84	76	73	70	79.5%
Z.AI GLM 4.7	84	84	82	76	70	79.0%
Writer: Palmyra X5	83	83	80	78	69	78.7%
Mistral NeMO	86	84	84	75	61	78.2%
DeepSeek V3.1	87	83	81	71	67	77.8%
Claude 3 Haiku	85	81	76	76	67	76.9%
GPT-4.1 Mini	92	73	73	72	72	76.5%
Claude 3.5 Sonnet	89	87	78	69	58	76.4%
DeepSeek-V2 Chat	88	84	81	70	58	76.3%
Z.AI GLM 4.5	86	84	77	77	57	76.2%
Claude Sonnet 4	86	86	72	68	67	75.9%
Gemini 3.1 Pro (Preview)	86	80	72	71	69	75.6%
DeepSeek V3 (2024-12-26)	78	77	73	72	72	74.7%
GPT-4o Mini (temp=1)	81	79	77	75	59	74.1%
Gemini 2.5 Flash	81	75	73	72	64	72.8%
Llama 3.1 70B	86	78	76	72	45	71.4%
Claude 3.7 Sonnet	81	72	68	67	65	70.6%
GPT-4o Mini (temp=0)	77	75	74	55	50	66.2%
GPT-4.1 Nano	65	60	60	48	41	55.0%

▼

Horror: alone in an eerie place at night

Model	# 1	# 2	# 3	# 4	# 5	Avg ▼
ByteDance Seed 1.6	100	100	100	95	90	97.1%
o4 Mini High	100	100	97	97	92	97.0%
Gemini 3 Flash (Preview)	100	97	97	93	90	95.3%
ByteDance Seed 1.6 Flash	97	94	94	93	93	94.3%
MoonshotAI: Kimi K2.5	100	96	95	89	89	93.7%
Qwen 3.5 397B A17B	100	93	92	92	91	93.5%
o4 Mini	100	94	93	93	87	93.4%
Gemini 3 Pro (Preview)	95	95	92	91	90	92.6%
Arcee AI: Trinity Large (Preview)	97	96	95	87	85	92.1%
Mistral NeMO	100	100	91	86	83	91.8%
GPT-5 Mini	97	93	92	91	85	91.6%
Stealth: Aurora Alpha	98	95	89	88	87	91.3%
GPT-5	95	95	91	91	83	91.2%
Mistral Medium 3.1	97	93	92	88	83	90.7%
Grok 4.1 Fast	97	92	90	89	86	90.5%
GPT-5 Nano	94	92	90	89	85	89.9%
GPT-4.1	100	89	89	86	85	89.9%
Z.AI GLM 4.7 Flash	92	92	92	86	85	89.4%
Minimax M2.5	93	93	90	89	81	89.2%
Qwen 2.5 72B	100	96	88	86	76	89.0%
Z.AI GLM 5	97	97	91	82	76	88.5%
Grok 4 Fast	94	91	88	85	84	88.5%
Z.AI GLM 4.7	94	90	87	86	85	88.4%
Ministral 8B	94	93	92	86	76	88.3%
Grok 4	94	90	88	86	82	88.2%
Llama 3.1 8B	93	92	88	87	78	87.9%
Mistral Small Creative	96	92	89	84	78	87.7%
Z.AI GLM 4.6	97	92	86	85	78	87.5%
Arcee AI: Trinity Mini	96	94	91	87	68	87.3%
Mistral Large 3	95	93	89	81	78	87.1%
Mistral Large	94	93	87	82	79	87.0%
GPT-4o, May 13th (temp=1)	93	92	89	84	77	87.0%
Rocinante 12B	91	91	87	86	77	86.7%
Qwen 3.5 Plus (2026-02-15)	91	89	88	82	82	86.6%
Gemini 3.1 Pro (Preview)	91	88	86	86	81	86.5%
Hermes 3 70B	100	93	85	82	73	86.4%
Mistral Small 3.2 24B	100	91	87	78	75	86.3%
Claude Sonnet 4.5	100	92	88	78	71	85.6%
DeepSeek V3.1	90	89	85	84	79	85.5%
Claude 3.7 Sonnet	97	94	84	78	74	85.4%
Claude Sonnet 4	93	91	86	78	78	85.1%
DeepSeek V3 (2025-03-24)	93	92	80	80	80	85.1%
Ministral 3 3B	95	90	81	80	79	84.8%
Ministral 3 8B	93	92	85	82	71	84.5%
Claude Opus 4.5	94	87	84	83	75	84.5%
Ministral 3B	88	86	85	83	80	84.3%
Claude Opus 4	94	86	82	82	77	84.1%
Mistral Large 2	95	94	82	76	73	84.1%
GPT-5.2	86	84	84	84	82	83.9%
GPT-4o Mini (temp=1)	93	88	84	80	75	83.8%
GPT-4o, Aug. 6th (temp=1)	92	89	87	86	65	83.8%
WizardLM 2 8x22b	90	88	83	81	76	83.7%
Ministral 3 14B	94	90	86	83	65	83.6%
Gemma 3 12B	96	90	87	77	66	83.1%
DeepSeek V3.2	88	88	83	80	76	83.0%
GPT-4o, May 13th (temp=0)	91	89	87	73	71	82.4%
Claude Haiku 4.5	90	83	81	81	77	82.3%
Z.AI GLM 4.5	88	87	85	82	69	82.2%
Llama 3.1 70B	93	93	84	76	64	82.1%
Claude Opus 4.6	86	84	84	82	75	82.1%
Gemini 2.5 Pro	93	90	80	75	72	81.8%
Writer: Palmyra X5	87	87	85	84	66	81.7%
Cohere Command R+ (Aug. 2024)	97	90	89	67	65	81.5%
Gemini 2.5 Flash Lite	89	87	79	78	68	80.5%
Claude 3 Haiku	91	85	83	72	69	79.9%
Gemini 2.5 Flash	83	81	80	79	77	79.8%
DeepSeek V3 (2024-12-26)	93	84	81	70	64	78.6%
Gemma 3 4B	86	82	78	73	70	77.6%
Claude 3.5 Haiku	100	79	78	71	60	77.5%
GPT-4o, Aug. 6th (temp=0)	87	83	76	74	65	76.9%
GPT-4o Mini (temp=0)	81	77	76	75	73	76.3%
Hermes 3 405B	87	87	84	76	48	76.3%
GPT-5.1	81	78	78	73	68	75.6%
Claude 3.5 Sonnet	90	83	77	71	57	75.5%
DeepSeek-V2 Chat	88	87	86	59	56	75.5%
Gemma 3 27B	78	77	77	76	67	74.9%
Llama 3.1 Nemotron 70B	100	83	74	61	55	74.7%
GPT-4.1 Mini	87	77	72	67	66	73.6%
GPT-4.1 Nano	86	81	69	54	52	68.5%
Claude Sonnet 4.6	75	73	69	58	41	63.4%

▼

Literary fiction: old friends reunite

Model	# 1	# 2	# 3	# 4	# 5	Avg ▼
ByteDance Seed 1.6	100	98	97	96	95	97.3%
ByteDance Seed 1.6 Flash	100	98	95	95	95	96.5%
Grok 4.1 Fast	97	94	94	94	92	94.2%
GPT-5 Mini	100	98	94	89	88	93.9%
Stealth: Aurora Alpha	98	94	93	92	90	93.5%
Grok 4 Fast	100	95	92	90	89	93.4%
o4 Mini High	100	97	93	90	86	93.1%
Grok 4	97	94	92	89	85	91.5%
Llama 3.1 70B	93	91	91	91	88	90.9%
GPT-4.1	100	97	90	84	81	90.4%
DeepSeek V3 (2025-03-24)	100	95	89	88	76	89.8%
Mistral Large 3	95	91	89	87	83	89.0%
Ministral 3 3B	94	94	89	84	84	89.0%
Z.AI GLM 4.6	93	89	88	87	83	88.1%
Cohere Command R+ (Aug. 2024)	97	96	87	82	78	88.0%
o4 Mini	96	90	87	86	80	88.0%
WizardLM 2 8x22b	94	87	86	85	85	87.5%
Mistral Medium 3.1	98	86	85	84	84	87.4%
Ministral 8B	92	91	87	84	82	87.2%
GPT-5 Nano	92	92	85	85	80	86.8%
Gemini 3 Pro (Preview)	90	87	86	85	84	86.2%
Z.AI GLM 5	90	89	86	86	80	86.1%
Claude Opus 4.6	93	92	84	81	81	86.0%
MoonshotAI: Kimi K2.5	97	94	88	79	71	85.8%
Rocinante 12B	97	96	90	74	71	85.6%
Llama 3.1 Nemotron 70B	91	91	88	82	75	85.4%
Gemini 3 Flash (Preview)	91	86	84	84	82	85.3%
Z.AI GLM 4.7 Flash	91	89	86	79	77	84.6%
GPT-5	89	88	83	81	81	84.6%
Qwen 3.5 397B A17B	89	87	84	84	79	84.6%
GPT-5.1	87	85	84	82	81	83.9%
Mistral NeMO	92	88	87	76	73	83.4%
Claude Opus 4.5	85	85	84	82	80	83.2%
Llama 3.1 8B	92	88	83	77	76	83.2%
Mistral Large 2	93	89	85	82	66	83.2%
Mistral Large	89	89	85	77	75	83.1%
GPT-4o, Aug. 6th (temp=0)	91	85	84	84	71	82.9%
Ministral 3 8B	91	89	82	79	73	82.6%
Gemini 2.5 Pro	94	85	81	78	71	81.8%
Claude Sonnet 4.5	88	86	82	77	75	81.7%
Z.AI GLM 4.7	92	84	81	76	75	81.7%
GPT-5.2	90	81	80	79	78	81.6%
DeepSeek V3 (2024-12-26)	88	86	82	81	69	81.2%
Claude Sonnet 4	87	87	85	74	73	81.0%
DeepSeek V3.2	95	82	80	74	74	80.9%
Qwen 3.5 Plus (2026-02-15)	84	84	80	79	78	80.9%
Claude Opus 4	96	89	84	74	61	80.8%
Qwen 2.5 72B	85	84	82	81	70	80.4%
GPT-4o Mini (temp=0)	91	87	86	67	66	79.2%
Gemini 2.5 Flash	92	79	78	76	70	79.1%
Hermes 3 405B	95	85	81	74	58	78.5%
Minimax M2.5	93	89	72	70	67	78.3%
Claude Haiku 4.5	82	81	80	78	71	78.3%
Ministral 3 14B	92	78	77	73	72	78.3%
GPT-4.1 Mini	86	86	80	77	62	78.1%
Mistral Small Creative	86	79	76	76	74	78.1%
GPT-4o, May 13th (temp=0)	90	86	84	73	58	78.0%
Mistral Small 3.2 24B	91	83	74	70	70	77.8%
GPT-4o, May 13th (temp=1)	87	86	81	80	53	77.2%
Z.AI GLM 4.5	85	84	83	71	62	76.9%
DeepSeek V3.1	87	80	73	72	70	76.2%
Ministral 3B	94	75	72	71	66	75.6%
Writer: Palmyra X5	80	80	74	74	69	75.4%
GPT-4o, Aug. 6th (temp=1)	87	83	72	71	62	75.3%
Claude 3.5 Sonnet	100	85	80	69	42	75.1%
Hermes 3 70B	82	80	74	71	67	74.6%
Gemma 3 27B	88	78	75	71	59	74.3%
Claude 3.7 Sonnet	78	76	75	74	69	74.3%
Arcee AI: Trinity Mini	79	72	72	71	67	72.1%
Gemini 2.5 Flash Lite	81	77	76	69	58	72.1%
Arcee AI: Trinity Large (Preview)	79	74	72	67	65	71.5%
GPT-4o Mini (temp=1)	82	76	71	65	59	70.7%
DeepSeek-V2 Chat	80	75	70	66	61	70.3%
Claude Sonnet 4.6	85	82	74	55	54	69.8%
Gemma 3 12B	77	75	74	67	54	69.3%
Claude 3.5 Haiku	84	79	71	60	48	68.5%
Gemini 3.1 Pro (Preview)	86	82	63	62	48	68.2%
Gemma 3 4B	78	78	69	59	51	67.2%
Claude 3 Haiku	78	73	71	52	51	64.8%
GPT-4.1 Nano	70	60	54	46	33	52.6%

▼

Mystery: examining a crime scene

Model	# 1	# 2	# 3	# 4	# 5	Avg ▼
ByteDance Seed 1.6 Flash	100	100	97	96	95	97.6%
GPT-4.1	100	97	96	93	93	95.9%
ByteDance Seed 1.6	98	98	97	96	91	95.9%
Grok 4	97	97	97	94	88	94.8%
Stealth: Aurora Alpha	100	95	94	93	91	94.5%
Grok 4.1 Fast	97	97	93	93	90	94.2%
o4 Mini High	100	97	96	91	86	94.0%
GPT-5	97	93	93	93	89	93.0%
Qwen 2.5 72B	100	96	95	95	79	92.8%
Gemini 3 Flash (Preview)	100	94	91	90	89	92.5%
o4 Mini	100	97	96	90	78	92.4%
Z.AI GLM 4.7 Flash	97	93	93	91	88	92.3%
WizardLM 2 8x22b	100	95	94	87	85	92.1%
Llama 3.1 8B	100	97	93	90	80	91.9%
Rocinante 12B	94	93	91	91	90	91.8%
Grok 4 Fast	94	92	92	92	88	91.6%
Mistral Large 3	100	96	91	87	82	91.2%
GPT-5 Mini	94	93	92	89	88	91.1%
Cohere Command R+ (Aug. 2024)	100	96	90	89	80	90.9%
GPT-4o, May 13th (temp=0)	96	94	90	87	86	90.8%
MoonshotAI: Kimi K2.5	97	95	92	91	79	90.7%
GPT-5 Nano	92	92	90	90	89	90.4%
Arcee AI: Trinity Mini	100	94	93	89	75	90.2%
Ministral 3 8B	100	94	87	85	83	89.9%
Claude Opus 4.6	93	93	91	87	86	89.9%
GPT-4o, Aug. 6th (temp=0)	95	95	91	83	81	89.2%
Mistral Medium 3.1	97	92	92	85	81	89.1%
Minimax M2.5	94	94	92	86	79	88.9%
Llama 3.1 70B	100	92	86	86	79	88.6%
Mistral NeMO	100	92	89	82	79	88.4%
Gemini 2.5 Flash	97	96	88	85	76	88.4%
Llama 3.1 Nemotron 70B	100	100	86	80	76	88.4%
Mistral Large 2	100	96	91	78	77	88.3%
Arcee AI: Trinity Large (Preview)	96	96	87	87	76	88.2%
Z.AI GLM 5	93	93	92	85	78	88.0%
Mistral Small 3.2 24B	92	90	87	86	83	87.5%
GPT-4o Mini (temp=0)	100	90	87	81	78	87.3%
Qwen 3.5 Plus (2026-02-15)	94	87	86	85	84	87.3%
Claude Sonnet 4.5	91	89	87	85	84	87.1%
Ministral 8B	100	95	84	83	72	86.9%
Claude Haiku 4.5	96	92	87	83	76	86.8%
Z.AI GLM 4.6	92	89	87	87	80	86.8%
Mistral Large	91	90	87	85	79	86.6%
Qwen 3.5 397B A17B	92	90	87	86	78	86.5%
Ministral 3 3B	89	88	88	88	80	86.5%
Gemini 3 Pro (Preview)	91	89	87	86	77	86.0%
Hermes 3 405B	100	93	82	78	77	86.0%
Mistral Small Creative	93	93	91	87	66	86.0%
GPT-5.2	91	87	86	84	80	85.8%
Hermes 3 70B	100	93	88	75	71	85.5%
Claude Sonnet 4	92	90	88	81	76	85.3%
DeepSeek V3.1	96	91	89	85	65	85.0%
Gemma 3 27B	92	87	83	81	81	84.8%
Ministral 3 14B	96	87	84	79	78	84.6%
Gemini 2.5 Pro	94	87	84	80	77	84.5%
Ministral 3B	100	88	88	84	62	84.4%
GPT-4o, Aug. 6th (temp=1)	95	91	86	78	69	83.9%
DeepSeek V3.2	90	88	87	79	76	83.7%
DeepSeek V3 (2025-03-24)	91	91	83	77	77	83.7%
Claude 3.5 Haiku	100	85	84	77	72	83.6%
Gemini 2.5 Flash Lite	97	95	81	76	69	83.4%
GPT-5.1	87	83	82	81	81	83.0%
GPT-4o Mini (temp=1)	88	86	85	82	74	82.9%
Claude 3.5 Sonnet	100	94	83	74	62	82.6%
Claude Opus 4.5	86	86	81	80	80	82.6%
Claude 3.7 Sonnet	94	90	83	79	65	82.3%
Z.AI GLM 4.7	85	85	84	77	76	81.5%
DeepSeek V3 (2024-12-26)	91	82	80	78	75	81.0%
Claude Sonnet 4.6	91	90	77	74	68	80.0%
DeepSeek-V2 Chat	92	87	76	75	67	79.3%
Gemma 3 12B	96	82	76	74	62	77.9%
Claude Opus 4	88	83	75	70	68	76.9%
Writer: Palmyra X5	92	84	76	68	64	76.7%
GPT-4o, May 13th (temp=1)	83	76	74	71	70	75.0%
Z.AI GLM 4.5	85	83	73	68	60	73.8%
Gemini 3.1 Pro (Preview)	77	71	68	64	63	68.5%
GPT-4.1 Mini	91	67	62	62	57	67.6%
GPT-4.1 Nano	89	80	64	62	44	67.6%
Claude 3 Haiku	76	65	65	64	59	65.9%
Gemma 3 4B	77	73	50	49	49	59.7%

▼

Romance: separated couple reunites

Model	# 1	# 2	# 3	# 4	# 5	Avg ▼
ByteDance Seed 1.6	100	100	97	95	93	97.2%
Grok 4.1 Fast	100	97	94	94	94	95.7%
Rocinante 12B	100	100	96	95	81	94.4%
ByteDance Seed 1.6 Flash	100	96	94	94	87	94.2%
Mistral Medium 3.1	95	94	94	94	90	93.5%
Llama 3.1 70B	100	93	93	93	87	93.3%
o4 Mini	100	96	91	90	88	92.9%
GPT-5 Mini	96	95	94	90	87	92.3%
Grok 4	100	92	92	90	86	91.9%
GPT-5 Nano	91	91	91	88	87	89.8%
Grok 4 Fast	95	93	92	87	82	89.7%
Mistral Large 2	100	95	91	83	80	89.7%
Mistral Large 3	97	95	95	81	76	88.9%
Llama 3.1 Nemotron 70B	94	94	89	83	83	88.6%
MoonshotAI: Kimi K2.5	94	93	92	83	80	88.5%
Z.AI GLM 5	94	94	90	85	79	88.4%
Ministral 8B	97	97	88	80	79	88.2%
Mistral Large	96	87	87	86	85	88.0%
Hermes 3 405B	100	95	88	79	77	87.8%
GPT-4.1	93	89	87	86	83	87.6%
Qwen 3.5 397B A17B	93	92	90	85	76	87.4%
DeepSeek V3 (2025-03-24)	100	100	88	85	64	87.3%
Claude Opus 4.6	92	90	88	87	79	87.3%
Gemini 3 Flash (Preview)	97	94	91	84	69	87.0%
o4 Mini High	97	89	86	85	77	86.8%
Claude Opus 4.5	94	91	89	80	78	86.5%
Stealth: Aurora Alpha	92	91	89	81	80	86.5%
GPT-5	93	87	85	84	83	86.4%
Llama 3.1 8B	93	86	86	84	81	85.9%
Qwen 2.5 72B	95	92	85	78	78	85.9%
Ministral 3 14B	91	88	85	82	80	85.4%
Claude 3.5 Sonnet	95	89	84	80	75	84.7%
Ministral 3 8B	94	90	84	78	76	84.3%
DeepSeek V3.1	88	87	85	83	77	83.8%
Z.AI GLM 4.7 Flash	87	86	84	83	79	83.7%
Mistral Small Creative	93	91	86	84	62	83.3%
GPT-5.2	86	85	84	83	79	83.3%
WizardLM 2 8x22b	91	91	82	76	75	82.8%
Gemini 3 Pro (Preview)	90	86	85	79	74	82.6%
Cohere Command R+ (Aug. 2024)	91	83	80	79	79	82.3%
Claude Sonnet 4	86	86	82	80	78	82.3%
Z.AI GLM 4.7	90	84	82	81	72	81.8%
Gemini 2.5 Pro	85	83	83	78	77	81.2%
Claude Opus 4	89	86	85	76	67	80.5%
Ministral 3B	88	85	82	75	71	80.5%
Mistral NeMO	92	86	85	77	61	80.1%
Z.AI GLM 4.6	87	84	79	78	73	80.1%
Arcee AI: Trinity Mini	100	83	76	72	68	79.8%
Minimax M2.5	84	80	80	78	76	79.8%
Ministral 3 3B	94	88	73	71	71	79.5%
GPT-4o, May 13th (temp=1)	85	79	78	78	77	79.4%
GPT-4o Mini (temp=0)	81	81	81	77	76	79.2%
DeepSeek V3.2	87	83	76	74	73	78.5%
GPT-4o, May 13th (temp=0)	86	82	80	76	68	78.4%
GPT-4o Mini (temp=1)	87	87	76	71	70	78.2%
GPT-4o, Aug. 6th (temp=1)	87	83	77	73	70	78.1%
Claude Haiku 4.5	87	84	82	78	59	78.0%
Qwen 3.5 Plus (2026-02-15)	90	83	75	72	69	77.9%
GPT-4o, Aug. 6th (temp=0)	86	82	75	72	68	76.5%
Gemma 3 27B	86	82	77	67	67	75.8%
Claude 3.5 Haiku	100	100	77	57	45	75.6%
DeepSeek-V2 Chat	84	81	79	67	63	74.9%
Gemma 3 12B	88	88	70	64	60	74.1%
DeepSeek V3 (2024-12-26)	89	83	67	66	64	73.7%
GPT-5.1	83	76	71	71	67	73.6%
Hermes 3 70B	89	78	69	66	62	72.7%
Writer: Palmyra X5	80	76	75	67	65	72.7%
Gemini 2.5 Flash Lite	85	75	74	70	54	71.8%
Gemini 2.5 Flash	84	74	71	70	59	71.6%
GPT-4.1 Mini	87	86	65	64	55	71.5%
Arcee AI: Trinity Large (Preview)	82	77	71	69	54	70.3%
Z.AI GLM 4.5	76	75	74	64	56	68.9%
Claude Sonnet 4.5	86	72	71	65	51	68.7%
Gemini 3.1 Pro (Preview)	75	71	69	66	61	68.5%
Claude Sonnet 4.6	84	74	67	64	49	67.6%
Claude 3.7 Sonnet	82	69	68	60	52	66.1%
Gemma 3 4B	80	78	70	56	37	63.9%
GPT-4.1 Nano	74	63	62	34	34	53.4%
Mistral Small 3.2 24B	68	67	66	35	28	53.0%
Claude 3 Haiku	63	60	54	40	37	50.8%

▼

Thriller: chase through city streets

Model	# 1	# 2	# 3	# 4	# 5	Avg ▼
o4 Mini	100	100	100	97	96	98.6%
Grok 4.1 Fast	100	100	97	97	97	98.2%
Grok 4 Fast	100	100	98	95	94	97.3%
GPT-5 Mini	100	100	98	95	94	97.3%
ByteDance Seed 1.6 Flash	100	98	97	96	95	97.2%
GPT-4.1	100	100	97	97	90	96.6%
Gemini 2.5 Pro	100	100	96	93	93	96.6%
Grok 4	100	100	95	94	93	96.4%
WizardLM 2 8x22b	100	100	100	98	83	96.3%
o4 Mini High	100	100	94	94	93	96.2%
MoonshotAI: Kimi K2.5	100	100	94	94	91	95.7%
ByteDance Seed 1.6	100	100	94	93	91	95.7%
Ministral 3B	100	100	98	93	87	95.7%
Mistral Large 3	100	96	95	94	93	95.5%
Gemini 3 Pro (Preview)	97	97	97	94	92	95.5%
Arcee AI: Trinity Mini	100	96	94	94	93	95.4%
GPT-5 Nano	98	97	94	94	93	95.2%
Z.AI GLM 4.7 Flash	97	97	97	93	92	95.2%
GPT-5	100	98	96	91	90	95.0%
GPT-5.2	96	95	95	94	94	94.8%
DeepSeek V3 (2024-12-26)	100	100	94	93	85	94.3%
Gemini 3 Flash (Preview)	100	96	94	91	89	94.1%
Claude Opus 4.6	98	97	95	92	88	93.9%
Qwen 2.5 72B	100	97	95	90	88	93.8%
DeepSeek V3.2	100	100	94	91	84	93.8%
Qwen 3.5 397B A17B	100	93	92	91	91	93.6%
Rocinante 12B	100	100	92	90	84	92.9%
Minimax M2.5	96	95	93	91	89	92.9%
GPT-4o, Aug. 6th (temp=0)	95	95	95	93	86	92.7%
Stealth: Aurora Alpha	95	94	91	91	90	92.0%
GPT-4o, May 13th (temp=1)	100	96	93	92	79	91.9%
Gemma 3 12B	96	96	92	92	83	91.7%
Z.AI GLM 4.6	96	93	92	90	87	91.6%
Z.AI GLM 5	97	97	93	87	84	91.5%
Qwen 3.5 Plus (2026-02-15)	100	93	90	89	86	91.5%
Llama 3.1 70B	100	94	93	93	78	91.4%
DeepSeek V3.1	96	95	94	94	79	91.4%
Ministral 3 14B	100	95	88	87	86	91.3%
Writer: Palmyra X5	100	92	91	86	86	91.1%
Claude 3 Haiku	100	95	92	90	77	90.6%
Claude Opus 4.5	94	94	90	89	86	90.6%
Claude Sonnet 4.5	96	96	91	88	82	90.4%
Mistral Small Creative	97	97	95	85	79	90.4%
Llama 3.1 8B	100	91	91	87	82	90.1%
Cohere Command R+ (Aug. 2024)	100	92	89	86	83	90.1%
Ministral 3 8B	96	90	89	89	87	90.0%
Claude 3.5 Sonnet	94	90	89	89	89	90.0%
GPT-5.1	94	94	91	87	84	89.9%
Gemini 2.5 Flash Lite	96	96	91	91	75	89.7%
Mistral Medium 3.1	97	93	90	87	81	89.5%
GPT-4o Mini (temp=1)	96	95	92	92	71	89.3%
Claude Opus 4	96	93	88	85	84	89.3%
Gemini 2.5 Flash	95	92	91	85	83	89.2%
Ministral 3 3B	100	100	90	84	69	88.6%
Gemma 3 27B	96	93	88	85	82	88.6%
Mistral Large	100	96	91	80	75	88.5%
GPT-4o Mini (temp=0)	96	89	89	82	80	87.1%
Z.AI GLM 4.7	90	90	87	85	83	86.8%
Claude Sonnet 4	96	95	88	87	68	86.7%
Hermes 3 70B	100	91	86	78	77	86.5%
DeepSeek V3 (2025-03-24)	100	100	82	80	70	86.3%
Ministral 8B	95	88	84	82	82	86.2%
Gemini 3.1 Pro (Preview)	91	89	86	86	77	86.0%
Mistral Large 2	90	87	87	83	82	85.9%
GPT-4o, Aug. 6th (temp=1)	95	90	81	81	81	85.8%
GPT-4o, May 13th (temp=0)	94	89	85	81	80	85.8%
Mistral NeMO	97	96	81	78	76	85.8%
Claude 3.5 Haiku	100	90	89	89	60	85.7%
GPT-4.1 Mini	95	91	84	79	77	85.3%
Claude 3.7 Sonnet	91	90	88	83	75	85.2%
Claude Haiku 4.5	95	93	89	85	64	85.2%
Z.AI GLM 4.5	91	87	85	81	80	84.7%
DeepSeek-V2 Chat	100	91	91	80	58	84.2%
Llama 3.1 Nemotron 70B	92	87	86	80	72	83.6%
Mistral Small 3.2 24B	100	97	90	79	50	83.2%
GPT-4.1 Nano	90	90	85	77	70	82.6%
Hermes 3 405B	95	93	84	76	64	82.3%
Arcee AI: Trinity Large (Preview)	90	89	79	77	74	81.8%
Gemma 3 4B	91	88	82	78	69	81.6%
Claude Sonnet 4.6	95	86	77	74	73	81.2%

Novelcrafter Default Prompt

▼

Fantasy: entering an ancient ruin

Model	# 1	# 2	# 3	# 4	# 5	Avg ▼
Grok 4.1 Fast	100	100	100	100	100	100.0%
GPT-5	100	100	100	98	97	99.0%
GPT-5.1	100	100	100	98	96	98.9%
GPT-5.2	100	100	98	98	96	98.3%
o4 Mini	100	100	100	96	92	97.7%
ByteDance Seed 1.6 Flash	100	100	97	96	96	97.6%
GPT-5 Mini	100	98	98	96	94	97.2%
o4 Mini High	100	97	96	96	95	96.9%
Mistral Large	100	100	97	95	91	96.6%
Mistral Large 2	100	96	96	95	95	96.5%
Gemini 3.1 Pro (Preview)	100	100	97	97	88	96.5%
Stealth: Aurora Alpha	100	98	95	95	93	96.1%
MoonshotAI: Kimi K2.5	97	97	96	95	93	95.3%
Grok 4 Fast	100	97	97	93	89	95.2%
Ministral 3 3B	100	100	100	94	82	95.0%
Mistral Large 3	100	100	93	92	89	94.8%
Mistral Medium 3.1	100	100	92	92	89	94.7%
Qwen 3.5 397B A17B	100	97	96	96	83	94.3%
GPT-4.1	100	96	96	93	85	94.1%
Grok 4	98	95	93	93	90	93.6%
ByteDance Seed 1.6	100	97	96	95	80	93.4%
Claude Haiku 4.5	100	95	95	91	82	92.7%
Z.AI GLM 4.7	100	92	91	91	89	92.7%
Ministral 3B	100	100	92	85	84	92.3%
Writer: Palmyra X5	100	92	91	90	88	92.1%
Mistral Small Creative	97	94	94	89	82	91.2%
Gemini 3 Flash (Preview)	96	93	92	87	86	90.9%
Gemini 3 Pro (Preview)	94	93	90	89	87	90.5%
Qwen 3.5 Plus (2026-02-15)	94	94	88	87	87	89.9%
Rocinante 12B	100	92	91	87	79	89.7%
DeepSeek V3 (2025-03-24)	100	94	90	82	81	89.6%
Llama 3.1 8B	98	92	88	86	83	89.5%
Minimax M2.5	92	91	90	89	84	89.2%
Z.AI GLM 5	100	97	92	83	74	89.1%
Claude 3.5 Haiku	100	100	100	73	72	88.9%
GPT-5 Nano	91	89	88	88	86	88.6%
Ministral 8B	100	88	87	85	83	88.5%
Ministral 3 14B	92	89	89	87	84	88.4%
Gemma 3 27B	95	95	91	86	74	88.3%
Claude Sonnet 4.5	92	90	89	85	85	88.2%
Claude Opus 4.5	93	89	86	86	85	88.0%
Arcee AI: Trinity Mini	94	91	87	86	82	88.0%
Z.AI GLM 4.6	100	89	84	84	83	87.9%
Claude Opus 4.6	97	95	91	80	74	87.1%
Claude Opus 4	93	91	88	82	81	87.0%
Cohere Command R+ (Aug. 2024)	94	92	87	85	76	87.0%
Qwen 2.5 72B	89	88	88	86	82	86.8%
Gemini 2.5 Pro	100	91	85	79	77	86.2%
Claude Sonnet 4	95	90	85	82	79	86.2%
WizardLM 2 8x22b	93	89	83	83	80	85.7%
Llama 3.1 70B	100	86	85	78	76	85.0%
GPT-4o, Aug. 6th (temp=0)	99	87	86	84	68	84.8%
Z.AI GLM 4.7 Flash	96	89	85	77	72	83.9%
GPT-4o Mini (temp=0)	100	84	82	76	74	83.3%
Claude 3.5 Sonnet	100	86	85	73	71	82.8%
Hermes 3 405B	94	88	86	79	66	82.7%
DeepSeek V3.2	90	90	79	78	76	82.6%
GPT-4o, May 13th (temp=0)	90	89	86	78	70	82.5%
Gemma 3 4B	91	83	79	78	76	81.3%
Ministral 3 8B	93	85	80	77	69	80.5%
DeepSeek V3 (2024-12-26)	89	88	84	78	65	80.5%
GPT-4o, Aug. 6th (temp=1)	89	89	88	83	52	80.2%
Z.AI GLM 4.5	91	85	76	74	68	78.7%
Mistral NeMO	87	86	74	73	72	78.5%
DeepSeek V3.1	93	87	77	72	60	77.9%
Claude Sonnet 4.6	90	80	76	75	68	77.7%
Gemini 2.5 Flash Lite	84	76	76	74	73	76.7%
GPT-4.1 Mini	82	79	75	74	70	76.1%
DeepSeek-V2 Chat	84	80	78	72	65	75.6%
Claude 3.7 Sonnet	82	81	81	73	57	75.0%
GPT-4o Mini (temp=1)	88	81	73	69	64	74.9%
Arcee AI: Trinity Large (Preview)	80	76	76	74	67	74.6%
Claude 3 Haiku	79	77	75	75	67	74.5%
Gemma 3 12B	88	86	70	70	56	74.0%
Llama 3.1 Nemotron 70B	84	77	75	69	60	73.0%
Gemini 2.5 Flash	90	79	70	66	60	73.0%
GPT-4o, May 13th (temp=1)	92	81	70	60	58	71.9%
Hermes 3 70B	84	83	55	54	51	65.3%
GPT-4.1 Nano	70	70	66	53	41	60.0%
Mistral Small 3.2 24B	75	68	57	40	14	50.8%

▼

Horror: alone in an eerie place at night

Model	# 1	# 2	# 3	# 4	# 5	Avg ▼
Grok 4.1 Fast	100	100	100	100	100	100.0%
ByteDance Seed 1.6 Flash	100	100	100	100	95	99.0%
GPT-5	100	100	100	100	94	98.9%
Qwen 3.5 397B A17B	100	100	100	100	93	98.6%
o4 Mini	100	100	100	97	96	98.6%
MoonshotAI: Kimi K2.5	100	100	100	100	92	98.5%
GPT-5.2	100	100	100	98	95	98.5%
o4 Mini High	100	100	100	96	93	97.9%
Gemini 3 Flash (Preview)	100	98	97	97	91	96.6%
ByteDance Seed 1.6	100	97	97	96	92	96.5%
Grok 4 Fast	100	100	97	95	88	96.1%
GPT-5.1	100	100	96	96	88	95.9%
Mistral Medium 3.1	100	100	95	94	89	95.8%
Claude 3.5 Haiku	100	100	100	100	75	94.9%
Gemini 3.1 Pro (Preview)	100	96	96	92	89	94.9%
Mistral Large 3	100	100	94	90	89	94.5%
Z.AI GLM 5	100	96	93	91	89	94.0%
Grok 4	97	95	95	92	91	93.9%
Qwen 3.5 Plus (2026-02-15)	100	97	94	90	89	93.9%
Arcee AI: Trinity Mini	100	94	94	91	90	93.9%
Z.AI GLM 4.7 Flash	100	96	93	92	87	93.8%
Stealth: Aurora Alpha	97	97	94	93	88	93.6%
Llama 3.1 8B	100	99	93	90	85	93.3%
GPT-4.1	100	97	92	88	87	92.9%
Z.AI GLM 4.7	96	95	93	91	85	92.2%
Mistral Large	100	100	100	86	73	91.8%
Mistral Large 2	100	100	92	92	74	91.6%
GPT-5 Mini	96	95	93	92	81	91.4%
Claude Sonnet 4.5	100	96	96	93	72	91.3%
Ministral 3 14B	94	94	93	91	85	91.2%
Arcee AI: Trinity Large (Preview)	100	100	95	90	71	91.0%
DeepSeek V3 (2025-03-24)	100	100	89	83	82	91.0%
Gemini 3 Pro (Preview)	94	92	91	89	88	90.8%
GPT-5 Nano	95	92	90	89	86	90.4%
Qwen 2.5 72B	95	95	90	86	83	89.8%
Z.AI GLM 4.5	95	93	92	89	78	89.2%
WizardLM 2 8x22b	97	96	86	84	82	89.1%
Hermes 3 405B	93	91	89	87	85	89.1%
Gemma 3 12B	95	95	90	86	80	89.0%
Writer: Palmyra X5	100	96	92	80	77	88.9%
Claude Opus 4.6	93	92	91	88	80	88.8%
GPT-4o, May 13th (temp=0)	92	90	88	88	85	88.5%
Gemini 2.5 Pro	95	91	89	86	80	88.3%
Ministral 8B	91	90	88	87	85	88.1%
Llama 3.1 70B	100	92	88	81	79	88.0%
Minimax M2.5	95	92	87	85	80	87.8%
Claude 3.5 Sonnet	100	92	85	85	76	87.5%
Mistral NeMO	100	86	85	85	79	87.0%
Mistral Small Creative	90	89	88	86	81	86.8%
Claude Opus 4	91	91	91	89	70	86.5%
DeepSeek V3.1	92	91	85	82	82	86.4%
GPT-4o, May 13th (temp=1)	88	86	85	83	82	84.8%
Gemini 2.5 Flash Lite	89	88	85	83	79	84.7%
GPT-4o, Aug. 6th (temp=1)	91	91	85	82	74	84.7%
Llama 3.1 Nemotron 70B	100	85	82	79	77	84.5%
DeepSeek-V2 Chat	92	86	83	81	79	84.3%
DeepSeek V3.2	92	86	84	83	73	83.6%
GPT-4o Mini (temp=0)	100	90	82	82	61	83.1%
Mistral Small 3.2 24B	100	100	85	83	47	83.1%
Z.AI GLM 4.6	94	86	80	79	75	82.9%
Ministral 3 8B	92	86	84	79	74	82.9%
Gemma 3 27B	100	95	79	78	60	82.4%
Claude Haiku 4.5	91	89	88	79	64	82.4%
GPT-4o, Aug. 6th (temp=0)	91	87	85	76	72	82.1%
Hermes 3 70B	96	89	85	69	68	81.3%
DeepSeek V3 (2024-12-26)	87	87	82	80	70	81.2%
Gemini 2.5 Flash	91	87	82	73	72	81.1%
GPT-4o Mini (temp=1)	87	83	81	79	76	81.0%
Ministral 3B	86	83	82	76	76	80.7%
Claude Opus 4.5	88	88	79	75	70	80.1%
GPT-4.1 Mini	90	81	81	74	74	79.9%
Claude Sonnet 4	91	83	80	73	72	79.8%
Rocinante 12B	100	84	76	75	63	79.7%
Ministral 3 3B	93	90	76	74	61	78.8%
Gemma 3 4B	91	87	83	69	61	78.3%
GPT-4.1 Nano	86	82	81	77	58	76.7%
Claude 3.7 Sonnet	83	80	78	71	68	76.0%
Cohere Command R+ (Aug. 2024)	89	74	74	72	66	74.8%
Claude Sonnet 4.6	85	79	74	72	60	73.8%
Claude 3 Haiku	88	69	67	65	60	69.9%

▼

Literary fiction: old friends reunite

Model	# 1	# 2	# 3	# 4	# 5	Avg ▼
Claude 3.5 Haiku	100	100	100	100	100	100.0%
GPT-5.2	100	100	100	100	97	99.3%
GPT-5	100	100	100	98	98	99.3%
Grok 4.1 Fast	100	100	100	100	96	99.3%
Gemini 3.1 Pro (Preview)	100	100	100	97	95	98.5%
GPT-5.1	99	98	98	97	95	97.4%
o4 Mini High	100	100	95	92	92	95.8%
o4 Mini	100	96	96	94	91	95.4%
ByteDance Seed 1.6 Flash	100	97	95	93	91	95.1%
Claude Opus 4.6	98	98	97	91	91	94.9%
GPT-4.1	96	96	96	93	93	94.9%
Qwen 2.5 72B	100	96	95	94	89	94.7%
ByteDance Seed 1.6	98	94	94	94	90	94.1%
Mistral Large	100	100	96	91	83	93.9%
Qwen 3.5 397B A17B	96	96	96	92	87	93.6%
Mistral Medium 3.1	96	96	93	92	91	93.6%
Grok 4	97	95	94	93	89	93.5%
MoonshotAI: Kimi K2.5	97	96	92	92	90	93.4%
Grok 4 Fast	98	97	95	93	82	92.9%
Stealth: Aurora Alpha	98	93	93	92	89	92.8%
Ministral 3B	95	95	95	91	87	92.6%
Llama 3.1 8B	100	95	92	89	86	92.4%
Ministral 3 14B	96	92	91	91	89	91.5%
Mistral Large 3	100	94	91	87	84	91.3%
Gemini 3 Flash (Preview)	98	97	92	87	83	91.3%
GPT-5 Nano	95	91	91	89	88	90.9%
GPT-5 Mini	96	92	92	91	83	90.8%
Llama 3.1 70B	95	95	94	93	75	90.4%
Hermes 3 70B	100	93	89	87	81	90.1%
Z.AI GLM 4.7	94	92	89	87	84	89.2%
Mistral Small Creative	94	92	86	86	79	87.8%
Mistral Large 2	94	92	91	85	76	87.7%
Qwen 3.5 Plus (2026-02-15)	89	88	88	87	86	87.7%
DeepSeek V3 (2025-03-24)	93	93	92	85	75	87.5%
Minimax M2.5	97	93	90	86	72	87.5%
Gemini 2.5 Pro	96	93	90	86	73	87.5%
Z.AI GLM 4.7 Flash	97	90	88	83	81	87.4%
Z.AI GLM 4.6	95	91	89	83	78	87.3%
Claude Sonnet 4.5	93	88	87	86	82	87.1%
Gemini 3 Pro (Preview)	94	90	87	86	78	87.1%
Claude Opus 4	96	89	87	85	78	87.0%
DeepSeek V3.1	93	88	86	82	77	85.2%
GPT-4o, Aug. 6th (temp=1)	91	91	87	85	72	85.2%
Ministral 3 3B	100	94	84	78	70	85.0%
Cohere Command R+ (Aug. 2024)	92	91	88	82	71	84.7%
GPT-4o, Aug. 6th (temp=0)	90	89	84	82	77	84.5%
Writer: Palmyra X5	88	88	83	82	80	84.2%
Llama 3.1 Nemotron 70B	95	85	83	81	77	84.1%
Rocinante 12B	100	91	83	80	67	84.0%
WizardLM 2 8x22b	92	84	83	82	77	83.4%
Z.AI GLM 5	92	86	85	82	72	83.4%
DeepSeek V3.2	89	86	84	81	77	83.4%
Claude Sonnet 4.6	95	87	81	77	76	83.3%
Z.AI GLM 4.5	95	95	81	78	68	83.2%
Gemma 3 27B	100	91	83	76	66	83.1%
Claude Opus 4.5	90	88	86	83	66	82.5%
DeepSeek V3 (2024-12-26)	85	85	84	82	75	82.2%
Ministral 3 8B	91	89	79	77	71	81.4%
GPT-4o Mini (temp=1)	92	86	83	79	64	81.0%
DeepSeek-V2 Chat	96	93	92	71	53	80.8%
GPT-4o Mini (temp=0)	96	96	76	67	67	80.3%
Mistral NeMO	85	81	81	80	74	80.0%
Hermes 3 405B	96	92	84	69	57	79.5%
Arcee AI: Trinity Large (Preview)	89	80	78	75	72	78.7%
Ministral 8B	84	82	77	75	70	77.7%
Claude Haiku 4.5	88	84	76	72	68	77.6%
Gemini 2.5 Flash	87	78	76	75	72	77.6%
Gemini 2.5 Flash Lite	84	82	81	66	66	75.9%
Arcee AI: Trinity Mini	83	82	72	72	69	75.6%
Mistral Small 3.2 24B	91	87	80	65	54	75.5%
Gemma 3 12B	81	79	78	70	67	75.3%
GPT-4o, May 13th (temp=1)	81	74	73	71	70	73.8%
Claude 3.7 Sonnet	81	77	71	70	63	72.5%
Claude 3 Haiku	88	75	74	73	49	71.8%
Claude 3.5 Sonnet	86	84	68	61	59	71.7%
Gemma 3 4B	92	83	71	57	55	71.6%
Claude Sonnet 4	86	82	73	60	51	70.4%
GPT-4o, May 13th (temp=0)	82	80	77	66	45	70.0%
GPT-4.1 Mini	76	70	63	60	54	64.5%
GPT-4.1 Nano	74	67	60	58	44	60.6%

▼

Mystery: examining a crime scene

Model	# 1	# 2	# 3	# 4	# 5	Avg ▼
MoonshotAI: Kimi K2.5	100	100	100	100	100	100.0%
Grok 4.1 Fast	100	100	100	100	100	100.0%
ByteDance Seed 1.6 Flash	100	100	100	100	100	100.0%
GPT-5.1	100	100	98	98	98	99.0%
GPT-5	100	100	98	97	97	98.4%
Qwen 3.5 397B A17B	100	100	97	96	96	97.8%
GPT-5.2	100	98	98	95	95	97.1%
o4 Mini High	100	100	97	95	92	96.8%
ByteDance Seed 1.6	100	97	97	97	90	96.4%
Mistral Medium 3.1	100	100	96	94	90	95.9%
o4 Mini	100	100	100	93	86	95.9%
Gemini 3.1 Pro (Preview)	100	100	97	96	86	95.8%
Cohere Command R+ (Aug. 2024)	100	100	100	95	84	95.8%
Grok 4 Fast	97	97	97	96	92	95.8%
Gemini 3 Flash (Preview)	97	97	96	95	93	95.6%
GPT-4o, May 13th (temp=0)	100	100	96	92	88	95.2%
GPT-4.1	97	97	96	93	92	94.9%
Grok 4	97	97	94	94	92	94.6%
GPT-5 Mini	97	95	94	94	92	94.5%
Stealth: Aurora Alpha	100	97	94	92	90	94.4%
Gemini 2.5 Pro	100	100	96	90	84	94.1%
Z.AI GLM 5	100	97	93	93	85	93.6%
Ministral 3 14B	100	100	93	90	83	93.3%
Qwen 3.5 Plus (2026-02-15)	96	93	93	93	89	93.0%
Arcee AI: Trinity Mini	100	93	92	91	86	92.2%
WizardLM 2 8x22b	100	94	94	90	82	92.0%
Claude Sonnet 4.5	100	96	96	92	75	91.7%
Claude Opus 4.6	95	95	92	89	86	91.5%
Ministral 3 3B	100	100	92	83	79	90.9%
Gemini 3 Pro (Preview)	94	93	93	90	84	90.8%
Ministral 3B	100	100	94	86	71	90.2%
Claude Sonnet 4.6	95	92	91	87	86	90.1%
Mistral Small 3.2 24B	99	99	98	87	67	90.1%
Llama 3.1 70B	100	98	94	86	72	90.0%
Ministral 3 8B	92	92	92	90	83	90.0%
Mistral Large 3	100	91	88	88	82	89.7%
GPT-5 Nano	92	90	90	89	88	89.7%
Ministral 8B	100	94	93	85	75	89.2%
Mistral Small Creative	95	94	86	86	85	89.2%
Mistral NeMO	96	95	93	86	76	89.0%
Z.AI GLM 4.7 Flash	92	91	89	86	82	88.0%
Mistral Large	94	94	91	89	72	87.9%
GPT-4o Mini (temp=0)	96	91	90	82	81	87.8%
Z.AI GLM 4.7	90	90	89	84	84	87.5%
Mistral Large 2	94	92	92	83	77	87.5%
Claude Opus 4.5	92	92	91	82	80	87.4%
GPT-4o, Aug. 6th (temp=0)	94	90	86	84	82	87.3%
Gemini 2.5 Flash	96	92	83	82	82	87.3%
Writer: Palmyra X5	92	90	86	86	82	87.2%
Z.AI GLM 4.6	96	90	85	84	80	87.0%
Claude Sonnet 4	92	91	91	85	75	86.7%
Hermes 3 405B	100	93	89	81	70	86.5%
Gemma 3 27B	95	94	91	77	71	85.6%
Llama 3.1 8B	93	92	88	85	69	85.5%
DeepSeek V3.2	97	87	82	81	77	84.8%
Gemini 2.5 Flash Lite	93	92	88	85	67	84.8%
GPT-4o Mini (temp=1)	100	96	80	75	72	84.6%
Claude 3.5 Sonnet	100	93	93	86	52	84.6%
DeepSeek V3.1	95	93	82	79	73	84.3%
Qwen 2.5 72B	88	84	84	82	81	83.9%
GPT-4o, Aug. 6th (temp=1)	100	84	81	80	73	83.5%
Claude Opus 4	92	89	86	86	63	83.1%
Hermes 3 70B	100	100	75	74	65	82.8%
Minimax M2.5	97	87	82	76	71	82.6%
Arcee AI: Trinity Large (Preview)	95	84	83	79	69	82.0%
GPT-4.1 Mini	89	88	87	75	70	81.8%
DeepSeek V3 (2025-03-24)	91	90	84	72	70	81.3%
DeepSeek-V2 Chat	94	91	80	76	65	81.2%
GPT-4o, May 13th (temp=1)	93	87	79	74	70	80.6%
Llama 3.1 Nemotron 70B	100	88	79	75	59	80.3%
Rocinante 12B	96	86	84	75	56	79.1%
Z.AI GLM 4.5	91	90	82	70	63	79.1%
Claude 3 Haiku	86	85	77	73	73	79.0%
DeepSeek V3 (2024-12-26)	83	82	81	77	71	78.7%
Gemma 3 4B	84	80	78	77	69	77.7%
Claude 3.5 Haiku	100	86	84	66	51	77.4%
Claude 3.7 Sonnet	92	81	81	69	62	77.1%
Gemma 3 12B	86	77	74	72	70	76.0%
Claude Haiku 4.5	88	78	77	71	65	75.8%
GPT-4.1 Nano	82	74	71	68	58	70.7%

▼

Romance: separated couple reunites

Model	# 1	# 2	# 3	# 4	# 5	Avg ▼
Gemini 3.1 Pro (Preview)	100	100	100	100	100	100.0%
GPT-5.2	100	100	98	98	98	98.7%
Grok 4.1 Fast	100	100	97	97	96	98.1%
ByteDance Seed 1.6 Flash	100	100	98	96	96	97.9%
o4 Mini High	100	100	100	96	93	97.9%
GPT-5	100	98	98	97	96	97.8%
o4 Mini	100	100	96	96	95	97.5%
Grok 4 Fast	100	97	97	97	96	97.4%
Mistral Large	100	100	100	94	89	96.7%
GPT-5.1	100	98	96	96	93	96.6%
Qwen 3.5 397B A17B	100	98	96	94	93	96.2%
Gemini 3 Flash (Preview)	97	96	95	95	94	95.4%
GPT-5 Mini	100	96	96	94	90	95.1%
Ministral 3 14B	100	100	100	100	74	94.7%
MoonshotAI: Kimi K2.5	100	100	94	92	87	94.7%
Mistral Large 3	96	95	94	94	92	94.1%
GPT-4.1	100	96	96	90	88	93.8%
ByteDance Seed 1.6	97	93	93	93	92	93.6%
Claude Opus 4.6	97	97	93	92	87	93.1%
Mistral Medium 3.1	96	96	92	90	90	92.7%
Qwen 2.5 72B	100	95	91	89	88	92.6%
Mistral Large 2	100	100	94	87	80	92.2%
Z.AI GLM 5	97	93	91	91	86	91.6%
Grok 4	97	91	91	91	86	91.3%
Claude Sonnet 4.5	100	96	92	87	80	90.9%
Claude 3.5 Sonnet	100	100	93	86	76	90.9%
Gemini 3 Pro (Preview)	95	93	90	89	87	90.8%
GPT-5 Nano	93	92	90	90	88	90.6%
WizardLM 2 8x22b	100	92	90	86	84	90.3%
Minimax M2.5	93	92	92	92	80	89.7%
DeepSeek V3.2	96	94	93	80	80	88.9%
Stealth: Aurora Alpha	94	90	87	87	85	88.7%
Writer: Palmyra X5	100	100	85	79	79	88.6%
DeepSeek V3 (2025-03-24)	100	95	94	84	71	88.6%
GPT-4o, Aug. 6th (temp=0)	95	90	86	84	83	87.9%
Mistral Small Creative	92	92	90	83	80	87.4%
Mistral NeMO	95	94	89	88	71	87.4%
Claude Haiku 4.5	91	90	89	84	82	87.3%
Qwen 3.5 Plus (2026-02-15)	94	91	87	85	79	87.1%
Z.AI GLM 4.6	94	88	88	85	81	87.1%
Ministral 8B	100	94	83	80	76	86.6%
Claude Opus 4.5	91	91	88	83	77	85.9%
Cohere Command R+ (Aug. 2024)	94	91	84	84	76	85.9%
Llama 3.1 Nemotron 70B	94	93	88	87	67	85.8%
Z.AI GLM 4.7 Flash	92	89	86	83	78	85.6%
Ministral 3B	94	94	93	77	70	85.6%
Z.AI GLM 4.7	94	87	84	82	80	85.3%
GPT-4o Mini (temp=0)	95	90	85	79	77	85.1%
Ministral 3 8B	94	89	84	83	75	85.0%
Gemma 3 27B	100	86	82	81	71	84.1%
Hermes 3 70B	94	91	84	82	67	83.6%
DeepSeek V3 (2024-12-26)	94	89	85	82	67	83.3%
Gemini 2.5 Pro	92	89	82	80	73	83.3%
Ministral 3 3B	100	90	89	79	57	83.2%
Gemini 2.5 Flash	95	87	86	73	72	82.5%
Llama 3.1 8B	92	89	86	83	62	82.5%
Gemma 3 12B	96	92	83	71	70	82.3%
Claude Sonnet 4	90	88	82	79	69	81.7%
Claude Opus 4	88	86	81	80	71	81.1%
Llama 3.1 70B	100	92	84	80	49	80.9%
Z.AI GLM 4.5	92	87	82	78	64	80.5%
Arcee AI: Trinity Large (Preview)	87	83	83	75	73	80.3%
DeepSeek V3.1	91	85	81	77	64	79.8%
Arcee AI: Trinity Mini	84	82	81	80	69	79.2%
DeepSeek-V2 Chat	85	82	78	75	69	77.7%
GPT-4o, May 13th (temp=0)	91	88	70	67	66	76.3%
GPT-4o, Aug. 6th (temp=1)	83	81	76	72	67	75.6%
GPT-4o Mini (temp=1)	86	83	77	75	55	75.3%
Hermes 3 405B	100	78	72	65	54	73.8%
Claude 3.7 Sonnet	90	85	72	65	50	72.6%
Gemini 2.5 Flash Lite	75	73	71	71	68	71.4%
GPT-4o, May 13th (temp=1)	94	84	68	62	43	70.3%
Rocinante 12B	91	86	78	76	19	70.0%
Gemma 3 4B	85	77	70	59	57	69.6%
Claude Sonnet 4.6	80	70	69	64	58	68.3%
GPT-4.1 Mini	74	74	73	59	55	67.0%
GPT-4.1 Nano	80	72	64	60	52	65.6%
Mistral Small 3.2 24B	94	68	50	46	30	57.6%
Claude 3 Haiku	72	59	58	51	37	55.5%
Claude 3.5 Haiku	100	59	44	41	13	51.3%

▼

Thriller: chase through city streets

Model	# 1	# 2	# 3	# 4	# 5	Avg ▼
Grok 4.1 Fast	100	100	100	100	100	100.0%
GPT-5	100	100	100	100	98	99.6%
GPT-5.2	100	100	100	100	98	99.5%
Grok 4	100	100	100	100	97	99.4%
ByteDance Seed 1.6	100	100	100	100	97	99.3%
GPT-4.1	100	100	100	100	96	99.2%
o4 Mini High	100	100	100	100	96	99.2%
o4 Mini	100	100	100	100	95	99.0%
MoonshotAI: Kimi K2.5	100	100	100	100	95	99.0%
Grok 4 Fast	100	100	100	97	96	98.5%
Stealth: Aurora Alpha	100	100	100	97	95	98.5%
Claude 3.5 Sonnet	100	100	100	100	92	98.3%
GPT-5 Mini	100	100	98	98	95	98.2%
Qwen 3.5 397B A17B	100	100	100	96	95	98.2%
GPT-5.1	100	98	98	98	97	98.1%
ByteDance Seed 1.6 Flash	100	100	100	95	94	98.0%
Mistral Large	100	100	100	95	93	97.5%
Arcee AI: Trinity Mini	100	100	100	94	93	97.4%
Claude Sonnet 4.5	100	100	96	96	93	96.9%
Gemini 3.1 Pro (Preview)	100	100	96	94	93	96.6%
Mistral Large 3	100	100	100	94	89	96.5%
Z.AI GLM 5	100	100	97	93	91	96.0%
Mistral Medium 3.1	100	100	100	95	84	95.9%
Ministral 3B	100	100	100	92	88	95.9%
Gemini 2.5 Pro	100	100	96	96	87	95.8%
GPT-4o Mini (temp=1)	100	96	95	95	91	95.5%
Mistral Small Creative	100	100	96	95	86	95.3%
Claude Opus 4	100	96	95	94	91	95.2%
Z.AI GLM 4.7	100	97	96	96	87	95.1%
Z.AI GLM 4.7 Flash	100	96	96	94	89	95.0%
Claude Opus 4.6	100	95	95	94	90	94.9%
Llama 3.1 8B	100	100	94	91	89	94.9%
GPT-4o, Aug. 6th (temp=1)	96	96	95	95	90	94.3%
WizardLM 2 8x22b	100	96	96	92	86	94.1%
Claude Opus 4.5	97	97	95	91	89	94.0%
Ministral 3 14B	100	94	93	93	90	94.0%
Mistral Small 3.2 24B	100	99	91	91	89	93.9%
Ministral 3 8B	100	100	91	90	88	93.9%
Gemini 3 Flash (Preview)	96	96	94	94	88	93.7%
Ministral 8B	100	100	100	87	82	93.6%
Mistral Large 2	100	94	93	92	88	93.6%
DeepSeek V3.2	100	97	95	90	85	93.4%
GPT-5 Nano	96	95	94	91	90	93.3%
Claude Sonnet 4.6	100	95	91	90	90	93.3%
Claude Haiku 4.5	96	96	95	92	87	93.2%
Gemini 3 Pro (Preview)	100	97	95	95	76	92.7%
Ministral 3 3B	100	100	92	92	78	92.5%
Gemini 2.5 Flash	100	94	92	89	86	92.4%
DeepSeek-V2 Chat	100	96	90	90	85	92.3%
GPT-4o, May 13th (temp=1)	96	95	93	91	87	92.3%
Z.AI GLM 4.6	100	92	90	90	88	92.1%
Rocinante 12B	100	100	92	91	78	92.1%
GPT-4o, Aug. 6th (temp=0)	100	95	90	88	87	92.0%
Qwen 3.5 Plus (2026-02-15)	100	97	90	89	84	92.0%
Writer: Palmyra X5	100	100	96	92	73	92.0%
Minimax M2.5	96	93	90	90	89	91.7%
Gemini 2.5 Flash Lite	94	92	91	90	89	91.0%
Llama 3.1 Nemotron 70B	100	94	92	86	80	90.6%
GPT-4o Mini (temp=0)	100	96	91	90	76	90.5%
Llama 3.1 70B	100	100	85	85	81	90.4%
Gemma 3 27B	96	91	90	90	83	90.0%
Qwen 2.5 72B	95	92	90	89	84	89.9%
Cohere Command R+ (Aug. 2024)	95	95	94	84	81	89.8%
GPT-4.1 Mini	100	95	87	85	82	89.7%
DeepSeek V3 (2024-12-26)	92	90	90	89	78	88.0%
DeepSeek V3.1	95	93	86	86	80	87.9%
Claude Sonnet 4	100	95	86	79	78	87.6%
Gemma 3 4B	92	89	88	88	78	87.0%
DeepSeek V3 (2025-03-24)	100	94	94	82	62	86.5%
Hermes 3 405B	92	91	91	82	72	85.6%
Mistral NeMO	95	90	84	83	76	85.5%
Z.AI GLM 4.5	93	92	87	82	70	85.0%
GPT-4o, May 13th (temp=0)	100	96	77	76	74	84.6%
Gemma 3 12B	100	87	82	81	71	84.0%
Arcee AI: Trinity Large (Preview)	94	84	81	77	77	82.8%
Hermes 3 70B	93	82	80	79	78	82.3%
Claude 3.7 Sonnet	97	87	81	73	70	81.6%
Claude 3 Haiku	83	83	81	74	66	77.6%
GPT-4.1 Nano	84	84	84	68	65	77.0%
Claude 3.5 Haiku	82	77	61	54	12	57.1%

AI-ism adverb frequency

Overall Performance

Performance Score Distribution (Top 20)

Price-Performance Score Distribution (Top 20)

Most Stable Models (Top 20)

Top Overall Models (Top 20)

Individual Scenarios

Detailed Writing Rules

Fantasy: entering an ancient ruin

Horror: alone in an eerie place at night

Literary fiction: old friends reunite

Mystery: examining a crime scene

Romance: separated couple reunites

Thriller: chase through city streets

genre

Fantasy: entering an ancient ruin

Horror: alone in an eerie place at night

Literary fiction: old friends reunite

Mystery: examining a crime scene

Romance: separated couple reunites

Thriller: chase through city streets

Novelcrafter Default Prompt

Fantasy: entering an ancient ruin

Horror: alone in an eerie place at night

Literary fiction: old friends reunite

Mystery: examining a crime scene

Romance: separated couple reunites

Thriller: chase through city streets