AI-ism word frequency

Test: Bad Writing Habits

Avg. Score

39.0%

Scenarios

Overall Performance

Performance Score Distribution (Top 20)

Click a model name to view its detail page.

Rank ▲	Model	Score	Avg. Cost	Avg. Time	Stability
1	ByteDance Seed 1.6 Flash	69.0%	$0.0013	27.3s	51%
2	GPT-5.4 Mini (Reasoning)	71.2%	$0.022	28.1s	55%
3	GPT-5.4 Mini	68.1%	$0.015	16.8s	53%
4	ByteDance Seed 2.0 Lite	76.3%	$0.012	2.2m	63%
5	GPT-5.4 Mini (Reasoning, Low)	68.0%	$0.015	16.8s	51%
6	Claude Opus 4.7	79.2%	$0.069	30.4s	60%
7	Claude Opus 4.7 (Reasoning)	78.1%	$0.076	32.0s	58%
8	GPT-5 Mini	66.0%	$0.0100	57.4s	49%
9	Claude Sonnet 4.6	70.0%	$0.031	39.3s	48%
10	GPT-5.4	73.9%	$0.049	1.4m	57%
11	GPT-5.4 (Reasoning, Low)	73.0%	$0.055	1.4m	58%
12	GPT-5.4 Nano (Reasoning, Low)	57.9%	$0.0055	20.6s	42%
13	Claude Opus 4.8 (Reasoning)	71.6%	$0.071	41.7s	53%
14	GPT-5.4 Nano	55.5%	$0.0057	26.3s	42%
15	GPT-5.4 Nano (Reasoning)	56.3%	$0.0061	24.5s	40%
16	MiniMax M3	71.2%	$0.0060	3.1m	54%
17	MiniMax M2.5	60.5%	$0.0034	1.3m	44%
18	Claude Opus 4.8 (Reasoning, Low)	71.5%	$0.071	41.9s	49%
19	Z.AI GLM 5 Turbo	60.3%	$0.0081	33.2s	37%
20	Claude Sonnet 4.6 (Reasoning)	71.3%	$0.060	1.2m	50%
21	Claude Haiku 4.5	57.4%	$0.011	21.6s	38%
22	MiniMax M2.7	58.4%	$0.0040	1.1m	40%
23	DeepSeek V4 Flash	54.9%	$0.0006	31.6s	35%
24	GPT-5	74.2%	$0.065	2.8m	61%
25	DeepSeek V4 Pro	57.6%	$0.0048	1.3m	40%
26	Grok 4.20 (Beta)	51.0%	$0.018	15.8s	38%
27	DeepSeek V4 Flash (Reasoning)	52.8%	$0.0007	31.1s	33%
28	Z.AI GLM 5	54.8%	$0.0084	1.2m	39%
29	Grok 4.20	50.1%	$0.0093	45.7s	37%
30	GPT-5.2	61.5%	$0.056	1.5m	48%
31	GPT-5.1	63.4%	$0.054	1.8m	48%
32	GPT-5.4 (Reasoning)	73.5%	$0.089	2.6m	58%
33	Grok 4.3	48.7%	$0.0069	30.5s	33%
34	Qwen 3.5 Flash	47.5%	$0.0025	47.5s	34%
35	GPT-5.5	74.4%	$0.139	1.7m	62%
36	Claude Opus 4.6	63.6%	$0.078	1.2m	47%
37	Qwen 3.5 9B	55.4%	$0.0011	1.4m	32%
38	Claude Sonnet 4.5	54.6%	$0.035	38.1s	35%
39	Writer: Palmyra X5	46.6%	$0.011	22.0s	32%
40	Grok 4.20 (Beta, Reasoning)	53.1%	$0.039	34.0s	37%
41	GPT-5.5 (Reasoning)	74.8%	$0.142	1.8m	62%
42	GPT-5.5 (Reasoning, Low)	74.4%	$0.139	1.8m	60%
43	Gemini 3.5 Flash (Reasoning, Minimal)	44.5%	$0.018	12.0s	31%
44	GPT-5 Nano	46.6%	$0.0042	1.4m	36%
45	Z.AI GLM 4.7 Flash	45.8%	$0.0017	1.2m	33%
46	Gemini 3 Flash (Preview)	41.1%	$0.0078	19.6s	30%
47	Claude Opus 4.5	58.0%	$0.070	53.4s	41%
48	Z.AI GLM 5.1	52.7%	$0.014	1.5m	34%
49	ByteDance Seed 2.0 Mini	68.6%	$0.0045	4.9m	51%
50	Grok 4.20 (Reasoning)	49.4%	$0.018	1.5m	36%
51	Z.AI GLM 4.7	47.8%	$0.010	1.4m	34%
52	Skyfall 36B V2	45.3%	$0.0019	23.1s	23%
53	Claude Opus 4.6 (Reasoning)	62.7%	$0.088	1.4m	44%
54	Z.AI GLM 4.5	43.0%	$0.0051	42.1s	28%
55	Mistral Small 4 (Reasoning)	41.5%	$0.0022	30.2s	27%
56	Qwen3 235B A22B Instruct 2507	43.8%	$0.0011	59.2s	28%
57	Xiaomi MIMO v2.5	44.0%	$0.0054	31.8s	25%
58	Claude 3.7 Sonnet	49.1%	$0.042	46.7s	33%
59	Xiaomi MIMO v2.5 Pro	45.5%	$0.0085	53.5s	26%
60	Mistral Medium 3.1	39.0%	$0.0048	36.5s	27%
61	Mistral Small Creative	35.9%	$0.0007	9.1s	24%
62	Mistral Small 4	37.0%	$0.0014	18.2s	25%
63	ByteDance Seed 1.6	54.6%	$0.013	2.5m	34%
64	Qwen 3.5 122B	46.4%	$0.025	1.1m	31%
65	Qwen 3.5 Plus (2026-02-15)	38.7%	$0.0060	31.5s	26%
66	Qwen 3.5 35B	47.0%	$0.018	1.0m	27%
67	Qwen 3 32B	40.4%	$0.0015	54.6s	25%
68	Stealth: Healer Alpha	37.4%	$0.0000	23.7s	22%
69	Cydonia 24B V4.1	38.8%	$0.0014	44.8s	25%
70	Rocinante 12B	43.1%	$0.0014	38.4s	20%
71	Stealth: Hunter Alpha	39.5%	$0.0000	55.0s	24%
72	Gemini 3 Flash (Preview, Reasoning)	37.3%	$0.012	30.1s	26%
73	DeepSeek V4 Pro (Reasoning)	54.2%	$0.015	3.1m	37%
74	Aion 2.0	40.3%	$0.0064	1.3m	28%
75	Grok 4.3 (Reasoning)	50.3%	$0.021	2.3m	33%
76	Ministral 3 14B	33.3%	$0.0007	11.7s	20%
77	Llama 3.1 8B	38.7%	$0.0003	1.3m	26%
78	Z.AI GLM 4.5 Air	38.0%	$0.0029	58.2s	23%
79	GPT-4.1	38.0%	$0.018	44.7s	25%
80	DeepSeek V3 (2025-03-24)	35.9%	$0.0014	39.4s	20%
81	Mistral Large 2	36.8%	$0.013	29.4s	21%
82	Qwen 3.6 Flash	36.3%	$0.010	41.4s	22%
83	Mistral Large 3	34.9%	$0.0033	30.3s	20%
84	Qwen 3.5 27B	44.5%	$0.020	1.6m	28%
85	Gemini 3 Pro (Preview)	45.0%	$0.055	54.4s	31%
86	Mistral Large	36.5%	$0.014	30.9s	21%
87	Arcee AI: Trinity Large (Preview)	35.7%	$0.0000	43.6s	19%
88	DeepSeek V3.2	39.2%	$0.0014	1.9m	26%
89	Claude Sonnet 4	39.2%	$0.032	43.7s	24%
90	Ministral 8B	27.1%	$0.0004	10.4s	15%
91	Qwen 3.5 397B A17B	46.8%	$0.014	3.0m	31%
92	Qwen 3.6 35B	33.5%	$0.0083	1.0m	21%
93	Gemini 3.5 Flash (Reasoning)	42.3%	$0.071	37.6s	29%
94	Z.AI GLM 4.6	31.3%	$0.0065	51.5s	18%
95	Ministral 3 8B	28.3%	$0.0008	19.6s	14%
96	Gemini 3.1 Flash Lite (Preview)	23.8%	$0.0030	8.4s	15%
97	MoonshotAI: Kimi K2.5	46.4%	$0.019	3.2m	31%
98	Qwen 3.5 Plus (2026-04-20)	35.5%	$0.017	1.8m	24%
99	Hermes 3 70B	29.9%	$0.0010	1.2m	18%
100	Hermes 3 405B	31.9%	$0.0032	53.2s	14%
101	Gemini 3.1 Flash Lite	23.3%	$0.0030	12.1s	13%
102	Gemini 3.1 Flash Lite (Reasoning)	22.5%	$0.0030	11.9s	13%
103	Claude 3.5 Sonnet	33.9%	$0.048	35.5s	19%
104	WizardLM 2 8x22b	33.8%	$0.0026	1.8m	17%
105	DeepSeek V3.1	30.3%	$0.0020	1.8m	19%
106	Gemma 3 27B	21.0%	$0.0006	52.6s	16%
107	DeepSeek V3 (2024-12-26)	23.8%	$0.0021	54.6s	13%
108	Gemini 2.5 Pro	26.5%	$0.036	36.2s	16%
109	DeepSeek-V2 Chat	21.9%	$0.0021	53.3s	12%
110	Gemma 4 31B	24.8%	$0.0010	1.6m	16%
111	Ministral 3B	17.3%	$0.0001	8.1s	7%
112	Qwen 3.6 27B	33.6%	$0.025	2.3m	22%
113	Grok 4 Fast	15.1%	$0.0017	24.1s	11%
114	Gemma 4 26B	19.6%	$0.0009	55.1s	12%
115	o4 Mini	17.6%	$0.015	25.7s	12%
116	LFM2 24B	18.4%	$0.0002	28.4s	7%
117	Grok 4.1 Fast	16.9%	$0.0018	37.8s	10%
118	Ministral 3 3B	13.5%	$0.0005	11.1s	5%
119	Qwen3.7 Max	38.8%	$0.068	2.3m	25%
120	Gemma 4 31B (Reasoning)	23.8%	$0.0014	2.2m	14%
121	Arcee AI: Trinity Mini	12.9%	$0.0003	9.2s	0%
122	Gemini 2.5 Flash	12.6%	$0.0052	10.6s	2%
123	Nemotron 3 Super	16.4%	$0.0000	1.4m	10%
124	Gemma 3 12B	13.0%	$0.0004	41.3s	5%
125	Mistral NeMO	10.6%	$0.0005	10.1s	1%
126	o4 Mini High	16.1%	$0.025	47.2s	9%
127	Qwen3.6 Max Preview	39.6%	$0.050	3.5m	25%
128	GPT-4.1 Mini	11.7%	$0.0027	19.0s	0%
129	Llama 3.1 70B	13.3%	$0.0015	29.4s	0%
130	Cohere Command R+ (Aug. 2024)	19.9%	$0.020	52.5s	4%
131	Claude 3 Haiku	9.6%	$0.0025	14.9s	0%
132	Gemini 2.5 Flash Lite	7.9%	$0.0009	9.5s	0%
133	GPT-4.1 Nano	8.0%	$0.0007	13.3s	0%
134	Inception Mercury	12.7%	$0.011	17.6s	0%
135	Claude Opus 4	54.6%	$0.209	1.4m	37%
136	Gemma 3 4B	8.2%	$0.0002	20.0s	0%
137	Gemini 2.5 Flash (Reasoning)	11.1%	$0.011	21.5s	0%
138	Gemma 4 26B (Reasoning)	15.3%	$0.0013	2.0m	10%
139	Stealth: Aurora Alpha	4.5%	$0.0000	9.8s	0%
140	Inception Mercury 2	5.1%	$0.0032	7.0s	0%
141	Gemini 2.5 Flash Lite (Reasoning)	8.9%	$0.0028	30.8s	0%
142	Gemini 3.1 Pro (Preview)	34.5%	$0.107	1.8m	23%
143	Qwen 2.5 72B	7.9%	$0.0010	36.7s	0%
144	Grok 4	19.2%	$0.048	1.7m	13%
145	Llama 3.1 Nemotron 70B	4.9%	$0.0038	31.7s	0%
146	GPT-4o Mini (temp=1)	2.3%	$0.0012	34.8s	0%
147	MoonshotAI: Kimi K2.6	52.1%	$0.058	6.5m	35%
148	GPT-4o Mini (temp=0)	0.8%	$0.0012	34.8s	0%
149	GPT-4o, May 13th (temp=0)	8.9%	$0.035	14.1s	0%
150	Nemotron 3 Nano	6.2%	$0.0010	1.1m	0%
151	GPT-OSS 120B	9.9%	$0.0015	1.8m	4%
152	GPT-4o, May 13th (temp=1)	7.4%	$0.033	14.4s	0%
153	GPT-4o, Aug. 6th (temp=1)	2.8%	$0.018	24.4s	0%
154	GPT-4o, Aug. 6th (temp=0)	3.1%	$0.023	22.7s	0%
155	Mistral Small 3.2 24B	11.9%	$0.0069	5.7m	0%
39.03%

Individual Scenarios

Detailed Writing Rules

▼

Fantasy: entering an ancient ruin

Model	# 1	# 2	# 3	# 4	# 5	Avg ▼
ByteDance Seed 2.0 Lite	89	79	77	75	70	78.0%
Claude Opus 4.7	81	81	67	66	62	71.3%
GPT-5.5	78	77	74	69	58	71.1%
GPT-5.4	77	72	69	66	61	69.0%
Claude Opus 4.7 (Reasoning)	82	77	70	63	48	68.1%
ByteDance Seed 1.6 Flash	82	77	69	55	48	66.1%
Claude Opus 4.8 (Reasoning)	77	75	63	54	45	62.8%
GPT-5.4 Mini	71	66	65	58	53	62.7%
GPT-5	75	63	63	56	56	62.4%
GPT-5.4 Mini (Reasoning)	72	65	62	60	51	62.0%
GPT-5.4 (Reasoning)	71	64	59	58	49	60.3%
Claude Sonnet 4.6 (Reasoning)	82	78	62	46	32	60.1%
GPT-5.5 (Reasoning, Low)	74	68	65	49	38	58.9%
GPT-5.4 Mini (Reasoning, Low)	66	62	61	55	50	58.9%
GPT-5.4 (Reasoning, Low)	71	61	58	52	52	58.8%
GPT-5 Mini	76	60	59	51	48	58.7%
GPT-5.5 (Reasoning)	60	59	58	57	56	58.1%
GPT-5.2	67	66	59	51	44	57.4%
ByteDance Seed 2.0 Mini	78	60	59	42	35	54.8%
Claude Opus 4.8 (Reasoning, Low)	71	68	56	40	35	54.0%
Claude Sonnet 4.6	65	65	50	50	28	51.7%
GPT-5.1	68	60	43	41	37	49.8%
Claude Opus 4.6	64	49	46	45	44	49.5%
Grok 4.20 (Beta, Reasoning)	61	52	49	44	36	48.5%
MiniMax M3	56	52	52	43	37	48.2%
Qwen 3.5 35B	73	64	36	32	29	47.0%
Claude Opus 4.5	64	54	53	39	15	45.1%
Claude Opus 4	61	51	47	35	32	45.0%
Claude Opus 4.6 (Reasoning)	63	57	53	27	21	44.4%
Qwen 3.5 9B	66	54	50	49	2	44.1%
ByteDance Seed 1.6	63	50	37	36	30	43.0%
MiniMax M2.5	67	62	34	27	25	42.8%
Grok 4.20 (Reasoning)	62	55	41	34	19	41.9%
GPT-5.4 Nano (Reasoning)	54	43	42	38	31	41.6%
Qwen 3.5 Flash	57	51	41	39	16	41.0%
Claude 3.7 Sonnet	53	39	39	38	34	40.7%
Z.AI GLM 4.7	53	46	40	33	30	40.2%
GPT-5.4 Nano (Reasoning, Low)	49	44	44	35	29	40.2%
Z.AI GLM 4.7 Flash	59	54	46	41	0	40.0%
Writer: Palmyra X5	63	58	54	21	0	39.2%
Z.AI GLM 4.5	54	54	48	20	19	39.1%
Qwen 3.5 397B A17B	56	51	43	25	20	38.9%
Grok 4.20 (Beta)	59	38	37	34	26	38.9%
Grok 4.20	51	45	43	41	13	38.8%
Z.AI GLM 5.1	56	54	43	28	11	38.3%
Qwen3 235B A22B Instruct 2507	50	43	30	29	28	36.1%
Qwen 3.5 Plus (2026-02-15)	69	46	32	24	10	36.0%
GPT-5 Nano	41	41	36	34	27	35.7%
DeepSeek V4 Pro (Reasoning)	46	45	35	35	15	35.3%
Z.AI GLM 5 Turbo	57	50	31	30	8	35.3%
Gemini 3.5 Flash (Reasoning, Minimal)	56	51	46	11	10	34.8%
Grok 4.3 (Reasoning)	51	48	41	23	10	34.7%
Qwen 3.5 Plus (2026-04-20)	64	45	39	13	12	34.6%
Cydonia 24B V4.1	61	42	32	18	17	34.0%
Claude Haiku 4.5	45	35	32	32	24	33.6%
MiniMax M2.7	46	39	34	34	15	33.5%
DeepSeek V3 (2025-03-24)	54	43	37	32	0	33.3%
Rocinante 12B	58	57	39	11	0	33.0%
Qwen 3.5 27B	45	44	30	24	22	32.7%
GPT-5.4 Nano	43	36	32	32	21	32.6%
Z.AI GLM 4.5 Air	60	41	40	9	6	31.5%
Qwen 3.5 122B	48	43	27	20	15	30.6%
Grok 4.3	44	41	37	29	0	30.2%
Z.AI GLM 5	43	35	27	25	18	29.4%
Xiaomi MIMO v2.5 Pro	48	34	32	21	11	29.4%
Gemini 3 Flash (Preview)	45	39	28	20	15	29.2%
MoonshotAI: Kimi K2.5	62	24	23	21	13	28.7%
Hermes 3 70B	58	33	28	25	0	28.7%
Claude Sonnet 4.5	40	35	30	24	13	28.1%
DeepSeek V4 Pro	44	37	28	21	10	28.1%
Qwen 3 32B	48	46	37	7	0	27.7%
DeepSeek V4 Flash	46	34	29	22	7	27.6%
Gemini 3 Pro (Preview)	52	31	31	13	11	27.4%
Llama 3.1 8B	54	43	38	0	0	27.0%
Mistral Small 4 (Reasoning)	52	37	27	14	2	26.4%
Gemini 3.5 Flash (Reasoning)	42	38	25	22	2	25.7%
Qwen 3.6 Flash	50	28	26	22	0	25.1%
Aion 2.0	44	34	17	16	13	24.8%
Mistral Medium 3.1	35	32	26	18	12	24.7%
WizardLM 2 8x22b	53	38	31	0	0	24.4%
Gemini 3.1 Pro (Preview)	43	40	26	10	0	23.8%
Mistral Large 3	34	33	18	16	13	22.9%
Ministral 3 14B	49	43	21	1	0	22.7%
Qwen3.7 Max	33	31	30	17	0	22.1%
DeepSeek V3.2	47	24	21	18	0	22.0%
DeepSeek V4 Flash (Reasoning)	33	29	20	16	8	21.5%
Mistral Large	41	23	21	14	8	21.5%
Mistral Small 4	44	40	20	0	0	20.9%
Hermes 3 405B	39	28	24	14	0	20.9%
DeepSeek V3 (2024-12-26)	41	39	25	0	0	20.9%
Xiaomi MIMO v2.5	25	22	20	19	15	20.1%
MoonshotAI: Kimi K2.6	46	34	18	0	0	19.6%
GPT-4.1	30	20	19	14	13	19.5%
Mistral Large 2	41	22	19	15	0	19.5%
Qwen3.6 Max Preview	42	30	22	3	0	19.2%
Stealth: Healer Alpha	37	29	14	13	2	19.0%
Inception Mercury	94	0	0	0	0	18.9%
Llama 3.1 70B	88	0	0	0	0	17.6%
Gemini 2.5 Pro	33	28	14	13	0	17.5%
Ministral 3B	67	20	0	0	0	17.4%
Claude 3.5 Sonnet	27	24	16	16	1	16.7%
Skyfall 36B V2	33	19	17	14	0	16.6%
Gemini 3.1 Flash Lite	38	37	4	0	0	15.8%
Mistral Small Creative	24	23	14	14	0	15.0%
Qwen 3.6 27B	31	21	18	5	0	14.9%
Stealth: Hunter Alpha	44	15	13	0	0	14.4%
Arcee AI: Trinity Large (Preview)	40	31	2	0	0	14.4%
Ministral 3 8B	28	26	15	0	0	13.9%
Gemma 4 26B	32	10	10	1	0	10.5%
Z.AI GLM 4.6	19	14	12	5	0	10.1%
Cohere Command R+ (Aug. 2024)	50	0	0	0	0	10.1%
Gemini 3.1 Flash Lite (Preview)	23	20	8	0	0	10.0%
Gemini 3.1 Flash Lite (Reasoning)	21	14	8	4	3	9.9%
Claude Sonnet 4	37	5	3	0	0	9.0%
DeepSeek-V2 Chat	30	14	0	0	0	8.7%
Grok 4.1 Fast	17	12	9	0	0	7.7%
Arcee AI: Trinity Mini	37	0	0	0	0	7.3%
DeepSeek V3.1	18	12	7	0	0	7.3%
Gemini 3 Flash (Preview, Reasoning)	13	12	9	2	0	7.2%
Ministral 8B	29	5	0	0	0	6.8%
Gemma 4 31B	14	8	6	2	0	5.9%
Mistral NeMO	11	10	0	0	0	4.3%
Gemma 3 27B	13	7	0	0	0	4.1%
Qwen 3.6 35B	10	8	0	0	0	3.8%
LFM2 24B	17	0	0	0	0	3.4%
Nemotron 3 Super	15	0	0	0	0	3.1%
Ministral 3 3B	12	0	0	0	0	2.4%
Grok 4 Fast	10	1	0	0	0	2.2%
Gemini 2.5 Flash	5	0	0	0	0	1.1%
GPT-4o, May 13th (temp=1)	4	0	0	0	0	0.8%
Gemma 3 4B	3	0	0	0	0	0.7%
Mistral Small 3.2 24B	3	0	0	0	0	0.6%
Nemotron 3 Nano	2	0	0	0	0	0.4%
Gemma 4 31B (Reasoning)	0	0	0	0	0	0.0%
Gemma 4 26B (Reasoning)	0	0	0	0	0	0.0%
o4 Mini High	0	0	0	0	0	0.0%
Grok 4	0	0	0	0	0	0.0%
o4 Mini	0	0	0	0	0	0.0%
GPT-OSS 120B	0	0	0	0	0	0.0%
GPT-4o, May 13th (temp=0)	0	0	0	0	0	0.0%
Gemini 2.5 Flash (Reasoning)	0	0	0	0	0	0.0%
Stealth: Aurora Alpha	0	0	0	0	0	0.0%
Gemini 2.5 Flash Lite (Reasoning)	0	0	0	0	0	0.0%
GPT-4o, Aug. 6th (temp=0)	0	0	0	0	0	0.0%
Inception Mercury 2	0	0	0	0	0	0.0%
GPT-4.1 Mini	0	0	0	0	0	0.0%
GPT-4o, Aug. 6th (temp=1)	0	0	0	0	0	0.0%
Gemini 2.5 Flash Lite	0	0	0	0	0	0.0%
GPT-4o Mini (temp=1)	0	0	0	0	0	0.0%
GPT-4o Mini (temp=0)	0	0	0	0	0	0.0%
Gemma 3 12B	0	0	0	0	0	0.0%
Llama 3.1 Nemotron 70B	0	0	0	0	0	0.0%
Qwen 2.5 72B	0	0	0	0	0	0.0%
Claude 3 Haiku	0	0	0	0	0	0.0%
GPT-4.1 Nano	0	0	0	0	0	0.0%

▼

Horror: alone in an eerie place at night

Model	# 1	# 2	# 3	# 4	# 5	Avg ▼
ByteDance Seed 2.0 Mini	87	84	80	71	61	76.5%
GPT-5.5 (Reasoning)	75	71	71	70	70	71.6%
GPT-5	74	73	70	69	65	70.1%
GPT-5.4	76	76	75	66	58	70.0%
GPT-5.5	75	73	68	68	59	68.9%
Claude Opus 4.7 (Reasoning)	77	71	70	67	55	68.1%
GPT-5.5 (Reasoning, Low)	77	71	64	62	60	66.5%
GPT-5.4 (Reasoning, Low)	79	76	66	57	43	64.3%
ByteDance Seed 2.0 Lite	79	71	58	57	44	61.8%
GPT-5.4 (Reasoning)	71	70	58	55	53	61.4%
GPT-5.4 Mini	78	66	61	49	47	60.2%
ByteDance Seed 1.6 Flash	75	63	58	54	48	59.5%
MiniMax M3	75	60	60	52	49	59.3%
Claude Opus 4.8 (Reasoning)	82	74	58	45	37	59.2%
GPT-5.4 Mini (Reasoning, Low)	68	61	59	53	51	58.5%
Claude Opus 4.7	76	66	51	47	43	56.7%
Rocinante 12B	100	75	53	36	14	55.4%
Claude Opus 4.6	70	66	49	46	41	54.6%
Claude Opus 4.8 (Reasoning, Low)	63	57	55	50	43	53.6%
GPT-5.1	73	59	50	49	36	53.6%
GPT-5.4 Mini (Reasoning)	77	52	50	49	38	53.2%
Qwen 3.5 27B	67	54	52	40	40	50.8%
Grok 4.20 (Beta)	62	50	49	48	36	49.0%
GPT-5.2	65	51	50	50	19	47.0%
GPT-5 Mini	62	60	49	35	25	46.4%
MiniMax M2.7	68	49	49	38	28	46.4%
Qwen 3.5 9B	82	49	43	43	14	46.3%
MiniMax M2.5	66	57	54	27	27	46.3%
GPT-5.4 Nano (Reasoning)	57	52	47	37	36	45.7%
Claude Opus 4	64	60	37	36	29	45.4%
DeepSeek V4 Pro	56	50	42	40	39	45.3%
Qwen 3.5 397B A17B	58	53	44	40	31	45.3%
Claude Sonnet 4.5	74	52	47	34	18	45.2%
Claude Opus 4.6 (Reasoning)	61	52	45	40	27	45.0%
Claude Haiku 4.5	69	49	41	35	31	44.9%
DeepSeek V4 Flash	69	56	43	29	27	44.9%
Grok 4.3	55	49	45	45	24	43.7%
Qwen 3 32B	62	51	45	35	23	43.2%
Grok 4.20	53	51	37	37	32	42.2%
Qwen 3.5 Flash	62	49	43	37	15	41.3%
Z.AI GLM 5 Turbo	73	59	51	12	10	41.2%
Qwen 3.5 122B	55	52	42	34	23	41.2%
ByteDance Seed 1.6	46	45	40	35	35	40.2%
GPT-5.4 Nano (Reasoning, Low)	66	54	30	27	25	40.2%
Z.AI GLM 4.7	55	52	44	35	13	40.0%
Grok 4.20 (Reasoning)	44	42	42	38	33	39.7%
Arcee AI: Trinity Large (Preview)	72	46	32	23	22	39.0%
Claude Opus 4.5	48	44	40	31	31	38.8%
GPT-5 Nano	49	40	38	35	30	38.4%
Z.AI GLM 4.7 Flash	51	51	40	32	18	38.3%
Claude Sonnet 4.6	60	37	36	32	26	38.1%
DeepSeek V4 Pro (Reasoning)	56	41	37	33	22	37.9%
Claude Sonnet 4.6 (Reasoning)	55	47	34	33	20	37.9%
Z.AI GLM 5	63	40	38	25	21	37.3%
Z.AI GLM 5.1	64	35	33	30	23	36.8%
MoonshotAI: Kimi K2.5	61	38	31	29	23	36.2%
Qwen 3.5 35B	44	42	40	32	23	36.2%
Gemini 3.5 Flash (Reasoning)	44	36	34	33	31	35.6%
MoonshotAI: Kimi K2.6	43	39	36	33	27	35.5%
Gemini 3 Flash (Preview, Reasoning)	40	38	36	35	25	34.8%
Skyfall 36B V2	71	40	33	28	0	34.4%
GPT-5.4 Nano	46	44	32	25	22	33.7%
Qwen 3.5 Plus (2026-02-15)	52	37	32	31	15	33.6%
Gemini 3 Pro (Preview)	48	44	32	29	14	33.3%
Hermes 3 405B	60	54	39	13	0	33.2%
DeepSeek V4 Flash (Reasoning)	64	52	24	22	4	33.0%
DeepSeek V3 (2025-03-24)	66	53	39	7	0	32.9%
Gemini 3 Flash (Preview)	51	38	29	28	20	32.9%
Qwen3 235B A22B Instruct 2507	51	39	30	28	11	31.8%
Qwen3.7 Max	41	31	31	27	24	30.9%
Grok 4.3 (Reasoning)	60	33	31	29	0	30.6%
Qwen 3.6 Flash	68	46	23	12	0	29.9%
Claude 3.7 Sonnet	41	39	35	18	14	29.6%
Xiaomi MIMO v2.5 Pro	43	37	25	23	15	28.4%
Qwen3.6 Max Preview	41	35	34	22	9	28.2%
Grok 4.20 (Beta, Reasoning)	47	37	18	17	15	27.0%
WizardLM 2 8x22b	45	41	27	15	0	25.8%
Writer: Palmyra X5	38	30	25	19	14	25.2%
Aion 2.0	34	34	29	20	9	25.1%
DeepSeek V3 (2024-12-26)	67	52	0	0	0	23.8%
Mistral Small Creative	50	29	25	9	4	23.5%
Gemini 3.1 Flash Lite (Reasoning)	68	19	13	12	4	23.3%
Gemini 3.5 Flash (Reasoning, Minimal)	34	32	23	20	4	22.9%
DeepSeek V3.2	36	34	27	16	0	22.5%
Mistral Medium 3.1	32	30	23	16	9	22.1%
GPT-4.1	33	26	19	18	14	22.0%
Claude Sonnet 4	46	37	26	0	0	21.9%
Gemini 3.1 Pro (Preview)	46	40	19	3	0	21.7%
Stealth: Healer Alpha	48	26	13	11	5	20.6%
Cydonia 24B V4.1	32	27	20	18	0	19.4%
Claude 3.5 Sonnet	40	35	21	0	0	19.3%
Llama 3.1 8B	51	21	17	0	0	18.1%
Gemini 3.1 Flash Lite	29	27	17	6	5	16.8%
Hermes 3 70B	61	19	0	0	0	16.2%
Z.AI GLM 4.5 Air	39	26	14	0	0	15.8%
Mistral Large 2	49	19	9	0	0	15.4%
DeepSeek-V2 Chat	75	0	0	0	0	15.0%
Qwen 3.5 Plus (2026-04-20)	29	28	10	7	0	14.6%
Mistral Large	42	17	8	5	0	14.6%
Xiaomi MIMO v2.5	39	15	12	4	1	14.3%
Mistral Small 4	28	22	18	0	0	13.5%
Z.AI GLM 4.5	34	16	15	1	0	13.3%
Llama 3.1 70B	62	0	0	0	0	12.4%
Qwen 3.6 27B	32	19	10	0	0	12.3%
Gemma 4 31B	23	15	12	10	0	12.0%
Mistral Small 4 (Reasoning)	33	18	6	4	0	11.9%
Stealth: Hunter Alpha	34	12	9	1	0	11.2%
Ministral 3 8B	27	19	9	0	0	10.8%
Gemini 2.5 Pro	27	26	0	0	0	10.6%
Qwen 3.6 35B	29	18	6	0	0	10.5%
Grok 4.1 Fast	27	13	10	0	0	10.0%
Gemini 3.1 Flash Lite (Preview)	24	15	8	0	0	9.3%
Gemma 3 27B	28	12	0	0	0	8.1%
Gemma 3 12B	25	0	0	0	0	5.1%
Mistral Small 3.2 24B	17	9	0	0	0	5.1%
Ministral 3 3B	18	6	0	0	0	4.7%
DeepSeek V3.1	17	6	0	0	0	4.6%
Ministral 3 14B	13	10	0	0	0	4.5%
Z.AI GLM 4.6	22	0	0	0	0	4.5%
GPT-OSS 120B	16	0	0	0	0	3.1%
Stealth: Aurora Alpha	9	0	0	0	0	1.8%
Gemma 4 26B	6	2	0	0	0	1.7%
Nemotron 3 Nano	8	0	0	0	0	1.5%
Mistral Large 3	5	1	0	0	0	1.2%
Cohere Command R+ (Aug. 2024)	5	0	0	0	0	1.0%
Gemini 2.5 Flash	5	0	0	0	0	1.0%
Gemma 4 31B (Reasoning)	2	2	0	0	0	0.8%
LFM2 24B	3	0	0	0	0	0.7%
Gemma 3 4B	2	0	0	0	0	0.4%
Gemini 2.5 Flash (Reasoning)	1	0	0	0	0	0.1%
Gemma 4 26B (Reasoning)	0	0	0	0	0	0.0%
o4 Mini High	0	0	0	0	0	0.0%
Grok 4	0	0	0	0	0	0.0%
o4 Mini	0	0	0	0	0	0.0%
Grok 4 Fast	0	0	0	0	0	0.0%
GPT-4o, May 13th (temp=0)	0	0	0	0	0	0.0%
Gemini 2.5 Flash Lite (Reasoning)	0	0	0	0	0	0.0%
GPT-4o, May 13th (temp=1)	0	0	0	0	0	0.0%
GPT-4o, Aug. 6th (temp=0)	0	0	0	0	0	0.0%
Inception Mercury 2	0	0	0	0	0	0.0%
GPT-4.1 Mini	0	0	0	0	0	0.0%
GPT-4o, Aug. 6th (temp=1)	0	0	0	0	0	0.0%
Gemini 2.5 Flash Lite	0	0	0	0	0	0.0%
Inception Mercury	0	0	0	0	0	0.0%
GPT-4o Mini (temp=1)	0	0	0	0	0	0.0%
Nemotron 3 Super	0	0	0	0	0	0.0%
GPT-4o Mini (temp=0)	0	0	0	0	0	0.0%
Llama 3.1 Nemotron 70B	0	0	0	0	0	0.0%
Qwen 2.5 72B	0	0	0	0	0	0.0%
Claude 3 Haiku	0	0	0	0	0	0.0%
GPT-4.1 Nano	0	0	0	0	0	0.0%
Arcee AI: Trinity Mini	0	0	0	0	0	0.0%
Mistral NeMO	0	0	0	0	0	0.0%
Ministral 8B	0	0	0	0	0	0.0%
Ministral 3B	0	0	0	0	0	0.0%

▼

Literary fiction: old friends reunite

Model	# 1	# 2	# 3	# 4	# 5	Avg ▼
Claude Opus 4.7	100	96	95	91	85	93.4%
Claude Opus 4.7 (Reasoning)	92	92	91	85	81	88.3%
GPT-5	92	88	87	84	79	86.2%
ByteDance Seed 2.0 Lite	92	90	89	85	65	84.2%
ByteDance Seed 1.6 Flash	94	91	89	76	72	84.2%
GPT-5.4	91	86	85	81	74	83.6%
Claude Opus 4.8 (Reasoning, Low)	96	95	81	75	68	83.1%
GPT-5.5 (Reasoning, Low)	93	83	82	81	74	82.4%
Claude Opus 4.8 (Reasoning)	91	86	84	77	72	81.8%
Claude Sonnet 4.6 (Reasoning)	97	91	79	72	67	81.1%
GPT-5.5 (Reasoning)	83	82	82	81	78	81.0%
MiniMax M3	93	89	78	74	69	80.7%
GPT-5.4 (Reasoning)	83	82	82	80	74	80.4%
GPT-5.4 (Reasoning, Low)	88	84	78	77	69	79.3%
GPT-5.4 Mini (Reasoning)	82	82	79	77	72	78.3%
GPT-5.5	81	81	80	77	73	78.2%
Qwen 3.5 27B	83	79	78	77	70	77.4%
GPT-5.1	82	82	82	72	69	77.3%
Claude Haiku 4.5	87	80	77	74	66	76.9%
GPT-5.4 Mini (Reasoning, Low)	86	85	77	71	65	76.8%
GPT-5.4 Mini	89	83	77	69	63	76.3%
Grok 4.3 (Reasoning)	84	82	82	69	58	74.9%
MiniMax M2.7	93	79	78	63	61	74.9%
GPT-5.2	82	78	78	69	66	74.5%
Claude Opus 4.6 (Reasoning)	81	80	75	73	63	74.1%
GPT-5 Mini	88	76	71	68	60	72.9%
Claude Sonnet 4.6	85	77	73	71	57	72.4%
Claude Opus 4.5	85	77	67	66	62	71.6%
Claude Sonnet 4.5	89	79	69	59	56	70.5%
MoonshotAI: Kimi K2.6	79	72	71	64	63	69.8%
Z.AI GLM 5 Turbo	78	75	75	64	57	69.7%
Claude Opus 4.6	78	77	72	61	61	69.7%
Hermes 3 405B	93	77	68	54	52	68.7%
Xiaomi MIMO v2.5 Pro	76	72	69	67	59	68.6%
Claude Opus 4	81	79	68	63	51	68.5%
Z.AI GLM 4.7	81	73	73	64	51	68.4%
ByteDance Seed 2.0 Mini	74	69	65	65	64	67.4%
GPT-5.4 Nano (Reasoning, Low)	78	73	69	58	58	67.3%
GPT-5.4 Nano	71	68	67	64	62	66.5%
Qwen 3.5 35B	84	80	71	65	32	66.4%
Qwen 3.5 397B A17B	80	71	69	58	53	66.4%
Z.AI GLM 5	72	70	67	63	58	66.1%
Grok 4.20 (Beta, Reasoning)	86	64	63	61	55	65.9%
Gemini 3 Pro (Preview)	75	69	67	59	56	65.3%
GPT-5.4 Nano (Reasoning)	73	67	63	62	60	64.9%
Qwen 3.5 122B	84	80	72	44	44	64.8%
DeepSeek V4 Pro	80	68	67	56	54	64.7%
DeepSeek V4 Flash (Reasoning)	78	77	66	58	40	63.9%
Grok 4.3	72	65	62	60	57	63.3%
Z.AI GLM 5.1	71	68	61	58	57	63.0%
MiniMax M2.5	80	69	69	67	28	62.6%
Qwen 3.5 Flash	75	63	62	58	54	62.4%
Z.AI GLM 4.7 Flash	79	70	65	54	40	61.6%
Grok 4.20 (Reasoning)	72	67	61	58	45	60.9%
DeepSeek V4 Pro (Reasoning)	77	74	59	56	38	60.7%
Writer: Palmyra X5	74	72	61	58	39	60.7%
ByteDance Seed 1.6	77	69	66	47	44	60.7%
Qwen 3.5 9B	76	73	59	54	40	60.4%
Stealth: Healer Alpha	78	78	49	44	43	58.3%
Z.AI GLM 4.5 Air	97	64	52	42	35	57.7%
DeepSeek V3.2	67	63	62	56	40	57.6%
MoonshotAI: Kimi K2.5	68	60	58	56	45	57.2%
Claude 3.7 Sonnet	76	74	52	41	40	56.6%
Gemma 4 31B (Reasoning)	67	67	52	52	45	56.5%
Gemini 3 Flash (Preview)	67	63	57	57	36	56.0%
Skyfall 36B V2	75	65	61	42	37	55.9%
Qwen3 235B A22B Instruct 2507	74	61	53	46	44	55.7%
Z.AI GLM 4.5	70	55	55	51	46	55.6%
Qwen3.7 Max	69	68	60	46	33	55.3%
Aion 2.0	73	63	62	38	38	54.8%
Gemini 3.5 Flash (Reasoning, Minimal)	66	61	59	50	36	54.4%
Gemini 3.5 Flash (Reasoning)	79	57	50	47	38	54.2%
Mistral Small 4 (Reasoning)	67	62	61	42	38	54.0%
DeepSeek V4 Flash	85	84	62	40	0	54.0%
Qwen 3.5 Plus (2026-02-15)	69	57	54	51	37	53.7%
Mistral Small 4	61	58	56	50	43	53.5%
GPT-4.1	79	65	53	39	30	53.2%
Claude Sonnet 4	67	65	53	51	31	53.2%
Grok 4.20 (Beta)	67	58	52	51	38	53.2%
WizardLM 2 8x22b	66	57	53	47	42	53.1%
DeepSeek V3 (2025-03-24)	71	66	55	54	19	53.0%
Mistral Large 3	66	58	58	41	38	52.0%
Mistral Large 2	69	68	53	43	20	50.7%
Claude 3.5 Sonnet	70	64	60	47	12	50.5%
Xiaomi MIMO v2.5	81	53	49	48	21	50.4%
Qwen 3.6 35B	60	58	56	40	36	50.0%
Gemini 3 Flash (Preview, Reasoning)	54	50	50	48	45	49.7%
Cydonia 24B V4.1	57	57	50	47	35	49.4%
Ministral 8B	77	51	50	36	33	49.3%
Stealth: Hunter Alpha	55	52	48	48	43	49.1%
Qwen3.6 Max Preview	69	61	49	34	30	48.7%
Qwen 3.6 27B	67	48	45	41	40	48.3%
Qwen 3.5 Plus (2026-04-20)	62	47	45	45	43	48.2%
Qwen 3 32B	71	63	63	22	20	47.5%
Gemini 3.1 Pro (Preview)	60	53	44	41	35	46.6%
Grok 4.20	58	53	49	46	26	46.4%
Rocinante 12B	100	56	39	34	2	46.3%
GPT-5 Nano	50	48	45	45	44	46.3%
Mistral Medium 3.1	69	59	43	31	30	46.1%
Ministral 3 8B	59	58	54	54	0	45.1%
DeepSeek V3.1	56	52	48	35	27	43.7%
Llama 3.1 8B	56	56	50	30	23	43.1%
Mistral Large	58	43	42	37	34	42.8%
Gemini 3.1 Flash Lite	54	48	44	36	32	42.7%
Qwen 3.6 Flash	71	46	40	34	22	42.7%
Gemini 2.5 Pro	64	48	45	32	17	41.3%
DeepSeek V3 (2024-12-26)	78	60	36	20	10	40.9%
Hermes 3 70B	85	44	37	36	0	40.5%
Gemma 3 27B	45	39	38	37	36	39.0%
Gemma 4 31B	54	45	37	32	26	38.9%
Gemma 4 26B	57	46	40	26	23	38.4%
Ministral 3 14B	59	38	34	34	25	37.9%
Arcee AI: Trinity Large (Preview)	67	34	31	30	26	37.7%
Grok 4	54	42	38	28	21	36.8%
Z.AI GLM 4.6	72	30	30	30	18	35.8%
o4 Mini	45	34	33	33	22	33.4%
Gemini 3.1 Flash Lite (Reasoning)	66	46	26	17	11	33.2%
Mistral Small Creative	50	50	40	21	1	32.2%
Inception Mercury	83	48	28	0	0	31.9%
Grok 4.1 Fast	54	41	39	20	0	31.0%
Gemini 3.1 Flash Lite (Preview)	53	39	29	26	10	31.0%
Nemotron 3 Super	48	45	21	21	0	27.3%
Grok 4 Fast	33	32	24	21	14	24.8%
Arcee AI: Trinity Mini	59	45	20	0	0	24.8%
DeepSeek-V2 Chat	34	32	25	20	0	22.4%
Gemma 4 26B (Reasoning)	44	36	22	5	4	22.3%
Cohere Command R+ (Aug. 2024)	59	44	0	0	0	20.7%
Gemma 3 12B	37	22	21	18	3	20.3%
Gemini 2.5 Flash (Reasoning)	47	38	9	0	0	18.9%
Llama 3.1 70B	71	20	0	0	0	18.3%
GPT-4.1 Mini	52	21	16	1	0	18.1%
Gemini 2.5 Flash Lite	29	26	18	12	0	16.9%
Ministral 3B	52	31	0	0	0	16.6%
Gemini 2.5 Flash	44	32	5	0	0	16.4%
Mistral NeMO	55	11	9	3	0	15.7%
LFM2 24B	48	17	12	0	0	15.6%
GPT-4o, May 13th (temp=1)	32	17	15	8	0	14.5%
GPT-OSS 120B	31	28	7	5	1	14.4%
Nemotron 3 Nano	32	32	4	0	0	13.5%
Gemini 2.5 Flash Lite (Reasoning)	39	15	12	0	0	13.2%
Mistral Small 3.2 24B	62	0	0	0	0	12.5%
Claude 3 Haiku	52	5	0	0	0	11.4%
o4 Mini High	38	10	8	0	0	11.1%
Ministral 3 3B	38	9	0	0	0	9.5%
Gemma 3 4B	38	0	0	0	0	7.6%
Qwen 2.5 72B	14	0	0	0	0	2.9%
Inception Mercury 2	13	0	0	0	0	2.7%
GPT-4o, Aug. 6th (temp=0)	11	0	0	0	0	2.2%
GPT-4o, Aug. 6th (temp=1)	7	4	0	0	0	2.2%
GPT-4.1 Nano	8	1	0	0	0	2.0%
GPT-4o Mini (temp=1)	7	2	0	0	0	1.8%
GPT-4o, May 13th (temp=0)	0	0	0	0	0	0.0%
Stealth: Aurora Alpha	0	0	0	0	0	0.0%
GPT-4o Mini (temp=0)	0	0	0	0	0	0.0%
Llama 3.1 Nemotron 70B	0	0	0	0	0	0.0%

▼

Mystery: examining a crime scene

Model	# 1	# 2	# 3	# 4	# 5	Avg ▼
Claude Opus 4.7 (Reasoning)	95	95	92	87	80	89.8%
Claude Opus 4.7	95	92	90	86	72	87.2%
GPT-5.4 Mini (Reasoning)	88	87	86	86	80	85.4%
Claude Sonnet 4.6	95	90	86	86	67	84.9%
GPT-5.4 (Reasoning)	97	88	79	79	76	83.8%
GPT-5.5 (Reasoning, Low)	87	83	81	79	79	81.8%
GPT-5.4	93	88	81	73	73	81.8%
GPT-5.4 (Reasoning, Low)	82	81	81	80	78	80.5%
GPT-5.5 (Reasoning)	85	84	81	77	76	80.4%
GPT-5.5	93	84	76	70	68	78.4%
ByteDance Seed 2.0 Lite	84	84	75	75	73	78.2%
Claude Opus 4.8 (Reasoning, Low)	86	81	77	75	72	78.2%
GPT-5	83	82	76	72	72	77.0%
Claude Sonnet 4.6 (Reasoning)	96	79	79	74	56	76.8%
GPT-5.4 Mini (Reasoning, Low)	83	83	75	75	68	76.8%
GPT-5.4 Mini	84	81	79	78	60	76.3%
DeepSeek V4 Flash (Reasoning)	84	82	72	71	68	75.6%
GPT-5.4 Nano (Reasoning)	85	76	76	69	66	74.5%
Claude Opus 4.6 (Reasoning)	83	77	76	68	66	74.1%
ByteDance Seed 1.6 Flash	92	86	79	52	50	71.6%
Claude Haiku 4.5	80	77	73	69	55	70.8%
GPT-5.2	78	74	71	65	64	70.5%
Claude Opus 4.6	82	79	73	62	56	70.4%
GPT-5.4 Nano (Reasoning, Low)	76	72	71	68	65	70.2%
Claude Opus 4.8 (Reasoning)	86	82	65	63	54	70.0%
Qwen 3.5 9B	85	77	71	60	57	70.0%
GPT-5 Mini	72	71	70	70	64	69.4%
DeepSeek V4 Pro (Reasoning)	80	79	66	63	54	68.3%
GPT-5.1	75	74	67	63	62	68.2%
GPT-5.4 Nano	78	76	70	60	54	67.6%
Claude Opus 4	72	71	71	64	58	67.2%
DeepSeek V4 Pro	71	70	69	63	62	67.1%
MiniMax M2.5	87	76	68	53	52	67.1%
Z.AI GLM 5	71	70	67	65	59	66.4%
Skyfall 36B V2	89	84	72	48	35	65.7%
Claude Sonnet 4.5	78	71	70	65	44	65.4%
Claude 3.7 Sonnet	81	79	65	52	50	65.2%
Qwen 3.5 35B	82	65	64	61	53	64.9%
Claude Opus 4.5	85	84	59	50	44	64.5%
Mistral Large 2	69	64	64	61	57	62.9%
Z.AI GLM 5.1	78	77	73	46	38	62.6%
Z.AI GLM 5 Turbo	81	81	71	69	7	61.8%
Grok 4.20 (Beta)	72	64	61	59	51	61.2%
ByteDance Seed 1.6	76	71	67	47	42	60.8%
WizardLM 2 8x22b	73	65	56	55	50	59.8%
Grok 4.20	73	66	54	53	52	59.7%
ByteDance Seed 2.0 Mini	75	65	62	54	40	59.1%
MiniMax M2.7	85	66	65	44	35	59.1%
Hermes 3 405B	92	60	60	54	29	58.9%
Writer: Palmyra X5	72	63	63	54	42	58.8%
Claude Sonnet 4	72	70	58	47	47	58.4%
MiniMax M3	76	65	64	50	37	58.3%
Stealth: Hunter Alpha	80	75	74	33	29	58.2%
Mistral Large	71	68	58	56	35	57.5%
DeepSeek V4 Flash	76	66	59	53	34	57.5%
Rocinante 12B	73	65	57	52	37	56.6%
Mistral Small 4 (Reasoning)	69	62	56	51	46	56.5%
Cydonia 24B V4.1	76	67	57	53	25	55.6%
Qwen 3.5 Flash	66	58	53	52	44	54.5%
Z.AI GLM 4.5 Air	83	65	59	47	17	54.5%
Xiaomi MIMO v2.5 Pro	69	56	55	50	40	54.0%
Stealth: Healer Alpha	64	63	54	45	44	54.0%
Z.AI GLM 4.7	64	57	54	47	47	53.7%
Qwen 3.5 122B	66	55	55	49	44	53.7%
Gemini 3.5 Flash (Reasoning, Minimal)	66	63	49	48	41	53.5%
Qwen3 235B A22B Instruct 2507	79	63	61	43	20	53.3%
Grok 4.20 (Reasoning)	69	60	53	50	34	53.2%
Xiaomi MIMO v2.5	69	65	54	45	30	52.5%
Arcee AI: Trinity Large (Preview)	87	54	47	41	32	52.3%
Z.AI GLM 4.5	82	53	49	49	29	52.3%
Grok 4.20 (Beta, Reasoning)	72	53	50	47	39	52.1%
MoonshotAI: Kimi K2.5	60	59	50	43	37	49.8%
Gemini 3 Pro (Preview)	63	53	46	44	40	49.4%
Grok 4.3 (Reasoning)	70	59	49	39	28	48.9%
Cohere Command R+ (Aug. 2024)	62	58	54	40	29	48.6%
Z.AI GLM 4.6	75	50	49	40	29	48.4%
Gemini 3.5 Flash (Reasoning)	62	57	45	40	37	48.1%
Grok 4.3	65	64	50	31	30	48.0%
Qwen 3.5 Plus (2026-04-20)	68	56	51	43	20	47.7%
GPT-5 Nano	53	52	44	44	43	47.2%
Mistral Medium 3.1	57	51	50	44	32	47.1%
Z.AI GLM 4.7 Flash	55	51	48	43	39	46.9%
MoonshotAI: Kimi K2.6	62	55	44	38	34	46.6%
Mistral Large 3	64	64	49	29	26	46.4%
DeepSeek V3.1	56	51	47	44	33	46.2%
Gemini 3 Flash (Preview)	65	49	44	42	29	45.7%
Mistral Small Creative	52	44	44	41	39	44.2%
Qwen 3.5 27B	78	49	35	30	28	43.7%
Gemma 3 27B	60	46	46	35	28	43.0%
Ministral 3 14B	83	65	27	27	12	42.6%
Qwen 3.5 397B A17B	60	45	42	37	27	42.4%
Gemini 3 Flash (Preview, Reasoning)	53	51	43	42	23	42.3%
Mistral Small 3.2 24B	97	77	36	0	0	41.9%
Mistral Small 4	60	39	38	37	26	40.2%
DeepSeek V3.2	67	50	41	23	18	39.8%
Qwen 3 32B	45	42	37	36	34	38.9%
Aion 2.0	54	53	41	24	20	38.6%
Llama 3.1 8B	65	55	39	32	0	38.1%
Qwen3.7 Max	54	51	40	30	14	37.7%
GPT-4.1	52	40	38	37	21	37.7%
Gemini 3.1 Pro (Preview)	56	38	36	26	22	35.8%
Qwen 3.5 Plus (2026-02-15)	46	39	33	29	26	34.5%
Gemini 2.5 Pro	44	38	36	35	17	34.2%
Gemini 3.1 Flash Lite (Preview)	46	39	39	34	10	33.5%
Qwen 3.6 Flash	46	42	37	21	21	33.2%
Gemma 3 12B	50	43	29	23	21	33.1%
Hermes 3 70B	89	40	34	0	0	32.4%
Gemini 2.5 Flash	45	30	30	29	28	32.3%
Qwen 3.6 35B	66	42	33	11	0	30.4%
Grok 4	52	31	31	17	17	29.6%
Ministral 3B	79	37	18	11	0	29.1%
Gemini 3.1 Flash Lite	62	53	19	9	0	28.6%
GPT-4o, May 13th (temp=1)	49	45	24	16	8	28.3%
Qwen 3.6 27B	43	42	38	14	0	27.3%
DeepSeek-V2 Chat	47	30	27	18	13	27.2%
Ministral 8B	42	41	30	16	4	26.6%
Gemma 4 31B (Reasoning)	38	33	30	30	0	26.1%
Ministral 3 8B	69	33	28	0	0	25.8%
Gemma 4 26B (Reasoning)	46	26	25	25	7	25.6%
Gemma 4 31B	45	32	26	22	2	25.4%
Claude 3 Haiku	55	31	27	6	1	24.0%
Qwen3.6 Max Preview	34	29	26	20	11	24.0%
o4 Mini High	36	25	23	17	17	23.5%
DeepSeek V3 (2024-12-26)	30	29	26	17	15	23.5%
o4 Mini	40	33	20	19	0	22.6%
Inception Mercury	73	38	0	0	0	22.2%
Grok 4.1 Fast	34	26	22	22	0	21.0%
DeepSeek V3 (2025-03-24)	49	28	14	13	0	20.9%
Gemini 3.1 Flash Lite (Reasoning)	41	24	23	9	0	19.6%
Ministral 3 3B	33	24	23	18	0	19.6%
Gemma 4 26B	38	27	24	5	4	19.3%
Nemotron 3 Super	55	21	17	4	0	19.3%
Arcee AI: Trinity Mini	47	26	23	0	0	19.3%
Gemini 2.5 Flash Lite	51	37	0	0	0	17.6%
Gemini 2.5 Flash (Reasoning)	36	23	14	8	1	16.3%
GPT-4.1 Mini	42	26	12	0	0	16.0%
Gemini 2.5 Flash Lite (Reasoning)	49	12	10	0	0	14.1%
Grok 4 Fast	23	23	18	7	0	14.1%
GPT-4.1 Nano	37	17	15	0	0	14.0%
Mistral NeMO	33	19	17	0	0	13.8%
Claude 3.5 Sonnet	36	17	14	1	0	13.5%
GPT-4o, May 13th (temp=0)	26	24	7	5	0	12.5%
Gemma 3 4B	21	15	10	10	2	11.6%
Llama 3.1 70B	32	15	0	0	0	9.3%
Nemotron 3 Nano	17	16	7	5	0	9.1%
GPT-4o Mini (temp=0)	26	19	0	0	0	8.9%
Inception Mercury 2	35	2	2	0	0	7.8%
Qwen 2.5 72B	30	2	0	0	0	6.4%
LFM2 24B	23	4	1	0	0	5.6%
GPT-OSS 120B	17	9	0	0	0	5.2%
GPT-4o, Aug. 6th (temp=1)	17	4	3	0	0	4.9%
GPT-4o Mini (temp=1)	15	0	0	0	0	3.0%
Stealth: Aurora Alpha	7	5	2	0	0	2.9%
GPT-4o, Aug. 6th (temp=0)	10	2	0	0	0	2.5%
Llama 3.1 Nemotron 70B	10	2	0	0	0	2.3%

▼

Romance: separated couple reunites

Model	# 1	# 2	# 3	# 4	# 5	Avg ▼
Claude Sonnet 4.6 (Reasoning)	100	93	92	91	81	91.3%
Claude Opus 4.7	95	91	90	87	81	88.7%
Claude Opus 4.8 (Reasoning, Low)	100	91	90	69	67	83.5%
GPT-5.4 Mini (Reasoning)	79	78	78	77	74	77.1%
MiniMax M3	82	81	79	73	71	77.0%
Claude Sonnet 4.6	88	80	76	65	65	74.8%
ByteDance Seed 2.0 Lite	80	79	76	69	69	74.6%
Claude Opus 4.7 (Reasoning)	85	80	74	73	59	74.3%
Z.AI GLM 5 Turbo	85	80	74	67	65	74.0%
ByteDance Seed 2.0 Mini	85	84	76	66	58	73.8%
GPT-5.5 (Reasoning, Low)	82	76	74	68	67	73.5%
GPT-5.4 (Reasoning, Low)	78	78	71	68	68	72.4%
Claude Opus 4.8 (Reasoning)	86	81	81	68	46	72.3%
Claude Opus 4.6	84	82	74	62	57	71.8%
ByteDance Seed 1.6 Flash	79	78	74	71	56	71.7%
Claude Haiku 4.5	86	83	79	64	45	71.4%
GPT-5.5 (Reasoning)	82	76	73	67	58	71.3%
Qwen 3.5 9B	88	83	73	68	43	71.2%
GPT-5.4 (Reasoning)	77	74	72	66	66	71.0%
GPT-5.4 Mini (Reasoning, Low)	82	71

AI-ism word frequency

Overall Performance

Performance Score Distribution (Top 20)

Price-Performance Score Distribution (Top 20)

Most Stable Models (Top 20)

Top Overall Models (Top 20)

Individual Scenarios

Detailed Writing Rules

Fantasy: entering an ancient ruin

Horror: alone in an eerie place at night

Literary fiction: old friends reunite

Mystery: examining a crime scene

Romance: separated couple reunites