Subordinate conjunction sentence starts

Test: Bad Writing Habits

Avg. Score
31.8%
Scenarios
18

Overall Performance

Rank ▲ Model Score Avg. Cost Avg. Time Stability
1GPT-5.4 Nano44.2%$0.005726.3s15%
2ByteDance Seed 1.6 Flash45.7%$0.001327.3s11%
3Gemini 2.5 Flash Lite43.8%$0.00099.5s11%
4Gemini 2.5 Flash Lite (Reasoning)44.3%$0.002830.8s10%
5Qwen 3 32B46.1%$0.001554.6s10%
6Gemma 3 4B42.9%$0.000220.0s9%
7Writer: Palmyra X544.4%$0.01122.0s9%
8Laguna XS 2.148.6%$0.000314.4s6%
9Muse Spark 1.1 (Reasoning, Minimal)40.6%$0.01219.2s10%
10Gemma 3 12B37.9%$0.000441.3s10%
11Gemini 3.1 Flash Lite (Preview)47.6%$0.00308.4s6%
12GPT-5.4 Nano (Reasoning, Low)39.1%$0.005520.6s9%
13Z.AI GLM 541.3%$0.00841.2m10%
14Qwen 3.5 Plus (2026-02-15)38.5%$0.006031.5s9%
15Qwen 3.5 397B A17B54.2%$0.0143.0m10%
16Xiaomi MIMO v2.532.9%$0.005431.8s11%
17Cydonia 24B V4.145.0%$0.001444.8s7%
18Gemini 3.1 Flash Lite (Reasoning)46.6%$0.003011.9s5%
19Z.AI GLM 5 Turbo36.5%$0.008133.2s9%
20Grok 4.2034.7%$0.009345.7s10%
21Gemma 3 27B39.2%$0.000652.6s8%
22GPT-5.4 Mini33.1%$0.01516.8s10%
23Qwen3 235B A22B Instruct 250739.3%$0.001159.2s8%
24Qwen 3.6 35B42.3%$0.00831.0m8%
25Muse Spark 1.1 (Reasoning, Medium)40.3%$0.01523.9s7%
26Gemini 3.1 Flash Lite45.0%$0.003012.1s4%
27Gemini 2.5 Flash (Reasoning)38.0%$0.01121.5s7%
28GPT-5.4 Mini (Reasoning, Low)32.8%$0.01516.8s9%
29GPT-5.6 Terra (Reasoning)29.2%$0.04435.2s12%
30Claude Sonnet 445.8%$0.03243.7s7%
31GPT-5.4 (Reasoning, Low)44.9%$0.0551.4m10%
32GPT-5 Nano38.3%$0.00421.4m8%
33Z.AI GLM 4.736.5%$0.0101.4m9%
34o4 Mini29.5%$0.01525.7s9%
35GPT-5.4 (Reasoning)47.6%$0.0892.6m14%
36GPT-4o, Aug. 6th (temp=1)45.8%$0.01824.4s4%
37GPT-5.444.6%$0.0491.4m9%
38GPT-5.4 Mini (Reasoning)32.4%$0.02228.1s9%
39Claude Opus 4.634.7%$0.0781.2m14%
40Qwen 3.6 Flash36.0%$0.01041.4s7%
41Grok 4.20 (Reasoning)37.5%$0.0181.5m9%
42Aion 2.032.1%$0.00641.3m9%
43Z.AI GLM 5.139.3%$0.0141.5m8%
44GPT-5.4 Nano (Reasoning)30.1%$0.006124.5s8%
45GPT-5 Mini33.0%$0.010057.4s8%
46Cohere Command R+ (Aug. 2024)47.1%$0.02052.5s3%
47Hermes 3 70B47.9%$0.00101.2m3%
48GPT-5.135.4%$0.0541.8m12%
49Claude Opus 4.6 (Reasoning)38.8%$0.0881.4m11%
50GPT-5.6 Terra28.8%$0.04636.9s9%
51Qwen 3.5 35B36.3%$0.0181.0m5%
52Mistral Small 4 (Reasoning)31.0%$0.002230.2s4%
53Mistral NeMO38.7%$0.000510.1s0%
54Qwen 3.5 Flash35.4%$0.002547.5s3%
55DeepSeek V4 Pro (Reasoning)38.5%$0.0153.1m8%
56GPT-4o Mini (temp=1)40.9%$0.001234.8s0%
57Laguna S 2.138.9%$0.000522.1s0%
58GPT-5.6 Sol (Reasoning)29.8%$0.1081.2m12%
59GPT-4.1 Nano36.0%$0.000713.3s0%
60GPT-5.6 Luna (Reasoning)25.2%$0.01718.0s4%
61Gemini 3.5 Flash (Reasoning, Minimal)37.4%$0.01812.0s0%
62Ministral 3 14B33.2%$0.000711.7s0%
63Claude Haiku 4.535.3%$0.01121.6s0%
64GPT-534.6%$0.0652.8m10%
65Arcee AI: Trinity Mini30.9%$0.00039.2s0%
66o4 Mini High26.5%$0.02547.2s5%
67Gemini 2.5 Flash31.2%$0.005210.6s0%
68Mistral Small 430.1%$0.001418.2s0%
69Z.AI GLM 4.7 Flash36.3%$0.00171.2m0%
70Gemini 3 Flash (Preview, Reasoning)33.5%$0.01230.1s0%
71GPT-5.5 (Reasoning, Low)34.3%$0.1391.8m12%
72DeepSeek V4 Flash (Reasoning)30.2%$0.000731.1s0%
73Qwen 3.5 Plus (2026-04-20)30.6%$0.0171.8m4%
74GPT-5.532.9%$0.1391.7m12%
75GPT-5.224.8%$0.0561.5m8%
76Claude Sonnet 4.637.6%$0.03139.3s0%
77Z.AI GLM 4.531.8%$0.005142.1s0%
78Ministral 3 8B27.6%$0.000819.6s0%
79Gemini 3.5 Flash Lite (Reasoning, Minimal)26.2%$0.00356.3s0%
80Gemma 4 26B31.6%$0.000955.1s0%
81Z.AI GLM 4.5 Air32.3%$0.002958.2s0%
82Gemini 3.6 Flash (Reasoning, Minimal)29.9%$0.01714.3s0%
83Z.AI GLM 4.632.0%$0.006551.5s0%
84GPT-5.6 Sol23.7%$0.1051.2m10%
85Mistral Large 328.0%$0.003330.3s0%
86Mistral Medium 3.128.3%$0.004836.5s0%
87Ministral 8B23.9%$0.000410.4s0%
88Hermes 3 405B29.9%$0.003253.2s0%
89GPT-4.1 Mini25.4%$0.002719.0s0%
90GPT-4o Mini (temp=0)27.0%$0.001234.8s0%
91Gemma 4 31B34.7%$0.00101.6m0%
92Aion 3.035.3%$0.0241.0m0%
93Gemini 3 Flash (Preview)25.2%$0.007819.6s0%
94Qwen3.6 Max Preview37.1%$0.0503.5m7%
95DeepSeek V3.234.6%$0.00141.9m0%
96Gemini 3.5 Flash Lite (Reasoning)21.5%$0.00356.6s0%
97Mistral Large 226.5%$0.01329.4s0%
98DeepSeek-V2 Chat26.5%$0.002153.3s0%
99MiniMax M2.728.6%$0.00401.1m0%
100DeepSeek V4 Flash23.2%$0.000631.6s0%
101GPT-5.5 (Reasoning)30.1%$0.1421.8m11%
102Llama 3.1 70B23.0%$0.001529.4s0%
103MiniMax M2.529.0%$0.00341.3m0%
104DeepSeek V3 (2024-12-26)25.4%$0.002154.6s0%
105Claude Sonnet 528.2%$0.02733.5s0%
106Aion 3.0 Mini27.6%$0.00531.2m0%
107Xiaomi MIMO v2.5 Pro26.3%$0.008553.5s0%
108DeepSeek V3.131.7%$0.00201.8m0%
109Ministral 3B18.4%$0.00018.1s0%
110Qwen 2.5 72B22.0%$0.001036.7s0%
111Nemotron 3 Nano25.5%$0.00101.1m0%
112Gemini 2.5 Pro29.5%$0.03636.2s0%
113Gemma 4 31B (Reasoning)33.1%$0.00142.2m0%
114DeepSeek V4 Pro27.0%$0.00481.3m0%
115GPT-4.125.9%$0.01844.7s0%
116GPT-5.6 Luna21.4%$0.01515.8s0%
117Gemini 3.6 Flash (Reasoning)30.0%$0.04432.5s0%
118Z.AI GLM 5.2 (Reasoning, High)25.8%$0.0111.0m0%
119GPT-4o, Aug. 6th (temp=0)23.4%$0.02322.7s0%
120Qwen 3.5 122B29.0%$0.0251.1m0%
121ByteDance Seed 1.636.2%$0.0132.5m0%
122Gemini 3.5 Flash (Reasoning)35.3%$0.07137.6s0%
123Grok 4.319.1%$0.006930.5s0%
124Claude Sonnet 5 (Reasoning)25.4%$0.03038.9s0%
125WizardLM 2 8x22b27.8%$0.00261.8m0%
126Claude Sonnet 4.526.0%$0.03538.1s0%
127MoonshotAI: Kimi K3 (Reasoning, Low)27.8%$0.0281.1m0%
128Claude Opus 4.535.1%$0.07053.4s0%
129DeepSeek V3 (2025-03-24)17.4%$0.001439.4s0%
130ByteDance Seed 2.0 Lite31.3%$0.0122.2m0%
131Qwen 3.5 9B22.3%$0.00111.4m0%
132Ministral 3 3B13.0%$0.000511.1s0%
133Claude Sonnet 5 (Reasoning, Low)22.3%$0.03138.4s0%
134Nemotron 3 Super21.1%$0.00001.4m0%
135Qwen 3.5 27B27.1%$0.0201.6m0%
136Gemma 4 26B (Reasoning)24.7%$0.00132.0m0%
137MoonshotAI: Kimi K2.537.5%$0.0193.2m0%
138Inception Mercury 29.2%$0.00327.0s0%
139Claude Opus 4.727.4%$0.06930.4s0%
140Claude Opus 4.8 (Reasoning, Low)28.3%$0.07141.9s0%
141Claude Opus 531.6%$0.08250.1s0%
142Thinking Machines Inkling18.7%$0.00751.5m0%
143Qwen 3.6 27B28.4%$0.0252.3m0%
144Claude Sonnet 4.6 (Reasoning)27.8%$0.0601.2m0%
145Claude Opus 439.1%$0.2091.4m8%
146Claude Opus 4.7 (Reasoning)26.0%$0.07632.0s0%
147Grok 4.5 (Reasoning, Low)15.7%$0.0181.1m0%
148MiniMax M327.6%$0.00603.1m0%
149Claude Opus 4.8 (Reasoning)24.1%$0.07141.7s0%
150MoonshotAI: Kimi K3 (Reasoning, High)26.1%$0.0441.8m0%
151ByteDance Seed 2.0 Mini38.0%$0.00454.9m0%
152Qwen3.7 Max33.2%$0.0682.3m0%
153GPT-OSS 120B11.3%$0.00151.8m0%
154Grok 4.3 (Reasoning)19.1%$0.0212.3m0%
155Grok 4.5 (Reasoning, High)14.2%$0.0301.6m0%
156Gemini 3.1 Pro (Preview)30.7%$0.1071.8m0%
157Claude Opus 5 (Reasoning, Low)20.7%$0.0971.0m0%
158Claude Opus 5 (Reasoning)19.4%$0.0981.0m0%
159Thinking Machines Inkling (Reasoning)24.3%$0.0255.1m0%
160MoonshotAI: Kimi K2.628.5%$0.0586.5m0%
161Mistral Small 3.2 24B5.9%$0.00695.7m0%
31.79%

Individual Scenarios

Detailed Writing Rules

Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Gemma 3 27B1001001001006492.8%
Cydonia 24B V4.110010076686080.8%
Cohere Command R+ (Aug. 2024)100100100100080.0%
Gemini 2.5 Flash Lite10010070646078.8%
Hermes 3 70B10010010071074.3%
Gemma 3 4B10010010071074.3%
DeepSeek V3.110010010062072.3%
Gemini 2.5 Pro1001008870071.6%
Gemma 3 12B1001007971070.2%
GPT-4o Mini (temp=0)1001007965068.9%
Mistral Large 2100887263064.5%
GPT-4o, Aug. 6th (temp=1)1001001000060.0%
MoonshotAI: Kimi K3 (Reasoning, Low)85747068059.4%
Muse Spark 1.1 (Reasoning, Medium)100854840054.6%
Xiaomi MIMO v2.5100675639052.4%
Muse Spark 1.1 (Reasoning, Minimal)100655043051.4%
Z.AI GLM 4.7100625342051.3%
Claude Sonnet 4.610085710051.2%
Laguna S 2.19391720051.2%
Writer: Palmyra X5100100490049.7%
GPT-5.4 (Reasoning)885945282348.7%
Gemini 3 Flash (Preview, Reasoning)100100430048.5%
Ministral 3 8B10070670047.4%
DeepSeek V3.210083490046.4%
Z.AI GLM 510060600044.0%
Gemini 2.5 Flash Lite (Reasoning)8665630042.9%
Xiaomi MIMO v2.5 Pro10065390040.9%
Claude Opus 5 (Reasoning, Low)7165640040.1%
Qwen3 235B A22B Instruct 250710010000040.0%
Ministral 3 14B10010000040.0%
Z.AI GLM 5.2 (Reasoning, High)10054450039.7%
Mistral Small 4 (Reasoning)8368440039.1%
GPT-4.150494947038.8%
ByteDance Seed 2.0 Mini1009300038.5%
MoonshotAI: Kimi K2.51008800037.5%
MiniMax M310055300037.0%
ByteDance Seed 1.6 Flash10050280035.4%
DeepSeek V4 Pro1007700035.4%
Gemini 3.5 Flash (Reasoning, Minimal)1006800033.7%
Claude Opus 4.8 (Reasoning, Low)1006800033.5%
Qwen 3.5 Flash10052140033.2%
Z.AI GLM 4.51006500033.0%
MiniMax M2.71006400032.8%
Claude Opus 47064300032.8%
Grok 4.207059330032.5%
Ministral 8B6752420032.0%
DeepSeek V4 Pro (Reasoning)1005800031.6%
Claude Opus 4.8 (Reasoning)867100031.5%
GPT-5.4 (Reasoning, Low)9634270031.4%
WizardLM 2 8x22b7242400030.9%
Grok 4.20 (Reasoning)6944390030.5%
Z.AI GLM 5 Turbo1004900029.8%
DeepSeek V4 Flash915600029.4%
Qwen3.7 Max1004700029.3%
Gemini 2.5 Flash786800029.2%
Claude Sonnet 4.51004200028.5%
Aion 2.01003800027.6%
DeepSeek V4 Flash (Reasoning)746100026.9%
Mistral NeMO963700026.6%
GPT-5.4 Nano (Reasoning, Low)58272522026.3%
Nemotron 3 Nano1003100026.2%
GPT-5 Mini1003000026.0%
Mistral Small 4685700025.1%
Aion 3.0 Mini655700024.4%
GPT-5.55929260022.8%
Claude Sonnet 4.6 (Reasoning)575700022.7%
Claude Opus 4.6585500022.6%
GPT-56324200021.5%
Claude Opus 4.6 (Reasoning)574900021.2%
GPT-5.4 Nano (Reasoning)4827270020.4%
Claude Sonnet 5 (Reasoning, Low)100000020.0%
Claude Opus 4.7100000020.0%
ByteDance Seed 1.6100000020.0%
Claude Sonnet 5100000020.0%
Gemini 3.5 Flash Lite (Reasoning)100000020.0%
Mistral Large 3100000020.0%
ByteDance Seed 2.0 Lite100000020.0%
DeepSeek-V2 Chat100000020.0%
Claude Haiku 4.5100000020.0%
DeepSeek V3 (2024-12-26)100000020.0%
Z.AI GLM 4.7 Flash100000020.0%
Hermes 3 405B100000020.0%
DeepSeek V3 (2025-03-24)100000020.0%
Llama 3.1 70B100000020.0%
GPT-4.1 Nano100000020.0%
Arcee AI: Trinity Mini100000020.0%
Ministral 3B100000020.0%
Thinking Machines Inkling (Reasoning)94000018.9%
Qwen 3.5 35B543800018.4%
GPT-5.4 Nano642500017.8%
Gemini 3.6 Flash (Reasoning, Minimal)88000017.5%
GPT-4o, Aug. 6th (temp=0)88000017.5%
MoonshotAI: Kimi K2.6454100017.1%
Claude Sonnet 483000016.7%
Laguna XS 2.181000016.1%
GPT-5.6 Luna (Reasoning)79000015.7%
Claude Opus 4.7 (Reasoning)78000015.6%
Gemma 4 31B (Reasoning)75000014.9%
Qwen 2.5 72B75000014.9%
GPT-5.6 Luna74000014.7%
Claude Opus 572000014.5%
Gemma 4 31B72000014.5%
Qwen 3.6 35B432900014.5%
Claude Opus 5 (Reasoning)71000014.3%
MoonshotAI: Kimi K3 (Reasoning, High)363400014.0%
GPT-4.1 Mini69000013.9%
GPT-5.4 Mini (Reasoning, Low)353300013.7%
GPT-5.6 Sol412600013.6%
Gemini 2.5 Flash (Reasoning)68000013.5%
GPT-5.5 (Reasoning)2422220013.5%
GPT-5.6 Sol (Reasoning)452300013.5%
GPT-5.4 Mini343300013.4%
Gemini 3.1 Flash Lite67000013.3%
GPT-5.465000013.1%
Claude Opus 4.565000013.0%
Gemini 3.5 Flash (Reasoning)61000012.2%
Qwen 3 32B60000012.0%
Qwen 3.5 Plus (2026-02-15)59000011.8%
Qwen 3.5 9B58000011.6%
GPT-5.6 Terra332400011.4%
GPT-5.6 Terra (Reasoning)302500010.9%
Aion 3.054000010.9%
Gemma 4 26B52000010.4%
Gemini 3 Flash (Preview)51000010.1%
Qwen 3.5 397B A17B28220009.9%
Z.AI GLM 4.5 Air4900009.8%
Qwen 3.5 Plus (2026-04-20)4900009.7%
Mistral Medium 3.14800009.6%
o4 Mini4700009.4%
Gemini 3.1 Pro (Preview)4700009.3%
GPT-5.5 (Reasoning, Low)24220009.2%
GPT-5.124220009.1%
GPT-5 Nano24210009.1%
GPT-5.4 Mini (Reasoning)4100008.2%
o4 Mini High3100006.3%
Qwen3.6 Max Preview3100006.3%
GPT-5.23000006.0%
Gemini 3.6 Flash (Reasoning)000000.0%
Grok 4.5 (Reasoning, High)000000.0%
Z.AI GLM 5.1000000.0%
Grok 4.3 (Reasoning)000000.0%
Grok 4.5 (Reasoning, Low)000000.0%
Claude Sonnet 5 (Reasoning)000000.0%
Qwen 3.5 122B000000.0%
Qwen 3.5 27B000000.0%
Qwen 3.6 Flash000000.0%
Gemma 4 26B (Reasoning)000000.0%
Qwen 3.6 27B000000.0%
Z.AI GLM 4.6000000.0%
MiniMax M2.5000000.0%
Gemini 3.1 Flash Lite (Reasoning)000000.0%
Gemini 3.1 Flash Lite (Preview)000000.0%
GPT-OSS 120B000000.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)000000.0%
Inception Mercury 2000000.0%
Nemotron 3 Super000000.0%
Grok 4.3000000.0%
GPT-4o Mini (temp=1)000000.0%
Mistral Small 3.2 24B000000.0%
Thinking Machines Inkling000000.0%
Ministral 3 3B000000.0%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Gemini 2.5 Flash Lite10010095747188.0%
Claude Opus 4.7 (Reasoning)100100100100080.0%
Cydonia 24B V4.110010010084076.8%
Laguna XS 2.110010010079075.9%
ByteDance Seed 2.0 Lite10010010077075.4%
MiniMax M2.71009978583373.6%
Claude Sonnet 4.610010010061072.2%
Aion 3.010010051504368.8%
Aion 2.01008069563668.2%
GPT-5 Mini10010075362968.1%
Qwen3 235B A22B Instruct 250710010010040067.9%
Thinking Machines Inkling (Reasoning)100897563065.4%
ByteDance Seed 1.6 Flash1009745423764.2%
Mistral Medium 3.11006853514763.8%
Z.AI GLM 5 Turbo1006053535263.5%
GPT-4o, Aug. 6th (temp=1)1001006947063.3%
GPT-5737069643862.7%
Gemini 2.5 Flash Lite (Reasoning)100896360062.4%
Claude Opus 51001005652061.5%
Muse Spark 1.1 (Reasoning, Minimal)1006052523760.1%
Claude Opus 4.8 (Reasoning)1001001000060.0%
Gemma 3 27B1001005246059.5%
MiniMax M2.5100945147058.4%
Mistral Large 31001004943058.3%
DeepSeek V4 Flash (Reasoning)1001005536058.2%
Muse Spark 1.1 (Reasoning, Medium)1001004942058.0%
Writer: Palmyra X51001004441057.1%
DeepSeek V4 Pro (Reasoning)1005653472856.9%
Claude Sonnet 4.51001004341056.8%
GPT-5.5 (Reasoning, Low)1008250312056.7%
Z.AI GLM 4.5 Air100985036056.7%
Z.AI GLM 5.2 (Reasoning, High)100964636055.6%
GPT-5.4 Nano846564432055.2%
Claude Opus 4.7100595654053.9%
Cohere Command R+ (Aug. 2024)100100680053.5%
Claude Opus 4.6 (Reasoning)10086790053.0%
Claude Sonnet 4.6 (Reasoning)100100650053.0%
WizardLM 2 8x22b1006836352653.0%
Gemma 3 4B100615746052.9%
GPT-5.11005145412752.7%
Grok 4.3 (Reasoning)93626148052.7%
ByteDance Seed 2.0 Mini9386830052.4%
GPT-4.1 Nano100100570051.5%
Claude Haiku 4.593784638051.2%
Xiaomi MIMO v2.51004940343251.1%
Xiaomi MIMO v2.5 Pro846137363650.8%
GPT-5.4 (Reasoning)837834302850.5%
GPT-5.4 Nano (Reasoning, Low)969023212150.3%
Gemini 3 Flash (Preview)100100450049.0%
Gemini 3.5 Flash (Reasoning)99535043048.9%
Claude Opus 4.6100823428048.9%
Gemini 3.6 Flash (Reasoning)71595856048.9%
MoonshotAI: Kimi K3 (Reasoning, Low)10077680048.9%
Claude Sonnet 4100100430048.7%
GPT-5.4 Mini (Reasoning)100703731047.6%
Nemotron 3 Super10070630046.6%
Claude Opus 4.8 (Reasoning, Low)10068650046.5%
Z.AI GLM 4.510071610046.5%
GPT-4.1 Mini10070590045.8%
Ministral 8B10064630045.5%
MiniMax M310064630045.3%
Z.AI GLM 510074500044.7%
Qwen 3.5 Plus (2026-02-15)100563227043.1%
GPT-5.6 Terra (Reasoning)656431292643.0%
GPT-5.5 (Reasoning)1003535212142.6%
GPT-4o Mini (temp=1)10058520042.0%
Mistral NeMO8662610041.8%
GPT-5.595643018041.4%
Z.AI GLM 5.110056420039.6%
Mistral Large 27467560039.3%
Claude Sonnet 5 (Reasoning, Low)1009600039.2%
Hermes 3 70B1009400038.9%
GPT-4.19052510038.5%
GPT-5.28358500038.1%
Grok 4.20 (Reasoning)10047380036.8%
Grok 4.5 (Reasoning, Low)69413733036.3%
GPT-5.4 Mini (Reasoning, Low)67602926036.2%
Gemma 3 12B8951380035.7%
GPT-5.6 Terra71552823035.5%
Grok 4.5 (Reasoning, High)6359560035.5%
GPT-5.466572826035.5%
Gemini 3.5 Flash (Reasoning, Minimal)1007500034.9%
MoonshotAI: Kimi K2.61007300034.6%
Laguna S 2.17650480034.6%
GPT-5.6 Luna74442722033.4%
Mistral Small 4 (Reasoning)9445270033.3%
DeepSeek V3.210034320033.3%
GPT-OSS 120B1006500033.0%
GPT-5.6 Sol (Reasoning)682823222132.4%
MoonshotAI: Kimi K2.51006200032.3%
Gemma 4 31B1006200032.3%
GPT-5 Nano52383834032.3%
Qwen 3 32B57532626032.2%
MoonshotAI: Kimi K3 (Reasoning, High)5551510031.3%
Claude Opus 5 (Reasoning, Low)1005600031.1%
Nemotron 3 Nano1005600031.1%
Ministral 3 8B1005500031.0%
Claude Sonnet 5 (Reasoning)817400030.8%
Gemini 3.1 Flash Lite (Reasoning)1005200030.4%
Aion 3.0 Mini1005000029.9%
Gemini 2.5 Pro1004900029.8%
Claude Opus 5 (Reasoning)964900029.0%
DeepSeek V4 Pro1004000027.9%
Gemini 2.5 Flash834900026.3%
DeepSeek-V2 Chat884400026.3%
GPT-5.6 Sol432320191924.7%
Gemma 4 26B (Reasoning)665700024.5%
Gemini 2.5 Flash (Reasoning)714900024.0%
Gemma 4 31B (Reasoning)605400022.7%
Claude Opus 4.5595400022.5%
GPT-5.4 (Reasoning, Low)29292825022.1%
Mistral Small 4555300021.6%
o4 Mini733400021.4%
Gemini 3.6 Flash (Reasoning, Minimal)574600020.7%
Claude Opus 44439190020.4%
ByteDance Seed 1.6100000020.0%
DeepSeek V3 (2024-12-26)100000020.0%
Z.AI GLM 4.7 Flash100000020.0%
DeepSeek V4 Flash100000020.0%
Llama 3.1 70B100000020.0%
Arcee AI: Trinity Mini100000020.0%
Ministral 3 3B100000020.0%
GPT-5.4 Nano (Reasoning)682900019.4%
Qwen3.7 Max474300018.0%
Gemini 3 Flash (Preview, Reasoning)444300017.4%
o4 Mini High2929270017.0%
GPT-5.4 Mini522800016.1%
Claude Sonnet 578000015.6%
Gemma 4 26B393700015.3%
Ministral 3 14B76000015.2%
GPT-5.6 Luna (Reasoning)492400014.6%
Grok 4.20512200014.5%
Grok 4.3432800014.1%
DeepSeek V3.166000013.2%
GPT-4o Mini (temp=0)64000012.8%
Inception Mercury 263000012.7%
Qwen 3.6 35B372400012.2%
Z.AI GLM 4.657000011.5%
Hermes 3 405B54000010.8%
Qwen 3.5 Flash351900010.7%
Gemini 3.1 Flash Lite (Preview)51000010.2%
Qwen 2.5 72B51000010.2%
Qwen 3.6 27B4800009.6%
Qwen 3.5 35B24180008.4%
Gemini 3.1 Pro (Preview)4100008.3%
Qwen 3.5 Plus (2026-04-20)3800007.6%
Z.AI GLM 4.73800007.6%
Qwen 3.6 Flash3100006.2%
Qwen 3.5 27B2100004.3%
GPT-4o, Aug. 6th (temp=0)700001.4%
Qwen3.6 Max Preview000000.0%
Qwen 3.5 397B A17B000000.0%
Qwen 3.5 122B000000.0%
Gemini 3.1 Flash Lite000000.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)000000.0%
Gemini 3.5 Flash Lite (Reasoning)000000.0%
Qwen 3.5 9B000000.0%
DeepSeek V3 (2025-03-24)000000.0%
Mistral Small 3.2 24B000000.0%
Thinking Machines Inkling000000.0%
Ministral 3B000000.0%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
GPT-4.1 Nano1001008377072.1%
Claude Haiku 4.510010010057071.4%
Claude Opus 410010010056071.2%
Qwen 3.5 397B A17B10010086362068.6%
Mistral Medium 3.11001008043064.6%
ByteDance Seed 1.6 Flash976959443661.1%
Qwen 3 32B93856661060.8%
Claude Opus 59893820054.5%
Writer: Palmyra X510096740054.0%
GPT-5.6 Luna (Reasoning)76686858053.9%
MoonshotAI: Kimi K2.510085820053.3%
GPT-4o, Aug. 6th (temp=1)9691790053.3%
Grok 4.2010091740053.0%
Mistral Small 4 (Reasoning)95744542051.1%
Gemma 3 4B100100540050.9%
GPT-5.4 Nano (Reasoning, Low)100953127050.6%
o4 Mini High100863531050.5%
GPT-5.6 Terra100733837049.6%
Qwen 3.6 35B100675130049.4%
GPT-5.4 Nano (Reasoning)74595655048.8%
Gemini 2.5 Flash Lite (Reasoning)76615347047.2%
Qwen3.6 Max Preview100633428045.0%
GPT-5.4 Nano10075490044.8%
Claude Sonnet 410064580044.4%
GPT-5.181534336042.7%
Qwen 2.5 72B7471650042.0%
Grok 4.5 (Reasoning, High)6968660040.7%
Mistral Small 49570380040.5%
GPT-5.4 Mini8874390040.2%
MoonshotAI: Kimi K2.610010000040.0%
Claude Sonnet 5 (Reasoning)10010000040.0%
ByteDance Seed 2.0 Mini10010000040.0%
Llama 3.1 70B10010000040.0%
GPT-5.4100353330039.7%
DeepSeek V4 Pro (Reasoning)7265600039.5%
Nemotron 3 Nano8168470039.3%
MoonshotAI: Kimi K3 (Reasoning, Low)1009600039.2%
Gemini 3.1 Flash Lite1009600039.2%
GPT-5.4 (Reasoning, Low)100363030039.2%
Qwen 3.5 35B80643811038.8%
Z.AI GLM 4.68257530038.4%
DeepSeek V3.21008800037.7%
Z.AI GLM 58355500037.6%
Claude Opus 4.51008800037.5%
Mistral Large 310046410037.4%
Gemma 4 31B968900037.1%
Gemini 2.5 Pro7567420036.7%
GPT-5.4 Mini (Reasoning, Low)10042390036.2%
Laguna XS 2.11008100036.1%
Cydonia 24B V4.11007900035.9%
GPT-5 Nano9743380035.7%
Qwen 3.5 Plus (2026-04-20)8254400035.2%
Claude Opus 5 (Reasoning)938100034.6%
Gemini 3.6 Flash (Reasoning)918100034.3%
Laguna S 2.11007100034.3%
Gemini 3.5 Flash (Reasoning, Minimal)898100034.0%
GPT-4o Mini (temp=1)1006900033.9%
Qwen 3.5 27B1006900033.8%
Aion 3.01006700033.3%
Gemma 4 26B1006700033.3%
Grok 4.20 (Reasoning)848200033.2%
Qwen 3.6 Flash7858290033.1%
GPT-5.5 (Reasoning, Low)71402726032.9%
Ministral 3 14B1006400032.8%
Gemini 2.5 Flash (Reasoning)1006300032.7%
Ministral 3B887500032.5%
GPT-5.6 Sol (Reasoning)7258310032.3%
Grok 4.31006100032.2%
Qwen 3.5 Plus (2026-02-15)5655500032.1%
Qwen 3.5 9B1005090031.7%
DeepSeek V3 (2024-12-26)867100031.5%
GPT-55856430031.3%
Ministral 8B1005600031.2%
GPT-5.4 Mini (Reasoning)7841350031.0%
Claude Sonnet 4.6827100030.7%
Xiaomi MIMO v2.5955800030.7%
GPT-5.6 Sol876500030.5%
Qwen3 235B A22B Instruct 25071005200030.3%
Nemotron 3 Super935400029.4%
Gemini 3.5 Flash (Reasoning)964900029.0%
GPT-5.56453280029.0%
GPT-5.5 (Reasoning)56343023028.4%
Qwen3.7 Max726800028.2%
Xiaomi MIMO v2.5 Pro1003700027.4%
Gemini 3.6 Flash (Reasoning, Minimal)675800025.0%
GPT-5.6 Luna813900024.0%
Claude Opus 4.6634600021.8%
DeepSeek V4 Flash575100021.6%
Z.AI GLM 5.1565200021.5%
MiniMax M3623900020.2%
Z.AI GLM 5 Turbo100000020.0%
Claude Opus 4.7 (Reasoning)100000020.0%
Claude Opus 4.8 (Reasoning)100000020.0%
Claude Opus 4.8 (Reasoning, Low)100000020.0%
Claude Sonnet 5 (Reasoning, Low)100000020.0%
ByteDance Seed 1.6100000020.0%
Claude Sonnet 5100000020.0%
GPT-4.1100000020.0%
MiniMax M2.7100000020.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100000020.0%
Mistral Large 2100000020.0%
Hermes 3 405B100000020.0%
Gemma 3 12B100000020.0%
Thinking Machines Inkling100000020.0%
GPT-5.4 (Reasoning)633000018.8%
Muse Spark 1.1 (Reasoning, Medium)474600018.7%
Gemma 4 31B (Reasoning)93000018.5%
GPT-5.6 Terra (Reasoning)504100018.1%
WizardLM 2 8x22b484200017.9%
Z.AI GLM 4.5 Air86000017.2%
Claude Opus 4.785000016.9%
Gemini 3.1 Flash Lite (Reasoning)85000016.9%
Claude Opus 5 (Reasoning, Low)83000016.7%
GPT-4o, Aug. 6th (temp=0)82000016.4%
Thinking Machines Inkling (Reasoning)79000015.9%
Hermes 3 70B79000015.9%
Grok 4.5 (Reasoning, Low)78000015.6%
o4 Mini423400015.3%
Qwen 3.6 27B393400014.6%
Gemini 3 Flash (Preview, Reasoning)72000014.5%
DeepSeek V4 Pro68000013.7%
Arcee AI: Trinity Mini66000013.2%
GPT-5 Mini343100013.0%
Gemini 2.5 Flash Lite62000012.3%
Qwen 3.5 Flash60000011.9%
DeepSeek V4 Flash (Reasoning)58000011.6%
GPT-5.2292900011.5%
Muse Spark 1.1 (Reasoning, Minimal)57000011.4%
GPT-4.1 Mini54000010.9%
Claude Sonnet 4.551000010.2%
Gemini 3.1 Pro (Preview)4900009.8%
Mistral Small 3.2 24B4520009.4%
DeepSeek V3.14600009.2%
Gemma 3 27B4200008.5%
Aion 2.03600007.2%
Z.AI GLM 4.73400006.8%
Ministral 3 8B3300006.6%
GPT-OSS 120B3200006.3%
Qwen 3.5 122B2900005.7%
Aion 3.0 Mini2700005.5%
Claude Opus 4.6 (Reasoning)000000.0%
Claude Sonnet 4.6 (Reasoning)000000.0%
Z.AI GLM 5.2 (Reasoning, High)000000.0%
MoonshotAI: Kimi K3 (Reasoning, High)000000.0%
Grok 4.3 (Reasoning)000000.0%
Gemma 4 26B (Reasoning)000000.0%
MiniMax M2.5000000.0%
Gemini 3 Flash (Preview)000000.0%
Gemini 3.1 Flash Lite (Preview)000000.0%
Z.AI GLM 4.5000000.0%
Gemini 3.5 Flash Lite (Reasoning)000000.0%
ByteDance Seed 2.0 Lite000000.0%
DeepSeek-V2 Chat000000.0%
Z.AI GLM 4.7 Flash000000.0%
Inception Mercury 2000000.0%
Gemini 2.5 Flash000000.0%
DeepSeek V3 (2025-03-24)000000.0%
GPT-4o Mini (temp=0)000000.0%
Cohere Command R+ (Aug. 2024)000000.0%
Ministral 3 3B000000.0%
Mistral NeMO000000.0%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
GPT-4o Mini (temp=1)10010096937592.7%
Mistral NeMO10010085824782.7%
Claude Haiku 4.510010068524573.0%
Z.AI GLM 51001001000060.0%
ByteDance Seed 1.61001001000060.0%
Claude Sonnet 51001001000060.0%
Claude Opus 4.6 (Reasoning)91895450056.8%
Writer: Palmyra X510088840054.5%
Z.AI GLM 5.1100685646054.0%
Claude Sonnet 4100100690053.9%
Gemma 3 27B100100650053.0%
Gemma 3 12B75686356052.2%
Z.AI GLM 4.510082780052.0%
Qwen3 235B A22B Instruct 250777686548051.7%
GPT-4o Mini (temp=0)10082660049.6%
Mistral Small 4 (Reasoning)10081620048.5%
Gemini 3.5 Flash (Reasoning, Minimal)10072650047.5%
GPT-51004341282547.3%
Claude Opus 4.7 (Reasoning)8576700046.2%
Aion 3.0 Mini10066590044.9%
Gemini 3.1 Flash Lite (Preview)10060600044.0%
Claude Opus 5 (Reasoning)10010000040.0%
Claude Opus 4.510010000040.0%
Z.AI GLM 4.610010000040.0%
DeepSeek V4 Flash10010000040.0%
GPT-4o, Aug. 6th (temp=1)10010000040.0%
Z.AI GLM 4.5 Air10010000040.0%
Hermes 3 70B10010000040.0%
Gemma 3 4B7169560039.4%
o4 Mini High8575360039.2%
Ministral 3 14B1009400038.9%
Cohere Command R+ (Aug. 2024)1009300038.5%
Claude Sonnet 5 (Reasoning, Low)1008800037.5%
GPT-5.4 Nano474640272637.3%
GPT-4.1 Nano1008100036.1%
Gemini 2.5 Flash Lite6156560034.5%
Gemma 4 31B1007200034.5%
Xiaomi MIMO v2.553434135034.3%
Mistral Large 27460360034.1%
DeepSeek V3.11006900033.9%
Gemini 2.5 Flash (Reasoning)6756470033.9%
GPT-5.4 (Reasoning)10037320033.7%
Z.AI GLM 5 Turbo1006700033.3%
Qwen 3 32B5654520032.4%
Qwen 3.5 397B A17B97272315032.3%
Qwen 3.5 Plus (2026-04-20)10047140032.1%
Claude Sonnet 4.6827800032.0%
DeepSeek V4 Flash (Reasoning)1005700031.5%
GPT-5.4 (Reasoning, Low)6460340031.4%
MoonshotAI: Kimi K3 (Reasoning, High)1005600031.2%
Claude Sonnet 4.6 (Reasoning)1005500031.0%
Gemini 3 Flash (Preview)1005500031.0%
Gemma 4 26B1005200030.4%
MiniMax M2.7916000030.1%
Qwen 3.5 Plus (2026-02-15)1004500028.9%
Muse Spark 1.1 (Reasoning, Medium)1004300028.5%
Mistral Medium 3.15949350028.5%
Qwen3.7 Max746800028.4%
GPT-5.5 (Reasoning, Low)6253250028.2%
Claude Opus 5 (Reasoning, Low)716700027.6%
o4 Mini1003400026.8%
Gemini 3.5 Flash (Reasoning)765800026.8%
Claude Opus 4.8 (Reasoning, Low)686400026.5%
GPT-5.4 Nano (Reasoning)6835290026.5%
GPT-5.137323130026.0%
MiniMax M3764600024.4%
Inception Mercury 2853500024.0%
GPT-5.56627260023.8%
Aion 3.0764300023.8%
Grok 4.5 (Reasoning, High)763900023.0%
Z.AI GLM 4.7 Flash605000022.0%
DeepSeek-V2 Chat614900022.0%
GPT-5 Nano6622220022.0%
GPT-5.4743300021.4%
Claude Sonnet 5 (Reasoning)100000020.0%
Z.AI GLM 4.7100000020.0%
Gemini 3.6 Flash (Reasoning, Minimal)100000020.0%
Gemini 3.1 Flash Lite (Reasoning)100000020.0%
ByteDance Seed 2.0 Mini100000020.0%
ByteDance Seed 2.0 Lite100000020.0%
Hermes 3 405B100000020.0%
DeepSeek V3 (2025-03-24)100000020.0%
Llama 3.1 70B100000020.0%
Cydonia 24B V4.1100000020.0%
Arcee AI: Trinity Mini100000020.0%
Ministral 3B100000020.0%
GPT-5.4 Mini3633300019.9%
Mistral Small 4514600019.5%
Mistral Small 3.2 24B87640019.4%
Claude Sonnet 4.596000019.2%
Gemini 2.5 Flash Lite (Reasoning)94000018.9%
GPT-5.4 Nano (Reasoning, Low)4027220017.9%
Qwen3.6 Max Preview543400017.7%
Mistral Large 388000017.7%
GPT-5 Mini3228270017.5%
GPT-4.1 Mini86000017.2%
Claude Opus 4483700016.9%
Gemini 3.1 Flash Lite83000016.7%
Laguna XS 2.183000016.7%
GPT-5.4 Mini (Reasoning)433900016.4%
DeepSeek V3 (2024-12-26)81000016.1%
MoonshotAI: Kimi K3 (Reasoning, Low)78000015.6%
GPT-5.6 Terra403600015.3%
MiniMax M2.571000014.3%
Qwen 3.5 35B2626170013.8%
MoonshotAI: Kimi K2.568000013.7%
GPT-4o, Aug. 6th (temp=0)68000013.7%
Claude Opus 4.665000013.0%
DeepSeek V4 Pro64000012.8%
Gemini 2.5 Pro63000012.5%
Xiaomi MIMO v2.5 Pro63000012.5%
Grok 4.5 (Reasoning, Low)61000012.2%
Claude Opus 561000012.2%
GPT-5.6 Sol292800011.5%
ByteDance Seed 1.6 Flash57000011.4%
Grok 4.356000011.2%
GPT-5.5 (Reasoning)282800011.0%
Ministral 3 8B55000011.0%
DeepSeek V4 Pro (Reasoning)54000010.9%
Z.AI GLM 5.2 (Reasoning, High)54000010.8%
GPT-5.2272600010.7%
Aion 2.053000010.6%
Grok 4.20 (Reasoning)53000010.5%
DeepSeek V3.250000010.0%
GPT-4.14900009.7%
Qwen 3.6 27B4800009.5%
Qwen 3.5 Flash31150009.3%
Nemotron 3 Super4400008.8%
GPT-OSS 120B3900007.8%
Nemotron 3 Nano3900007.8%
GPT-5.4 Mini (Reasoning, Low)3800007.6%
Qwen 3.5 27B3610007.4%
Grok 4.203200006.3%
GPT-5.6 Luna (Reasoning)3100006.3%
Qwen 3.6 Flash2900005.7%
Qwen 3.5 122B1900003.9%
Qwen 3.6 35B600001.2%
GPT-5.6 Sol (Reasoning)000000.0%
Gemini 3.6 Flash (Reasoning)000000.0%
Gemini 3.1 Pro (Preview)000000.0%
MoonshotAI: Kimi K2.6000000.0%
GPT-5.6 Terra (Reasoning)000000.0%
Claude Opus 4.8 (Reasoning)000000.0%
Muse Spark 1.1 (Reasoning, Minimal)000000.0%
Grok 4.3 (Reasoning)000000.0%
Thinking Machines Inkling (Reasoning)000000.0%
Gemini 3 Flash (Preview, Reasoning)000000.0%
Claude Opus 4.7000000.0%
Gemma 4 31B (Reasoning)000000.0%
Gemma 4 26B (Reasoning)000000.0%
GPT-5.6 Luna000000.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)000000.0%
Gemini 3.5 Flash Lite (Reasoning)000000.0%
Qwen 3.5 9B000000.0%
Gemini 2.5 Flash000000.0%
Laguna S 2.1000000.0%
Thinking Machines Inkling000000.0%
Qwen 2.5 72B000000.0%
WizardLM 2 8x22b000000.0%
Ministral 3 3B000000.0%
Ministral 8B000000.0%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Cohere Command R+ (Aug. 2024)10010098856990.4%
DeepSeek V3.21001009795078.5%
Laguna S 2.110010010088077.5%
Gemma 3 4B10010010085076.9%
Writer: Palmyra X510010010068073.5%
Qwen 3.5 397B A17B1009669632670.9%
Gemini 2.5 Flash Lite (Reasoning)1009166494369.8%
GPT-4o Mini (temp=1)100888181069.8%
Arcee AI: Trinity Mini100947776069.4%
Z.AI GLM 4.6100797571065.1%
Qwen 3.5 Flash1001006148061.9%
Claude Sonnet 41001001000060.0%
Hermes 3 70B1001001000060.0%
ByteDance Seed 1.6100100910058.2%
Gemini 3.5 Flash (Reasoning, Minimal)10096880056.8%
Laguna XS 2.1100100770055.4%
Gemini 2.5 Flash Lite100100680053.7%
Xiaomi MIMO v2.510096680052.7%
Gemma 4 31B (Reasoning)9181770049.7%
Gemma 4 31B8582770048.7%
Qwen 3.5 27B100100410048.2%
GPT-4o Mini (temp=0)8581700047.2%
GPT-5.472705834046.9%
Z.AI GLM 5.110068630046.0%
Gemini 3 Flash (Preview, Reasoning)10063600044.4%
Gemini 2.5 Flash10070440042.9%
Z.AI GLM 4.7 Flash10059540042.6%
Gemma 3 12B10056550042.2%
Mistral Large 26968680041.1%
Claude Haiku 4.57566640040.9%
Z.AI GLM 510060420040.4%
Claude Sonnet 5 (Reasoning)10010000040.0%
Claude Sonnet 4.510010000040.0%
ByteDance Seed 2.0 Mini10010000040.0%
Gemini 3.1 Flash Lite (Preview)10010000040.0%
Ministral 8B10010000040.0%
Qwen 3.6 Flash10062350039.3%
GPT-5.4 Nano (Reasoning, Low)86552727039.1%
GPT-5.4 (Reasoning, Low)10060350038.9%
Mistral Small 4 (Reasoning)10049410038.0%
Gemini 3.6 Flash (Reasoning)1008900037.9%
Claude Opus 5 (Reasoning)1008900037.9%
Claude Opus 4.6 (Reasoning)10051360037.3%
Qwen 3.5 Plus (2026-02-15)10048390037.3%
Claude Opus 4.71008600037.2%
Z.AI GLM 4.5 Air1008500036.9%
GPT-5 Mini10043420036.9%
GPT-5.4 Mini (Reasoning, Low)10045370036.3%
Grok 4.5 (Reasoning, Low)1007900035.7%
Claude Opus 4.56755530034.8%
GPT-4.1 Mini987500034.5%
Gemma 3 27B1007000034.1%
Grok 4.20 (Reasoning)888100033.8%
Gemini 2.5 Flash (Reasoning)1006600033.2%
Claude Opus 47056370032.8%
Qwen 3.6 35B7558300032.8%
Z.AI GLM 4.5887400032.2%
Qwen 3.5 Plus (2026-04-20)1006000032.0%
Thinking Machines Inkling857100031.2%
Gemini 3.1 Pro (Preview)896400030.7%
Claude Sonnet 4.6836800030.4%
Claude Opus 4.65451460030.2%
ByteDance Seed 1.6 Flash5746460029.8%
DeepSeek V3 (2024-12-26)816800029.6%
Muse Spark 1.1 (Reasoning, Minimal)5347430028.7%
MiniMax M2.5746800028.5%
DeepSeek V4 Pro (Reasoning)1004200028.3%
GPT-5.4 Nano46412624027.4%
GPT-5.6 Terra (Reasoning)1003700027.4%
GPT-OSS 120B<