Name drop frequency

Test: Bad Writing Habits

Avg. Score
69.1%
Scenarios
18

Overall Performance

Rank ▲ Model Score Avg. Cost Avg. Time Stability
1GPT-4.1 Nano94.8%$0.000713.3s81%
2Gemini 3.1 Flash Lite93.6%$0.003012.1s77%
3Gemini 3.1 Flash Lite (Reasoning)92.2%$0.003011.9s69%
4Gemini 3.1 Flash Lite (Preview)90.2%$0.00308.4s66%
5Gemma 3 4B88.9%$0.000220.0s65%
6Gemini 2.5 Pro92.7%$0.03636.2s69%
7DeepSeek V3.190.6%$0.00201.8m69%
8Z.AI GLM 4.689.7%$0.006551.5s59%
9Xiaomi MIMO v2.585.5%$0.005431.8s57%
10Gemini 2.5 Flash Lite (Reasoning)84.6%$0.002830.8s56%
11Grok 4.5 (Reasoning, Low)87.9%$0.0181.1m62%
12Grok 4.20 (Reasoning)88.6%$0.0181.5m66%
13GPT-5 Nano85.9%$0.00421.4m63%
14Gemma 4 26B84.1%$0.000955.1s56%
15Claude Haiku 5.5 (Reasoning, Medium)82.6%$0.001414.9s50%
16Claude Haiku 5.5 (Adaptive)83.6%$0.001819.3s50%
17Grok 4.5 (Reasoning, High)90.3%$0.0301.6m66%
18Claude Sonnet 588.1%$0.02733.5s55%
19Nemotron 3 Nano83.3%$0.00101.1m52%
20Inception Mercury 276.8%$0.00327.0s48%
21GPT-4o Mini (temp=1)80.4%$0.001234.8s48%
22Claude Sonnet 5 (Reasoning, Low)84.6%$0.03138.4s54%
23Grok 4.2083.4%$0.009345.7s48%
24Claude Haiku 5.5 (Reasoning, Max)94.4%$0.0314.7m84%
25Gemini 2.5 Flash80.2%$0.005210.6s42%
26Gemini 2.5 Flash Lite78.5%$0.00099.5s41%
27ByteDance Seed 2.0 Lite86.1%$0.0122.2m59%
28Nemotron 3 Super82.5%$0.00001.4m50%
29DeepSeek V3.283.5%$0.00141.9m54%
30Z.AI GLM 5.3 Flash (Reasoning, Low)83.2%$0.00051.1m45%
31GPT-OSS 120B83.0%$0.00151.8m53%
32Grok 4.3 (Reasoning)87.3%$0.0212.3m60%
33GPT-5 Mini82.2%$0.010057.4s47%
34Claude Sonnet 5 (Reasoning)85.1%$0.03038.9s47%
35Kimi K3 (Reasoning, Low)85.2%$0.0281.1m51%
36Gemma 4 26B (Reasoning)82.0%$0.00132.0m52%
37Gemini 2.5 Flash (Reasoning)79.5%$0.01121.5s41%
38Aion 3.5 (Reasoning, High)82.0%$0.0221.3m51%
39Xiaomi MIMO v2.6 Pro85.2%$0.00332.0m48%
40Grok 4.379.3%$0.006930.5s40%
41Aion 3.5 Mini (Reasoning, High)86.6%$0.0112.4m54%
42Z.AI GLM 5.2 (Reasoning, High)81.4%$0.0111.0m44%
43Aion 2.081.1%$0.00641.3m45%
44Qwen 3.7 Flash (Reasoning)79.4%$0.001055.2s41%
45Arcee AI: Trinity Mini76.0%$0.00039.2s36%
46Laguna XS 2.176.0%$0.000314.4s37%
47Claude Sonnet 5.5 (Reasoning)82.1%$0.04236.9s47%
48DeepSeek V4 Flash75.7%$0.000631.6s37%
49ByteDance Seed 1.684.3%$0.0132.5m53%
50Claude Opus 4.8 (Reasoning, Low)86.1%$0.07141.9s53%
51Xiaomi MIMO v2.6 Flash80.7%$0.00081.8m44%
52Claude Haiku 5.5 (Reasoning, Low)76.5%$0.001515.4s31%
53Xiaomi MIMO v2.5 Pro78.1%$0.008553.5s38%
54Gemma 3 27B76.7%$0.000652.6s35%
55Gemini 3.5 Flash Lite (Reasoning)72.9%$0.00356.6s32%
56Gemini 3.7 Flash (Reasoning, Medium)71.3%$0.01218.2s38%
57Gemini 3.5 Flash Lite (Reasoning, Minimal)71.2%$0.00356.3s33%
58Claude Sonnet 4.681.4%$0.03139.3s37%
59DeepSeek V4 Flash (Reasoning)73.8%$0.000731.1s33%
60Claude Opus 4.784.4%$0.06930.4s45%
61Gemini 3.5 Flash (Reasoning, Minimal)71.8%$0.01812.0s37%
62Z.AI GLM 5 Turbo75.6%$0.008133.2s32%
63Mistral Large 4.074.5%$0.00631.1m39%
64Claude Opus 4.7 (Reasoning)84.2%$0.07632.0s47%
65Z.AI GLM 577.1%$0.00841.2m37%
66Gemini 3 Flash (Preview, Reasoning)70.9%$0.01230.1s37%
67GPT-4o, Aug. 6th (temp=1)72.7%$0.01824.4s36%
68GPT-4.1 Mini71.9%$0.002719.0s30%
69Gemini 3.8 Flash (Reasoning, Medium)70.8%$0.01418.0s35%
70Gemini 3 Flash (Preview)68.4%$0.007819.6s36%
71Z.AI GLM 5.177.7%$0.0141.5m40%
72Claude Opus 5.5 (Reasoning)86.7%$0.09256.0s51%
73DeepSeek V4.1 Flash (Reasoning, High)73.7%$0.002935.4s29%
74MiniMax M2.575.3%$0.00341.3m35%
75Claude Opus 584.5%$0.08250.1s48%
76DeepSeek V4 Flash 0731 (Reasoning, High)79.9%$0.00222.6m42%
77ByteDance Seed 2.0 Mini88.4%$0.00454.9m58%
78GPT-4.171.7%$0.01844.7s36%
79Gemma 4 31B71.6%$0.00101.6m38%
80MiniMax M2.772.5%$0.00401.1m33%
81Z.AI GLM 4.7 Flash71.5%$0.00171.2m33%
82MiniMax M381.6%$0.00603.1m44%
83DeepSeek V4 Pro71.0%$0.00481.3m36%
84Qwen 3.6 Flash70.0%$0.01041.4s32%
85Claude Sonnet 4.6 (Reasoning)81.8%$0.0601.2m42%
86Claude Opus 4.8 (Reasoning)83.3%$0.07141.7s39%
87Mistral Medium 3.167.9%$0.004836.5s31%
88Laguna S 2.166.0%$0.000522.1s28%
89Qwen 3 32B67.6%$0.001554.6s32%
90Muse Spark 1.1 (Reasoning, Medium)69.3%$0.01523.9s30%
91Cydonia 24B V4.169.5%$0.001444.8s28%
92Qwen 3.6 35B70.4%$0.00831.0m31%
93o4 Mini High73.6%$0.02547.2s31%
94Gemma 4 31B (Reasoning)72.7%$0.00142.2m38%
95Gemma 3 12B68.7%$0.000441.3s25%
96Claude Haiku 4.567.0%$0.01121.6s27%
97Gemini 3.6 Flash (Reasoning, Minimal)65.7%$0.01714.3s29%
98Aion 3.0 Mini70.9%$0.00531.2m28%
99Aion 3.071.6%$0.0241.0m32%
100Mistral Medium 3.5 (Reasoning)64.3%$0.01818.0s31%
101Mistral Medium 3.566.2%$0.01818.2s28%
102Qwen 3.5 Plus (2026-02-15)64.3%$0.006031.5s28%
103Claude Sonnet 469.2%$0.03243.7s34%
104Qwen 3 235B A22B Instruct 250770.8%$0.001159.2s23%
105Claude Opus 5 (Reasoning)83.3%$0.0981.0m45%
106o4 Mini67.0%$0.01525.7s26%
107Ministral 3 14B59.1%$0.000711.7s27%
108Grok 4.7 (Reasoning, High)87.6%$0.0743.9m61%
109Mistral Large 361.2%$0.003330.3s28%
110Thinking Machines Inkling Small (Reasoning, High)70.3%$0.00881.7m32%
111DeepSeek V4 Pro (Reasoning)78.5%$0.0153.1m39%
112Ministral 3 8B59.7%$0.000819.6s26%
113Mistral Small 458.8%$0.001418.2s27%
114Claude Opus 5 (Reasoning, Low)82.9%$0.0971.0m41%
115DeepSeek V3 (2024-12-26)64.7%$0.002154.6s26%
116WizardLM 2 8x22b69.3%$0.00261.8m30%
117Z.AI GLM 4.769.1%$0.0101.4m29%
118Grok 4.6 (Reasoning, High)79.4%$0.0422.5m40%
119Writer: Palmyra X564.7%$0.01122.0s21%
120Muse Spark 1.1 (Reasoning, Minimal)63.3%$0.01219.2s22%
121Claude Opus 4.6 (Reasoning)79.4%$0.0881.4m42%
122Ministral 8B57.3%$0.000410.4s22%
123GPT-4o Mini (temp=0)61.3%$0.001234.8s22%
124Mistral Large 4.0 (Reasoning)78.3%$0.0233.4m41%
125Cohere Command R+ (Aug. 2024)64.2%$0.02052.5s28%
126Muse Spark 1.2 (Reasoning, Medium)65.6%$0.01838.3s23%
127DeepSeek-V2 Chat61.4%$0.002153.3s25%
128ByteDance Seed 1.6 Flash57.8%$0.001327.3s24%
129Claude Opus 4.677.6%$0.0781.2m37%
130GPT-580.8%$0.0652.8m45%
131Gemini 3.6 Flash (Reasoning)66.7%$0.04432.5s28%
132Mistral NeMO54.7%$0.000510.1s21%
133Ministral 3B53.1%$0.00018.1s22%
134GPT-5.4 Mini (Reasoning)61.2%$0.02228.1s24%
135Mistral Large 257.5%$0.01329.4s25%
136Mistral Small 4 (Reasoning)56.5%$0.002230.2s22%
137Hermes 3 70B59.7%$0.00101.2m25%
138 Kimi K3 (Reasoning, High)72.9%$0.0441.8m32%
139Muse Glimmer 30B (Reasoning, Medium)61.8%$0.003843.4s17%
140Qwen 3.5 Plus (2026-04-20)69.0%$0.0171.8m25%
141GPT-5.4 Mini54.6%$0.01516.8s25%
142DeepSeek V3 (2025-03-24)55.6%$0.001439.4s22%
143Kimi K2.573.1%$0.0193.2m36%
144Claude Sonnet 4.562.8%$0.03538.1s23%
145Z.AI GLM 5.3 Flash (Reasoning, Max)84.7%$0.00316.5m49%
146Gemini 3.5 Flash (Reasoning)68.4%$0.07137.6s29%
147Claude Opus 4.567.7%$0.07053.4s32%
148GPT-4o, Aug. 6th (temp=0)55.7%$0.02322.7s22%
149Qwen 3.5 Flash55.3%$0.002547.5s19%
150DeepSeek V4 Pro 0813 (Reasoning, High)66.5%$0.0251.8m25%
151Ministral 3 3B47.8%$0.000511.1s19%
152Muse Spark 1.3 (Reasoning, Medium)64.7%$0.0251.8m25%
153GPT-5.4 Mini (Reasoning, Low)52.2%$0.01516.8s18%
154Llama 3.1 70B47.7%$0.001529.4s19%
155GPT-5.463.0%$0.0491.4m28%
156Qwen 3.8 Flash (Reasoning)64.8%$0.00643.1m28%
157GPT-5.171.7%$0.0541.8m23%
158Qwen 3.6 Max Preview75.2%$0.0503.5m34%
159GPT-6 Luna (Reasoning, High)46.4%$0.002357.1s21%
160Hermes 3 405B50.4%$0.003253.2s15%
161GPT-6 Luna (Reasoning, Medium)44.6%$0.001643.0s18%
162Hy4 Preview (Reasoning, High)75.3%$0.0404.4m37%
163Qwen 2.5 72B40.8%$0.001036.7s21%
164GPT-6 Luna41.2%$0.001332.6s19%
165Z.AI GLM 4.5 Air47.1%$0.002958.2s17%
166Qwen 3.6 27B63.8%$0.0252.3m20%
167GPT-5.4 (Reasoning, Low)61.4%$0.0551.4m22%
168GPT-5.6 Luna (Reasoning, Medium)38.2%$0.01718.0s21%
169Thinking Machines Inkling51.1%$0.00751.5m15%
170Z.AI GLM 5.3 (Reasoning, Max)87.3%$0.0667.3m57%
171GPT-5.6 Terra (Reasoning, Medium)44.6%$0.04435.2s24%
172Z.AI GLM 4.542.0%$0.005142.1s14%
173Qwen 3.5 397B A17B57.9%$0.0143.0m22%
174Qwen 3.5 122B51.5%$0.0251.1m12%
175Qwen 3.5 35B49.7%$0.0181.0m11%
176GPT-5.4 Nano (Reasoning)39.1%$0.006124.5s12%
177GPT-5.4 Nano (Reasoning, Low)36.5%$0.005520.6s13%
178GPT-5.4 Nano36.9%$0.005726.3s12%
179GPT-5.6 Terra40.5%$0.04636.9s25%
180GPT-5.6 Luna32.8%$0.01515.8s18%
181Qwen 3.7 Max61.7%$0.0682.3m21%
182Qwen 3.5 9B42.1%$0.00111.4m7%
183Kimi K2.678.3%$0.0586.5m43%
184Gemini 3.1 Pro (Preview)64.3%$0.1071.8m25%
185Thinking Machines Inkling (Reasoning)67.9%$0.0255.1m27%
186Qwen 3.8 27B (Reasoning, XHigh)66.6%$0.0404.7m29%
187GPT-5.4 (Reasoning)64.8%$0.0892.6m26%
188GPT-6.1 Sol (Reasoning, Medium)42.7%$0.0311.6m17%
189GPT-6 Sol (Reasoning, Medium)37.1%$0.0311.0m16%
190GPT-6 Sol33.1%$0.02751.4s15%
191Qwen 3.5 27B44.2%$0.0201.6m8%
192GPT-5.6 Sol43.4%$0.1051.2m28%
193Mistral Small 3.2 24B52.8%$0.00695.7m15%
194GPT-5.544.5%$0.1391.7m28%
195GPT-5.6 Sol (Reasoning, Medium)34.8%$0.1081.2m17%
196Qwen 3.8 Max (Reasoning, XHigh)61.0%$0.0835.9m27%
197GPT-5.228.0%$0.0561.5m6%
198GPT-5.5 (Reasoning, Medium)39.5%$0.1421.8m21%
199Claude Opus 456.3%$0.2091.4m22%
200GPT-5.5 (Reasoning, Low)36.1%$0.1391.8m15%
69.07%

Individual Scenarios

Detailed Writing Rules

Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Claude Opus 5.5 (Reasoning)100100100100100100.0%
Claude Opus 5 (Reasoning)100100100100100100.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Low)10010099 – – 99.6%
Gemini 3.1 Flash Lite1001001001009398.6%
GPT-4.1 Nano100100100989498.3%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100988997.3%
Claude Opus 5 (Reasoning, Low)100100100958395.7%
Claude Sonnet 4.6 (Reasoning)100100100958395.6%
Gemma 3 4B100100100928395.2%
Claude Sonnet 5 (Reasoning)100100100898394.4%
Grok 4.3 (Reasoning)10010099898394.3%
Gemini 3.5 Flash Lite (Reasoning)1001001001006993.7%
ByteDance Seed 2.0 Mini1001001001006793.3%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100966792.5%
Aion 3.5 Mini (Reasoning, High)1001001001006092.1%
ByteDance Seed 2.0 Lite10010094838191.7%
Gemini 3.5 Flash (Reasoning, Minimal)1001001001005090.0%
Claude Opus 51009892827790.0%
Z.AI GLM 4.710010097836989.8%
Claude Sonnet 5 (Reasoning, Low)1009388877588.6%
GPT-OSS 120B1009492857188.5%
Grok 4.5 (Reasoning, High)1009683837888.2%
Gemini 2.5 Flash (Reasoning)1009088887087.1%
Claude Sonnet 4.61008683838387.1%
Gemini 3.1 Pro (Preview)10010083836786.7%
Xiaomi MIMO v2.6 Pro100100100676786.7%
MiniMax M3988383838386.3%
Gemini 3.5 Flash Lite (Reasoning, Minimal)1009788836185.9%
Thinking Machines Inkling Small (Reasoning, High)959594826385.8%
DeepSeek V3.21009483836785.5%
GPT-4.1 Mini10010080786785.0%
Claude Opus 4.8 (Reasoning, Low)1008887816784.4%
Grok 4.3938383837483.4%
GPT-510010083835083.3%
GPT-5 Nano10010083676783.3%
Grok 4.5 (Reasoning, Low)978683836783.3%
Inception Mercury 2898887826782.6%
Gemma 3 12B1009898675082.5%
Claude Haiku 5.5 (Adaptive)100100100555181.3%
Nemotron 3 Super958877766981.0%
Xiaomi MIMO v2.5 Pro959283676780.8%
Qwen 3.7 Flash (Reasoning)100100100831880.4%
Z.AI GLM 5.3 (Reasoning, Max)838383836780.0%
Grok 4.7 (Reasoning, High)1008383676780.0%
GPT-5.11008383785078.9%
Claude Sonnet 5838282767178.6%
Xiaomi MIMO v2.51008773676678.5%
Gemini 2.5 Pro10010091673378.3%
Gemma 4 31B (Reasoning)948477716478.0%
Grok 4.20878282716777.8%
Grok 4.6 (Reasoning, High)888583825077.7%
ByteDance Seed 1.6838282717077.6%
Z.AI GLM 5.2 (Reasoning, High)1009483605077.6%
Qwen 3.7 Max10010076654276.7%
Kimi K3 (Reasoning, High)1009183595076.7%
Muse Spark 1.1 (Reasoning, Minimal)1008372676276.7%
Gemini 3.6 Flash (Reasoning, Minimal)10010067665076.5%
Claude Opus 4.71009669675076.2%
Gemini 3.1 Flash Lite (Preview)10010068615176.1%
DeepSeek V4 Pro (Reasoning)1009285584475.9%
DeepSeek V3.11008478675075.8%
Ministral 3 3B938779695075.7%
Muse Glimmer 30B (Reasoning, Medium)838378676775.6%
Muse Spark 1.1 (Reasoning, Medium)1009273674675.5%
Kimi K3 (Reasoning, Low)838373706675.1%
Claude Opus 4.7 (Reasoning)1008171685574.9%
Z.AI GLM 4.6969483673374.8%
Gemini 2.5 Flash Lite (Reasoning)1008583505073.6%
Claude Haiku 5.5 (Reasoning, Medium)100100100422473.2%
Gemma 4 26B (Reasoning)978270674973.0%
GPT-5 Mini1009867505073.0%
Nemotron 3 Nano998382673372.8%
Claude Sonnet 5.5 (Reasoning)997875615072.6%
Qwen 3.8 Flash (Reasoning)1008379673372.5%
DeepSeek V4 Flash1008268625072.4%
Thinking Machines Inkling (Reasoning)1009267673472.0%
GPT-5.4 Mini837867676572.0%
Z.AI GLM 5.1938178743371.9%
Grok 4.20 (Reasoning)837572705971.6%
Claude Opus 4.6878276625071.4%
Z.AI GLM 510010062613371.2%
Gemini 3 Flash (Preview)838371675070.8%
Qwen 3.6 35B997167665070.5%
Gemini 3 Flash (Preview, Reasoning)877968675070.2%
DeepSeek V4 Pro 0813 (Reasoning, High)917775555470.2%
Claude Opus 4.6 (Reasoning)1008367673370.0%
Aion 3.0 Mini927966644969.9%
Ministral 3B949367484669.5%
Gemini 2.5 Flash Lite848267645069.4%
GPT-5.4 (Reasoning)838366645069.3%
Gemma 4 31B767469676169.3%
GPT-4o Mini (temp=1)848367625069.0%
Cydonia 24B V4.110010067611768.9%
Laguna S 2.11007766515068.8%
GPT-5.4846767675868.4%
Gemini 2.5 Flash838176505068.2%
Gemma 3 27B1007967613368.0%
DeepSeek V4.1 Flash (Reasoning, High)838375653468.0%
Aion 3.5 (Reasoning, High)807967645067.8%
Laguna XS 2.1797767585667.3%
Claude Haiku 4.5826765645967.2%
Claude Opus 4.8 (Reasoning)978754504766.9%
DeepSeek V4 Flash 0731 (Reasoning, High)848367673366.7%
Z.AI GLM 5 Turbo916767585066.4%
Muse Spark 1.2 (Reasoning, Medium)10010050453365.6%
MiniMax M2.7936760585065.6%
Hy4 Preview (Reasoning, High)1008057484265.5%
DeepSeek V4 Flash (Reasoning)1006764603364.7%
Xiaomi MIMO v2.6 Flash756767615063.8%
Hermes 3 70B887850504963.1%
Mistral Large 4.0 (Reasoning)877165622862.6%
Gemini 3.5 Flash (Reasoning)1006766503062.5%
Ministral 3 8B906865503962.5%
Z.AI GLM 4.7 Flash948358413361.9%
Gemma 4 26B1006554493961.7%
Gemini 3.6 Flash (Reasoning)1005955534261.6%
Mistral Medium 3.5756764624061.6%
Aion 2.0918367333361.5%
Mistral Small 3.2 24B89816967061.0%
Kimi K2.61006762562061.0%
Ministral 8B1006756483360.8%
Qwen 3.5 Plus (2026-02-15)100786659060.6%
MiniMax M2.5837750484259.9%
Mistral Large 4.0896767433359.8%
GPT-5.4 Mini (Reasoning)796464504259.7%
ByteDance Seed 1.6 Flash676160565559.7%
Qwen 3 235B A22B Instruct 2507837667501658.5%
Qwen 3.6 Max Preview766564533358.3%
Kimi K2.5726864543358.2%
o4 Mini636057555257.5%
Gemini 3.8 Flash (Reasoning, Medium)686766503356.8%
GPT-5.6 Terra (Reasoning, Medium)625957504955.3%
WizardLM 2 8x22b100675850055.0%
GPT-5.4 Mini (Reasoning, Low)897560331754.9%
Claude Sonnet 4675856504254.5%
Mistral Large 2676056553454.5%
GPT-5.6 Sol (Reasoning, Medium)656354464254.2%
Hermes 3 405B93906819054.1%
Qwen 3.6 Flash957657241753.9%
Llama 3.1 70B82716250053.2%
Mistral Large 3675550494553.2%
Arcee AI: Trinity Mini726763372753.1%
DeepSeek-V2 Chat685351503952.3%
Mistral Medium 3.1666160422751.3%
Qwen 3.8 Max (Reasoning, XHigh)786841333250.6%
Mistral NeMO82675944050.3%
Claude Opus 4645450503350.2%
GPT-5.5 (Reasoning, Low)815050333349.6%
Aion 3.0716857331749.2%
Cohere Command R+ (Aug. 2024)100504846048.8%
GPT-5.6 Terra525050484448.7%
Claude Sonnet 4.5706844441447.9%
Mistral Medium 3.5 (Reasoning)746350331747.5%
GPT-4o, Aug. 6th (temp=1)675949451847.4%
GPT-5.6 Sol555050423947.3%
DeepSeek V4 Pro747333282346.3%
GPT-5.5505050473346.1%
Qwen 3.8 27B (Reasoning, XHigh)767348171746.1%
Gemini 3.7 Flash (Reasoning, Medium)615050412846.0%
Qwen 2.5 72B635550431946.0%
DeepSeek V3 (2025-03-24)635642382945.6%
Writer: Palmyra X567595350045.6%
Mistral Small 481635033045.4%
Ministral 3 14B676449271744.9%
GPT-4.1545050353344.4%
o4 Mini High835148211744.1%
GPT-6 Sol (Reasoning, Medium)505049393243.8%
GPT-5.6 Luna (Reasoning, Medium)584646333343.2%
GPT-6.1 Sol (Reasoning, Medium)595633333343.1%
Qwen 3.5 35B67555044043.0%
GPT-5.4 (Reasoning, Low)67645033042.8%
Claude Opus 4.5675044331742.4%
Qwen 3.5 Plus (2026-04-20)62505045041.3%
Qwen 3 32B605050331441.3%
Thinking Machines Inkling79474136140.8%
Qwen 3.5 Flash67604231040.0%
GPT-5.5 (Reasoning, Medium)505050331740.0%
DeepSeek V3 (2024-12-26)655442221639.6%
Muse Spark 1.3 (Reasoning, Medium)575043311739.5%
Qwen 3.6 27B66645017039.1%
Mistral Small 4 (Reasoning)62504533038.0%
GPT-4o Mini (temp=0)67563333037.9%
GPT-5.4 Nano (Reasoning, Low)474233331734.4%
Qwen 3.5 397B A17B60474517033.7%
GPT-5.28350330033.3%
GPT-4o, Aug. 6th (temp=0)59353433032.2%
Z.AI GLM 4.5 Air50383633031.4%
GPT-5.4 Nano (Reasoning)46433333031.1%
GPT-5.6 Luna443332261129.0%
GPT-5.4 Nano423329221728.6%
Z.AI GLM 4.550332928028.1%
GPT-6 Luna63342216027.1%
Qwen 3.5 27B973300026.1%
GPT-6 Luna (Reasoning, High)373120151423.5%
GPT-6 Sol38221817720.3%
GPT-6 Luna (Reasoning, Medium)45241413620.2%
Qwen 3.5 122B2800005.6%
Qwen 3.5 9B000000.0%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Claude Opus 5.5 (Reasoning)100100100100100100.0%
Claude Opus 4.6 (Reasoning)100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100.0%
Claude Sonnet 4.6 (Reasoning)100100100100100100.0%
Z.AI GLM 5 Turbo100100100100100100.0%
Kimi K3 (Reasoning, High)100100100100100100.0%
Claude Opus 4.8 (Reasoning)100100100100100100.0%
Claude Opus 4.6100100100100100100.0%
Kimi K3 (Reasoning, Low)100100100100100100.0%
Claude Opus 5 (Reasoning, Low)100100100100100100.0%
Claude Opus 4.8 (Reasoning, Low)100100100100100100.0%
Xiaomi MIMO v2.6 Pro100100100100100100.0%
GPT-5100100100100100100.0%
GPT-5.1100100100100100100.0%
Claude Sonnet 4.6100100100100100100.0%
Claude Sonnet 5 (Reasoning)100100100100100100.0%
Claude Opus 5100100100100100100.0%
ByteDance Seed 1.6100100100100100100.0%
Gemma 4 26B (Reasoning)100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100100100100.0%
Gemini 2.5 Pro100100100100100100.0%
DeepSeek V4 Flash (Reasoning)100100100100100100.0%
DeepSeek V4 Flash 0731 (Reasoning, High)100100100100100100.0%
Z.AI GLM 4.7100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Low)100100100 – – 100.0%
Z.AI GLM 4.6100100100100100100.0%
Claude Sonnet 5100100100100100100.0%
Xiaomi MIMO v2.6 Flash100100100100100100.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100100100.0%
ByteDance Seed 2.0 Mini100100100100100100.0%
Gemini 3.1 Flash Lite (Preview)100100100100100100.0%
Gemini 3.1 Flash Lite100100100100100100.0%
Gemma 4 26B100100100100100100.0%
ByteDance Seed 2.0 Lite100100100100100100.0%
Gemini 2.5 Flash (Reasoning)100100100100100100.0%
Xiaomi MIMO v2.5100100100100100100.0%
Gemini 2.5 Flash Lite (Reasoning)100100100100100100.0%
DeepSeek V3.1100100100100100100.0%
GPT-5 Nano100100100100100100.0%
Gemini 2.5 Flash Lite100100100100100100.0%
GPT-4o Mini (temp=1)100100100100100100.0%
Gemma 3 12B100100100100100100.0%
Gemma 3 27B100100100100100100.0%
GPT-4.1 Nano100100100100100100.0%
Thinking Machines Inkling (Reasoning)1001001001009999.9%
Z.AI GLM 5.11001001001009999.9%
Aion 2.01001001001009999.9%
GPT-4o, Aug. 6th (temp=1)1001001001009999.8%
Nemotron 3 Super1001001001009699.2%
Muse Spark 1.3 (Reasoning, Medium)1001001001009699.2%
Grok 4.5 (Reasoning, High)1001001001009699.2%
Claude Haiku 5.5 (Adaptive)1001001001009498.8%
Z.AI GLM 5100100100979698.7%
Grok 4.20 (Reasoning)1001001001009398.5%
Claude Sonnet 5 (Reasoning, Low)1001001001009398.5%
Nemotron 3 Nano1001001001009298.4%
Claude Sonnet 5.5 (Reasoning)1001001001009097.9%
Inception Mercury 210010099989197.6%
Claude Haiku 5.5 (Reasoning, Medium)1001001001008897.6%
Gemini 3.5 Flash (Reasoning)1001001001008897.5%
Qwen 3.7 Max100100100988897.1%
Gemma 4 31B10010097959397.0%
Gemini 3.5 Flash (Reasoning, Minimal)1001001001008496.9%
Muse Spark 1.2 (Reasoning, Medium)1001001001008396.7%
GPT-5.4 (Reasoning)1001001001008396.7%
Muse Spark 1.1 (Reasoning, Medium)1001001001008396.7%
Z.AI GLM 5.2 (Reasoning, High)1001001001008396.7%
Claude Opus 4.71001001001008396.7%
Qwen 3.7 Flash (Reasoning)1001001001008396.7%
MiniMax M2.71001001001008396.7%
DeepSeek V3.21001001001008396.7%
Writer: Palmyra X51001001001008396.7%
Laguna XS 2.11001001001008396.7%
Qwen 3.6 Flash1001001001008396.7%
Aion 3.01001001001008396.7%
Gemma 3 4B1001001001008396.7%
Xiaomi MIMO v2.5 Pro100100100998396.5%
GPT-5.4 Mini (Reasoning)10010098978395.8%
Grok 4.3 (Reasoning)100100100898895.4%
GPT-4.1 Mini100100100928395.0%
WizardLM 2 8x22b100100100908394.7%
Gemma 4 31B (Reasoning)10010099898694.6%
Aion 3.0 Mini100100100947693.9%
Qwen 3.5 122B100100100868393.8%
Gemini 3.6 Flash (Reasoning, Minimal)1009693928693.6%
Grok 4.3100100100888093.5%
Z.AI GLM 5.3 (Reasoning, Max)1001001001006793.3%
DeepSeek V4.1 Flash (Reasoning, High)1001001001006793.3%
Grok 4.7 (Reasoning, High)100100100838393.3%
Claude Opus 4.7 (Reasoning)1001001001006793.3%
GPT-5 Mini1001001001006793.3%
Claude Opus 5 (Reasoning)1001001001006793.3%
DeepSeek V4 Pro 0813 (Reasoning, High)1001001001006793.3%
Claude Opus 4.5100100100838393.3%
o4 Mini High100100100838393.3%
Z.AI GLM 4.7 Flash100100100838393.3%
Gemini 2.5 Flash1001001001006793.3%
Qwen 3 235B A22B Instruct 25071001001001006793.3%
Cydonia 24B V4.1100100100838393.3%
Kimi K2.6100100100838393.2%
Gemini 3.7 Flash (Reasoning, Medium)10010091888693.1%
Grok 4.2010010096838392.5%
Thinking Machines Inkling Small (Reasoning, High)10010099827992.0%
Gemini 3.6 Flash (Reasoning)100100100807991.8%
Mistral Large 4.0 (Reasoning)10010098926791.3%
DeepSeek V4 Flash100100100866790.6%
Qwen 3.6 35B100100100846790.2%
Qwen 3.8 Max (Reasoning, XHigh)1001001001005090.0%
DeepSeek V4 Pro (Reasoning)1001001001005090.0%
Qwen 3.6 27B1001001001005090.0%
DeepSeek V4 Pro10010083838390.0%
Hy4 Preview (Reasoning, High)100100100995089.9%
Mistral Large 310010094847089.7%
Qwen 3.8 27B (Reasoning, XHigh)1009390817788.1%
GPT-5.4 (Reasoning, Low)100100100915088.1%
Qwen 3.5 397B A17B1009689866988.0%
Gemini 3 Flash (Preview)1009083837886.9%
Aion 3.5 Mini (Reasoning, High)1001001001003386.7%
Qwen 3.5 Plus (2026-04-20)1001001001003386.7%
MiniMax M2.51001001001003386.7%
Qwen 3.5 35B10010083836786.7%
Z.AI GLM 4.5 Air100100100835086.7%
GPT-5.4 Nano1008383838386.7%
Gemini 3.5 Flash Lite (Reasoning)100100100805286.6%
GPT-OSS 120B1009083837686.5%
DeepSeek V3 (2024-12-26)1009794746786.4%
Gemini 3.8 Flash (Reasoning, Medium)10010098835086.1%
Ministral 3 3B1009793855485.7%
Claude Haiku 4.510010098953385.3%
GPT-5.4 Nano (Reasoning)10010083766785.2%
Claude Sonnet 4.510010083756785.1%
Qwen 3.5 Plus (2026-02-15)979583836785.0%
GPT-5.4 Mini (Reasoning, Low)10010099923384.8%
GPT-4.110010089835084.5%
Gemini 3.5 Flash Lite (Reasoning, Minimal)10010087854984.2%
DeepSeek V3 (2025-03-24)10010098675684.2%
Gemini 3 Flash (Preview, Reasoning)1008683816783.3%
Hermes 3 70B100100100872883.1%
Qwen 3.6 Max Preview100100100961782.5%
Grok 4.5 (Reasoning, Low)10010096675082.5%
Mistral Medium 3.5 (Reasoning)838383807480.7%
o4 Mini10010071706180.5%
Claude Sonnet 41009893624980.2%
Kimi K2.51009383794680.2%
Grok 4.6 (Reasoning, High)100100100831780.0%
Aion 3.5 (Reasoning, High)100100100100080.0%
MiniMax M3100100100831780.0%
GPT-4o Mini (temp=0)10010083675080.0%
Mistral Medium 3.1968379746779.8%
DeepSeek-V2 Chat1008374706778.9%
Mistral Large 2959191675078.7%
Ministral 3 14B999778635678.7%
Ministral 8B1009292911778.4%
GPT-5.4 Nano (Reasoning, Low)908380676777.3%
GPT-5.21008683833377.2%
Arcee AI: Trinity Mini10010085831777.0%
Mistral Small 410010083484875.8%
Qwen 3.5 Flash1008383674475.6%
Ministral 3 8B828075706774.7%
GPT-5.4 Mini999184673374.7%
ByteDance Seed 1.6 Flash838376676274.3%
Mistral Small 4 (Reasoning)1008383505073.2%
Mistral NeMO1009172673372.7%
Ministral 3B1009875731772.5%
Mistral Medium 3.5998073615072.4%
Cohere Command R+ (Aug. 2024)1008371545071.8%
Qwen 3.8 Flash (Reasoning)938383811771.6%
Mistral Small 3.2 24B1009583423771.3%
GPT-5.6 Terra (Reasoning, Medium)808070675069.4%
GPT-5.5858167625069.0%
Thinking Machines Inkling939379582168.8%
GPT-4o, Aug. 6th (temp=0)1008483561768.1%
Muse Spark 1.1 (Reasoning, Minimal)1001008350066.7%
GPT-5.4838367505066.7%
Z.AI GLM 4.5827871673366.1%
GPT-6 Luna (Reasoning, Medium)827967643364.9%
Muse Glimmer 30B (Reasoning, Medium)1001007450064.7%
Claude Opus 4766767635064.6%
GPT-6 Luna827261585064.4%
Llama 3.1 70B94888158064.1%
Qwen 2.5 72B757167565063.7%
GPT-6 Luna (Reasoning, High)837567583363.1%
GPT-6 Sol836765505063.0%
GPT-6.1 Sol (Reasoning, Medium)836763505062.6%
GPT-5.5 (Reasoning, Low)796767505062.5%
Laguna S 2.11009067331761.3%
GPT-5.6 Sol746761505060.4%
GPT-5.5 (Reasoning, Medium)837867501758.9%
Qwen 3 32B95836733055.6%
Qwen 3.5 27B676763502854.8%
Hermes 3 405B806748392251.3%
Qwen 3.5 9B100625833050.7%
GPT-5.6 Terra755049333348.1%
Mistral Large 4.0836733331746.7%
GPT-5.6 Sol (Reasoning, Medium)676733333346.6%
GPT-6 Sol (Reasoning, Medium)705033331740.6%
GPT-5.6 Luna (Reasoning, Medium)50423317028.4%
GPT-5.6 Luna373317171724.0%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Gemma 3 12B100100100100100100.0%
Mistral Large 4.0100100100959197.2%
Claude Opus 5.5 (Reasoning)1001001001008396.7%
GPT-5 Nano1001001001008396.7%
GPT-4.1 Nano1001001001008396.7%
Arcee AI: Trinity Mini100100100938295.1%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100878394.0%
Gemini 3.1 Flash Lite (Reasoning)1001001001006793.3%
DeepSeek V3.11001001001006793.3%
GPT-4o Mini (temp=0)100100100838393.3%
Gemma 3 4B100100100838393.3%
Claude Sonnet 5.5 (Reasoning)100100100877993.2%
Z.AI GLM 5.3 Flash (Reasoning, Max)1001001001005090.0%
DeepSeek V4 Flash1001001001004689.2%
Qwen 3.8 27B (Reasoning, XHigh)10010083837488.0%
Gemini 3.1 Flash Lite (Preview)10010083837287.7%
DeepSeek V4 Flash 0731 (Reasoning, High)100100100676786.7%
Gemini 3.1 Flash Lite100100100676786.7%
Gemini 2.5 Pro1001001001003286.5%
Mistral Large 210010096835085.9%
GPT-5 Mini100100100675083.3%
Claude Opus 41008383757182.5%
Gemma 3 27B10010083676282.4%
Gemma 4 26B (Reasoning)10010092675081.8%
Mistral Medium 3.5100100100505080.0%
Cydonia 24B V4.1100100100100080.0%
Z.AI GLM 5.3 (Reasoning, Max)10010081675079.5%
Z.AI GLM 4.7100100100673079.3%
Xiaomi MIMO v2.510010010094078.9%
Xiaomi MIMO v2.6 Pro100100100771778.7%
Aion 2.010010010093078.6%
DeepSeek V3 (2024-12-26)1009689644278.3%
Aion 3.5 (Reasoning, High)100100100573177.6%
GPT-4.1 Mini1009469665977.6%
MiniMax M310010083831776.5%
Aion 3.5 Mini (Reasoning, High)10010098503376.3%
GPT-4o Mini (temp=1)10010080673376.0%
Z.AI GLM 510010010080076.0%
Gemini 2.5 Flash1001009483075.4%
Laguna S 2.11008383703874.9%
Claude Haiku 5.5 (Adaptive)1001009480074.9%
Grok 4.3 (Reasoning)998983564774.8%
Aion 3.0 Mini1001009975074.8%
Grok 4.201008383712271.9%
Nemotron 3 Super1008277672870.7%
Hermes 3 70B1008380483970.2%
Kimi K3 (Reasoning, Low)10010083511770.2%
Grok 4.5 (Reasoning, High)10010010050070.0%
Gemma 4 31B1008383503369.8%
Claude Haiku 5.5 (Reasoning, Medium)100888673069.4%
Qwen 3.6 Max Preview1008380503369.3%
Gemini 2.5 Flash Lite10010083461769.1%
Qwen 3 32B838367575068.1%
Mistral Medium 3.1908267633367.0%
Gemini 2.5 Flash Lite (Reasoning)100986767066.3%
Gemini 3 Flash (Preview, Reasoning)838367613365.5%
Thinking Machines Inkling Small (Reasoning, High)977867503365.1%
Grok 4.7 (Reasoning, High)836867653463.4%
Grok 4.20 (Reasoning)918367413363.0%
Z.AI GLM 4.61001009317061.9%
Claude Opus 4.71001006148061.9%
Claude Opus 4.51008376351461.7%
Grok 4.5 (Reasoning, Low)100958328061.3%
GPT-4o, Aug. 6th (temp=1)98917541061.1%
Gemini 3.6 Flash (Reasoning, Minimal)83836767060.0%
ByteDance Seed 2.0 Mini10010033333360.0%
Gemma 4 26B10010050331760.0%
ByteDance Seed 2.0 Lite836750505060.0%
Nemotron 3 Nano836767503360.0%
ByteDance Seed 1.61008365331759.7%
Inception Mercury 2837254503158.2%
Z.AI GLM 5.1100838317056.7%
GPT-583836750056.7%
DeepSeek V3.210010050171756.7%
MiniMax M2.51008367171656.5%
Qwen 3.8 Flash (Reasoning)1008250331756.3%
Claude Sonnet 5 (Reasoning, Low)1007140363356.0%
DeepSeek-V2 Chat100635757055.4%
Z.AI GLM 4.7 Flash836760441854.5%
DeepSeek V4 Pro100805833054.3%
Qwen 3.8 Max (Reasoning, XHigh)100675050053.3%
Hy4 Preview (Reasoning, High)100835033053.3%
Claude Opus 4.8 (Reasoning, Low)1009925231753.0%
Laguna XS 2.1100100630052.6%
Claude Opus 4.6 (Reasoning)9983780052.1%
Ministral 3 8B836650332651.7%
Grok 4.3100100504050.7%
DeepSeek V4 Pro 0813 (Reasoning, High)82675450050.4%
Z.AI GLM 5.2 (Reasoning, High)100675033050.0%
Gemini 3 Flash (Preview)675050503350.0%
Mistral Medium 3.5 (Reasoning)82676733049.6%
Claude Sonnet 5100803730049.4%
Cohere Command R+ (Aug. 2024)917735331249.4%
GPT-OSS 120B816235333348.8%
Gemini 3.7 Flash (Reasoning, Medium)79746725048.7%
Mistral Small 4 (Reasoning)83675042048.5%
Qwen 3.7 Flash (Reasoning)100505033046.7%
DeepSeek V4 Flash (Reasoning)100100330046.7%
Claude Sonnet 4100100330046.7%
Aion 3.083645032046.0%
MiniMax M2.794833617046.0%
Claude Opus 5 (Reasoning, Low)1004533331745.6%
Hermes 3 405B100553332044.0%
GPT-5.48383500043.3%
Kimi K2.610074338042.9%
Mistral Large 4.0 (Reasoning)83753317041.6%
Kimi K2.5676333331141.5%
Gemini 3.5 Flash Lite (Reasoning, Minimal)65634730040.8%
Mistral Small 410050500040.0%
Ministral 3 14B7269500038.3%
Claude Opus 5100383317037.6%
Xiaomi MIMO v2.6 Flash10045390036.8%
GPT-4.11008300036.7%
Qwen 3.5 Plus (2026-02-15)67503333036.7%
WizardLM 2 8x22b1008300036.7%
GPT-5.4 Mini67505017036.7%
Qwen 3 235B A22B Instruct 25071008100036.1%
Gemini 3.5 Flash (Reasoning, Minimal)67633317036.0%
Kimi K3 (Reasoning, High)91511717035.2%
Gemini 3.1 Pro (Preview)675025171735.0%
Claude Haiku 5.5 (Reasoning, Low)10040 – – 34.8%
Gemini 3.6 Flash (Reasoning)833323171734.7%
Z.AI GLM 4.5 Air10050220034.4%
Qwen 3.5 Plus (2026-04-20)6754500034.1%
Qwen 3.5 9B8667170033.8%
Z.AI GLM 5 Turbo838300033.3%
GPT-5.11006700033.3%
Qwen 3.6 Flash8350330033.3%
Qwen 3.6 27B83501717033.3%
o4 Mini1006500033.0%
Mistral Large 367671714032.8%
GPT-5.4 Nano (Reasoning, Low)50453333032.3%
o4 Mini High1005800031.5%
Qwen 3.6 35B7350330031.3%
Thinking Machines Inkling (Reasoning)8544270031.2%
Muse Glimmer 30B (Reasoning, Medium)7367160031.1%
Writer: Palmyra X59048170030.9%
DeepSeek V3 (2025-03-24)5750433030.5%
Qwen 3.5 Flash505017171730.0%
Claude Opus 4.7 (Reasoning)363433232029.2%
Claude Opus 5 (Reasoning)483333171529.2%
Grok 4.6 (Reasoning, High)7933320029.1%
Claude Sonnet 4.6 (Reasoning)1004400028.8%
Ministral 8B9817170026.3%
GPT-6 Luna676100025.6%
Qwen 3.5 122B8031170025.5%
Ministral 3B676000025.2%
GPT-5.6 Sol793390024.2%
Mistral NeMO35333317023.6%
Mistral Small 3.2 24B5733226023.5%
DeepSeek V4.1 Flash (Reasoning, High)6733170023.3%
Xiaomi MIMO v2.5 Pro8317170023.3%
Claude Haiku 4.51001700023.3%
GPT-6 Sol5247170023.2%
Gemini 3.8 Flash (Reasoning, Medium)46331818023.2%
Muse Spark 1.1 (Reasoning, Medium)655000023.0%
Qwen 3.7 Max6333170022.7%
Claude Opus 4.66733110022.3%
Muse Spark 1.3 (Reasoning, Medium)40331715021.0%
Gemma 4 31B (Reasoning)40331714020.7%
DeepSeek V4 Pro (Reasoning)97600020.6%
GPT-5.4 (Reasoning, Low)6717170020.0%
GPT-5.550171717020.0%
Llama 3.1 70B33252417019.9%
Gemini 3.5 Flash Lite (Reasoning)5039100019.7%
Ministral 3 3B494500018.7%
ByteDance Seed 1.6 Flash83600017.9%
Gemini 3.5 Flash (Reasoning)671700016.7%
GPT-5.6 Terra3333170016.7%
Gemini 2.5 Flash (Reasoning)33171717016.7%
Qwen 3.5 397B A17B3331170016.3%
Claude Sonnet 4.5671300015.9%
GPT-5.4 Mini (Reasoning)452600014.2%
Claude Sonnet 5 (Reasoning)333300013.3%
GPT-6 Sol (Reasoning, Medium)3217150012.8%
Claude Sonnet 4.6331700010.0%
Qwen 3.5 27B331700010.0%
GPT-4o, Aug. 6th (temp=0)331700010.0%
GPT-5.4 Nano (Reasoning)331700010.0%
Qwen 2.5 72B331700010.0%
GPT-5.4 Nano331700010.0%
Muse Spark 1.1 (Reasoning, Minimal)50000010.0%
GPT-5.6 Terra (Reasoning, Medium)3300006.7%
Thinking Machines Inkling19140006.6%
GPT-5.6 Sol (Reasoning, Medium)13120004.9%
Z.AI GLM 4.52300004.5%
GPT-5.5 (Reasoning, Medium)1740004.0%
GPT-5.5 (Reasoning, Low)1700003.3%
GPT-5.6 Luna (Reasoning, Medium)1700003.3%
GPT-6.1 Sol (Reasoning, Medium)1200002.5%
GPT-5.4 Mini (Reasoning, Low)1000002.1%
Muse Spark 1.2 (Reasoning, Medium)000000.0%
GPT-6 Luna (Reasoning, High)000000.0%
GPT-5.4 (Reasoning)000000.0%
GPT-6 Luna (Reasoning, Medium)000000.0%
Claude Opus 4.8 (Reasoning)000000.0%
GPT-5.2000000.0%
Qwen 3.5 35B000000.0%
GPT-5.6 Luna000000.0%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Kimi K3 (Reasoning, Low)100100100999398.4%
Claude Opus 5 (Reasoning)10010099969497.9%
Claude Opus 4.71001001001008396.7%
Claude Opus 4.7 (Reasoning)1001001001008396.7%
Claude Sonnet 510010099958395.5%
Claude Sonnet 5 (Reasoning, Low)1009897978395.0%
Claude Opus 5100100100928395.0%
Z.AI GLM 5.3 (Reasoning, Max)100100100918394.8%
Claude Sonnet 4.6100100100868093.1%
Claude Opus 5 (Reasoning, Low)10010097838392.8%
Claude Opus 4.8 (Reasoning)100100100926791.8%
ByteDance Seed 2.0 Mini10010090838391.3%
Z.AI GLM 4.610010093777789.3%
Aion 3.5 Mini (Reasoning, High)1009991837088.6%
Gemma 3 27B10010091915988.1%
Gemini 2.5 Flash Lite (Reasoning)10010090836788.0%
Claude Opus 4.610010093836488.0%
GPT-4.1 Nano1009285838087.8%
ByteDance Seed 2.0 Lite1009184838087.7%
Gemini 3.1 Flash Lite10010091796587.0%
Grok 4.5 (Reasoning, High)1009886836786.7%
Gemma 3 4B100100100835086.7%
Claude Sonnet 5 (Reasoning)1009489796785.7%
Xiaomi MIMO v2.6 Pro1009996834484.5%
Grok 4.6 (Reasoning, High)1009583756784.0%
Gemini 3.1 Flash Lite (Preview)1008483836883.8%
Gemini 2.5 Pro868583837983.6%
GPT-5 Nano10010083675080.0%
Gemini 3.1 Flash Lite (Reasoning)1009976744779.3%
Z.AI GLM 5.3 Flash (Reasoning, Max)1009683675079.2%
Qwen 3.5 Plus (2026-04-20)10010078674978.6%
Claude Opus 4.8 (Reasoning, Low)838382746778.0%
Mistral Large 3908379676776.9%
Grok 4.3 (Reasoning)898273717176.9%
Claude Opus 5.5 (Reasoning)1008367676776.7%
Z.AI GLM 5.3 Flash (Reasoning, Low)1008572675976.5%
Aion 3.5 (Reasoning, High)1008767675976.0%
Xiaomi MIMO v2.5918371676775.8%
Gemma 4 26B838379676775.8%
ByteDance Seed 1.6988367676375.7%
Qwen 3.6 Flash10010066625075.7%
Claude Opus 4.6 (Reasoning)1008377675075.5%
Grok 4.5 (Reasoning, Low)978973674774.5%
Xiaomi MIMO v2.6 Flash998367675073.1%
Z.AI GLM 5.2 (Reasoning, High)10010083651773.0%
Grok 4.7 (Reasoning, High)838380675072.7%
DeepSeek V3.1918683554872.6%
GPT-5968383673372.6%
Qwen 3 235B A22B Instruct 250797938782071.8%
GPT-4o Mini (temp=1)897673635070.4%
GPT-5.4 (Reasoning, Low)838367675070.0%
Gemini 3 Flash (Preview, Reasoning)957467655070.0%
Gemini 2.5 Flash Lite837979733469.7%
GPT-5.1838382505069.7%
Xiaomi MIMO v2.5 Pro988067663368.7%
Mistral Small 4838367565067.9%
GPT-4.1857267665067.8%
Z.AI GLM 5976762615067.2%
Claude Sonnet 4.6 (Reasoning)1008367503366.6%
Grok 4.20838267673366.5%
Gemma 4 26B (Reasoning)806767675166.2%
Muse Spark 1.3 (Reasoning, Medium)806767675066.1%
Claude Haiku 5.5 (Reasoning, Medium)818066525165.9%
Claude Haiku 5.5 (Reasoning, Low)9041 – – – 65.3%
DeepSeek V3.2837467673364.9%
Aion 2.0837767623364.5%
Gemma 4 31B (Reasoning)1006060574364.1%
Gemini 2.5 Flash (Reasoning)838067503362.5%
Claude Sonnet 5.5 (Reasoning)837850505062.2%
Qwen 3.6 Max Preview93836767062.0%
Gemini 3.5 Flash (Reasoning)1006450504361.4%
MiniMax M2.5836967503560.9%
Claude Haiku 5.5 (Adaptive)838162453360.7%
Qwen 3.7 Flash (Reasoning)1008360411760.2%
Hermes 3 70B100676666059.7%
Cydonia 24B V4.11008367301759.4%
Z.AI GLM 5.1866760503359.2%
Grok 4.3858358501758.6%
MiniMax M2.7908367331758.0%
Muse Spark 1.2 (Reasoning, Medium)837150473657.4%
Claude Sonnet 4.5836952443857.2%
Hy4 Preview (Reasoning, High)1006750333356.7%
GPT-5.4838350333356.7%
GPT-5.4 Mini (Reasoning)777667501356.5%
DeepSeek V4 Pro (Reasoning)826767501756.4%
Mistral Large 4.0 (Reasoning)765650494956.1%
Grok 4.20 (Reasoning)816255483355.8%
Qwen 3.8 Flash (Reasoning)856750413655.8%
Z.AI GLM 5 Turbo84815952055.3%
Qwen 3 32B716657552454.7%
Gemini 3 Flash (Preview)635850505054.2%
GPT-5.6 Luna (Reasoning, Medium)736760352752.2%
Qwen 3.5 397B A17B786160451752.2%
Z.AI GLM 4.7786650333352.2%
GPT-6 Luna (Reasoning, Medium)806657312451.8%
DeepSeek V4.1 Flash (Reasoning, High)676150503051.7%
Mistral Medium 3.167676359051.1%
Mistral Small 4 (Reasoning)87675349051.0%
DeepSeek V4 Pro 0813 (Reasoning, High)535350504950.9%
Qwen 3.6 35B84835333050.9%
Inception Mercury 2765452393150.6%
Muse Spark 1.1 (Reasoning, Medium)835350333350.5%
Kimi K2.5866456331350.4%
GPT-5.4 (Reasoning)836550331749.6%
Kimi K2.694545049049.3%
Mistral Large 4.0886750251749.2%
Qwen 3.5 Plus (2026-02-15)745150501748.5%
WizardLM 2 8x22b685250363348.0%
Arcee AI: Trinity Mini76675045047.5%
Gemini 3.1 Pro (Preview)835050332047.4%
Gemma 3 12B74675037947.2%
Nemotron 3 Super625951461747.0%
Nemotron 3 Nano80535050146.8%
Claude Haiku 4.5676750311846.5%
Claude Opus 4.5675645441946.3%
Writer: Palmyra X583706314045.9%
GPT-OSS 120B645749381745.1%
ByteDance Seed 1.6 Flash555252501244.2%
Mistral Medium 3.5 (Reasoning)735648261744.1%
GPT-6 Luna (Reasoning, High)525049471743.1%
Ministral 3 14B715042341943.1%
DeepSeek V3 (2025-03-24)524946382943.1%
GPT-5.5676450171742.7%
DeepSeek V4 Flash 0731 (Reasoning, High)715050241742.4%
Qwen 3.8 Max (Reasoning, XHigh)674534333342.4%
Mistral Medium 3.5100503024942.4%
DeepSeek V4 Pro664933332841.9%
GPT-4o, Aug. 6th (temp=1)615235332641.3%
Aion 3.0625250251741.2%
DeepSeek V4 Flash66635720041.1%
GPT-5.6 Terra (Reasoning, Medium)674733292840.9%
Gemini 2.5 Flash70584629040.5%
Gemma 4 31B61525033740.5%
Gemini 3.6 Flash (Reasoning)656331261740.3%
Mistral Large 277504033040.0%
Laguna XS 2.157505038039.0%
Ministral 8B71544326038.7%
Aion 3.0 Mini100423317038.4%
DeepSeek V4 Flash (Reasoning)64614323038.2%
GPT-5.5 (Reasoning, Low)79672817038.0%
GPT-5.6 Terra67563333037.8%
Muse Spark 1.1 (Reasoning, Minimal)675433171737.5%
Z.AI GLM 4.7 Flash59505017936.9%
GPT-5 Mini675033171736.7%
o4 Mini High504734331836.4%
Qwen 3.8 27B (Reasoning, XHigh)603633321735.5%
Kimi K3 (Reasoning, High)674033201735.2%
Gemini 3.6 Flash (Reasoning, Minimal)75473317034.5%
GPT-5.6 Sol50494824034.0%
Claude Sonnet 496392010433.9%
Cohere Command R+ (Aug. 2024)77393318033.5%
Gemini 3.5 Flash Lite (Reasoning, Minimal)6864340033.3%
Ministral 3 8B57563717033.3%
Claude Opus 4573330261732.8%
GPT-6 Luna54504016031.9%
MiniMax M38350179031.8%
Thinking Machines Inkling Small (Reasoning, High)48454518331.8%
Qwen 3.6 27B5650480030.7%
Qwen 3.5 27B8350170030.0%
Gemini 3.5 Flash (Reasoning, Minimal)393331291729.8%
Hermes 3 405B1004260029.7%
Gemini 3.8 Flash (Reasoning, Medium)54333317829.1%
Laguna S 2.140403322027.0%
GPT-5.5 (Reasoning, Medium)5050330026.7%
Gemini 3.5 Flash Lite (Reasoning)55292621026.3%
Qwen 3.5 9B1003000026.0%
GPT-5.6 Luna402726171524.9%
GPT-6 Sol (Reasoning, Medium)59332111024.7%
Mistral NeMO49411717024.7%
GPT-6 Sol42333214024.4%
GPT-5.6 Sol (Reasoning, Medium)39333317024.4%
Thinking Machines Inkling893000023.8%
GPT-5.4 Mini6733170023.3%
Qwen 2.5 72B46381616023.0%
Muse Glimmer 30B (Reasoning, Medium)713480022.6%
Ministral 3 3B35332321022.3%
Gemini 3.7 Flash (Reasoning, Medium)33312710020.4%
Z.AI GLM 4.5 Air515000020.3%
GPT-5.4 Nano (Reasoning)33331716019.9%
Ministral 3B671286218.9%
Qwen 3.7 Max4821145017.7%
GPT-5.4 Nano503000016.0%
GPT-6.1 Sol (Reasoning, Medium)3328142015.4%
Thinking Machines Inkling (Reasoning)393700015.2%
DeepSeek V3 (2024-12-26)56000011.2%
DeepSeek-V2 Chat401400010.6%
GPT-5.4 Mini (Reasoning, Low)331700010.0%
GPT-4.1 Mini32170009.7%
o4 Mini171713009.3%
Qwen 3.5 Flash27170008.8%
GPT-4o Mini (temp=0)4300008.7%
GPT-4o, Aug. 6th (temp=0)27160008.6%
Qwen 3.5 35B3700007.5%
Llama 3.1 70B3430007.5%
GPT-5.217170006.7%
GPT-5.4 Nano (Reasoning, Low)17170006.7%
Qwen 3.5 122B3200006.4%
Z.AI GLM 4.51700003.3%
Mistral Small 3.2 24B1700003.3%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Claude Opus 5.5 (Reasoning)100100100100100100.0%
Z.AI GLM 5.3 (Reasoning, Max)100100100100100100.0%
DeepSeek V4.1 Flash (Reasoning, High)100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100100100100.0%
Claude Sonnet 5.5 (Reasoning)100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100.0%
Grok 4.7 (Reasoning, High)100100100100100100.0%
Claude Opus 4.7 (Reasoning)100100100100100100.0%
Aion 3.5 Mini (Reasoning, High)100100100100100100.0%
Kimi K3 (Reasoning, Low)100100100100100100.0%
Claude Opus 5 (Reasoning, Low)100100100100100100.0%
Aion 3.5 (Reasoning, High)100100100100100100.0%
Claude Opus 4.8 (Reasoning, Low)100100100100100100.0%
Claude Opus 5 (Reasoning)100100100100100100.0%
Claude Sonnet 5 (Reasoning)100100100100100100.0%
Claude Sonnet 5 (Reasoning, Low)100100100100100100.0%
Claude Opus 5100100100100100100.0%
Claude Opus 4.7100100100100100100.0%
Claude Haiku 5.5 (Adaptive)100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100100100100.0%
Gemini 2.5 Pro100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Low)100 – – – – 100.0%
Claude Sonnet 5100100100100100100.0%
Aion 2.0100100100100100100.0%
Gemini 3.1 Flash Lite (Preview)100100100100100100.0%
Gemini 3.1 Flash Lite100100100100100100.0%
ByteDance Seed 2.0 Lite100100100100100100.0%
Gemini 2.5 Flash Lite (Reasoning)100100100100100100.0%
DeepSeek V3.1100100100100100100.0%
DeepSeek V3.2100100100100100100.0%
Gemini 2.5 Flash100100100100100100.0%
Gemma 3 12B100100100100100100.0%
Gemma 3 27B100100100100100100.0%
GPT-4.1 Nano100100100100100100.0%
Grok 4.20 (Reasoning)1001001001009999.8%
DeepSeek V4 Flash (Reasoning)1001001001009999.8%
Gemini 3.1 Flash Lite (Reasoning)1001001001009799.4%
Claude Opus 4.8 (Reasoning)1001001001009699.2%
Mistral Large 4.0 (Reasoning)1001001001009599.1%
Z.AI GLM 5.2 (Reasoning, High)100100100989799.0%
Grok 4.5 (Reasoning, High)100100100989798.9%
Gemini 3 Flash (Preview)1001001001009498.7%
Muse Spark 1.1 (Reasoning, Minimal)1001001001009398.7%
Gemini 3.1 Pro (Preview)1001001001009198.3%
Hy4 Preview (Reasoning, High)1001001001008997.7%
Kimi K3 (Reasoning, High)1001001001008697.1%
GPT-4o Mini (temp=1)1001001001008496.8%
Claude Opus 4.6 (Reasoning)1001001001008396.7%
Claude Sonnet 4.6 (Reasoning)1001001001008396.7%
Z.AI GLM 51001001001008396.7%
o4 Mini High1001001001008396.7%
ByteDance Seed 2.0 Mini1001001001008396.7%
Gemma 3 4B1001001001008396.7%
Xiaomi MIMO v2.6 Flash1001001001008396.7%
MiniMax M2.7100100100988496.4%
Xiaomi MIMO v2.5100100100998396.4%
DeepSeek V4 Flash 0731 (Reasoning, High)1001001001008296.3%
GPT-4o Mini (temp=0)1001001001008096.1%
Kimi K2.51001001001007895.6%
Nemotron 3 Super100100100938395.2%
Gemini 3.5 Flash Lite (Reasoning)100100100928294.9%
Thinking Machines Inkling (Reasoning)10010099938294.8%
Claude Opus 4.510010096948394.6%
Qwen 3.8 Max (Reasoning, XHigh)10010095918694.3%
Kimi K2.6100100100967393.7%
Muse Spark 1.1 (Reasoning, Medium)10010097878393.4%
Z.AI GLM 5.11001001001006793.3%
GPT-51001001001006793.3%
GPT-5 Mini100100100838393.3%
Claude Sonnet 4.6100100100838393.3%
MiniMax M2.51001001001006793.3%
Gemma 4 26B (Reasoning)1001001001006793.3%
Aion 3.0 Mini10010094898393.2%
Hermes 3 405B1001001001006693.2%
GPT-4.110010097907993.1%
Xiaomi MIMO v2.6 Pro100100100837892.3%
Z.AI GLM 5 Turbo10010094838392.1%
Mistral Medium 3.110010099837691.8%
Grok 4.5 (Reasoning, Low)100100100866790.6%
Gemini 3.7 Flash (Reasoning, Medium)1009892907390.5%
Claude Haiku 5.5 (Reasoning, Medium)10010093827890.5%
Z.AI GLM 4.710010094906790.2%
Muse Spark 1.2 (Reasoning, Medium)100100100836790.0%
Qwen 3.5 Plus (2026-04-20)1001001001005090.0%
Qwen 3 235B A22B Instruct 250710010097916289.9%
Gemini 3.8 Flash (Reasoning, Medium)969592838289.7%
Grok 4.3 (Reasoning)1009792867389.6%
DeepSeek V3 (2024-12-26)100100100786889.1%
Gemini 3.6 Flash (Reasoning)1009787817988.7%
Z.AI GLM 4.7 Flash100100100915088.3%
GPT-5.4 (Reasoning)1009583837988.1%
Arcee AI: Trinity Mini979692896788.0%
Aion 3.0100100100785787.1%
Gemma 4 26B10010093756787.0%
Claude Opus 4.610010083836786.7%
Gemini 3 Flash (Preview, Reasoning)100100100676786.7%
Z.AI GLM 4.610010083836786.7%
GPT-5.110010083836786.7%
Xiaomi MIMO v2.5 Pro100100100835086.7%
DeepSeek V4 Flash100100100884486.5%
Gemini 2.5 Flash (Reasoning)100100100834886.3%
Gemma 4 31B999089837186.2%
Gemini 3.5 Flash (Reasoning, Minimal)10010098815186.0%
ByteDance Seed 1.61009583816985.6%
Writer: Palmyra X510010092924385.4%
Muse Spark 1.3 (Reasoning, Medium)10010095933985.3%
Gemma 4 31B (Reasoning)1009682806785.0%
Claude Sonnet 410010096675984.4%
Gemini 3.5 Flash Lite (Reasoning, Minimal)10010093705784.2%
Grok 4.3949285846584.1%
DeepSeek V4 Pro (Reasoning)10010083676783.3%
Mistral Medium 3.5 (Reasoning)1008383836783.3%
Gemini 2.5 Flash Lite100100100833383.3%
Laguna XS 2.11009588805082.5%
GPT-4o, Aug. 6th (temp=0)1009581815582.3%
Qwen 3 32B10010075696782.2%
GPT-5 Nano10010093675082.0%
GPT-OSS 120B10010087685081.0%
Mistral Large 210010083754580.6%
Mistral Small 410010070676680.4%
Z.AI GLM 4.5 Air100100100100080.0%
ByteDance Seed 1.6 Flash1008383676780.0%
Claude Haiku 4.510010097505079.5%
GPT-5.4 (Reasoning, Low)918380746779.1%
Qwen 3.8 Flash (Reasoning)1009583664578.0%
Cydonia 24B V4.1100100100563377.9%
Ministral 3B10010083644277.8%
Gemini 3.6 Flash (Reasoning, Minimal)1009869655577.7%
GPT-5.41008883675077.6%
Grok 4.201001009690077.1%
DeepSeek V4 Pro 0813 (Reasoning, High)10010083673677.1%
o4 Mini1009887613877.0%
MiniMax M310010010083076.7%
Thinking Machines Inkling Small (Reasoning, High)10010067675076.7%
Mistral Medium 3.51008383665076.6%
GPT-6 Luna (Reasoning, High)948169686775.8%
Mistral Large 4.010010067674675.8%
DeepSeek V4 Pro838375676574.5%
GPT-4o, Aug. 6th (temp=1)958383674274.1%
Muse Glimmer 30B (Reasoning, Medium)1009573525074.1%
Gemini 3.5 Flash (Reasoning)1008367675073.3%
Qwen 3.7 Flash (Reasoning)10010083503373.3%
GPT-6 Luna (Reasoning, Medium)947367676673.2%
GPT-4.1 Mini838181793371.7%
WizardLM 2 8x22b1008383671770.0%
Qwen 3.7 Max1008367534168.8%
Qwen 3.8 27B (Reasoning, XHigh)838167575067.7%
GPT-5.5726767675865.9%
GPT-6.1 Sol (Reasoning, Medium)906767555065.8%
Qwen 3.6 Flash1007067593365.7%
GPT-5.4 Mini (Reasoning, Low)837367504763.9%
Qwen 3.5 Flash1008367333363.3%
Nemotron 3 Nano1001006750063.3%
Inception Mercury 2776964575063.3%
GPT-5.4 Mini908360503363.3%
Cohere Command R+ (Aug. 2024)1001008033062.7%
GPT-5.4 Mini (Reasoning)956656504361.9%
Qwen 3.5 397B A17B1007567501761.6%
DeepSeek-V2 Chat1001001000060.0%
Claude Sonnet 4.593876744058.4%
GPT-5.6 Sol786353504257.2%
Laguna S 2.1100100830056.7%
Qwen 3.5 Plus (2026-02-15)91835049054.7%
Ministral 3 14B958955171754.4%
GPT-5.5 (Reasoning, Medium)835050503754.0%
GPT-5.6 Terra666553523353.8%
Ministral 3 3B1001003533053.7%
Claude Opus 4100100670053.3%
Mistral Small 4 (Reasoning)1006750331753.3%
Hermes 3 70B81706747052.9%
GPT-5.6 Luna (Reasoning, Medium)645749493450.7%
Ministral 3 8B8884770049.8%
GPT-5.5 (Reasoning, Low)675050463349.3%
Qwen 3.6 Max Preview83675833048.2%
GPT-5.6 Terra (Reasoning, Medium)675742333145.8%
Qwen 3.6 35B99674117044.8%
GPT-5.6 Sol (Reasoning, Medium)645044333144.3%
GPT-5.6 Luna505048333342.9%
Mistral Small 3.2 24B83673330042.6%
Mistral NeMO905033171741.3%
Llama 3.1 70B504945421941.2%
Mistral Large 3100563312040.4%
DeepSeek V3 (2025-03-24)63484641039.7%
GPT-6 Luna615033241736.9%
GPT-6 Sol474540262536.7%
Qwen 3.6 27B67505017036.7%
Qwen 3.5 27B83503316036.4%
Qwen 2.5 72B554933331136.3%
Qwen 3.5 122B9950310036.0%
Ministral 8B996700033.2%
GPT-5.4 Nano (Reasoning, Low)67463313031.7%
Thinking Machines Inkling836300029.3%
Qwen 3.5 35B6750170026.7%
Z.AI GLM 4.56738170024.2%
GPT-5.4 Nano50331717023.3%
GPT-5.4 Nano (Reasoning)3733170017.4%
GPT-6 Sol (Reasoning, Medium)3029170015.2%
Qwen 3.5 9B33140009.5%
GPT-5.2171711008.9%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Claude Opus 5.5 (Reasoning)100100100100100100.0%
Z.AI GLM 5.3 (Reasoning, Max)100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100.0%
Claude Opus 5 (Reasoning, Low)100100100100100100.0%
Aion 3.5 (Reasoning, High)100100100100100100.0%
GPT-5.1100100100100100100.0%
Claude Sonnet 4.6100100100100100100.0%
Gemini 2.5 Pro100100100100100100.0%
Xiaomi MIMO v2.6 Flash100100100100100100.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100100100.0%
Gemini 3.1 Flash Lite (Preview)100100100100100100.0%
Gemini 3.1 Flash Lite100100100100100100.0%
Gemini 2.5 Flash Lite (Reasoning)100100100100100100.0%
DeepSeek V3.1100100100100100100.0%
Claude Opus 5 (Reasoning)10010010010010099.9%
Xiaomi MIMO v2.6 Pro1001001001009498.8%
Gemini 2.5 Flash1001001001009298.4%
Claude Sonnet 5 (Reasoning, Low)100100100979498.3%
GPT-4o Mini (temp=1)100100100999097.9%
Claude Sonnet 5100100100999197.9%
Kimi K3 (Reasoning, Low)10010097959597.2%
Claude Opus 51001001001008596.9%
Grok 4.7 (Reasoning, High)1001001001008396.7%
Claude Opus 4.7 (Reasoning)1001001001008396.7%
Claude Opus 4.71001001001008396.7%
Z.AI GLM 5.3 Flash (Reasoning, Low)1001001001008396.7%
Z.AI GLM 4.61001001001008396.7%
Gemma 3 27B1001001001008396.7%
GPT-4.1 Nano1001001001008396.7%
DeepSeek V4 Pro (Reasoning)1001001001008296.4%
Claude Opus 4.8 (Reasoning, Low)10010098918995.7%
Mistral Large 4.0 (Reasoning)100100100948395.5%
Hy4 Preview (Reasoning, High)1009895958995.4%
Gemini 2.5 Flash (Reasoning)100100100938395.3%
Aion 3.5 Mini (Reasoning, High)1001001001007595.0%
Grok 4.5 (Reasoning, Low)10010096948494.7%
Claude Opus 4.8 (Reasoning)100100100878394.0%
GPT-5100100100838393.3%
Xiaomi MIMO v2.5 Pro1001001001006793.3%
Xiaomi MIMO v2.51001001001006793.3%
Claude Sonnet 4.6 (Reasoning)10010097838192.3%
ByteDance Seed 2.0 Lite10010094838392.0%
Aion 2.01009993838391.9%
DeepSeek V4 Pro1001001001005290.3%
Z.AI GLM 5.2 (Reasoning, High)100100100836790.0%
GPT-5 Mini100100100836790.0%
ByteDance Seed 2.0 Mini100100100836790.0%
GPT-5 Nano10010083838390.0%
Gemini 2.5 Flash Lite100100100836790.0%
Writer: Palmyra X5100100100836790.0%
MiniMax M3100100100826789.8%
Muse Spark 1.3 (Reasoning, Medium)10010090837489.6%
Claude Opus 4.610010096836789.3%
DeepSeek V4.1 Flash (Reasoning, High)10010099965089.0%
Gemma 4 26B (Reasoning)10010083837688.6%
MiniMax M2.51009998836288.6%
Claude Opus 4.6 (Reasoning)10010092836788.3%
Cydonia 24B V4.110010091836788.3%
Grok 4.3 (Reasoning)1009189887488.2%
Muse Spark 1.1 (Reasoning, Medium)1009995836488.2%
Aion 3.0 Mini10010097776788.1%
Claude Sonnet 5.5 (Reasoning)10010095945087.8%
o4 Mini1008886838187.6%
Gemma 4 26B1008883838287.3%
Claude Sonnet 5 (Reasoning)1009984787386.8%
Claude Haiku 5.5 (Reasoning, Low)9084 – – – 86.7%
Z.AI GLM 5 Turbo1001001001003386.7%
Muse Spark 1.2 (Reasoning, Medium)10010098696586.4%
Mistral Medium 3.1100100100805086.0%
Claude Haiku 5.5 (Reasoning, Medium)1009595855385.7%
Kimi K3 (Reasoning, High)10010098805085.7%
DeepSeek V4 Flash10010085737085.6%
Gemini 3.5 Flash Lite (Reasoning)1008684837185.0%
Claude Haiku 5.5 (Adaptive)1009990835084.5%
Claude Opus 4.5938683837684.5%
Z.AI GLM 4.7 Flash10010083766384.4%
DeepSeek V4 Flash (Reasoning)10010096735083.7%
Grok 4.310010081785883.5%
DeepSeek V4 Pro 0813 (Reasoning, High)1009283746783.1%
GPT-OSS 120B978381817283.1%
Kimi K2.6100100100655083.0%
Z.AI GLM 5.110010097833382.6%
Kimi K2.510010083795082.6%
Gemma 3 4B1009683676782.5%
Laguna XS 2.1888683837282.5%
Grok 4.2010010079676782.5%
Claude Haiku 4.51009289676181.7%
o4 Mini High10010080755080.8%
Nemotron 3 Super1008180766780.8%
Mistral Medium 3.5969585755080.3%
Grok 4.20 (Reasoning)838381777680.3%
DeepSeek V3.2100100100831780.0%
Qwen 3 235B A22B Instruct 25071008383676780.0%
Mistral NeMO1001008633 – 79.9%
Muse Spark 1.1 (Reasoning, Minimal)10010083803379.4%
Muse Glimmer 30B (Reasoning, Medium)1009583764279.4%
Thinking Machines Inkling (Reasoning)10010083753378.3%
Gemma 4 31B938382676778.2%
Z.AI GLM 510010091831778.1%
Qwen 3.6 27B1008383645978.0%
Hermes 3 70B10010010086377.9%
Qwen 3.6 Max Preview959483675077.8%
ByteDance Seed 1.6838378766777.4%
Gemini 3 Flash (Preview, Reasoning)838381676776.2%
ByteDance Seed 1.6 Flash928372676776.1%
GPT-4.1 Mini888381675675.1%
GPT-4o, Aug. 6th (temp=1)1008078675075.0%
Claude Sonnet 4.51008380565073.9%
Aion 3.01001008383073.3%
DeepSeek V4 Flash 0731 (Reasoning, High)1009672663373.3%
Mistral Small 4 (Reasoning)100998383073.1%
Nemotron 3 Nano928574674772.9%
Mistral Small 41008375673371.8%
DeepSeek-V2 Chat888380555271.7%
GPT-4o Mini (temp=0)1008858555571.5%
Laguna S 2.1858383505070.4%
Claude Sonnet 4958883592570.1%
Gemini 3.8 Flash (Reasoning, Medium)838367675070.0%
Gemma 3 12B1006767675070.0%
Gemini 3.7 Flash (Reasoning, Medium)887767674769.1%
Gemini 3.5 Flash (Reasoning)837867665068.8%
WizardLM 2 8x22b10010067601768.7%
Mistral Large 3988676671768.6%
DeepSeek V3 (2024-12-26)1007368653367.9%
Gemma 4 31B (Reasoning)827467675067.9%
Mistral Medium 3.5 (Reasoning)838371505067.5%
MiniMax M2.71008267503166.0%
Ministral 3 14B856767585366.0%
Qwen 3.6 35B1006765633365.7%
GPT-5.4907567633365.6%
Thinking Machines Inkling Small (Reasoning, High)1007367533565.6%
Cohere Command R+ (Aug. 2024)1007767503365.5%
GPT-5.4 Nano836766605065.1%
Qwen 3.5 Plus (2026-04-20)10010083251765.0%
Mistral Large 2676767656065.0%
Gemini 3.6 Flash (Reasoning)836767575064.8%
GPT-5.4 (Reasoning, Low)816767595064.8%
Mistral Large 4.0837664505064.7%
Mistral Small 3.2 24B10010067391764.5%
Qwen 3.8 Flash (Reasoning)968361433363.5%
GPT-5.4 Mini (Reasoning)826362605063.4%
Inception Mercury 2787067544763.1%
GPT-5.4 (Reasoning)796767505062.5%
Gemini 3 Flash (Preview)736767505061.2%
Qwen 3.8 Max (Reasoning, XHigh)866750505060.4%
Z.AI GLM 4.5676661565060.1%
Z.AI GLM 4.7100838333060.0%
Gemini 3.1 Pro (Preview)1005050505060.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)1005452513758.8%
Ministral 8B676665504458.5%
GPT-5.4 Mini (Reasoning, Low)756767671758.4%
Qwen 3 32B837467501758.2%
Arcee AI: Trinity Mini1007250472057.9%
GPT-5.4 Nano (Reasoning, Low)835650505057.9%
Gemini 3.5 Flash (Reasoning, Minimal)676754505057.4%
Qwen 3.7 Max838353412156.3%
Qwen 3.5 Plus (2026-02-15)766767501755.3%
Z.AI GLM 4.5 Air868050332655.0%
Ministral 3 3B817154383154.9%
DeepSeek V3 (2025-03-24)96666039753.5%
Thinking Machines Inkling81616053852.8%
Ministral 3B767354342151.7%
Gemini 3.6 Flash (Reasoning, Minimal)665350503350.6%
Qwen 3.7 Flash (Reasoning)100675033050.0%
GPT-6 Luna (Reasoning, High)625654413349.2%
GPT-4.1715750501749.0%
Qwen 3.5 397B A17B946733301748.1%
GPT-4o, Aug. 6th (temp=0)83655633047.4%
GPT-6 Sol605250343345.9%
GPT-5.5635047333345.4%
GPT-6 Luna (Reasoning, Medium)625549331743.3%
Qwen 3.8 27B (Reasoning, XHigh)565045333042.9%
Qwen 2.5 72B67625233042.8%
GPT-5.5 (Reasoning, Medium)65505047042.6%
Qwen 3.6 Flash83625017042.4%
Qwen 3.5 122B585250331741.9%
GPT-5.6 Terra (Reasoning, Medium)675033332641.8%
Ministral 3 8B67673733040.7%
GPT-5.6 Sol524938342940.7%
GPT-6 Luna484839353340.5%
GPT-5.4 Nano (Reasoning)675533271739.8%
GPT-5.6 Sol (Reasoning, Medium)574733322538.6%
GPT-6.1 Sol (Reasoning, Medium)543333333237.3%
GPT-5.6 Terra67623717036.5%
GPT-5.6 Luna (Reasoning, Medium)494433312436.2%
GPT-5.4 Mini61503333035.5%
Hermes 3 405B563533311834.8%
GPT-5.6 Luna393636342534.0%
GPT-6 Sol (Reasoning, Medium)484029261731.9%
GPT-5.5 (Reasoning, Low)583333171731.7%
Claude Opus 467331717026.8%
Qwen 3.5 Flash65331717026.3%
Qwen 3.5 9B782800021.2%
Llama 3.1 70B474071019.0%
Qwen 3.5 27B3333170016.7%
Qwen 3.5 35B4125120015.6%
GPT-5.23300006.7%

genre

Model # 1 # 2 # 3 # 4 # 5 Avg ▼
GPT-5 Mini1001001001009398.6%
Z.AI GLM 4.61001001001008396.7%
Nemotron 3 Super1001001001008396.7%
Gemma 3 4B1001001001008396.7%
Claude Opus 5 (Reasoning)10010099978395.9%
GPT-OSS 120B100100100958395.6%
Inception Mercury 210010099928394.8%
ByteDance Seed 2.0 Lite10010095958394.8%
Gemini 2.5 Flash (Reasoning)10010093919094.7%
Grok 4.310010099938194.6%
GPT-4.1 Nano100100100888394.0%
Claude Opus 510010097898393.9%
Qwen 3.6 Flash10010097878393.6%
Grok 4.5 (Reasoning, Low)10010099838393.1%
Qwen 3.6 35B10010099838393.1%
Grok 4.20 (Reasoning)100100100986793.0%
Gemini 3.1 Flash Lite (Reasoning)10010092868392.2%
Nemotron 3 Nano10010094838392.1%
Grok 4.3 (Reasoning)1009888838390.6%
Xiaomi MIMO v2.6 Pro10010089838090.5%
Arcee AI: Trinity Mini10010091837790.2%
Qwen 3.6 Max Preview10010092837690.1%
Qwen 3.7 Flash (Reasoning)10010093896789.8%
GPT-4.1 Mini1008989878189.3%
Claude Opus 4.8 (Reasoning, Low)1009187838389.1%
Gemini 3.1 Flash Lite1009995826788.6%
DeepSeek V4.1 Flash (Reasoning, High)999385837987.9%
Claude Sonnet 51009189837487.3%
Gemini 3.1 Flash Lite (Preview)1009994925087.2%
ByteDance Seed 1.6999189807787.1%
Grok 4.5 (Reasoning, High)10010083836786.7%
MiniMax M3100100100676786.7%
Qwen 3.5 Plus (2026-04-20)1009983836786.6%
Gemini 3.7 Flash (Reasoning, Medium)908686848386.0%
Claude Haiku 5.5 (Reasoning, Low)1008176 – – 85.7%
Claude Opus 5 (Reasoning, Low)989089836785.4%
Claude Opus 5.5 (Reasoning)1009483826785.1%
WizardLM 2 8x22b959281807684.8%
Gemini 3.5 Flash Lite (Reasoning, Minimal)1009583786283.8%
Gemini 2.5 Flash Lite (Reasoning)1008383817083.5%
GPT-51008383836783.3%
Z.AI GLM 5.11009795903383.0%
ByteDance Seed 2.0 Mini10010098675082.9%
Claude Sonnet 5.5 (Reasoning)1008381806782.2%
Muse Spark 1.2 (Reasoning, Medium)938383787282.0%
Kimi K3 (Reasoning, Low)908683836781.9%
Llama 3.1 70B1009380765981.7%
Qwen 3.7 Max1008883706781.6%
Laguna XS 2.11008783815681.1%
DeepSeek V4 Pro (Reasoning)1009083815081.0%
GPT-4o Mini (temp=1)1008376766780.3%
Claude Opus 4.71008383676780.0%
Claude Sonnet 4.6 (Reasoning)10010067676780.0%
Grok 4.7 (Reasoning, High)10010083833380.0%
GPT-5.110010083675080.0%
Claude Opus 4.8 (Reasoning)10010070676379.9%
Claude Sonnet 41008381785579.7%
Gemini 2.5 Flash1008383676579.6%
Gemini 2.5 Pro1009793743379.4%
DeepSeek V3.1968383676779.2%
Claude Opus 4.7 (Reasoning)1008383676178.9%
DeepSeek V4 Flash 0731 (Reasoning, High)1008373706778.6%
Ministral 8B868583696778.0%
Gemini 3.8 Flash (Reasoning, Medium)938380676777.9%
Claude Opus 4.6 (Reasoning)958376676777.6%
o4 Mini High878383756077.6%
GPT-4o, Aug. 6th (temp=0)878681676677.4%
GPT-5.4 Mini (Reasoning)838383676776.7%
Grok 4.20948883675076.5%
Qwen 3.5 Flash838376716876.4%
Claude Haiku 5.5 (Adaptive)797875737175.2%
Thinking Machines Inkling Small (Reasoning, High)838380795075.2%
Qwen 2.5 72B917971676774.9%
DeepSeek V3.21009183831774.8%
Z.AI GLM 5 Turbo838383675574.3%
Gemma 4 26B (Reasoning)988967665074.1%
Laguna S 2.1838370676773.9%
GPT-4.1918373725073.8%
Xiaomi MIMO v2.51008567675073.6%
Claude Opus 4.61008967625073.5%
Z.AI GLM 5.2 (Reasoning, High)838367676773.3%
Xiaomi MIMO v2.6 Flash838383675073.3%
Claude Haiku 5.5 (Reasoning, Medium)807876676573.2%
Qwen 3.5 35B807977676373.1%
Qwen 3.6 27B837970676573.0%
Qwen 3.5 397B A17B837673676572.7%
Qwen 3.8 Flash (Reasoning)966767676772.5%
Claude Sonnet 5 (Reasoning)989288503372.3%
Mistral Large 4.0 (Reasoning)878367675672.0%
DeepSeek V4 Pro 0813 (Reasoning, High)827669676772.0%
Gemini 3 Flash (Preview, Reasoning)978375505071.1%
Aion 3.0 Mini1008670505071.1%
Claude Sonnet 4.61008373653370.9%
Muse Spark 1.1 (Reasoning, Minimal)928367615070.4%
Kimi K3 (Reasoning, High)1008383503370.0%
GPT-4o, Aug. 6th (temp=1)787668675969.5%
Gemma 4 31B (Reasoning)787370685969.5%
Claude Sonnet 5 (Reasoning, Low)848067675069.5%
MiniMax M2.5838067675069.4%
Gemini 3 Flash (Preview)817267626168.7%
Mistral Small 3.2 24B878367673968.5%
GPT-5.4 (Reasoning)837567675068.4%
Cohere Command R+ (Aug. 2024)898483503368.0%
Gemma 4 26B928067673367.8%
DeepSeek V4 Flash (Reasoning)828273673367.4%
Mistral Large 4.0787474625067.3%
Gemma 3 12B807467645067.0%
Z.AI GLM 5.3 (Reasoning, Max)838367505066.7%
Z.AI GLM 5.3 Flash (Reasoning, Max)836767675066.7%
Claude Haiku 4.5837977484566.5%
Kimi K2.6837868505066.0%
DeepSeek V4 Pro816767655065.9%
GPT-5.4837967673365.8%
Gemini 3.5 Flash (Reasoning, Minimal)727168675065.5%
Aion 3.5 (Reasoning, High)837767505065.5%
DeepSeek V4 Flash948367503365.4%
o4 Mini737066635064.3%
Qwen 3 32B797366614063.9%
Gemini 3.5 Flash Lite (Reasoning)1008365333362.9%
GPT-5.4 Mini (Reasoning, Low)976765503362.5%
GPT-5.4 Mini676765615061.8%
Ministral 3B866463504461.3%
Ministral 3 3B836559584261.3%
Z.AI GLM 4.7676765575061.0%
Mistral Medium 3.1847150505060.9%
ByteDance Seed 1.6 Flash837567413860.7%
GPT-6.1 Sol (Reasoning, Medium)786563633360.4%
DeepSeek V3 (2024-12-26)826761543860.4%
Thinking Machines Inkling (Reasoning)836762612760.0%
DeepSeek-V2 Chat736858554660.0%
GPT-5 Nano838367501760.0%
MiniMax M2.7676767505060.0%
Gemini 3.6 Flash (Reasoning, Minimal)836756504359.7%
Hy4 Preview (Reasoning, High)676764505059.5%
Muse Glimmer 30B (Reasoning, Medium)837671333359.4%
Claude Sonnet 4.5796758504459.3%
Gemini 3.1 Pro (Preview)836763503359.3%
Xiaomi MIMO v2.5 Pro936767501758.6%
Z.AI GLM 5.3 Flash (Reasoning, Low)746967503358.6%
Mistral NeMO806855503858.2%
Z.AI GLM 5837367333358.0%
Gemini 3.5 Flash (Reasoning)827350503357.7%
Gemma 3 27B776963473257.6%
Aion 3.0706767503357.4%
Aion 3.5 Mini (Reasoning, High)90837833056.9%
Hermes 3 70B815753504356.7%
Gemini 2.5 Flash Lite1006767331756.7%
Grok 4.6 (Reasoning, High)838350333356.7%
Muse Spark 1.1 (Reasoning, Medium)676663503355.7%
Ministral 3 8B83776252055.0%
Gemini 3.6 Flash (Reasoning)836758501755.0%
Qwen 3.8 27B (Reasoning, XHigh)736750503354.6%
Qwen 3.5 122B736362393354.1%
Z.AI GLM 4.7 Flash675350505053.9%
DeepSeek V3 (2025-03-24)745957532553.7%
GPT-5.4 (Reasoning, Low)836767331753.3%
Aion 2.0676767333353.3%
Mistral Small 4836750501753.3%
GPT-5.4 Nano (Reasoning)575550505052.5%
Mistral Large 2746056502352.4%
Qwen 3.5 Plus (2026-02-15)776751333352.3%
GPT-5.6 Luna (Reasoning, Medium)646350503352.1%
Cydonia 24B V4.1626250503351.4%
GPT-4o Mini (temp=0)665250493350.1%
Qwen 3.8 Max (Reasoning, XHigh)676750333350.0%
Claude Opus 4.5835050333350.0%
Thinking Machines Inkling777150331749.7%
GPT-5.6 Sol655450453349.4%
GPT-5.5 (Reasoning, Medium)625050503349.1%
GPT-5.4 Nano675048453348.7%
Kimi K2.5675050433348.6%
Gemma 4 31B635650403348.3%
Ministral 3 14B785750361747.4%
Hermes 3 405B83766017047.2%
Claude Opus 4625855332847.2%
Muse Spark 1.3 (Reasoning, Medium)676750331746.7%
GPT-5.6 Terra595050403346.5%
GPT-5.5 (Reasoning, Low)676450331746.1%
Mistral Medium 3.5 (Reasoning)645050333346.1%
Writer: Palmyra X5605050333345.4%
GPT-5.6 Luna645050331742.7%
GPT-5.4 Nano (Reasoning, Low)635033333342.5%
GPT-5.6 Sol (Reasoning, Medium)505046333342.5%
GPT-6 Sol (Reasoning, Medium)515046402542.3%
Mistral Medium 3.58378339040.7%
Qwen 3.5 9B545042391740.4%
Mistral Large 362524542040.2%
Z.AI GLM 4.5545042282639.9%
GPT-6 Luna (Reasoning, Medium)68433933036.8%
GPT-6 Luna504833331736.3%
GPT-5.6 Terra (Reasoning, Medium)50503333033.3%
Mistral Small 4 (Reasoning)673332171733.0%
GPT-6 Luna (Reasoning, High)503333301732.8%
Qwen 3.5 27B423933301732.0%
GPT-5.5503333171730.0%
Z.AI GLM 4.5 Air50333317026.7%
Qwen 3 235B A22B Instruct 25075050330026.7%
GPT-6 Sol2523170013.0%
GPT-5.2331700010.0%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Claude Haiku 5.5 (Reasoning, Max)100100 – – – 100.0%
Gemini 3.8 Flash (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.3 (Reasoning, Max)100100100100100100.0%
Claude Opus 4.6 (Reasoning)100100100100100100.0%
Gemini 3.6 Flash (Reasoning)100100100100100100.0%
Muse Spark 1.2 (Reasoning, Medium)100100100100100100.0%
Qwen 3.7 Max100100100100100100.0%
DeepSeek V4.1 Flash (Reasoning, High)100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100.0%
Muse Spark 1.1 (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.1100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100.0%
Claude Sonnet 4.6 (Reasoning)100100100100100100.0%
Z.AI GLM 5.2 (Reasoning, High)100100100100100100.0%
Gemini 3.5 Flash (Reasoning)100100100100100100.0%
Z.AI GLM 5 Turbo100100100100100100.0%
Kimi K3 (Reasoning, High)100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100.0%
Grok 4.7 (Reasoning, High)100100100100100100.0%
Kimi K2.6100100100100100100.0%
Claude Opus 4.7 (Reasoning)100100100100100100.0%
Aion 3.5 Mini (Reasoning, High)100100100100100100.0%
Claude Opus 4.8 (Reasoning)100100100100100100.0%
Claude Opus 4.6100100100100100100.0%
Kimi K3 (Reasoning, Low)100100100100100100.0%
Claude Opus 5 (Reasoning, Low)100100100100100100.0%
Xiaomi MIMO v2.6 Pro100100100100100100.0%
GPT-5100100100100100100.0%
Muse Spark 1.1 (Reasoning, Minimal)100100100100100100.0%
GPT-5 Mini100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100.0%
GPT-5.1100100100100100100.0%
Claude Sonnet 4.6100100100100100100.0%
Claude Sonnet 5 (Reasoning)100100100100100100.0%
Qwen 3.5 122B100100100100100100.0%
Claude Sonnet 5 (Reasoning, Low)100100100100100100.0%
Qwen 3.5 27B100100100100100100.0%
Claude Opus 5100100100100100100.0%
Gemini 3 Flash (Preview, Reasoning)100100100100100100.0%
Claude Opus 4.7100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100.0%
Z.AI GLM 5100100100100100100.0%
ByteDance Seed 1.6100100100100100100.0%
Claude Haiku 5.5 (Adaptive)100100100100100100.0%
Qwen 3.6 Flash100100100100100100.0%
DeepSeek V4 Pro (Reasoning)100100100100100100.0%
Gemma 4 26B (Reasoning)100100100100100100.0%
Muse Glimmer 30B (Reasoning, Medium)100100100100100100.0%
Aion 3.0100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100100100100.0%
Qwen 3.7 Flash (Reasoning)100100100100100100.0%
Gemini 2.5 Pro100100100100100100.0%
Z.AI GLM 4.7100100100100100100.0%
Qwen 3.6 35B100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Low)100100100 – – 100.0%
Z.AI GLM 4.6100100100100100100.0%
Thinking Machines Inkling Small (Reasoning, High)100100100100100100.0%
Claude Sonnet 5100100100100100100.0%
Xiaomi MIMO v2.6 Flash100100100100100100.0%
MiniMax M2.5100100100100100100.0%
Aion 2.0100100100100100100.0%
MiniMax M2.7100100100100100100.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100100100.0%
Gemini 3.5 Flash (Reasoning, Minimal)100100100100100100.0%
ByteDance Seed 2.0 Mini100100100100100100.0%
Qwen 3.5 Flash100100100100100100.0%
Gemini 3.1 Flash Lite (Preview)100100100100100100.0%
Gemma 4 31B100100100100100100.0%
Gemini 3.1 Flash Lite100100100100100100.0%
Gemma 4 26B100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100100100100100100.0%
GPT-5.4100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Medium)100100100100100100.0%
Gemini 2.5 Flash (Reasoning)100100100100100100.0%
Xiaomi MIMO v2.5100100100100100100.0%
GPT-5.4 Mini (Reasoning, Low)100100100100100100.0%
Claude Haiku 4.5100100100100100100.0%
Gemini 2.5 Flash Lite (Reasoning)100100100100100100.0%
DeepSeek V3.1100100100100100100.0%
DeepSeek V3.2100100100100100100.0%
Z.AI GLM 4.7 Flash100100100100100100.0%
Nemotron 3 Super100100100100100100.0%
Gemini 2.5 Flash100100100100100100.0%
GPT-5.4 Nano (Reasoning)100100100100100100.0%
Gemini 2.5 Flash Lite100100100100100100.0%
Grok 4.3100100100100100100.0%
GPT-4o Mini (temp=1)100100100100100100.0%
Laguna XS 2.1100100100100100100.0%
GPT-4.1 Nano100100100100100100.0%
Gemma 3 4B100100100100100100.0%
GPT-5.2100100100100100100.0%
Claude Opus 4.51001001001009999.9%
Gemma 3 12B1001001001009899.6%
Gemini 3.7 Flash (Reasoning, Medium)100100100999899.4%
Qwen 3.5 9B1001001001009799.4%
Thinking Machines Inkling (Reasoning)100100100999799.3%
o4 Mini High1001001001009799.3%
Qwen 3.5 Plus (2026-04-20)1001001001009699.3%
Qwen 3.6 27B1001001001009699.2%
Mistral Large 4.0 (Reasoning)1001001001009699.1%
Gemini 3.6 Flash (Reasoning, Minimal)1001001001009498.9%
Gemini 3 Flash (Preview)1001001001009398.7%
Mistral Small 3.2 24B1001001001009298.5%
Qwen 3 32B100100100969598.2%
Claude Sonnet 4.510010099969497.8%
DeepSeek V4 Flash (Reasoning)1001001001008897.6%
GPT-OSS 120B10010097969597.6%
Kimi K2.5100100100998997.6%
Gemini 3.1 Pro (Preview)100100100949397.3%
Claude Opus 5.5 (Reasoning)1001001001008396.7%
Hy4 Preview (Reasoning, High)1001001001008396.7%
Muse Spark 1.3 (Reasoning, Medium)1001001001008396.7%
Claude Sonnet 5.5 (Reasoning)1001001001008396.7%
Claude Opus 5 (Reasoning)1001001001008396.7%
DeepSeek V4 Pro 0813 (Reasoning, High)1001001001008396.7%
Gemma 4 31B (Reasoning)1001001001008396.7%
Qwen 3.5 35B1001001001008396.7%
Qwen 3.5 Plus (2026-02-15)1001001001008396.7%
Gemini 3.5 Flash Lite (Reasoning)1001001001008396.7%
ByteDance Seed 2.0 Lite1001001001008396.7%
GPT-5 Nano1001001001008396.7%
Laguna S 2.11001001001008396.7%
Writer: Palmyra X51001001001008396.7%
Aion 3.5 (Reasoning, High)1001001001008396.7%
GPT-5.4 (Reasoning, Low)1001001001008396.7%
GPT-4o Mini (temp=0)1001001001008396.7%
Arcee AI: Trinity Mini1001001001008396.7%
Mistral Large 3100100100988496.4%
DeepSeek V3 (2024-12-26)10010099968696.2%
Gemma 3 27B100100100988396.2%
Thinking Machines Inkling100100100968395.9%
GPT-4.1 Mini1001001001007795.5%
o4 Mini100100100978095.4%
DeepSeek V4 Flash100100100938395.4%
DeepSeek V4 Pro100100100908394.6%
GPT-4o, Aug. 6th (temp=1)100100100898394.5%
Qwen 3 235B A22B Instruct 2507100100100888394.3%
GPT-6 Sol (Reasoning, Medium)10010093928393.5%
MiniMax M31001001001006793.3%
DeepSeek V4 Flash 0731 (Reasoning, High)1001001001006793.3%
Nemotron 3 Nano1001001001006793.3%
Mistral Medium 3.5 (Reasoning)1009995918293.3%
GPT-5.4 Mini100100100966792.5%
Mistral Large 4.010010087838390.8%
GPT-4.1100100100837090.6%
Inception Mercury 210010095916790.5%
Qwen 3.8 Flash (Reasoning)100100100836790.0%
Claude Opus 4.8 (Reasoning, Low)1001001001005090.0%
Grok 4.20100100100836790.0%
Cohere Command R+ (Aug. 2024)1001001001005090.0%
GPT-6 Luna (Reasoning, High)1009287868389.6%
GPT-5.4 Nano1009997836789.3%
Cydonia 24B V4.110010094836788.8%
Ministral 3 8B1009391827988.8%
Mistral Large 21009990876788.6%
Qwen 3.8 Max (Reasoning, XHigh)1008883838387.6%
Ministral 3B999583818087.6%
GPT-5.4 Nano (Reasoning, Low)989483837987.4%
Claude Sonnet 410010083836786.7%
Xiaomi MIMO v2.5 Pro100100100835086.7%
Z.AI GLM 4.51009588846786.6%
Aion 3.0 Mini1001001001002685.2%
GPT-6 Sol1009183836784.8%
Ministral 3 14B939188836784.5%
Mistral Medium 3.510010083676783.3%
ByteDance Seed 1.6 Flash10010082676783.1%
GPT-6 Luna (Reasoning, Medium)948885816782.9%
WizardLM 2 8x22b1008383737382.4%
Mistral Small 410010091675081.6%
DeepSeek V3 (2025-03-24)938988726481.2%
GPT-4o, Aug. 6th (temp=0)1008584696781.0%
GPT-5.6 Terra (Reasoning, Medium)838383816779.5%
Mistral NeMO10010092713379.3%
DeepSeek-V2 Chat10010085674278.8%
GPT-6.1 Sol (Reasoning, Medium)1009467676778.8%
Ministral 8B10010082673376.4%
Mistral Small 4 (Reasoning)10010083503373.3%
GPT-6 Luna838379675072.4%
Ministral 3 3B1008682593372.1%
Mistral Medium 3.1998167615071.5%
GPT-5.6 Luna (Reasoning, Medium)977767675071.5%
Claude Opus 410010083333370.0%
Llama 3.1 70B1007864594969.8%
Hermes 3 70B919064504968.8%
Hermes 3 405B10010056433266.2%
Z.AI GLM 4.5 Air966767593364.3%
GPT-5.6 Luna836763505062.6%
GPT-5.5966750503359.1%
GPT-5.6 Terra836767501756.7%
GPT-5.5 (Reasoning, Medium)836767501756.7%
GPT-5.5 (Reasoning, Low)83838333056.6%
Qwen 2.5 72B93776733054.0%
GPT-5.6 Sol706733333347.3%
GPT-5.6 Sol (Reasoning, Medium)6950330030.4%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Hy4 Preview (Reasoning, High)100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100.0%
Gemini 2.5 Pro100100100100100100.0%
Z.AI GLM 4.6100100100100100100.0%
Inception Mercury 2100100100100100100.0%
Grok 4.20100100100100100100.0%
GPT-5 Nano100100100100100100.0%
Arcee AI: Trinity Mini100100100100100100.0%
Gemma 3 4B100100100100100100.0%
o4 Mini1001001001009899.7%
Qwen 3 235B A22B Instruct 2507100100100999398.3%
Z.AI GLM 5 Turbo1001001001008396.7%
GPT-OSS 120B1001001001008396.7%
Mistral Large 4.01001001001008396.7%
DeepSeek V3.21001001001008396.7%
GPT-4.1 Nano100100100987294.1%
Thinking Machines Inkling Small (Reasoning, High)100100100838393.3%
DeepSeek V3.11001001001006793.3%
Grok 4.3 (Reasoning)100100100996793.1%
Gemini 2.5 Flash100100100837992.4%
Gemini 3.1 Flash Lite100100100956792.3%
Mistral Large 4.0 (Reasoning)100100100936792.0%
DeepSeek V4 Flash 0731 (Reasoning, High)100100100827591.4%
Grok 4.5 (Reasoning, High)1001001001005090.0%
Qwen 3.7 Flash (Reasoning)100100100836790.0%
Xiaomi MIMO v2.5 Pro100100100836790.0%
ByteDance Seed 2.0 Mini1001001001005090.0%
Ministral 3 8B10010098975089.2%
Qwen 3.7 Max1009583838389.0%
Qwen 3 32B10010097836088.0%
Laguna XS 2.1100100100974187.6%
Ministral 3 14B1009283818087.2%
Qwen 3.8 27B (Reasoning, XHigh)1001001001003386.7%
o4 Mini High1001001001003386.7%
Qwen 3.5 35B1009583836785.6%
Z.AI GLM 4.71008383836783.3%
Nemotron 3 Super10010083676783.3%
Gemini 3.5 Flash Lite (Reasoning, Minimal)999983676783.0%
Mistral Large 31008383826783.0%
Nemotron 3 Nano10010094833382.0%
Mistral Medium 3.11008983676781.1%
GPT-4o Mini (temp=1)1009590833380.2%
Ministral 8B10010095723380.1%
Claude Sonnet 41008383835080.0%
Mistral Small 4 (Reasoning)100100100505080.0%
GPT-4.1100100100100079.9%
Gemma 4 31B958383676779.1%
DeepSeek V4 Pro10010083832879.0%
GPT-4.1 Mini10010099781778.9%
Gemma 4 26B1009083675078.0%
Qwen 3.5 Plus (2026-02-15)908383676778.0%
Claude Sonnet 5.5 (Reasoning)100100100553377.8%
Grok 4.6 (Reasoning, High)10010067675076.7%
Gemini 3.5 Flash (Reasoning, Minimal)1008367676776.7%
Qwen 3.5 122B10010083673376.7%
Qwen 3.6 35B10010067675076.7%
Aion 2.010010010083076.7%
GPT-4o, Aug. 6th (temp=1)10010010083076.7%
Gemini 3.1 Flash Lite (Preview)1009983831776.5%
Grok 4.31001009883076.2%
GPT-5 Mini10010067673373.3%
Qwen 3.5 Plus (2026-04-20)100100100333373.3%
Gemini 3.1 Flash Lite (Reasoning)1008383673373.3%
GPT-5.4838383675073.3%
Qwen 3.5 9B1008367675073.3%
Gemini 2.5 Flash Lite (Reasoning)10010010067073.3%
Z.AI GLM 4.7 Flash1008367675073.3%
MiniMax M310010010061072.1%
Qwen 3.6 Flash968367635071.7%
Claude Haiku 4.51008380672571.0%
ByteDance Seed 1.610010087333370.6%
DeepSeek V3 (2024-12-26)868383673370.5%
Gemma 4 26B (Reasoning)10010067503370.0%
Muse Spark 1.1 (Reasoning, Minimal)10010010050070.0%
Claude Sonnet 510010067503370.0%
DeepSeek V4 Flash1001008367070.0%
DeepSeek V4 Flash (Reasoning)100100100272169.6%
Gemma 4 31B (Reasoning)1008383503169.6%
Aion 3.5 (Reasoning, High)10010062503369.2%
Kimi K2.510010083501269.0%
Qwen 3.6 Max Preview10010050504368.6%
Gemini 2.5 Flash Lite1009167671768.2%
Z.AI GLM 5.3 (Reasoning, Max)10010050503366.7%
Gemini 3.1 Pro (Preview)838367673366.7%
Thinking Machines Inkling (Reasoning)10010010033066.7%
Qwen 3.6 27B100100100171766.7%
Mistral Small 4836767675066.7%
Gemini 3 Flash (Preview)838367663366.4%
DeepSeek V3 (2025-03-24)1008067671766.1%
WizardLM 2 8x22b1006761505065.5%
Mistral Medium 3.51006767503363.3%
Gemini 3.5 Flash Lite (Reasoning)836767505063.3%
Xiaomi MIMO v2.510010050333363.3%
MiniMax M2.510010010017063.3%
Gemma 3 27B1008367501763.3%
GPT-4o Mini (temp=0)83838067062.6%
Cohere Command R+ (Aug. 2024)786767525062.5%
Gemini 3.8 Flash (Reasoning, Medium)100836750060.0%
DeepSeek-V2 Chat100676767060.0%
Gemini 2.5 Flash (Reasoning)1001008316059.9%
Claude Sonnet 5 (Reasoning, Low)1005150474658.8%
Claude Opus 4.8 (Reasoning)1001004442057.2%
Mistral Medium 3.5 (Reasoning)100836733056.7%
Qwen 3.8 Flash (Reasoning)100100830056.7%
Kimi K2.610010050171756.7%
Xiaomi MIMO v2.6 Pro100835050056.7%
Claude Sonnet 4.610010033331756.7%
Qwen 3.5 27B1001006717056.7%
GPT-5.4 Mini83836750056.7%
Llama 3.1 70B1001006717056.7%
Hermes 3 405B100895042056.3%
Claude Opus 4.7 (Reasoning)10010033291755.8%
Claude Opus 492838316054.9%
Claude Opus 4.8 (Reasoning, Low)1005649353354.8%
Claude Haiku 5.5 (Reasoning, Medium)100835733054.6%
Gemini 3.7 Flash (Reasoning, Medium)838350331753.3%
GPT-5.4 (Reasoning, Low)100836717053.3%
ByteDance Seed 2.0 Lite836767331753.3%
Laguna S 2.11001005017053.3%
Writer: Palmyra X510098670052.8%
Thinking Machines Inkling10097670052.6%
Ministral 3B83676050052.1%
Cydonia 24B V4.1585050505051.5%
Z.AI GLM 5.11001003317751.4%
Gemini 3.6 Flash (Reasoning)675050503350.0%
DeepSeek V4.1 Flash (Reasoning, High)1006733331750.0%
Claude Sonnet 4.6 (Reasoning)1005050331750.0%
Aion 3.5 Mini (Reasoning, High)1006733331750.0%
Gemini 3 Flash (Preview, Reasoning)836750331750.0%
Qwen 3.5 Flash83825033049.7%
GPT-4o, Aug. 6th (temp=0)100913317048.2%
GPT-5.4 Nano675050333346.7%
Grok 4.7 (Reasoning, High)1005050171746.7%
ByteDance Seed 1.6 Flash9983500046.6%
Qwen 3.5 397B A17B826733331746.4%
Gemini 3.6 Flash (Reasoning, Minimal)83675027045.3%
Z.AI GLM 5100484133044.4%
GPT-5.4 Nano (Reasoning)695050331743.8%
Z.AI GLM 5.2 (Reasoning, High)100503333043.3%
Z.AI GLM 5.3 Flash (Reasoning, Low)100503333043.3%
Xiaomi MIMO v2.6 Flash675050331743.3%
GPT-5.4 Nano (Reasoning, Low)67505050043.3%
Kimi K3 (Reasoning, High)100434324042.1%
Claude Sonnet 5 (Reasoning)605550271441.2%
Claude Opus 5505035333340.3%
Muse Spark 1.3 (Reasoning, Medium)83503333040.0%
GPT-5100503317040.0%
DeepSeek V4 Pro (Reasoning)100671717040.0%
Muse Glimmer 30B (Reasoning, Medium)10083170040.0%
MiniMax M2.71003333171740.0%
Claude Opus 5 (Reasoning)67505029039.1%
GPT-5.4 (Reasoning)1008300036.7%
Claude Opus 4.58367330036.7%
Aion 3.083333333036.7%
Mistral Large 210067170036.7%
Mistral NeMO67503333036.7%
Z.AI GLM 4.5 Air505033331736.7%
Claude Opus 4.6100333317036.5%
Hermes 3 70B763328231234.6%
Qwen 3.8 Max (Reasoning, XHigh)838300033.3%
Claude Opus 4.6 (Reasoning)50503333033.3%
Gemini 3.5 Flash (Reasoning)67503317033.3%
GPT-5.6 Terra67503317033.3%
Aion 3.0 Mini100331717033.3%
Claude Opus 4.710033320033.1%
Claude Haiku 5.5 (Adaptive)65503217032.7%
Claude Sonnet 4.51005060031.2%
GPT-5.4 Mini (Reasoning, Low)836700030.0%
GPT-5.6 Luna836700030.0%
Mistral Small 3.2 24B6750290029.1%
Qwen 2.5 72B7850170028.9%
Ministral 3 3B78331711027.8%
Claude Opus 5.5 (Reasoning)47393317027.4%
GPT-5.6 Sol676700026.7%
DeepSeek V4 Pro 0813 (Reasoning, High)1003300026.7%
Z.AI GLM 4.567331717026.7%
Z.AI GLM 5.3 Flash (Reasoning, Max)50333317026.7%
Kimi K3 (Reasoning, Low)433320161425.2%
GPT-5.5675000023.3%
GPT-6 Luna100000020.0%
Muse Spark 1.1 (Reasoning, Medium)5033170020.0%
GPT-5.6 Terra (Reasoning, Medium)505000020.0%
GPT-5.6 Sol (Reasoning, Medium)67000013.3%
Claude Opus 5 (Reasoning, Low)3317170013.3%
Muse Spark 1.2 (Reasoning, Medium)331700010.0%
GPT-5.250000010.0%
GPT-5.4 Mini (Reasoning)3300006.7%
Gemma 3 12B17160006.5%
GPT-6.1 Sol (Reasoning, Medium)000000.0%
GPT-6 Luna (Reasoning, High)000000.0%
GPT-5.5 (Reasoning, Medium)000000.0%
GPT-6 Sol (Reasoning, Medium)000000.0%
GPT-5.5 (Reasoning, Low)000000.0%
GPT-6 Luna (Reasoning, Medium)000000.0%
GPT-5.1000000.0%
GPT-5.6 Luna (Reasoning, Medium)000000.0%
GPT-6 Sol000000.0%
Claude Haiku 5.5 (Reasoning, Low)0 – – – – 0.0%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Claude Opus 5 (Reasoning, Low)1001001001009799.3%
Claude Opus 5.5 (Reasoning)1001001001008396.7%
Claude Opus 4.8 (Reasoning)100100100998396.4%
Xiaomi MIMO v2.6 Flash100100100958395.7%
Claude Sonnet 5 (Reasoning)100100100918394.9%
GPT-4.1 Nano100100100868393.7%
Z.AI GLM 5.3 (Reasoning, Max)1001001001006793.3%
Claude Opus 4.7 (Reasoning)1001001001006793.3%
Claude Haiku 5.5 (Adaptive)100100100996793.1%
Grok 4.5 (Reasoning, Low)10010098916791.2%
Claude Opus 4.8 (Reasoning, Low)1001001001004989.9%
Claude Opus 4.7100100100826789.8%
Claude Sonnet 5 (Reasoning, Low)100100100975089.4%
Grok 4.3 (Reasoning)10010092836788.4%
Gemini 3.5 Flash Lite (Reasoning)1009589837488.4%
Claude Haiku 5.5 (Reasoning, Medium)10010090836687.8%
Kimi K3 (Reasoning, High)10010099835086.5%
Aion 3.5 Mini (Reasoning, High)10010083816786.3%
Claude Opus 51009783836786.0%
Qwen 3.6 Max Preview979283837485.9%
Gemma 4 26B1009283787585.7%
Qwen 3.6 Flash1008683837685.7%
Grok 4.7 (Reasoning, High)1009883806785.6%
Claude Sonnet 510010081766684.8%
Nemotron 3 Nano1009283796784.1%
Kimi K3 (Reasoning, Low)948383807984.1%
Grok 4.310010084676783.4%
Xiaomi MIMO v2.6 Pro10010083676783.3%
Claude Opus 5 (Reasoning)100100100675083.3%
ByteDance Seed 2.0 Mini10010083676783.3%
GPT-5 Nano10010083676783.3%
Grok 4.5 (Reasoning, High)1009783805082.2%
MiniMax M2.51009383835081.8%
ByteDance Seed 2.0 Lite988383676779.6%
Z.AI GLM 5.3 Flash (Reasoning, Low)958874716678.9%
Gemini 3.1 Flash Lite838380746777.5%
Claude Sonnet 5.5 (Reasoning)10010083831776.7%
Nemotron 3 Super10010067675076.7%
DeepSeek V4 Flash1008369676176.0%
ByteDance Seed 1.6838383805076.0%
GPT-OSS 120B948383675075.6%
Gemini 3.5 Flash Lite (Reasoning, Minimal)968375675074.2%
Claude Sonnet 4.5827972676172.0%
Z.AI GLM 5.1979667663371.8%
Gemini 3.1 Flash Lite (Preview)838375675071.7%
Muse Spark 1.1 (Reasoning, Medium)838375675071.6%
Qwen 3 32B858575625071.5%
Qwen 3.6 35B937967674770.3%
Gemma 4 26B (Reasoning)838367675070.2%
Aion 3.5 (Reasoning, High)10010067503370.0%
DeepSeek V4 Pro (Reasoning)838067675069.3%
Aion 3.01008379671769.0%
Gemini 3.1 Flash Lite (Reasoning)838377673368.8%
MiniMax M3838377673368.8%
Gemini 3.5 Flash (Reasoning, Minimal)827972585068.4%
Hermes 3 70B1008362554168.3%
Inception Mercury 2838076505067.9%
Qwen 3.6 27B1009780332867.7%
MiniMax M2.7948357505066.7%
Z.AI GLM 5.3 Flash (Reasoning, Max)1001008350066.7%
Mistral Large 4.0998367671766.5%
Grok 4.6 (Reasoning, High)838267505066.5%
Gemini 2.5 Pro747367575064.1%
Qwen 3.7 Max907167474263.3%
DeepSeek V4.1 Flash (Reasoning, High)838367503363.3%
Mistral Medium 3.1100996750063.1%
Z.AI GLM 5.2 (Reasoning, High)1009983171763.1%
GPT-5 Mini837667503361.9%
Grok 4.20100928333061.7%
GPT-6 Luna (Reasoning, High)836562504761.5%
Mistral NeMO1008149413360.8%
Muse Spark 1.3 (Reasoning, Medium)676767505060.0%
Grok 4.20 (Reasoning)676767505060.0%
Qwen 3.5 Flash838367501760.0%
Kimi K2.6836550505059.7%
Qwen 3.5 Plus (2026-04-20)10010046331759.2%
Qwen 3.5 27B856655503357.9%
Cydonia 24B V4.11009641331757.4%
Laguna S 2.1776758513357.2%
Mistral Large 3817167501757.0%
Claude Sonnet 4.6 (Reasoning)100836733056.7%
Xiaomi MIMO v2.5100676750056.7%
DeepSeek V3.1755650505056.2%
Z.AI GLM 5948450331755.5%
Qwen 3.5 Plus (2026-02-15)837750353055.1%
GPT-4.194816733055.1%
Qwen 3.7 Flash (Reasoning)87837723054.3%
Gemma 3 4B726761521753.6%
GPT-5.4 (Reasoning)1006767171753.3%
Gemini 2.5 Flash Lite (Reasoning)676750503353.3%
Kimi K2.5665852504053.1%
Thinking Machines Inkling Small (Reasoning, High)676450503352.8%
Z.AI GLM 4.6746450453152.7%
DeepSeek V4 Flash 0731 (Reasoning, High)1005045333352.4%
Claude Sonnet 4836648332951.9%
GPT-4o Mini (temp=1)817750331751.5%
Gemini 3.7 Flash (Reasoning, Medium)676150413350.5%
Aion 2.0706748333350.2%
WizardLM 2 8x22b79726436050.2%
Muse Spark 1.1 (Reasoning, Minimal)846750331750.1%
GPT-5100833333050.0%
Hy4 Preview (Reasoning, High)100505050050.0%
Qwen 3.8 27B (Reasoning, XHigh)676750333350.0%
Claude Sonnet 4.683675050050.0%
Xiaomi MIMO v2.5 Pro67676750050.0%
Muse Spark 1.2 (Reasoning, Medium)816256331749.6%
Gemini 2.5 Flash (Reasoning)806750331749.3%
Gemma 3 27B656350333349.0%
Claude Opus 4.6100615033048.9%
ByteDance Seed 1.6 Flash796833333048.9%
Gemma 4 31B676461331748.5%
Gemini 3.8 Flash (Reasoning, Medium)795750391748.5%
DeepSeek V3.2745050333348.1%
GPT-4o, Aug. 6th (temp=1)837350171748.0%
DeepSeek V4 Pro946133331747.5%
GPT-6 Luna746762171747.1%
Muse Glimmer 30B (Reasoning, Medium)756050331747.0%
Mistral Large 275744738046.9%
Mistral Small 3.2 24B67675150046.9%
Gemma 3 12B10067670046.7%
Gemini 2.5 Flash Lite625050333345.6%
Gemini 3.5 Flash (Reasoning)70675533045.0%
Gemini 3.6 Flash (Reasoning)60605743043.9%
Laguna XS 2.1635533333343.6%
Z.AI GLM 5 Turbo83673333043.3%
GPT-5.4 Mini83673333043.3%
Ministral 3 14B675033333343.3%
Claude Opus 4.6 (Reasoning)676733331743.3%
GPT-5.183505033043.3%
GPT-4o Mini (temp=0)68515048043.3%
Ministral 8B755933311743.0%
Gemini 3 Flash (Preview, Reasoning)675048331742.9%
Qwen 3.8 Max (Reasoning, XHigh)635050331742.5%
DeepSeek V4 Flash (Reasoning)1003333271742.1%
Arcee AI: Trinity Mini67575528041.2%
Cohere Command R+ (Aug. 2024)67564833040.7%
GPT-5.4 Mini (Reasoning)835033171740.0%
GPT-5.6 Terra (Reasoning, Medium)83493333039.9%
Gemma 4 31B (Reasoning)68504532039.0%
GPT-6 Sol (Reasoning, Medium)674533331739.0%
Aion 3.0 Mini50505044038.8%
Mistral Large 4.0 (Reasoning)77505017038.7%
Thinking Machines Inkling66604817038.1%
GPT-5.6 Luna (Reasoning, Medium)545333331738.1%
GPT-5.4 Mini (Reasoning, Low)833333171736.7%
Qwen 3.8 Flash (Reasoning)505033331736.7%
Gemini 3 Flash (Preview)673333281735.5%
Mistral Medium 3.593333317035.2%
GPT-6 Luna (Reasoning, Medium)504733271734.9%
GPT-5.467503317033.3%
Mistral Small 463543316033.3%
Qwen 3.5 397B A17B72392824032.8%
DeepSeek V3 (2025-03-24)56523321032.5%
Thinking Machines Inkling (Reasoning)67501917832.1%
Ministral 3 3B50433826031.5%
o4 Mini534922201331.3%
Claude Opus 4.552503317030.5%
Qwen 3.5 35B50333328730.2%
DeepSeek V4 Pro 0813 (Reasoning, High)50503317030.0%
Mistral Small 4 (Reasoning)67501717030.0%
GPT-5.4 (Reasoning, Low)8150170029.5%
o4 Mini High50503017029.4%
Ministral 3B48453316028.6%
Gemini 3.1 Pro (Preview)786300028.2%
Gemini 3.6 Flash (Reasoning, Minimal)47333323027.2%
GPT-4o, Aug. 6th (temp=0)493023171025.8%
DeepSeek-V2 Chat423229171025.7%
GPT-4.1 Mini50461710024.6%
GPT-5.56733170023.3%
GPT-5.4 Nano (Reasoning)33333317023.3%
GPT-5.2333317171723.3%
Claude Haiku 4.539302422023.1%
GPT-5.6 Sol (Reasoning, Medium)36323117023.1%
Qwen 3.5 122B4735330023.1%
Ministral 3 8B584780022.5%
GPT-5.6 Luna33332714021.6%
GPT-6 Sol3833330020.9%
GPT-6.1 Sol (Reasoning, Medium)3333330020.0%
Z.AI GLM 4.5 Air7017130020.0%
Gemini 2.5 Flash33331715019.6%
Claude Opus 4762010019.4%
Qwen 3.5 9B504340019.2%
Z.AI GLM 4.7 Flash33281717019.0%
Hermes 3 405B493372018.3%
Qwen 2.5 72B27251917017.4%
Z.AI GLM 4.7503300016.7%
Writer: Palmyra X55017170016.7%
Mistral Medium 3.5 (Reasoning)3327170015.5%
Llama 3.1 70B482440015.3%
DeepSeek V3 (2024-12-26)3317173014.0%
GPT-5.6 Sol333300013.3%
GPT-5.4 Nano (Reasoning, Low)471700012.7%
GPT-5.6 Terra1717170010.0%
Qwen 3 235B A22B Instruct 25073300006.7%
GPT-5.5 (Reasoning, Low)1700003.3%
GPT-5.4 Nano1700003.3%
Z.AI GLM 4.5400000.7%
GPT-5.5 (Reasoning, Medium)000000.0%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Claude Opus 5.5 (Reasoning)100100100100100100.0%
Z.AI GLM 5.3 (Reasoning, Max)100100100100100100.0%
Claude Opus 4.6 (Reasoning)100100100100100100.0%
DeepSeek V4.1 Flash (Reasoning, High)100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100100100100.0%
Claude Sonnet 4.6 (Reasoning)100100100100100100.0%
Z.AI GLM 5.2 (Reasoning, High)100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100.0%
Claude Opus 4.7 (Reasoning)100100100100100100.0%
Claude Opus 4.8 (Reasoning)100100100100100100.0%
Mistral Large 4.0 (Reasoning)100100100100100100.0%
Claude Opus 4.8 (Reasoning, Low)100100100100100100.0%
Xiaomi MIMO v2.6 Pro100100100100100100.0%
GPT-5 Mini100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100.0%
MiniMax M3100100100100100100.0%
Claude Opus 4.7100100100100100100.0%
Gemma 4 26B (Reasoning)100100100100100100.0%
o4 Mini High100100100100100100.0%
Qwen 3.7 Flash (Reasoning)100100100100100100.0%
Gemini 2.5 Pro100100100100100100.0%
DeepSeek V4 Flash 0731 (Reasoning, High)100100100100100100.0%
Claude Sonnet 5100100100100100100.0%
MiniMax M2.5100100100100100100.0%
Aion 2.0100100100100100100.0%
ByteDance Seed 2.0 Mini100100100100100100.0%
Gemma 4 26B100100100100100100.0%
GPT-OSS 120B100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Medium)100100100100100100.0%
Gemini 2.5 Flash (Reasoning)100100100100100100.0%
Z.AI GLM 4.7 Flash100100100100100100.0%
DeepSeek V4 Flash100100100100100100.0%
Nemotron 3 Super100100100100100100.0%
Writer: Palmyra X5100100100100100100.0%
Qwen 3 235B A22B Instruct 2507100100100100100100.0%
Nemotron 3 Nano100100100100100100.0%
GPT-4.1 Nano100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100.0%
Aion 3.0 Mini1001001001009999.8%
Gemma 3 4B1001001001009999.8%
GPT-4o Mini (temp=1)1001001001009799.4%
GPT-4.1 Mini1001001001009699.2%
Kimi K2.61001001001009599.0%
Kimi K3 (Reasoning, Low)1001001001009398.7%
Claude Opus 4100100100989598.5%
Claude Sonnet 4.61001001001009298.4%
Claude Opus 5 (Reasoning, Low)1001001001009298.4%
Claude Opus 51001001001009298.3%
Muse Spark 1.3 (Reasoning, Medium)1001001001008396.7%
Z.AI GLM 5 Turbo1001001001008396.7%
Kimi K3 (Reasoning, High)1001001001008396.7%
Claude Sonnet 5.5 (Reasoning)1001001001008396.7%
Grok 4.7 (Reasoning, High)1001001001008396.7%
Aion 3.5 Mini (Reasoning, High)1001001001008396.7%
Kimi K2.51001001001008396.7%
Claude Sonnet 5 (Reasoning)1001001001008396.7%
Claude Sonnet 5 (Reasoning, Low)1001001001008396.7%
Z.AI GLM 51001001001008396.7%
Muse Glimmer 30B (Reasoning, Medium)1001001001008396.7%
Aion 3.01001001001008396.7%
Z.AI GLM 4.61001001001008396.7%
Qwen 3.5 35B1001001001008396.7%
GPT-4.11001001001008396.7%
Xiaomi MIMO v2.5 Pro1001001001008396.7%
Gemini 3.1 Flash Lite (Reasoning)1001001001008396.7%
DeepSeek V3.11001001001008396.7%
DeepSeek V3.21001001001008396.7%
ByteDance Seed 2.0 Lite1001001001008396.7%
GPT-5 Nano100100100998396.5%
Gemma 4 31B (Reasoning)100100100998296.3%
Inception Mercury 2100100100988396.2%
GPT-5.4100100100988396.2%
DeepSeek V4 Flash (Reasoning)100100100958395.7%
Gemini 3.5 Flash (Reasoning, Minimal)100100100948395.4%
Laguna S 2.1100100100938395.3%
Xiaomi MIMO v2.5100100100938395.2%
Claude Opus 5 (Reasoning)100100100938395.2%
GPT-4o, Aug. 6th (temp=1)100100100957593.9%
Qwen 3.5 Plus (2026-02-15)10010096908393.8%
Qwen 3.5 27B1009998878393.5%
Z.AI GLM 5.11001001001006793.3%
Claude Opus 4.61001001001006793.3%
GPT-51001001001006793.3%
Claude Haiku 5.5 (Adaptive)100100100838393.3%
Claude Sonnet 4.51001001001006793.3%
Xiaomi MIMO v2.6 Flash100100100838393.3%
MiniMax M2.7100100100838393.3%
Mistral Medium 3.5 (Reasoning)100100100838393.3%
Grok 4.20100100100838393.3%
ByteDance Seed 1.6 Flash1001001001006793.3%
Arcee AI: Trinity Mini100100100907693.2%
Laguna XS 2.1100100100838293.1%
Claude Opus 4.510010091918393.0%
Gemini 3.1 Flash Lite (Preview)100100100986792.9%
Thinking Machines Inkling10010097838392.7%
Gemini 3.6 Flash (Reasoning)10010095838392.3%
Qwen 3.6 27B10010092838391.6%
Thinking Machines Inkling (Reasoning)10010090838391.4%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100100100906791.3%
GPT-5.4 Mini (Reasoning)1009990838391.2%
Gemini 3.8 Flash (Reasoning, Medium)100100100837291.1%
Gemini 3.5 Flash Lite (Reasoning)1009592838390.8%
Muse Spark 1.1 (Reasoning, Medium)1001001001005090.0%
Aion 3.5 (Reasoning, High)10010083838390.0%
GPT-5.110010083838390.0%
DeepSeek V4 Pro (Reasoning)1001001001005090.0%
Thinking Machines Inkling Small (Reasoning, High)1001001001005090.0%
Qwen 3.5 Flash10010083838390.0%
DeepSeek V4 Pro100100100836790.0%
Gemini 2.5 Flash Lite100100100836790.0%
Gemma 3 12B100100100975089.3%
Claude Sonnet 4100100100836389.2%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100826489.2%
GPT-4o Mini (temp=0)100100100955088.9%
Claude Haiku 4.510010083827788.4%
Qwen 3.5 122B988883838387.1%
Qwen 3.5 Plus (2026-04-20)100100100855087.1%
Gemini 3.7 Flash (Reasoning, Medium)1008683838287.0%
Gemini 2.5 Flash Lite (Reasoning)10010083836786.7%
Gemini 2.5 Flash10010083836786.7%
Gemini 3.5 Flash (Reasoning)10010083836786.7%
ByteDance Seed 1.610010083836786.7%
Z.AI GLM 4.71008383838386.7%
Qwen 3.6 35B100100100835086.7%
Grok 4.31001001001003386.7%
GPT-5.4 (Reasoning, Low)100100100835086.5%
Mistral Medium 3.110010096676785.8%
o4 Mini1009383836785.2%
Qwen 3.5 9B10010099923384.8%
Gemma 4 31B1009383806784.7%
Qwen 3.8 Max (Reasoning, XHigh)1008383836783.3%
Muse Spark 1.2 (Reasoning, Medium)10010083676783.3%
Gemini 3.1 Pro (Preview)838383838383.3%
GPT-5.4 (Reasoning)1008383836783.3%
Gemini 3.1 Flash Lite10010083835083.3%
Gemini 3 Flash (Preview, Reasoning)1008782816683.2%
Qwen 3.5 397B A17B1009583676782.4%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100100981.8%
GPT-6.1 Sol (Reasoning, Medium)1008383726981.4%
GPT-4o, Aug. 6th (temp=0)1009483755281.0%
GPT-6 Luna918383796780.7%
Z.AI GLM 4.5928383796780.6%
Ministral 3 14B979782785080.6%
Gemini 3 Flash (Preview)858383836780.3%
Qwen 3.7 Max10010083833380.0%
Qwen 3.6 Flash10010083833380.0%
Gemini 3.6 Flash (Reasoning, Minimal)1008383676780.0%
Mistral Large 4.0100100100100080.0%
DeepSeek V3 (2024-12-26)1009483675078.8%
WizardLM 2 8x22b1008375695776.8%
Hy4 Preview (Reasoning, High)1008383833376.7%
Qwen 3.6 Max Preview10010083673376.7%
GPT-5.4 Mini (Reasoning, Low)1008383675076.7%
Qwen 3 32B1009990831076.4%
GPT-6 Luna (Reasoning, Medium)838282676676.0%
Hermes 3 405B1001009083074.7%
Muse Spark 1.1 (Reasoning, Minimal)1008383673373.3%
Mistral Medium 3.51008367675073.3%
GPT-5.6 Terra (Reasoning, Medium)838367676773.3%
Z.AI GLM 4.5 Air10010067505073.3%
GPT-5.5 (Reasoning, Medium)828167676772.5%
Ministral 3B978567674471.7%
Cohere Command R+ (Aug. 2024)918383663371.4%
Mistral Large 31009570524071.3%
GPT-5.5 (Reasoning, Low)836767676770.0%
DeepSeek-V2 Chat1001008367070.0%
Mistral Small 41001008350066.7%
GPT-6 Luna (Reasoning, High)838164505065.6%
Qwen 3.8 Flash (Reasoning)1007867503365.6%
GPT-5.6 Sol766767595564.6%
Llama 3.1 70B1007964453364.4%
GPT-5.6 Terra838350505063.3%
GPT-5.6 Sol (Reasoning, Medium)676767655062.9%
Mistral Small 4 (Reasoning)837967671762.5%
GPT-5.6 Luna83837767062.0%
GPT-5.4 Nano (Reasoning)756767673361.7%
Ministral 3 3B797470473861.5%
GPT-5.6 Luna (Reasoning, Medium)736767673361.4%
DeepSeek V3 (2025-03-24)95946750061.3%
Hermes 3 70B1008367322260.8%
GPT-5.4 Mini836767503360.0%
GPT-5.5838367333360.0%
Gemma 3 27B1001001000060.0%
Cydonia 24B V4.1100835050858.2%
Mistral Small 3.2 24B776750494156.7%
GPT-6 Sol (Reasoning, Medium)686760503355.5%
GPT-6 Sol676750474555.2%
Qwen 2.5 72B81676550052.5%
Mistral NeMO855050421748.8%
Ministral 3 8B98625917047.2%
GPT-5.4 Nano (Reasoning, Low)675050331743.3%
GPT-5.2725033331741.1%
Ministral 8B10069330040.5%
GPT-5.4 Nano503333171730.0%
Mistral Large 26450330029.5%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Claude Opus 5.5 (Reasoning)100100100100100100.0%
Z.AI GLM 5.3 (Reasoning, Max)100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100.0%
Claude Sonnet 4.6 (Reasoning)100100100100100100.0%
Grok 4.7 (Reasoning, High)100100100100100100.0%
Claude Opus 4.7 (Reasoning)100100100100100100.0%
Aion 3.5 Mini (Reasoning, High)100100100100100100.0%
Claude Opus 4.8 (Reasoning)100100100100100100.0%
Aion 3.5 (Reasoning, High)100100100100100100.0%
Claude Opus 4.8 (Reasoning, Low)100100100100100100.0%
GPT-5 Mini100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100.0%
Claude Sonnet 4.6100100100100100100.0%
Claude Sonnet 5 (Reasoning)100100100100100100.0%
Claude Opus 4.7100100100100100100.0%
Claude Haiku 5.5 (Adaptive)100100100100100100.0%
Muse Glimmer 30B (Reasoning, Medium)100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Low)100 – – – – 100.0%
Z.AI GLM 4.6100100100100100100.0%
Thinking Machines Inkling Small (Reasoning, High)100100100100100100.0%
Claude Sonnet 5100100100100100100.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100100100.0%
Qwen 3.5 Flash100100100100100100.0%
Gemini 3.1 Flash Lite (Preview)100100100100100100.0%
Gemini 3.1 Flash Lite100100100100100100.0%
Gemini 2.5 Flash (Reasoning)100100100100100100.0%
Claude Opus 5 (Reasoning, Low)10010010010010099.9%
Xiaomi MIMO v2.510010010010010099.9%
Qwen 3.5 35B1001001001009999.8%
DeepSeek V4 Pro (Reasoning)1001001001009999.8%
Claude Opus 51001001001009999.8%
Mistral Large 4.0 (Reasoning)1001001001009799.3%
Xiaomi MIMO v2.6 Flash100100100999899.3%
Xiaomi MIMO v2.5 Pro1001001001009699.2%
Grok 4.6 (Reasoning, High)100100100989899.1%
Gemma 4 26B (Reasoning)1001001001009498.9%
Kimi K2.61001001001009498.8%
Grok 4.3 (Reasoning)1001001001009398.7%
Qwen 3.7 Flash (Reasoning)100100100989698.6%
Claude Haiku 5.5 (Reasoning, Medium)100100100989598.5%
Gemma 4 31B (Reasoning)1001001001009298.4%
GPT-4.1 Nano1001001001009298.3%
Nemotron 3 Nano1001001001009198.1%
MiniMax M2.71001001001009098.1%
Z.AI GLM 5100100100969297.7%
GPT-4o, Aug. 6th (temp=1)100100100969197.4%
Gemini 3.7 Flash (Reasoning, Medium)1001001001008797.4%
Muse Spark 1.2 (Reasoning, Medium)1001001001008396.7%
Z.AI GLM 5.2 (Reasoning, High)1001001001008396.7%
Claude Sonnet 5.5 (Reasoning)1001001001008396.7%
Kimi K3 (Reasoning, Low)1001001001008396.7%
Claude Opus 5 (Reasoning)1001001001008396.7%
Gemini 2.5 Pro1001001001008396.7%
Gemma 4 26B1001001001008396.7%
ByteDance Seed 2.0 Lite1001001001008396.7%
Gemini 2.5 Flash Lite (Reasoning)1001001001008396.7%
DeepSeek V3.11001001001008396.7%
Nemotron 3 Super1001001001008396.7%
Gemini 2.5 Flash Lite1001001001008396.7%
Grok 4.20 (Reasoning)1001001001008396.7%
GPT-OSS 120B1001001001008396.7%
Qwen 3.5 397B A17B10010098949096.5%
Kimi K2.510010099968395.5%
Qwen 3.5 Plus (2026-04-20)10010098968395.5%
DeepSeek V4.1 Flash (Reasoning, High)100100100938395.3%
DeepSeek V4 Pro 0813 (Reasoning, High)10010095928795.0%
Gemini 2.5 Flash10010096958394.7%
Grok 4.2010010097948194.4%
Qwen 3.5 122B10010098918394.3%
Qwen 3.7 Max10010094928393.8%
Qwen 3.6 Flash10010098947593.4%
Muse Spark 1.1 (Reasoning, Medium)100100100838393.3%
Z.AI GLM 5.11001001001006793.3%
Z.AI GLM 5 Turbo100100100838393.3%
Xiaomi MIMO v2.6 Pro1001001001006793.3%
GPT-5100100100838393.3%
Claude Sonnet 5 (Reasoning, Low)1001001001006793.3%
Z.AI GLM 5.3 Flash (Reasoning, Low)1001001001006793.3%
MiniMax M2.5100100100838393.3%
ByteDance Seed 2.0 Mini1001001001006793.3%
GPT-5 Nano100100100838393.3%
Thinking Machines Inkling (Reasoning)100100100838293.0%
Laguna XS 2.110010095838392.3%
ByteDance Seed 1.61009797838392.1%
Qwen 3.6 35B1009896838392.1%
MiniMax M310010093838391.9%
Gemini 3.6 Flash (Reasoning)10010096838091.8%
Gemini 3.5 Flash Lite (Reasoning)1009896838091.7%
Aion 3.0 Mini100100100916791.5%
Hy4 Preview (Reasoning, High)10010090838391.3%
GPT-4o Mini (temp=1)10010098906790.9%
Qwen 3.6 27B1009795837990.9%
Gemini 3.5 Flash (Reasoning)1009691838390.7%
Gemini 3.5 Flash (Reasoning, Minimal)989695838090.5%
Claude Opus 4.6 (Reasoning)100100100836790.0%
Qwen 3.8 Flash (Reasoning)10010083838390.0%
Claude Opus 4.6100100100836790.0%
Muse Spark 1.1 (Reasoning, Minimal)100100100836790.0%
Aion 3.010010083838390.0%
Writer: Palmyra X5100100100836790.0%
DeepSeek V4 Pro100100100836789.9%
DeepSeek V3.210010097836789.4%
Qwen 3.5 Plus (2026-02-15)10010097836789.4%
DeepSeek V4 Flash (Reasoning)10010085837789.2%
Claude Sonnet 41009889887089.0%
Muse Spark 1.3 (Reasoning, Medium)989088838388.5%
Qwen 3.5 27B10010092836788.4%
Claude Sonnet 4.51009489866787.2%
Aion 2.01008583838387.0%
Gemini 3.8 Flash (Reasoning, Medium)10010091766786.8%
GPT-5.1100100100835086.7%
GPT-4.110010083836786.7%
Qwen 3 235B A22B Instruct 250710010083836786.7%
Gemma 3 27B100100100835086.7%
DeepSeek V4 Flash 0731 (Reasoning, High)10010083836786.7%
o4 Mini High1009983836786.4%
Thinking Machines Inkling1009983826786.3%
Mistral Medium 3.5 (Reasoning)1009383836785.3%
Ministral 3 8B10010088875084.9%
Gemma 3 4B1009382826784.7%
Gemini 3.6 Flash (Reasoning, Minimal)1009990835084.6%
Claude Haiku 5.5 (Reasoning, Max)83 – – – – 83.3%
Qwen 3.5 9B1001001001001783.3%
o4 Mini888383837783.1%
Gemini 3.5 Flash Lite (Reasoning, Minimal)1009894903382.9%
GPT-5.4 (Reasoning, Low)838383838082.8%
DeepSeek V3 (2025-03-24)1008779796782.4%
GPT-4.1 Mini908383817582.4%
Gemma 3 12B1009383835081.9%
Inception Mercury 210010067676780.0%
Gemma 4 31B1008383676780.0%
DeepSeek V4 Flash1009982675079.6%
GPT-5.41009867676779.6%
Grok 4.3948383676778.7%
GPT-5.4 Mini (Reasoning, Low)988383676278.6%
GPT-4o, Aug. 6th (temp=0)958378686778.1%
Gemini 3.1 Pro (Preview)838180796778.0%
GPT-5.4 Mini (Reasoning)838383726777.7%
GPT-5.4 (Reasoning)918383805077.6%
Qwen 3 32B959167666576.7%
Claude Opus 4.51008367676776.7%
Z.AI GLM 4.7 Flash10010067675076.7%
Hermes 3 70B1008378626076.6%
Mistral Small 4838383676776.6%
Arcee AI: Trinity Mini1009671674976.5%
Mistral Large 4.01001009883076.2%
GPT-5.4 Nano1008374675074.8%
Claude Haiku 4.5918383625073.8%
Mistral Small 4 (Reasoning)948382763373.7%
Cohere Command R+ (Aug. 2024)1007567675873.3%
GPT-6 Luna (Reasoning, Medium)807877676272.6%
Qwen 3.8 27B (Reasoning, XHigh)1009667505072.5%
Gemini 3 Flash (Preview, Reasoning)837767676070.7%
Ministral 8B10010010050070.0%
Z.AI GLM 4.5 Air1009967671769.7%
Ministral 3 3B948368673369.1%
DeepSeek-V2 Chat1008463504668.6%
GPT-6 Luna (Reasoning, High)827565645067.3%
GPT-5.4 Nano (Reasoning)838367673366.7%
Cydonia 24B V4.110010050503366.7%
Kimi K3 (Reasoning, High)1008350504966.6%
Mistral Large 2967169613366.1%
Laguna S 2.1827264605065.7%
Mistral Medium 3.11008364631765.6%
Mistral Large 3987455505065.5%
GPT-4o Mini (temp=0)736767655264.8%
Claude Opus 4817470633364.3%
Gemini 3 Flash (Preview)838367503363.3%
GPT-5.5 (Reasoning, Medium)676767645062.9%
Qwen 3.8 Max (Reasoning, XHigh)928367501761.8%
GPT-6 Luna676765565561.8%
Z.AI GLM 4.7816759505061.2%
Mistral NeMO86838350060.5%
GPT-5.2836767503360.0%
GPT-5.4 Mini836767503360.0%
WizardLM 2 8x22b1001005050060.0%
Mistral Medium 3.594836750058.7%
GPT-5.6 Terra (Reasoning, Medium)717167671758.4%
GPT-5.5 (Reasoning, Low)796563503358.1%
Z.AI GLM 4.5998754331757.9%
Ministral 3 14B825650505057.6%
GPT-5.6 Terra676750505056.8%
DeepSeek V3 (2024-12-26)706753484656.7%
Mistral Small 3.2 24B995050503356.5%
Ministral 3B975858501756.1%
GPT-5.5675050505053.3%
GPT-5.4 Nano (Reasoning, Low)836767331753.2%
GPT-5.6 Luna (Reasoning, Medium)645250483349.6%
GPT-5.6 Sol (Reasoning, Medium)595050503348.4%
GPT-6.1 Sol (Reasoning, Medium)725047333347.0%
Llama 3.1 70B83554943046.2%
GPT-6 Sol (Reasoning, Medium)505049453345.5%
Qwen 2.5 72B94505033045.4%
GPT-5.6 Sol625048333345.2%
GPT-5.6 Luna624342363543.8%
Hermes 3 405B93483017037.5%
GPT-6 Sol50483333032.9%
ByteDance Seed 1.6 Flash6733330026.7%

Novelcrafter Default Prompt

Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Claude Sonnet 4.6100100100938996.4%
Nemotron 3 Nano1009796938393.8%
Z.AI GLM 4.6100100100887793.1%
Claude Sonnet 4.6 (Reasoning)100100100838293.0%
Gemini 2.5 Pro100100100976792.7%
Gemini 3.1 Flash Lite10010097838392.7%
Gemini 3.1 Flash Lite (Preview)10010097838392.6%
ByteDance Seed 2.0 Mini100100100897392.4%
Claude Sonnet 5 (Reasoning)100100100936892.2%
Grok 4.20 (Reasoning)10010093838392.0%
Gemini 2.5 Flash100100100926791.7%
ByteDance Seed 2.0 Lite10010083838390.0%
GPT-510010086837889.6%
Gemma 3 4B10010083838089.3%
Qwen 3.6 Flash1009793857089.1%
GPT-OSS 120B1009587838189.1%
Gemini 3.5 Flash Lite (Reasoning, Minimal)1009997826889.1%
Claude Sonnet 5.5 (Reasoning)1009494896788.8%
Grok 4.20979188868088.5%
Qwen 3.6 35B1009491807788.4%
Z.AI GLM 5.3 Flash (Reasoning, Low)1009796826788.2%
Claude Opus 4.8 (Reasoning, Low)1009883837688.1%
Nemotron 3 Super1009383837887.5%
Inception Mercury 21009392836786.9%
DeepSeek V4 Flash 0731 (Reasoning, High)1009783827386.9%
Gemini 3.1 Flash Lite (Reasoning)10010083836786.7%
GPT-5.1100100100834986.5%
Claude Sonnet 51009689816786.5%
Grok 4.5 (Reasoning, High)1009383787786.2%
Kimi K2.61009589816686.1%
Qwen 3.7 Flash (Reasoning)1009782826785.4%
Claude Opus 51009283836785.1%
Gemini 2.5 Flash (Reasoning)1008885836985.0%
Gemma 4 31B (Reasoning)989187757484.8%
Aion 3.5 Mini (Reasoning, High)10010094834684.7%
MiniMax M3999690865084.4%
Z.AI GLM 5.2 (Reasoning, High)999889775884.2%
Gemini 3.7 Flash (Reasoning, Medium)1009088776584.1%
Claude Opus 5 (Reasoning, Low)1008884816784.0%
Grok 4.5 (Reasoning, Low)1009686716783.9%
Grok 4.3999383786783.8%
Z.AI GLM 5.3 (Reasoning, Max)989189736783.5%
Claude Opus 4.61008383836783.4%
GPT-5 Nano10010083835083.3%
Qwen 3.6 Max Preview10010083815082.8%
Grok 4.3 (Reasoning)979493676382.8%
Gemini 3.8 Flash (Reasoning, Medium)1009885686182.6%
Claude Opus 4.7 (Reasoning)968783796782.3%
Xiaomi MIMO v2.6 Pro948883786782.1%
Gemma 4 26B1009175726781.1%
Gemini 2.5 Flash Lite1008380736881.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)838383837180.9%
GPT-4.1 Nano868382816980.2%
GPT-5 Mini10010083833380.0%
Aion 3.5 (Reasoning, High)1008383825079.8%
Laguna S 2.1988881716079.6%
Claude Opus 5.5 (Reasoning)868382796779.4%
Grok 4.7 (Reasoning, High)1009783675079.4%
DeepSeek V3.1958681676778.9%
Claude Opus 5 (Reasoning)938280676777.6%
Gemma 3 12B1008871676077.1%
Arcee AI: Trinity Mini1008377764877.0%
Claude Opus 4.8 (Reasoning)1008767656576.6%
Qwen 3.8 Flash (Reasoning)1008382675076.4%
Claude Opus 4.6 (Reasoning)888383676176.2%
Gemini 3 Flash (Preview)967675676575.6%
Gemini 3 Flash (Preview, Reasoning)898370676774.9%
Xiaomi MIMO v2.6 Flash918383823374.7%
Grok 4.6 (Reasoning, High)1008383733374.7%
Aion 3.0998367674973.1%
Claude Haiku 5.5 (Reasoning, Medium)848278715073.0%
Claude Haiku 5.5 (Reasoning, Low)917351 – – 71.8%
MiniMax M2.5857768656271.2%
Xiaomi MIMO v2.5928067675071.1%
ByteDance Seed 1.6858367675070.4%
GPT-5.4 (Reasoning, Low)978367555070.4%
Gemini 2.5 Flash Lite (Reasoning)1006767675070.0%
Muse Spark 1.1 (Reasoning, Medium)828071655069.5%
Claude Opus 4.5908374505069.4%
Mistral Large 4.0837568616069.3%
Kimi K3 (Reasoning, Low)797570616069.1%
Aion 2.01008167643368.9%
Gemini 3.5 Flash Lite (Reasoning)797469635968.7%
Kimi K3 (Reasoning, High)919083502668.0%
Qwen 3 235B A22B Instruct 2507837666655068.0%
DeepSeek V4 Pro (Reasoning)918267505068.0%
Gemini 3.6 Flash (Reasoning, Minimal)837469615367.9%
Mistral Small 3.2 24B10010067581367.5%
o4 Mini High837769565067.2%
Gemma 4 26B (Reasoning)726767666466.9%
Claude Haiku 5.5 (Adaptive)837367664466.7%
Gemini 3.5 Flash (Reasoning)777467645066.6%
Qwen 3.5 397B A17B838383503366.5%
MiniMax M2.7996767505066.4%
Cydonia 24B V4.1948361603366.3%
Gemini 3.5 Flash (Reasoning, Minimal)867673504666.1%
WizardLM 2 8x22b877867504765.6%
DeepSeek V3 (2024-12-26)817372574365.6%
Claude Opus 4.7787369673965.0%
GPT-4.1966761505064.6%
Mistral NeMO837370633364.5%
Ministral 3 8B767067585064.2%
Thinking Machines Inkling Small (Reasoning, High)836663604864.1%
Claude Sonnet 5 (Reasoning, Low)756964594863.0%
Gemini 3.6 Flash (Reasoning)816765505062.6%
Aion 3.0 Mini836763505062.5%
Laguna XS 2.1838162463461.1%
GPT-5.4 Mini (Reasoning, Low)786767613361.1%
Gemma 4 31B756767534361.1%
Mistral Large 4.0 (Reasoning)1009560331760.9%
GPT-5.4 Mini (Reasoning)866765503360.2%
GPT-5.4 (Reasoning)767367503359.8%
Xiaomi MIMO v2.5 Pro878263501759.7%
DeepSeek V4 Pro 0813 (Reasoning, High)836762423958.7%
DeepSeek-V2 Chat676259535158.5%
DeepSeek V3.2676759505058.5%
Ministral 3 14B796059504258.1%
Hermes 3 70B876756562357.6%
GPT-5.4695959505057.2%
Ministral 3B736959473556.7%
Qwen 3.5 Plus (2026-04-20)838367282156.5%
GPT-4o, Aug. 6th (temp=1)956552462556.4%
ByteDance Seed 1.6 Flash626160504856.2%
Hy4 Preview (Reasoning, High)796751503356.0%
Z.AI GLM 583817833055.3%
Claude Opus 4746752483355.0%
DeepSeek V4 Pro686750503954.7%
Z.AI GLM 5.1836458501754.6%
Writer: Palmyra X5806763461754.5%
GPT-4.1 Mini837946333154.4%
Thinking Machines Inkling (Reasoning)656550504154.3%
Gemma 3 27B726552424054.2%
Claude Haiku 4.5676653503354.0%
Ministral 8B736560521753.1%
GPT-5.6 Sol (Reasoning, Medium)675650474653.1%
Mistral Medium 3.1715050474753.1%
Qwen 3.7 Max656056453953.0%
GPT-5.6 Terra (Reasoning, Medium)585550505052.7%
Muse Spark 1.1 (Reasoning, Minimal)605352504752.5%
Muse Spark 1.2 (Reasoning, Medium)817556331752.4%
Llama 3.1 70B746450393352.1%
Mistral Medium 3.5676261422852.1%
Qwen 2.5 72B615453504151.8%
DeepSeek V4 Flash (Reasoning)766766331751.7%
Hermes 3 405B676652502351.7%
Mistral Medium 3.5 (Reasoning)715452493151.3%
Claude Sonnet 4626258551851.1%
Kimi K2.5815849333350.9%
GPT-5.5645650503350.8%
Z.AI GLM 4.7 Flash706750333350.6%
Qwen 3 32B715450373349.2%
Ministral 3 3B575550493549.2%
Qwen 3.6 27B966750171749.1%
Z.AI GLM 4.5 Air615449453749.1%
GPT-4o, Aug. 6th (temp=0)715143413848.8%
o4 Mini675047443348.2%
GPT-4o Mini (temp=1)805044412547.9%
Claude Sonnet 4.5655652382947.9%
DeepSeek V3 (2025-03-24)705247452347.1%
Muse Spark 1.3 (Reasoning, Medium)676650351746.9%
Z.AI GLM 5 Turbo836733331746.7%
DeepSeek V4.1 Flash (Reasoning, High)787734331146.6%
Z.AI GLM 4.5775337333346.6%
Qwen 3.8 Max (Reasoning, XHigh)715441333346.6%
Mistral Large 2585150393346.1%
GPT-6 Sol (Reasoning, Medium)614942403244.7%
GPT-5.6 Luna (Reasoning, Medium)504947383844.4%
DeepSeek V4 Flash71505050044.3%
Mistral Large 3584947362643.1%
Mistral Small 467645033042.8%
Qwen 3.8 27B (Reasoning, XHigh)665633312542.4%
GPT-5.6 Luna515043343342.3%
Gemini 3.1 Pro (Preview)585043331740.2%
Cohere Command R+ (Aug. 2024)494747421640.0%
Qwen 3.5 Plus (2026-02-15)835033171740.0%
GPT-5.6 Sol625041251738.7%
GPT-6.1 Sol (Reasoning, Medium)474545322438.4%
Z.AI GLM 4.778503330038.4%
GPT-5.5 (Reasoning, Medium)57505033038.1%
Mistral Small 4 (Reasoning)564640271837.3%
Thinking Machines Inkling60473635837.0%
Qwen 3.5 122B7853490035.8%
GPT-5.4 Mini444241331735.5%
GPT-5.4 Nano504843171734.9%
Qwen 3.5 Flash8750330034.1%
GPT-6 Luna (Reasoning, High)493533272433.7%
GPT-5.5 (Reasoning, Low)583333171731.5%
GPT-5.6 Terra504529171731.5%
GPT-6 Luna (Reasoning, Medium)504033231031.2%
Muse Glimmer 30B (Reasoning, Medium)5654370029.4%
GPT-5.4 Nano (Reasoning, Low)60333317028.6%
GPT-6 Luna474317171728.0%
GPT-4o Mini (temp=0)59501713027.8%
Qwen 3.5 9B6950160027.1%
Qwen 3.5 35B646400025.6%
GPT-5.4 Nano (Reasoning)3326160014.9%
GPT-6 Sol393000013.8%
Qwen 3.5 27B2900005.9%
GPT-5.21600003.2%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Z.AI GLM 5.3 (Reasoning, Max)100100100100100100.0%
Claude Opus 4.6 (Reasoning)100100100100100100.0%
DeepSeek V4.1 Flash (Reasoning, High)100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100100100100.0%
Claude Sonnet 4.6 (Reasoning)100100100100100100.0%
Z.AI GLM 5 Turbo100100100100100100.0%
Kimi K3 (Reasoning, High)100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100.0%
Grok 4.7 (Reasoning, High)100100100100100100.0%
Claude Opus 4.7 (Reasoning)100100100100100100.0%
Claude Opus 4.8 (Reasoning)100100100100100100.0%
Claude Opus 4.6100100100100100100.0%
Kimi K3 (Reasoning, Low)100100100100100100.0%
Claude Opus 5 (Reasoning, Low)100100100100100100.0%
Claude Opus 4.8 (Reasoning, Low)100100100100100100.0%
Xiaomi MIMO v2.6 Pro100100100100100100.0%
GPT-5100100100100100100.0%
GPT-5 Mini100100100100100100.0%
Claude Opus 5 (Reasoning)100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100.0%
GPT-5.1100100100100100100.0%
Claude Sonnet 4.6100100100100100100.0%
Claude Sonnet 5 (Reasoning)100100100100100100.0%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100100100100.0%
Claude Sonnet 5 (Reasoning, Low)100100100100100100.0%
Claude Opus 5100100100100100100.0%
Claude Opus 4.7100100100100100100.0%
Claude Haiku 5.5 (Adaptive)100100100100100100.0%
DeepSeek V4 Pro (Reasoning)100100100100100100.0%
Gemma 4 26B (Reasoning)100100100100100100.0%
Muse Glimmer 30B (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100100100100.0%
Gemini 2.5 Pro100100100100100100.0%
DeepSeek V4 Flash (Reasoning)100100100100100100.0%
DeepSeek V4 Flash 0731 (Reasoning, High)100100100100100100.0%
Z.AI GLM 4.7100100100100100100.0%
Z.AI GLM 4.6100100100100100100.0%
Claude Sonnet 5100100100100100100.0%
Xiaomi MIMO v2.6 Flash100100100100100100.0%
Aion 2.0100100100100100100.0%
Qwen 3.5 Plus (2026-02-15)100100100100100100.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100100100.0%
ByteDance Seed 2.0 Mini100100100100100100.0%
Gemini 3.1 Flash Lite (Preview)100100100100100100.0%
Gemini 3.1 Flash Lite100100100100100100.0%
Gemma 4 26B100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning)100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Medium)100100100100100100.0%
Gemini 2.5 Flash (Reasoning)100100100100100100.0%
Xiaomi MIMO v2.5100100100100100100.0%
Gemini 2.5 Flash Lite (Reasoning)100100100100100100.0%
DeepSeek V3.1100100100100100100.0%
Z.AI GLM 4.7 Flash100100100100100100.0%
GPT-4.1 Mini100100100100100100.0%
Grok 4.20100100100100100100.0%
Gemini 2.5 Flash100100100100100100.0%
GPT-5 Nano100100100100100100.0%
Laguna XS 2.1100100100100100100.0%
Nemotron 3 Nano100100100100100100.0%
WizardLM 2 8x22b100100100100100100.0%
GPT-4.1 Nano100100100100100100.0%
Gemma 3 4B100100100100100100.0%
Muse Spark 1.1 (Reasoning, Medium)1001001001009999.9%
Arcee AI: Trinity Mini1001001001009999.8%
Grok 4.3100100100999799.4%
Qwen 3.5 397B A17B1001001001009699.3%
Aion 3.0 Mini1001001001009599.1%
Grok 4.3 (Reasoning)1001001001009498.7%
Z.AI GLM 51001001001009398.6%
Qwen 3.8 27B (Reasoning, XHigh)1001001001009398.5%
Grok 4.5 (Reasoning, Low)10010099979698.4%
GPT-5.4 Mini (Reasoning)100100100999398.3%
Kimi K2.51001001001009198.3%
Grok 4.5 (Reasoning, High)1001001001009198.3%
Gemini 3.1 Pro (Preview)1001001001009098.0%
DeepSeek V4 Pro1001001001008997.9%
Cohere Command R+ (Aug. 2024)1001001001008797.4%
Gemma 4 31B10010098989197.3%
Hermes 3 405B100100100959197.3%
GPT-4.110010098969196.9%
Muse Spark 1.2 (Reasoning, Medium)1001001001008396.7%
Z.AI GLM 5.2 (Reasoning, High)1001001001008396.7%
Aion 3.5 (Reasoning, High)1001001001008396.7%
MiniMax M31001001001008396.7%
Claude Opus 4.51001001001008396.7%
ByteDance Seed 1.61001001001008396.7%
o4 Mini High1001001001008396.7%
Qwen 3.7 Flash (Reasoning)1001001001008396.7%
o4 Mini1001001001008396.7%
Xiaomi MIMO v2.5 Pro1001001001008396.7%
DeepSeek V3.21001001001008396.7%
Gemini 2.5 Flash Lite1001001001008396.7%
Qwen 3 235B A22B Instruct 25071001001001008396.7%
Mistral Large 4.0 (Reasoning)1001001001008396.7%
Gemini 3.5 Flash Lite (Reasoning, Minimal)1001001001008396.7%
Gemini 3.8 Flash (Reasoning, Medium)10010099939096.6%
Muse Spark 1.3 (Reasoning, Medium)10010099948996.6%
Gemini 3.6 Flash (Reasoning)10010099988596.5%
Claude Sonnet 4100100100998396.4%
GPT-5.4 Mini (Reasoning, Low)100100100988396.3%
Z.AI GLM 5.1100100100978396.2%
MiniMax M2.7100100100968395.9%
Kimi K2.6100100100958395.6%
Gemini 3.5 Flash (Reasoning, Minimal)10010093929295.4%
GPT-6.1 Sol (Reasoning, Medium)1009998938394.7%
Qwen 3.5 27B100100100977594.5%
Claude Sonnet 4.510010097948094.3%
Gemini 3 Flash (Preview, Reasoning)1001001001007093.9%
Gemma 4 31B (Reasoning)100100100937693.8%
Gemini 3.7 Flash (Reasoning, Medium)10010097888393.7%
Gemini 3.6 Flash (Reasoning, Minimal)10010097888393.6%
Claude Opus 5.5 (Reasoning)1001001001006793.3%
Aion 3.5 Mini (Reasoning, High)1001001001006793.3%
MiniMax M2.51001001001006793.3%
DeepSeek-V2 Chat100100100868193.3%
Muse Spark 1.1 (Reasoning, Minimal)100100100907693.2%
Qwen 3.6 Max Preview100100100986792.9%
Gemma 3 27B100100100837992.5%
Thinking Machines Inkling (Reasoning)1009494948092.3%
GPT-5.4 (Reasoning, Low)10010094838392.2%
Nemotron 3 Super1001001001006192.1%
Qwen 3.5 122B10010091838391.6%
Gemini 3.5 Flash (Reasoning)100100100916791.6%
GPT-4o Mini (temp=1)100100100906791.3%
Cydonia 24B V4.1100100100886791.0%
GPT-4o, Aug. 6th (temp=1)10010098856990.5%
Claude Sonnet 5.5 (Reasoning)1001001001005090.0%
Writer: Palmyra X510010099836789.9%
DeepSeek V4 Flash10010099836789.8%
Gemini 3 Flash (Preview)10010099836789.7%
Claude Haiku 4.510010092896789.5%
Qwen 3.5 9B10010083837488.1%
Thinking Machines Inkling Small (Reasoning, High)100100100875087.5%
Qwen 3.6 35B100100100835086.7%
GPT-5.4 (Reasoning)1001001001003386.7%
GPT-6 Luna (Reasoning, Medium)1009884846786.5%
Mistral Medium 3.11009584807486.4%
GPT-OSS 120B1009783836786.0%
Hy4 Preview (Reasoning, High)100100100795085.9%
Laguna S 2.110010096835085.8%
Ministral 8B958585827884.8%
Qwen 3 32B10010090775083.4%
ByteDance Seed 2.0 Lite10010083835083.3%
GPT-5.41001001001001783.3%
Ministral 3 14B1009081747083.0%
Qwen 3.6 27B10010086834583.0%
Qwen 3.8 Max (Reasoning, XHigh)1009976716782.7%
Qwen 3.7 Max1009285706682.6%
Qwen 3.8 Flash (Reasoning)10010095675082.4%
Claude Opus 410010099793382.3%
Qwen 3.5 Flash1008883676780.9%
DeepSeek V3 (2024-12-26)1009483765180.6%
Mistral Small 3.2 24B10010010099079.7%
GPT-5.4 Mini1009883823379.5%
Z.AI GLM 4.51008383815079.4%
Ministral 3B1008479795679.4%
GPT-5.4 Nano (Reasoning, Low)1008380676779.4%
Mistral Large 4.0989174676779.3%
GPT-6 Luna (Reasoning, High)888779756779.1%
GPT-6 Sol1009897505079.1%
Aion 3.010010010095079.0%
Gemma 3 12B1008377676778.8%
Ministral 3 8B988685774277.6%
Mistral Large 2918377696677.1%
Inception Mercury 21007772686776.7%
GPT-5.6 Terra (Reasoning, Medium)968174676376.1%
Mistral Large 3938778675576.1%
Z.AI GLM 4.5 Air1009273605475.8%
GPT-5.4 Nano (Reasoning)838377676775.4%
Mistral Small 4 (Reasoning)1001009283075.0%
Qwen 2.5 72B838075676774.4%
DeepSeek V3 (2025-03-24)868376725474.2%
GPT-4o, Aug. 6th (temp=0)1007873675073.6%
GPT-6 Sol (Reasoning, Medium)1009490503373.5%
Qwen 3.6 Flash10010010067073.3%
Mistral Medium 3.51008367655073.0%
Mistral Medium 3.5 (Reasoning)1008778504872.5%
GPT-5.5 (Reasoning, Medium)858367675070.4%
Qwen 3.5 35B10010050505070.0%
GPT-5.4 Nano838367675070.0%
ByteDance Seed 1.6 Flash1008382671769.7%
Ministral 3 3B828270574968.1%
Thinking Machines Inkling888073633367.7%
GPT-4o Mini (temp=0)1008867503367.5%
Mistral NeMO1008367661766.5%
GPT-5.2838175593366.3%
GPT-5.6 Sol838267613365.1%
GPT-5.6 Terra776767645065.0%
Llama 3.1 70B1006359564163.9%
Qwen 3.5 Plus (2026-04-20)1001001000060.0%
Hermes 3 70B676257565058.3%
GPT-5.6 Sol (Reasoning, Medium)89676662056.7%
GPT-5.5 (Reasoning, Low)816764501755.7%
GPT-5.5676765333353.1%
GPT-5.6 Luna (Reasoning, Medium)645751333347.8%
Mistral Small 483675033046.7%
GPT-6 Luna70655033043.6%
GPT-5.6 Luna653333271735.2%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Grok 4.7 (Reasoning, High)100100100100100100.0%
MiniMax M3100100100100100100.0%
Z.AI GLM 4.6100100100100100100.0%
DeepSeek V3.1100100100100100100.0%
GPT-4.1 Nano100100100100100100.0%
Gemma 3 4B100100100100100100.0%
Gemini 2.5 Pro1001001001008396.7%
Arcee AI: Trinity Mini1001001001008396.6%
Laguna S 2.110010099838393.1%
Grok 4.20 (Reasoning)10010098838392.9%
Inception Mercury 210010094888192.7%
Nemotron 3 Nano10010094838392.1%
DeepSeek V3 (2024-12-26)10010090838291.2%
Mistral Large 4.0100100100846790.1%
ByteDance Seed 1.61001001001005090.0%
DeepSeek V3.2100100100836790.0%
Qwen 3.7 Flash (Reasoning)100100100836790.0%
GPT-OSS 120B10010092807389.1%
Gemini 3.1 Flash Lite1009595836787.9%
GPT-5 Mini1001001001003386.7%
Grok 4.201001001001003386.7%
Grok 4.5 (Reasoning, Low)10010099676686.2%
Xiaomi MIMO v2.51008883836784.2%
Gemma 3 27B1009683756583.7%
Gemini 3.1 Flash Lite (Reasoning)100100100833383.3%
Xiaomi MIMO v2.5 Pro1001001001001783.3%
DeepSeek V4 Pro (Reasoning)100100100991783.2%
Cohere Command R+ (Aug. 2024)10010098872682.2%
Qwen 3 32B10010097565080.5%
Gemini 2.5 Flash Lite (Reasoning)1009392833380.4%
Kimi K2.6100100100673380.0%
Mistral Large 21008972696779.4%
Grok 4.5 (Reasoning, High)10010083793379.1%
Thinking Machines Inkling1001009694078.0%
GPT-4o Mini (temp=1)10010068675077.0%
Kimi K2.510010083831776.7%
Claude Sonnet 5 (Reasoning)10010010083076.7%
Aion 2.010010010083076.7%
GPT-5.4 Mini10010083505076.7%
Z.AI GLM 4.7 Flash1008383803376.0%
Mistral Large 310010083564075.8%
GPT-4.1 Mini838375676775.1%
Aion 3.5 Mini (Reasoning, High)100100100551774.3%
Mistral Medium 3.5 (Reasoning)1008383545074.1%
o4 Mini10010010067073.3%
DeepSeek V4 Flash10010010067073.3%
Laguna XS 2.11001008383073.3%
WizardLM 2 8x22b10010079671772.5%
Llama 3.1 70B1009469534672.3%
Gemma 4 26B1009167505071.5%
Qwen 3.5 Plus (2026-04-20)1001008767070.7%
Gemini 3.1 Flash Lite (Preview)1009967523370.1%
DeepSeek-V2 Chat100968371070.0%
Qwen 3 235B A22B Instruct 25071001008367070.0%
GPT-4o Mini (temp=0)817864646169.8%
o4 Mini High10010010048069.5%
GPT-5 Nano1008375503368.3%
ByteDance Seed 2.0 Lite10010065571767.7%
Ministral 3 14B1009279501767.6%
DeepSeek V4 Flash (Reasoning)10010010033066.7%
Gemini 3.5 Flash Lite (Reasoning)97958050064.4%
GPT-4o, Aug. 6th (temp=0)1006751505063.6%
Gemini 2.5 Flash100928333061.6%
Ministral 3B906750505061.4%
Hy4 Preview (Reasoning, High)1001001000060.0%
Claude Sonnet 41001006733060.0%
Z.AI GLM 4.5100676767060.0%
Mistral Small 4100838333059.8%
Z.AI GLM 5.1100100990059.8%
Mistral Medium 3.183838150059.6%
Claude Sonnet 5100100960059.2%
Gemini 2.5 Flash Lite1001006725058.4%
Grok 4.3 (Reasoning)1008353331757.3%
Claude Opus 4.6 (Reasoning)1005050503356.7%
Claude Opus 4.61006750501756.7%
Gemini 3.5 Flash (Reasoning, Minimal)676750505056.7%
Gemini 3 Flash (Preview)836767501756.7%
Mistral Medium 3.583676767056.7%
Claude Haiku 4.51001006717056.7%
Hermes 3 405B1005050503356.7%
Mistral Large 4.0 (Reasoning)1009830291754.7%
Kimi K3 (Reasoning, Low)10083830053.3%
DeepSeek V4 Flash 0731 (Reasoning, High)100835033053.3%
ByteDance Seed 2.0 Mini100995017053.2%
Ministral 8B10098670052.9%
Gemini 3 Flash (Preview, Reasoning)676350503352.7%
GPT-4o, Aug. 6th (temp=1)96675050052.5%
Mistral NeMO835850501751.6%
Nemotron 3 Super99954617051.2%
Claude Haiku 5.5 (Adaptive)100505047951.1%
Qwen 3.8 27B (Reasoning, XHigh)93834233050.4%
Gemini 3.7 Flash (Reasoning, Medium)676750501750.0%
Claude Sonnet 4.6 (Reasoning)1008333171750.0%
Ministral 3 8B10083670050.0%
Mistral Small 4 (Reasoning)836767171750.0%
Gemma 4 31B676650333349.8%
Claude Opus 4.8 (Reasoning, Low)1001003311349.4%
Z.AI GLM 4.79583670049.1%
Z.AI GLM 5100754129049.1%
Z.AI GLM 5.3 Flash (Reasoning, Max)95833333049.0%
Claude Opus 5100983312048.7%
Cydonia 24B V4.11006033331748.6%
Hermes 3 70B10083500046.7%
Z.AI GLM 5.2 (Reasoning, High)100833317046.7%
Claude Opus 4.8 (Reasoning)100100330046.7%
Aion 3.5 (Reasoning, High)675050333346.7%
GPT-5100675017046.7%
Qwen 3.5 397B A17B100833317046.7%
Qwen 3.6 35B83676717046.7%
DeepSeek V4 Pro83675033046.7%
Gemma 4 31B (Reasoning)675050501746.7%
Gemma 3 12B9867670046.2%
Thinking Machines Inkling (Reasoning)9783500046.1%
Claude Haiku 5.5 (Reasoning, Medium)585047383345.3%
Aion 3.09392410045.2%
Qwen 3.5 122B83683333043.6%
Gemini 3.8 Flash (Reasoning, Medium)835033331743.3%
Gemini 3.5 Flash (Reasoning)675050331743.3%
Aion 3.0 Mini100100170043.3%
Gemma 4 26B (Reasoning)1005030201743.3%
Gemini 2.5 Flash (Reasoning)100633317042.6%
GPT-5.4676333331742.6%
GPT-4.183613333042.3%
Thinking Machines Inkling Small (Reasoning, High)94505017042.2%
Grok 4.367634931042.0%
Writer: Palmyra X583505017040.0%
Claude Sonnet 5 (Reasoning, Low)1003327171738.7%
Qwen 3.5 Flash8067470038.6%
Qwen 3.5 Plus (2026-02-15)67505017036.7%
Qwen 3.6 Flash99501717036.5%
Z.AI GLM 5 Turbo10050177034.8%
Claude Opus 4.7100331917033.7%
Qwen 3.6 Max Preview67503317033.3%
Claude Opus 4.7 (Reasoning)100331717033.3%
GPT-5.6 Sol50505017033.3%
MiniMax M2.78350330033.3%
Qwen 3.7 Max6762330032.4%
DeepSeek V3 (2025-03-24)10050110032.2%
ByteDance Seed 1.6 Flash100331710032.0%
Z.AI GLM 5.3 (Reasoning, Max)6050500032.0%
Claude Haiku 5.5 (Reasoning, Low)50332914 – 31.5%
Kimi K3 (Reasoning, High)64501717029.4%
Xiaomi MIMO v2.6 Flash836200029.0%
Grok 4.6 (Reasoning, High)7949170028.9%
Gemini 3.6 Flash (Reasoning, Minimal)77311717028.4%
GPT-5.6 Terra50403317028.1%
GPT-5.55050330026.7%
GPT-6 Luna6143280026.4%
Gemini 3.5 Flash Lite (Reasoning, Minimal)5050178325.7%
Gemini 3.1 Pro (Preview)45333317025.6%
Claude Opus 5.5 (Reasoning)33333317023.3%
Gemini 3.6 Flash (Reasoning)5033330023.3%
Z.AI GLM 5.3 Flash (Reasoning, Low)1001700023.3%
Mistral Small 3.2 24B8217170023.1%
Qwen 3.5 35B6732170023.0%
Ministral 3 3B4333330022.0%
Claude Opus 5 (Reasoning)5036170020.5%
Qwen 3.8 Max (Reasoning, XHigh)100000020.0%
Muse Glimmer 30B (Reasoning, Medium)100000020.0%
Qwen 3.6 27B100000020.0%
Claude Opus 4831700020.0%
Claude Opus 4.550171717020.0%
Muse Spark 1.3 (Reasoning, Medium)4533150018.6%
Qwen 2.5 72B91000018.2%
MiniMax M2.533171717617.9%
Qwen 3.5 9B83600017.8%
Claude Sonnet 4.583000016.7%
Claude Sonnet 4.64817170016.3%
Claude Opus 5 (Reasoning, Low)3828110015.3%
Claude Sonnet 5.5 (Reasoning)3317170013.3%
Xiaomi MIMO v2.6 Pro3317170013.3%
Muse Spark 1.1 (Reasoning, Minimal)64000012.8%
GPT-5.4 Nano (Reasoning)292600011.0%
GPT-6.1 Sol (Reasoning, Medium)50200010.4%
GPT-6 Sol331700010.0%
Muse Spark 1.1 (Reasoning, Medium)22170007.8%
GPT-5.6 Luna3800007.6%
Muse Spark 1.2 (Reasoning, Medium)3300006.7%
Qwen 3.5 27B3300006.7%
Z.AI GLM 4.5 Air3300006.7%
GPT-6 Sol (Reasoning, Medium)3100006.1%
DeepSeek V4.1 Flash (Reasoning, High)1700003.3%
GPT-5.4 (Reasoning)1700003.3%
GPT-5.6 Terra (Reasoning, Medium)1700003.3%
DeepSeek V4 Pro 0813 (Reasoning, High)1700003.3%
GPT-5.4 Nano1700003.3%
Qwen 3.8 Flash (Reasoning)1300002.6%
GPT-5.6 Sol (Reasoning, Medium)000000.0%
GPT-6 Luna (Reasoning, High)000000.0%
GPT-5.5 (Reasoning, Medium)000000.0%
GPT-5.5 (Reasoning, Low)000000.0%
GPT-6 Luna (Reasoning, Medium)000000.0%
GPT-5.4 (Reasoning, Low)000000.0%
GPT-5.1000000.0%
GPT-5.6 Luna (Reasoning, Medium)000000.0%
GPT-5.4 Mini (Reasoning)000000.0%
GPT-5.2000000.0%
GPT-5.4 Mini (Reasoning, Low)000000.0%
GPT-5.4 Nano (Reasoning, Low)000000.0%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Grok 4.20 (Reasoning)100100100100100100.0%
Qwen 3.6 Max Preview1001001001009398.6%
Claude Sonnet 4.61001001001008396.6%
Claude Opus 5.5 (Reasoning)10010097978395.5%
Claude Haiku 5.5 (Adaptive)999897908393.5%
Gemini 3.1 Flash Lite100100100957293.5%
Claude Opus 4.71001001001006092.0%
ByteDance Seed 2.0 Mini10010094838292.0%
Claude Opus 4.8 (Reasoning)100100100896791.1%
Gemini 2.5 Pro1009690838390.6%
Gemini 3.1 Flash Lite (Reasoning)100100100807190.2%
ByteDance Seed 1.610010083838390.0%
Gemini 3.1 Flash Lite (Preview)10010098836789.6%
Kimi K3 (Reasoning, Low)978988878188.3%
Claude Sonnet 51009889886788.3%
Grok 4.6 (Reasoning, High)1009283838288.2%
DeepSeek V3.11009790836787.4%
Grok 4.3 (Reasoning)10010097835486.8%
Grok 4.7 (Reasoning, High)10010083836786.7%
Claude Sonnet 5 (Reasoning)1008783807985.8%
Claude Haiku 5.5 (Reasoning, Low)8783 – – – 85.3%
Claude Sonnet 5 (Reasoning, Low)1009283826985.1%
Claude Haiku 5.5 (Reasoning, Medium)1009088836585.1%
Z.AI GLM 4.610010087795984.9%
Claude Opus 4.7 (Reasoning)10010087835084.1%
Xiaomi MIMO v2.6 Flash989692835083.9%
Grok 4.310010087755583.3%
GPT-5 Nano1008383836783.3%
Xiaomi MIMO v2.6 Pro100100100813383.0%
Z.AI GLM 5.3 (Reasoning, Max)928383797382.2%
Grok 4.5 (Reasoning, High)1009683795081.7%
Aion 3.5 Mini (Reasoning, High)888383807081.2%
Claude Opus 4.8 (Reasoning, Low)989183676380.3%
Nemotron 3 Nano1008583676680.2%
Qwen 3.6 27B10010010095079.0%
Z.AI GLM 5.2 (Reasoning, High)1009977675078.5%
Claude Opus 5 (Reasoning, Low)948383755578.1%
Claude Opus 5 (Reasoning)959084674976.7%
ByteDance Seed 2.0 Lite10010083673376.7%
Claude Opus 4.6 (Reasoning)10010083505076.7%
DeepSeek V4 Pro (Reasoning)10010083505076.7%
Grok 4.201008383833376.7%
Aion 3.5 (Reasoning, High)1009967675076.6%
GPT-4.1 Nano1009076675076.5%
Gemma 4 26B929071676376.5%
Xiaomi MIMO v2.51009272675076.1%
Z.AI GLM 5.3 Flash (Reasoning, Max)1008269676075.5%
DeepSeek V3.2917878785175.2%
Qwen 3.6 35B1008371675174.4%
Cohere Command R+ (Aug. 2024)999887513373.6%
GPT-510010067505073.3%
Claude Opus 51008383673373.3%
Claude Opus 4.61009867505073.0%
Gemma 3 4B10010067623372.4%
Aion 3.0947774635071.7%
Grok 4.5 (Reasoning, Low)977667675271.6%
Gemini 2.5 Flash Lite (Reasoning)1007867625071.5%
Z.AI GLM 5.3 Flash (Reasoning, Low)948372703370.5%
Z.AI GLM 5 Turbo838079574869.6%
Qwen 3.7 Flash (Reasoning)10010050503366.7%
Gemma 4 26B (Reasoning)817268664466.2%
Mistral Medium 3.1908867602766.1%
DeepSeek V4 Pro817362565064.2%
Kimi K3 (Reasoning, High)1008383331763.3%
Gemini 2.5 Flash (Reasoning)786767545063.1%
DeepSeek V4.1 Flash (Reasoning, High)838379462262.8%
Claude Sonnet 4.6 (Reasoning)836764505062.8%
GPT-4.1838350504862.8%
Muse Spark 1.1 (Reasoning, Medium)796761565062.3%
Qwen 3.5 Plus (2026-04-20)10010079171562.3%
Z.AI GLM 5.1838350474461.4%
GPT-OSS 120B927650503360.3%
Gemini 2.5 Flash Lite866967463360.1%
GPT-4o, Aug. 6th (temp=1)906762503360.1%
Muse Spark 1.2 (Reasoning, Medium)676763564760.0%
GPT-5.4 (Reasoning)836750505060.0%
DeepSeek V4 Flash 0731 (Reasoning, High)838350503360.0%
Xiaomi MIMO v2.5 Pro796767503559.3%
Gemma 4 31B (Reasoning)776767592458.6%
Qwen 3.8 Flash (Reasoning)836767552258.5%
Mistral Large 4.0100676756057.8%
Mistral Large 4.0 (Reasoning)837167501757.6%
GPT-5.4 Mini (Reasoning)756767443357.1%
Hy4 Preview (Reasoning, High)756767433357.0%
Kimi K2.6816867333356.4%
Inception Mercury 2826150503355.2%
Mistral Small 3.2 24B837367331754.7%
Cydonia 24B V4.1816764382154.1%
Claude Sonnet 4.5756766421753.4%
GPT-5.11006750331753.3%
Z.AI GLM 51008350171753.3%
Mistral Medium 3.596807317053.1%
Qwen 3.8 Max (Reasoning, XHigh)676750473352.8%
Aion 2.0956550331751.9%
Gemini 2.5 Flash676451413351.3%
Gemini 3.5 Flash (Reasoning, Minimal)726554333251.2%
Claude Sonnet 5.5 (Reasoning)83636049051.2%
Gemini 3.8 Flash (Reasoning, Medium)676664332651.2%
Gemini 3.5 Flash (Reasoning)806750411751.0%
o4 Mini High77756733050.4%
Qwen 3.5 Plus (2026-02-15)845751411749.8%
Mistral NeMO985450281749.3%
Gemini 3.7 Flash (Reasoning, Medium)825348333049.0%
Ministral 3 8B74626246048.8%
Nemotron 3 Super72705740047.6%
Claude Sonnet 4635849373147.6%
Gemma 4 31B100813317747.6%
WizardLM 2 8x22b67675450047.4%
Qwen 3.6 Flash676745352247.0%
MiniMax M2.7100505033046.7%
MiniMax M3836733331646.6%
Claude Opus 4.569655045346.3%
Gemini 3.6 Flash (Reasoning, Minimal)615545333245.3%
GPT-5.6 Sol565048432945.1%
Gemini 3.5 Flash Lite (Reasoning, Minimal)84723920844.6%
MiniMax M2.583675017043.3%
Laguna S 2.183524732043.0%
Claude Haiku 4.5676738261743.0%
GPT-4o Mini (temp=1)565336333342.4%
GPT-5.467615033042.2%
GPT-6 Luna (Reasoning, High)785033321741.9%
Qwen 3.8 27B (Reasoning, XHigh)79504326240.1%
Muse Spark 1.3 (Reasoning, Medium)655433301339.2%
DeepSeek V4 Flash78503333039.0%
DeepSeek V4 Flash (Reasoning)62625015037.8%
Gemini 3.5 Flash Lite (Reasoning)9480120037.2%
GPT-5.5503333333336.7%
Gemini 3 Flash (Preview, Reasoning)6767500036.7%
Ministral 8B6862485036.6%
GPT-6 Luna (Reasoning, Medium)67433933036.5%
Claude Opus 4524342331036.2%
Thinking Machines Inkling (Reasoning)57503333034.8%
Laguna XS 2.154463326833.7%
Gemma 3 12B8339259632.5%
Ministral 3B6854328032.4%
Gemini 3.6 Flash (Reasoning)55504412032.0%
Qwen 3 32B84421717031.7%
Mistral Small 4 (Reasoning)86331717030.6%
Aion 3.0 Mini91201717630.2%
Gemini 3 Flash (Preview)50493317029.9%
GPT-6 Sol (Reasoning, Medium)5950278028.9%
DeepSeek-V2 Chat67501710028.6%
Hermes 3 70B7347167028.5%
DeepSeek V3 (2024-12-26)6042308027.9%
GPT-5.6 Terra43333329027.8%
GPT-5.6 Terra (Reasoning, Medium)443326171727.3%
Mistral Medium 3.5 (Reasoning)5650300027.0%
Kimi K2.556333311026.9%
DeepSeek V4 Pro 0813 (Reasoning, High)5736337026.8%
GPT-5 Mini67331717026.7%
Mistral Large 253323216026.7%
GPT-5.6 Luna (Reasoning, Medium)50491717026.5%
Muse Spark 1.1 (Reasoning, Minimal)49333317026.4%
GPT-5.4 Mini (Reasoning, Low)67331714026.1%
Writer: Palmyra X5834700026.0%
GPT-5.4 (Reasoning, Low)6333330025.9%
Mistral Large 35744179025.4%
GPT-4o, Aug. 6th (temp=0)655900024.9%
o4 Mini7433170024.7%
Arcee AI: Trinity Mini46392610023.9%
Qwen 3.5 397B A17B35333317023.7%
Z.AI GLM 4.7 Flash42322417023.0%
ByteDance Seed 1.6 Flash8117140022.4%
Qwen 3 235B A22B Instruct 25076727170022.1%
Thinking Machines Inkling832500021.7%
Mistral Small 433332417021.4%
GPT-6 Luna4744170021.4%
GPT-5.6 Luna4533270021.0%
Llama 3.1 70B673300020.0%
Ministral 3 14B494720019.8%
GPT-6 Sol50171715019.7%
Z.AI GLM 4.5 Air5717150017.8%
Thinking Machines Inkling Small (Reasoning, High)3330230017.1%
Qwen 3.7 Max493400016.6%
Gemma 3 27B671600016.5%
GPT-5.5 (Reasoning, Medium)3327220016.5%
GPT-5.4 Mini393370015.9%
Gemini 3.1 Pro (Preview)31171710015.0%
Z.AI GLM 4.7502400014.8%
Ministral 3 3B22201611013.8%
GPT-5.6 Sol (Reasoning, Medium)501700013.3%
GPT-5.217171715013.0%
Hermes 3 405B2920150012.8%
GPT-6.1 Sol (Reasoning, Medium)3613120012.2%
GPT-4.1 Mini57000011.4%
GPT-5.5 (Reasoning, Low)331700010.0%
Qwen 3.5 Flash50000010.0%
Qwen 2.5 72B25170008.4%
DeepSeek V3 (2025-03-24)26140007.9%
Muse Glimmer 30B (Reasoning, Medium)3300006.7%
Qwen 3.5 35B3300006.7%
Qwen 3.5 9B2800005.5%
Qwen 3.5 27B1700003.3%
Z.AI GLM 4.51000001.9%
Qwen 3.5 122B000000.0%
GPT-5.4 Nano (Reasoning)000000.0%
GPT-5.4 Nano (Reasoning, Low)000000.0%
GPT-4o Mini (temp=0)000000.0%
GPT-5.4 Nano000000.0%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Z.AI GLM 5.3 (Reasoning, Max)100100100100100100.0%
Claude Sonnet 4.6 (Reasoning)100100100100100100.0%
Grok 4.7 (Reasoning, High)100100100100100100.0%
Claude Opus 4.8 (Reasoning)100100100100100100.0%
Kimi K3 (Reasoning, Low)100100100100100100.0%
Claude Opus 4.8 (Reasoning, Low)100100100100100100.0%
Claude Opus 5 (Reasoning)100100100100100100.0%
Claude Opus 4.7100100100100100100.0%
Gemini 2.5 Pro100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Low)100100 – – – 100.0%
Aion 2.0100100100100100100.0%
MiniMax M2.7100100100100100100.0%
DeepSeek V3.1100100100100100100.0%
Z.AI GLM 4.7 Flash100100100100100100.0%
GPT-4o Mini (temp=1)100100100100100100.0%
Claude Opus 5.5 (Reasoning)100100100100100100.0%
DeepSeek V4 Flash (Reasoning)1001001001009899.6%
Grok 4.20 (Reasoning)1001001001009699.2%
Z.AI GLM 5.3 Flash (Reasoning, Low)1001001001009599.1%
Claude Haiku 5.5 (Adaptive)1001001001009498.8%
Mistral Medium 3.5100100100989698.8%
Arcee AI: Trinity Mini1001001001009098.1%
Claude Sonnet 5.5 (Reasoning)1001001001009098.0%
Aion 3.0 Mini100100100988897.2%
Claude Sonnet 5 (Reasoning)100100100998496.8%
Z.AI GLM 5.3 Flash (Reasoning, Max)1001001001008396.7%
Claude Opus 4.7 (Reasoning)1001001001008396.7%
Claude Sonnet 4.61001001001008396.7%
Z.AI GLM 51001001001008396.7%
MiniMax M2.51001001001008396.7%
Gemini 3.1 Flash Lite1001001001008396.7%
Xiaomi MIMO v2.51001001001008396.7%
GPT-4.1 Nano1001001001008396.7%
Z.AI GLM 5.2 (Reasoning, High)1001001001008396.7%
Aion 3.5 Mini (Reasoning, High)1001001001008396.7%
GPT-5.11001001001008396.7%
ByteDance Seed 1.61001001001008396.7%
Gemini 3.1 Flash Lite (Reasoning)1001001001008396.7%
Claude Opus 4.6 (Reasoning)1001001001008396.6%
Xiaomi MIMO v2.6 Flash1001001001008296.4%
Claude Opus 4.6100100100988396.3%
Aion 3.5 (Reasoning, High)1001001001008196.1%
Gemma 3 27B100100100978396.1%
Gemini 3.1 Flash Lite (Preview)100100100978396.0%
Kimi K2.6100100100968395.9%
Nemotron 3 Super100100100958395.7%
Mistral Large 4.01001001001007895.7%
Kimi K2.5100100100948195.1%
Nemotron 3 Nano10010098978195.0%
DeepSeek V4.1 Flash (Reasoning, High)100100100958095.0%
Claude Haiku 5.5 (Reasoning, Medium)1001001001007594.9%
Gemma 4 26B (Reasoning)100100100948094.8%
Gemma 4 26B100100100977494.2%
Mistral Large 4.0 (Reasoning)100100100997194.0%
GPT-5 Mini100100100838393.3%
MiniMax M31001001001006793.3%
Claude Opus 4100100100838393.3%
o4 Mini100100100838393.3%
Gemini 2.5 Flash Lite (Reasoning)100100100838393.3%
DeepSeek V3.21001001001006793.3%
DeepSeek V4 Flash100100100838393.3%
Gemini 2.5 Flash100100100838393.3%
GPT-4o Mini (temp=0)100100100838393.3%
Claude Opus 4.510010095838392.3%
o4 Mini High1001001001006192.3%
Grok 4.3 (Reasoning)100100100857692.1%
GPT-4.11009694868492.0%
Thinking Machines Inkling (Reasoning)1009997966892.0%
Claude Sonnet 5 (Reasoning, Low)1001001001005991.8%
GPT-5.4 (Reasoning)10010096837891.6%
Gemini 3.8 Flash (Reasoning, Medium)100100100837491.5%
Claude Sonnet 5100100100926391.0%
DeepSeek V3 (2025-03-24)10010087838390.8%
Gemma 3 4B1009995936790.7%
Mistral Medium 3.5 (Reasoning)10010088838190.6%
GPT-OSS 120B10010092857690.5%
Claude Opus 5 (Reasoning, Low)10010097837090.2%
Xiaomi MIMO v2.5 Pro100100100836790.0%
ByteDance Seed 2.0 Mini10010083838390.0%
ByteDance Seed 2.0 Lite10010083838390.0%
Gemini 2.5 Flash Lite10010083838390.0%
Laguna XS 2.1100100100836790.0%
WizardLM 2 8x22b100100100836790.0%
Gemini 3.7 Flash (Reasoning, Medium)10010088837990.0%
Z.AI GLM 4.710010096837089.8%
Xiaomi MIMO v2.6 Pro100100100905989.8%
Gemini 2.5 Flash (Reasoning)100100100985089.7%
DeepSeek V4 Pro (Reasoning)10010098836789.6%
Gemini 3 Flash (Preview, Reasoning)10010092837289.5%
Gemini 3.5 Flash (Reasoning)1009683838389.2%
Z.AI GLM 5.1100100100836188.8%
Grok 4.5 (Reasoning, High)1009891886488.2%
Gemini 3.6 Flash (Reasoning, Minimal)998885848387.7%
GPT-4o, Aug. 6th (temp=1)100100100835587.6%
GPT-5100100100835086.7%
Grok 4.5 (Reasoning, Low)10010089895586.6%
Z.AI GLM 4.61001001001003386.6%
Aion 3.0100100100825086.5%
Claude Opus 510010087746785.6%
GPT-4o, Aug. 6th (temp=0)10010079786684.6%
Gemini 3.6 Flash (Reasoning)1009589726784.5%
Qwen 3.8 Max (Reasoning, XHigh)10010083726784.3%
GPT-4.1 Mini1009895795084.3%
GPT-5.4 (Reasoning, Low)1008983836584.1%
Gemini 3 Flash (Preview)959486835983.4%
DeepSeek V4 Pro 0813 (Reasoning, High)1001001001001783.3%
Gemma 4 31B (Reasoning)929184826683.0%
Gemma 4 31B968581787082.0%
Z.AI GLM 5 Turbo1008983815681.9%
Kimi K3 (Reasoning, High)100100100614681.5%
Muse Spark 1.1 (Reasoning, Medium)1008378766881.0%
DeepSeek-V2 Chat10010078675680.0%
Cydonia 24B V4.110010083675080.0%
ByteDance Seed 1.6 Flash1009489833379.9%
Qwen 3 235B A22B Instruct 250710010010099079.8%
Qwen 3 32B10010082655079.4%
Mistral Small 4 (Reasoning)969271676778.5%
Gemini 3.5 Flash (Reasoning, Minimal)959275735678.2%
Muse Glimmer 30B (Reasoning, Medium)1009988812177.8%
Mistral Small 41009970675077.3%
DeepSeek V4 Pro1008376765077.0%
Qwen 3.8 27B (Reasoning, XHigh)999393504976.9%
Claude Sonnet 41009089832176.7%
Qwen 3.5 Flash838381676776.1%
DeepSeek V4 Flash 0731 (Reasoning, High)10010010077075.4%
Qwen 3.5 Plus (2026-02-15)967978735075.4%
Laguna S 2.1989283545075.3%
Claude Haiku 4.510010087701774.8%
Grok 4.2010010010067073.3%
Qwen 3.8 Flash (Reasoning)1007672675073.0%
Grok 4.6 (Reasoning, High)968273664572.4%
Writer: Palmyra X51001009567072.3%
Muse Spark 1.1 (Reasoning, Minimal)927773675272.1%
GPT-5.4 Mini (Reasoning)827469676771.7%
Muse Spark 1.2 (Reasoning, Medium)1007367605871.5%
Thinking Machines Inkling Small (Reasoning, High)998381771571.1%
Hy4 Preview (Reasoning, High)1009267603370.4%
Qwen 3.7 Flash (Reasoning)1001008367070.0%
Llama 3.1 70B878367615069.5%
GPT-5.4 Mini958367505069.1%
Gemini 3.5 Flash Lite (Reasoning)10010088272267.4%
Cohere Command R+ (Aug. 2024)908383552467.1%
GPT-6.1 Sol (Reasoning, Medium)838370554366.8%
Mistral NeMO94847976066.7%
Grok 4.31001009832066.1%
Ministral 3 8B939158483364.7%
Ministral 8B777567663363.8%
Qwen 3.5 122B100836767063.3%
GPT-5.5 (Reasoning, Medium)838367503363.3%
Qwen 3.6 27B1008367501763.3%
GPT-5 Nano1006750505063.3%
DeepSeek V3 (2024-12-26)1001006746263.0%
Ministral 3 14B1007353503161.3%
Muse Spark 1.3 (Reasoning, Medium)998373292361.3%
GPT-6 Luna (Reasoning, High)856554524660.4%
Qwen 3.5 35B100838333060.0%
Claude Sonnet 4.5100927420057.2%
Inception Mercury 2686751505057.2%
Gemini 3.1 Pro (Preview)766967433057.0%
GPT-5.6 Luna (Reasoning, Medium)865150503354.1%
Gemma 3 12B1006749331753.2%
GPT-5.5676450503352.8%
GPT-6 Luna95676433051.9%
GPT-5.4 Mini (Reasoning, Low)635650503350.6%
Qwen 3.5 27B1006750171750.0%
Qwen 3.6 Flash975050331749.5%
GPT-5.6 Sol675754333348.9%
GPT-5.5 (Reasoning, Low)795048333348.6%
GPT-5.6 Terra (Reasoning, Medium)685250413148.6%
GPT-6 Luna (Reasoning, Medium)676746302847.5%
Qwen 3.5 Plus (2026-04-20)100675017046.7%
Gemini 3.5 Flash Lite (Reasoning, Minimal)895732322046.0%
GPT-5.6 Terra675350441746.0%
Qwen 3.5 9B10092330045.1%
GPT-5.6 Sol (Reasoning, Medium)675750331744.8%
GPT-5.49281500044.6%
Thinking Machines Inkling10064530043.5%
Qwen 2.5 72B76554732042.2%
Hermes 3 405B8272560042.1%
Z.AI GLM 4.565605029040.8%
GPT-5.6 Luna504841333040.4%
Mistral Large 38766470040.2%
Z.AI GLM 4.5 Air625533331740.1%
Qwen 3.6 Max Preview10067170036.7%
Hermes 3 70B8365217035.1%
Qwen 3.7 Max10050121032.7%
GPT-6 Sol57393326031.1%
Qwen 3.6 35B10033170030.0%
GPT-6 Sol (Reasoning, Medium)533623201729.7%
Mistral Large 2835900028.5%
Ministral 3 3B10017130025.9%
Mistral Small 3.2 24B49332323025.6%
Qwen 3.5 397B A17B5041330024.9%
Mistral Medium 3.11001750024.4%
GPT-5.24329150017.5%
GPT-5.4 Nano331700010.0%
Ministral 3B3830008.1%
GPT-5.4 Nano (Reasoning)19170007.2%
GPT-5.4 Nano (Reasoning, Low)000000.0%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Z.AI GLM 5.3 (Reasoning, Max)100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100100100100.0%
Claude Sonnet 4.6 (Reasoning)100100100100100100.0%
Z.AI GLM 5.2 (Reasoning, High)100100100100100100.0%
Claude Opus 4.7 (Reasoning)100100100100100100.0%
Aion 3.5 Mini (Reasoning, High)100100100100100100.0%
Xiaomi MIMO v2.6 Pro100100100100100100.0%
Claude Sonnet 4.6100100100100100100.0%
Claude Haiku 5.5 (Adaptive)100100100100100100.0%
Gemini 2.5 Pro100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Low)100100 – – – 100.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100100100.0%
Gemini 3.1 Flash Lite (Preview)100100100100100100.0%
Gemini 3.1 Flash Lite100100100100100100.0%
Xiaomi MIMO v2.5100100100100100100.0%
DeepSeek V3.1100100100100100100.0%
DeepSeek V3.210010010010010099.9%
Gemini 2.5 Flash (Reasoning)1001001001009899.6%
Claude Sonnet 5 (Reasoning, Low)1001001001009899.5%
Claude Opus 4.8 (Reasoning)1001001001009899.5%
GPT-51001001001009699.2%
Aion 2.0100100100979798.8%
Kimi K2.51001001001009398.7%
Claude Sonnet 5100100100999097.9%
Mistral Large 4.0 (Reasoning)1001001001008997.9%
Claude Opus 5 (Reasoning)100100100959297.4%
DeepSeek V4.1 Flash (Reasoning, High)1001001001008396.7%
Gemini 2.5 Flash1001001001008396.7%
Claude Opus 4.8 (Reasoning, Low)10010099978696.6%
Claude Opus 4.7100100100998396.6%
Claude Sonnet 5.5 (Reasoning)100100100998396.5%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100998396.5%
Claude Opus 4.6 (Reasoning)100100100988396.3%
Grok 4.7 (Reasoning, High)100100100988396.2%
Kimi K3 (Reasoning, Low)100100100978396.1%
Grok 4.6 (Reasoning, High)100100100968395.8%
Z.AI GLM 4.7 Flash100100100968395.8%
Claude Sonnet 5 (Reasoning)100100100978295.7%
Gemini 3.5 Flash (Reasoning)100100100978195.5%
Z.AI GLM 5100100100997895.4%
Z.AI GLM 4.6100100100908695.3%
Qwen 3 235B A22B Instruct 2507100100100938395.2%
MiniMax M3100100100997594.8%
DeepSeek V4 Flash 0731 (Reasoning, High)10010099908394.6%
Xiaomi MIMO v2.6 Flash1001001001006893.6%
GPT-4.1 Nano100100100848393.5%
Claude Opus 5 (Reasoning, Low)1001001001006793.3%
ByteDance Seed 2.0 Lite1001001001006793.3%
Hy4 Preview (Reasoning, High)1009997927893.1%
DeepSeek V4 Pro (Reasoning)10010098838092.2%
Claude Haiku 5.5 (Reasoning, Medium)10010095957292.2%
Laguna XS 2.110010099837892.2%
Grok 4.20 (Reasoning)10010094838392.1%
Kimi K2.610010098837791.6%
Grok 4.20100100100906791.3%
Gemini 3.8 Flash (Reasoning, Medium)1009989838390.9%
Qwen 3.6 Max Preview10010096837490.6%
Mistral Medium 3.51009995877190.5%
Grok 4.5 (Reasoning, High)1009795946790.5%
Aion 3.01009788838390.4%
Gemma 4 26B1009594837990.3%
DeepSeek V4 Pro 0813 (Reasoning, High)1009292838390.2%
Claude Opus 5.5 (Reasoning)100100100836790.0%
Z.AI GLM 5 Turbo1001001001005090.0%
Claude Opus 51001001001005090.0%
Gemma 3 27B100100100836790.0%
GPT-5 Mini100100100826789.7%
Gemini 2.5 Flash Lite100100100836188.8%
Gemma 4 26B (Reasoning)1009286818087.8%
DeepSeek V3 (2024-12-26)10010095836087.6%
Muse Glimmer 30B (Reasoning, Medium)10010095895387.4%
Gemini 3.6 Flash (Reasoning)1009583837387.0%
Claude Opus 4.610010083836786.7%
Aion 3.5 (Reasoning, High)1008383838386.7%
Xiaomi MIMO v2.5 Pro10010083836786.7%
Gemini 2.5 Flash Lite (Reasoning)100100100835086.7%
o4 Mini High10010083836786.7%
GPT-5 Nano10010083836786.7%
GPT-5.110010097835086.2%
Writer: Palmyra X51009483836785.4%
Grok 4.5 (Reasoning, Low)1008783787785.0%
GPT-4.1 Mini1009383816784.9%
ByteDance Seed 1.610010088835084.4%
Claude Opus 4.51009183806784.3%
DeepSeek-V2 Chat1008380787783.6%
GPT-OSS 120B1009788835083.6%
ByteDance Seed 2.0 Mini10010083835083.3%
Nemotron 3 Super10010094665683.1%
Claude Haiku 4.5959383806382.5%
GPT-4o, Aug. 6th (temp=1)10010093833382.0%
Claude Sonnet 4.51008480796781.9%
Z.AI GLM 5.11009877676781.6%
Gemini 3.1 Pro (Preview)10010081675981.4%
Qwen 3.7 Flash (Reasoning)868383836780.5%
Mistral Medium 3.5 (Reasoning)1008383825079.6%
WizardLM 2 8x22b1009883675079.5%
Grok 4.3868383796579.1%
Mistral Large 4.0918377766779.0%
GPT-5.4 (Reasoning)949083785078.9%
Kimi K3 (Reasoning, High)1008878676278.9%
MiniMax M2.510010074715078.9%
DeepSeek V4 Flash (Reasoning)1009976635678.7%
Mistral Medium 3.1958379676778.1%
Gemini 3.5 Flash Lite (Reasoning, Minimal)1007978785277.2%
Muse Spark 1.2 (Reasoning, Medium)838377726776.5%
Mistral Small 3.2 24B1001009983076.5%
GPT-4o Mini (temp=1)999473684976.4%
Hermes 3 70B10010083504876.2%
Gemini 3.7 Flash (Reasoning, Medium)978383675075.9%
MiniMax M2.710010083791775.7%
Gemini 3.5 Flash Lite (Reasoning)1009869674275.2%
DeepSeek V3 (2025-03-24)888878724674.3%
Nemotron 3 Nano1009367625074.2%
GPT-4.11008272675074.2%
Qwen 3.6 Flash978367675072.8%
DeepSeek V4 Pro1009867673272.6%
Muse Spark 1.3 (Reasoning, Medium)958380643872.0%
GPT-5.4 Mini (Reasoning)907267646271.0%
DeepSeek V4 Flash928067665071.0%
Z.AI GLM 4.71009567593370.9%
Gemini 3.6 Flash (Reasoning, Minimal)907967675070.4%
Cydonia 24B V4.11001008367070.0%
Inception Mercury 21008367504669.2%
Muse Spark 1.1 (Reasoning, Medium)888371673769.1%
Gemma 4 31B836867676269.1%
Qwen 3.6 35B878278673269.1%
Ministral 3 8B837774615068.8%
ByteDance Seed 1.6 Flash100948267068.6%
Thinking Machines Inkling (Reasoning)887574673768.2%
Claude Sonnet 4888376613368.1%
GPT-4o, Aug. 6th (temp=0)898158535066.4%
Mistral Large 3807464644866.2%
Aion 3.0 Mini1009274461766.0%
o4 Mini836767625065.8%
GPT-5.4 (Reasoning, Low)826764625065.0%
Qwen 3.8 Flash (Reasoning)838266593364.7%
Grok 4.3 (Reasoning)868559503362.9%
Gemma 3 4B836767504562.6%
Gemma 4 31B (Reasoning)837167583362.5%
Claude Opus 4847561484262.0%
Gemini 3 Flash (Preview)837667503361.9%
Qwen 3.8 Max (Reasoning, XHigh)995959533561.1%
Z.AI GLM 4.5 Air866763503660.4%
Muse Spark 1.1 (Reasoning, Minimal)676759574558.8%
Cohere Command R+ (Aug. 2024)1006764332858.4%
Qwen 3.8 27B (Reasoning, XHigh)837363403258.4%
Gemma 3 12B83756767058.3%
Gemini 3 Flash (Preview, Reasoning)736767503358.0%
Qwen 3 32B808050433357.3%
Arcee AI: Trinity Mini87836550056.9%
Ministral 8B837956501656.8%
Qwen 3.6 27B81686767056.4%
Mistral Small 4 (Reasoning)916152423355.9%
Thinking Machines Inkling Small (Reasoning, High)97716940055.5%
GPT-5.5 (Reasoning, Medium)675550505054.4%
Mistral NeMO676454493353.4%
Gemini 3.5 Flash (Reasoning, Minimal)676050503352.0%
Mistral Large 2905048482351.9%
Mistral Small 4595950494251.8%
GPT-4o Mini (temp=0)725947433450.9%
Qwen 3.5 397B A17B696750501750.6%
GPT-6 Luna (Reasoning, High)646057501749.4%
Qwen 3.5 Plus (2026-04-20)84776717048.9%
Qwen 3.5 122B75675350048.9%
Qwen 3.5 Plus (2026-02-15)836150331748.8%
Z.AI GLM 4.5696740333348.5%
Ministral 3 14B786746331748.3%
Ministral 3 3B715050501747.5%
Qwen 3.5 35B83665533047.5%
GPT-5.4 Mini (Reasoning, Low)83675033046.6%
Qwen 3.7 Max76636033046.5%
Ministral 3B874934302745.5%
GPT-6 Luna (Reasoning, Medium)544847443345.2%
Qwen 2.5 72B535049383344.8%
GPT-5.4 Nano (Reasoning)67505050043.3%
GPT-5.5624933333342.3%
Llama 3.1 70B575544312441.9%
GPT-6 Sol (Reasoning, Medium)624443331739.7%
GPT-5.6 Sol494436343339.2%
Hermes 3 405B55484844039.0%
GPT-5.4675033171736.7%
Qwen 3.5 Flash8382170036.4%
GPT-5.5 (Reasoning, Low)585033171734.9%
Thinking Machines Inkling55484225034.0%
Qwen 3.5 9B44434038033.0%
Qwen 3.5 27B7167220032.0%
GPT-6.1 Sol (Reasoning, Medium)6150440031.0%
GPT-5.6 Terra (Reasoning, Medium)363333331730.6%
GPT-5.6 Luna (Reasoning, Medium)343329231727.3%
GPT-5.4 Nano (Reasoning, Low)6733330026.7%
GPT-5.4 Mini67331717026.7%
GPT-5.6 Luna45393217026.5%
GPT-5.250333217026.3%
GPT-6 Luna41373317025.5%
GPT-5.6 Sol (Reasoning, Medium)33333228025.4%
GPT-5.4 Nano50391717024.4%
GPT-5.6 Terra333317171723.3%
GPT-6 Sol43331717021.9%
Laguna S 2.1331700010.0%