Correct "no violations" response

Test: Codex Red Herring (False Positive Detection)

Avg. Score
58.2%
Scenarios
8

Overall Performance

Rank ▲ Model Score Avg. Cost Avg. Time Stability
1GPT-5.4 Nano (Reasoning, Low)97.5%$0.00083.9s73%
2Nemotron 3 Super98.8%$0.00001.3m78%
3Z.AI GLM 5.3 Flash (Reasoning, Low)95.0%$0.00037.3s56%
4Muse Spark 1.1 (Reasoning, Minimal)96.3%$0.01211.2s62%
5Inception Mercury 295.0%$0.00273.8s56%
6Z.AI GLM 5 Turbo95.0%$0.007116.0s56%
7GPT-5.4 Mini (Reasoning, Low)93.8%$0.00344.0s52%
8Laguna S 2.192.5%$0.000841.9s58%
9o4 Mini95.0%$0.01425.0s56%
10ByteDance Seed 1.6 Flash92.5%$0.00089.1s47%
11GPT-5.4 Nano (Reasoning)92.5%$0.001711.4s47%
12o4 Mini High96.3%$0.02752.5s62%
13Muse Spark 1.1 (Reasoning, Medium)93.8%$0.01919.4s52%
14Z.AI GLM 5.2 (Reasoning, High)92.5%$0.008125.8s47%
15Grok 4.5 (Reasoning, Low)92.5%$0.01217.0s47%
16GPT-5.193.8%$0.02526.1s52%
17GPT-5.6 Luna (Reasoning)90.0%$0.00484.7s40%
18Muse Spark 1.2 (Reasoning, Medium)93.8%$0.02930.4s52%
19GPT-5 Mini91.3%$0.005937.8s43%
20GPT-4.185.6%$0.00481.2s38%
21Laguna XS 2.188.8%$0.000516.4s37%
22Gemini 2.5 Flash Lite (Reasoning)88.8%$0.002316.6s37%
23GPT-5 Nano90.0%$0.00351.1m40%
24Grok 4.3 (Reasoning)90.0%$0.01450.4s40%
25Grok 4.5 (Reasoning, High)92.5%$0.0311.0m47%
26Ministral 8B74.4%$0.00074.4s33%
27MiniMax M2.786.3%$0.004734.6s31%
28Z.AI GLM 591.3%$0.0171.4m43%
29Ministral 3 8B80.6%$0.001317.9s30%
30GPT-5.4 Mini (Reasoning)85.0%$0.009010.8s29%
31DeepSeek V4 Flash (Reasoning)85.0%$0.000930.8s29%
32Gemini 3.7 Flash (Reasoning, Medium)83.8%$0.0118.4s26%
33Muse Spark 1.3 (Reasoning, Medium)88.8%$0.02452.0s37%
34Gemma 4 26B (Reasoning)91.3%$0.00272.6m43%
35Gemini 2.5 Flash (Reasoning)82.5%$0.008514.2s24%
36Qwen 3.5 Plus (2026-04-20)90.0%$0.0201.9m40%
37Z.AI GLM 5.191.3%$0.0242.1m43%
38ByteDance Seed 1.681.3%$0.004332.7s22%
39Claude Sonnet 4.673.8%$0.03317.4s39%
40GPT-5.281.3%$0.01314.5s22%
41GPT-4.1 Nano68.1%$0.00054.6s24%
42Xiaomi MIMO v2.581.3%$0.007530.3s22%
43Claude Opus 4.681.9%$0.04913.2s38%
44Grok 4.20 (Reasoning)83.8%$0.01747.9s26%
45GPT-OSS 120B81.3%$0.001256.4s22%
46Kimi K3 (Reasoning, Low)82.5%$0.02028.5s24%
47Muse Glimmer 30B (Reasoning, Medium)80.0%$0.004437.4s20%
48MiniMax M383.8%$0.00481.4m26%
49Aion 2.083.8%$0.00961.3m26%
50Mistral Small 4 (Reasoning)77.5%$0.002522.6s16%
51Claude Opus 4.7 (Reasoning)90.0%$0.07513.1s40%
52Gemini 3.6 Flash (Reasoning, Minimal)75.6%$0.00781.6s15%
53GPT-5.4 Nano66.3%$0.00051.5s18%
54Z.AI GLM 4.5 Air76.9%$0.002743.1s18%
55Xiaomi MIMO v2.5 Pro81.3%$0.0151.1m22%
56Ministral 3B43.1%$0.000412.4s33%
57MiniMax M2.573.1%$0.003225.9s12%
58Gemini 3.8 Flash (Reasoning, Medium)75.0%$0.02112.8s13%
59Claude Haiku 4.551.2%$0.00804.2s24%
60GPT-5.4 (Reasoning, Low)71.3%$0.0128.8s9%
61GPT-5.6 Sol68.8%$0.00911.7s7%
62GPT-4.1 Mini51.2%$0.00186.9s18%
63Mistral Medium 3.153.1%$0.00324.7s17%
64Nemotron 3 Nano83.8%$0.00272.9m26%
65Arcee AI: Trinity Mini67.5%$0.000926.3s6%
66Z.AI GLM 4.561.3%$0.003825.0s12%
67Aion 3.0 Mini78.8%$0.0112.0m21%
68Gemma 4 26B61.9%$0.001239.3s13%
69GPT-5.6 Luna63.7%$0.00201.2s4%
70Gemma 4 31B63.7%$0.000911.7s5%
71DeepSeek V4 Flash35.0%$0.000512.2s27%
72Qwen 3.7 Flash (Reasoning)68.8%$0.001245.9s7%
73Cydonia 24B V4.158.1%$0.00148.7s8%
74Ministral 3 3B37.5%$0.001331.1s28%
75Gemini 3.6 Flash (Reasoning)78.8%$0.05324.4s18%
76Z.AI GLM 4.668.1%$0.01559.0s14%
77Claude Opus 4.6 (Reasoning)92.5%$0.1201.0m47%
78Qwen 2.5 72B45.6%$0.000911.3s15%
79Ministral 3 14B50.6%$0.001929.2s15%
80Qwen 3.6 27B83.8%$0.0332.3m26%
81Claude Opus 4.762.5%$0.0493.9s22%
82GPT-5.6 Terra (Reasoning)61.3%$0.00935.0s3%
83Qwen 3.6 Flash68.8%$0.01644.4s7%
84DeepSeek V4 Flash 0731 (Reasoning, High)73.8%$0.00192.0m12%
85Grok 4.6 (Reasoning, High)86.3%$0.0572.2m31%
86Mistral Small 428.1%$0.00127.4s23%
87Qwen 3 32B60.6%$0.001437.7s3%
88Gemma 4 31B (Reasoning)78.8%$0.00253.1m18%
89Hermes 3 70B42.5%$0.001812.1s9%
90DeepSeek V4 Pro36.3%$0.006942.0s22%
91Qwen 3.7 Max78.8%$0.0541.3m18%
92 Kimi K3 (Reasoning, High)76.3%$0.0461.3m15%
93DeepSeek V4.1 Flash (Reasoning, High)63.7%$0.00891.1m4%
94Thinking Machines Inkling67.5%$0.0172.0m15%
95Thinking Machines Inkling Small (Reasoning, High)59.4%$0.00941.0m5%
96Claude Opus 561.3%$0.0464.4s8%
97GPT-5.4 (Reasoning)63.7%$0.03231.9s4%
98Z.AI GLM 4.7 Flash70.0%$0.00392.5m8%
99GPT-4o Mini (temp=1)32.5%$0.00085.6s7%
100Claude Sonnet 532.5%$0.0206.0s15%
101Cohere Command R+ (Aug. 2024)50.0%$0.0177.4s0%
102Qwen 3.6 35B62.5%$0.0171.2m3%
103Claude Sonnet 5 (Reasoning)75.0%$0.06957.0s13%
104Aion 3.079.4%$0.0582.4m20%
105Mistral Large 336.9%$0.004011.7s0%
106Claude Sonnet 5 (Reasoning, Low)72.5%$0.06955.4s11%
107Claude Opus 4.540.0%$0.0364.4s9%
108ByteDance Seed 2.0 Mini68.1%$0.00333.1m7%
109GPT-4o, Aug. 6th (temp=1)32.5%$0.00942.4s0%
110GPT-5.6 Terra28.7%$0.00451.4s0%
111Hermes 3 405B30.6%$0.00595.2s0%
112Gemini 3.5 Flash (Reasoning)66.3%$0.06729.5s5%
113Gemini 2.5 Flash Lite25.0%$0.00104.0s0%
114GPT-567.5%$0.0481.5m6%
115Mistral Small 3.2 24B26.3%$0.001011.9s0%
116Mistral Large 235.0%$0.01611.4s0%
117Claude Opus 5 (Reasoning, Low)78.8%$0.11335.8s18%
118Grok 4.326.9%$0.00774.4s0%
119GPT-5.5 (Reasoning, Low)38.8%$0.02512.0s0%
120Claude Sonnet 435.0%$0.0224.5s0%
121Z.AI GLM 5.3 Flash (Reasoning, Max)62.5%$0.00243.0m3%
122GPT-5.527.5%$0.0132.9s0%
123Llama 3.1 70B25.0%$0.003116.4s0%
124GPT-5.6 Sol (Reasoning)35.0%$0.0269.1s0%
125Gemini 3.5 Flash (Reasoning, Minimal)23.8%$0.0112.2s0%
126Gemini 3 Flash (Preview, Reasoning)44.4%$0.02849.2s0%
127Gemini 3.5 Flash Lite (Reasoning, Minimal)16.3%$0.00312.1s0%
128Writer: Palmyra X522.5%$0.008513.8s0%
129GPT-5.4 Mini15.0%$0.00201.2s0%
130GPT-4o Mini (temp=0)16.9%$0.000914.5s0%
131Qwen 3 235B A22B Instruct 250721.3%$0.001132.0s0%
132Gemini 3.5 Flash Lite (Reasoning)14.4%$0.00312.2s0%
133Claude Opus 5 (Reasoning)75.0%$0.11336.5s13%
134Gemini 3.1 Flash Lite13.1%$0.00173.2s0%
135Gemini 3.1 Flash Lite (Preview)11.9%$0.00171.6s0%
136WizardLM 2 8x22b26.9%$0.004155.3s0%
137Gemini 3.1 Flash Lite (Reasoning)11.3%$0.00151.9s0%
138DeepSeek V4 Pro (Reasoning)65.0%$0.0173.4m5%
139Z.AI GLM 4.755.0%$0.0232.2m1%
140ByteDance Seed 2.0 Lite25.0%$0.00671.0m0%
141Grok 4.2012.5%$0.008211.7s0%
142Claude Sonnet 4.520.6%$0.0245.9s0%
143DeepSeek V3.112.5%$0.001936.6s0%
144DeepSeek V3.213.8%$0.001842.8s0%
145Kimi K2.552.5%$0.0172.6m0%
146DeepSeek-V2 Chat5.0%$0.00238.3s0%
147DeepSeek V3 (2024-12-26)4.4%$0.00236.6s0%
148GPT-4o, Aug. 6th (temp=0)8.8%$0.0112.6s0%
149DeepSeek V3 (2025-03-24)5.6%$0.001515.7s0%
150GPT-5.5 (Reasoning)38.8%$0.05124.1s0%
151Gemini 3 Flash (Preview)2.5%$0.00343.2s0%
152Qwen 3.5 Flash34.4%$0.00712.0m0%
153Gemini 2.5 Flash0.6%$0.00211.5s0%
154GPT-5.42.5%$0.00483.1s0%
155Gemma 3 12B1.3%$0.000511.7s0%
156Gemma 3 27B0.0%$0.000712.6s0%
157Gemma 3 4B0.0%$0.000315.0s0%
158Claude Opus 4.8 (Reasoning, Low)78.8%$0.15052.5s18%
159Claude Opus 4.8 (Reasoning)80.0%$0.15856.0s20%
160Gemini 2.5 Pro46.3%$0.07352.1s0%
161Mistral NeMO8.8%$0.00181.6m0%
162Thinking Machines Inkling (Reasoning)71.3%$0.0325.2m9%
163Qwen 3.5 Plus (2026-02-15)18.8%$0.0212.0m0%
164Qwen 3.6 Max Preview67.5%$0.0723.8m6%
165Claude Sonnet 4.6 (Reasoning)76.3%$0.1452.2m15%
166Qwen 3.5 35B35.0%$0.0442.4m0%
167Z.AI GLM 5.3 (Reasoning, Max)63.7%$0.0584.2m4%
168Qwen 3.5 9B42.5%$0.00384.7m0%
169Hy4 Preview (Reasoning, High)53.8%$0.0454.0m0%
170DeepSeek V4 Pro 0813 (Reasoning, High)32.5%$0.0492.4m0%
171Gemini 3.1 Pro (Preview)57.5%$0.1201.5m1%
172Qwen 3.8 27B (Reasoning, XHigh)35.6%$0.0353.6m0%
173Qwen 3.8 Flash (Reasoning)36.3%$0.00995.0m0%
174Kimi K2.656.3%$0.0475.2m1%
175Claude Opus 418.1%$0.1097.1s0%
176Qwen 3.5 27B50.6%$0.0564.8m2%
177Qwen 3.5 397B A17B31.3%$0.0285.4m0%
178Qwen 3.8 Max (Reasoning, XHigh)42.5%$0.0955.7m0%
179Qwen 3.5 122B49.4%$0.1356.4m0%
58.24%

Individual Scenarios

basic entries

Model # 1 # 2 # 3 # 4 # 5 # 6 # 7 # 8 # 9 # 10 Avg ▼
Gemini 3.8 Flash (Reasoning, Medium)100100100100100100100100100100100.0%
Claude Opus 4.6 (Reasoning)100100100100100100100100100100100.0%
Gemini 3.7 Flash (Reasoning, Medium)100100100100100100100100100100100.0%
Muse Spark 1.2 (Reasoning, Medium)100100100100100100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100100100100100100.0%
Claude Opus 5 (Reasoning, Low)100100100100100100100100100100100.0%
Muse Spark 1.1 (Reasoning, Minimal)100100100100100100100100100100100.0%
GPT-5.1100100100100100100100100100100100.0%
DeepSeek V4 Pro (Reasoning)100100100100100100100100100100100.0%
Aion 2.0100100100100100100100100100100100.0%
Inception Mercury 2100100100100100100100100100100100.0%
GPT-5 Nano100100100100100100100100100100100.0%
GPT-5.4 Nano (Reasoning, Low)100100100100100100100100100100100.0%
Claude Opus 4.61001001001001001001001001005095.0%
Ministral 3 8B1001001001001001001001001005095.0%
GPT-4.1 Nano1001001001001001001001001005095.0%
Gemini 3.6 Flash (Reasoning)100100100100100100100100100090.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100100100100090.0%
GPT-5100100100100100100100100100090.0%
Grok 4.3 (Reasoning)100100100100100100100100100090.0%
GPT-5.2100100100100100100100100100090.0%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100100100100100100100090.0%
Xiaomi MIMO v2.5100100100100100100100100100090.0%
Gemini 2.5 Flash Lite (Reasoning)100100100100100100100100100090.0%
Nemotron 3 Super100100100100100100100100100090.0%
Mistral Small 4 (Reasoning)100100100100100100100100100090.0%
Laguna XS 2.1100100100100100100100100100090.0%
Nemotron 3 Nano100100100100100100100100100090.0%
ByteDance Seed 1.6 Flash100100100100100100100100100090.0%
Laguna S 2.110010010010010010010010050085.0%
Muse Spark 1.1 (Reasoning, Medium)1001001001001001001001000080.0%
Claude Sonnet 4.6 (Reasoning)1001001001001001001001000080.0%
Claude Opus 5 (Reasoning)1001001001001001001001000080.0%
Z.AI GLM 51001001001001001001001000080.0%
o4 Mini High1001001001001001001001000080.0%
o4 Mini1001001001001001001001000080.0%
GPT-OSS 120B1001001001001001001001000080.0%
Gemini 2.5 Flash (Reasoning)1001001001001001001001000080.0%
Aion 3.0 Mini1001001001001001001001000080.0%
GPT-5.4 Mini (Reasoning, Low)1001001001001001001001000080.0%
Cydonia 24B V4.1100100100100100100505050075.0%
Kimi K3 (Reasoning, High)10010010010010010010000070.0%
Grok 4.5 (Reasoning, Low)10010010010010010010000070.0%
Kimi K2.510010010010010010010000070.0%
GPT-5.6 Luna (Reasoning)10010010010010010010000070.0%
Qwen 3.5 Plus (2026-04-20)10010010010010010010000070.0%
DeepSeek V4 Flash (Reasoning)10010010010010010010000070.0%
Z.AI GLM 4.7 Flash10010010010010010010000070.0%
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100000060.0%
Z.AI GLM 5 Turbo100100100100100100000060.0%
Kimi K2.6100100100100100100000060.0%
Kimi K3 (Reasoning, Low)100100100100100100000060.0%
Thinking Machines Inkling (Reasoning)100100100100100100000060.0%
Claude Sonnet 4.6100100100100505050500060.0%
Ministral 8B10010010050505050500055.0%
GPT-5.4 (Reasoning)1001001001001000000050.0%
Z.AI GLM 5.11001001001001000000050.0%
Z.AI GLM 5.2 (Reasoning, High)1001001001001000000050.0%
Aion 3.01001001001001000000050.0%
Qwen 3.7 Flash (Reasoning)1001001001001000000050.0%
Qwen 3.6 27B1001001001001000000050.0%
GPT-4.11001005050505050500050.0%
MiniMax M2.51001001001001000000050.0%
MiniMax M2.71001001001001000000050.0%
Xiaomi MIMO v2.5 Pro1001001001001000000050.0%
Z.AI GLM 4.5 Air1001001001001000000050.0%
GPT-5.4 Nano (Reasoning)1001001001001000000050.0%
Qwen 3 32B1001001001001000000050.0%
GPT-5.4 Nano1001001001005050000050.0%
Claude Opus 4.7505050505050505050045.0%
Z.AI GLM 4.6100100100100500000045.0%
Hy4 Preview (Reasoning, High)10010010010000000040.0%
GPT-5.5 (Reasoning, Low)10010010010000000040.0%
Grok 4.20 (Reasoning)10010010010000000040.0%
ByteDance Seed 1.610010010010000000040.0%
Claude Sonnet 550505050505050500040.0%
DeepSeek V4 Flash50505050505050500040.0%
Writer: Palmyra X550505050505050500040.0%
Qwen 2.5 72B50505050505050500040.0%
Arcee AI: Trinity Mini10010010010000000040.0%
Ministral 3B50505050505050500040.0%
Claude Opus 4.55050505050505000035.0%
Qwen 3 235B A22B Instruct 25075050505050505000035.0%
Mistral Small 45050505050505000035.0%
Ministral 3 14B5050505050505000035.0%
GPT-5.6 Sol (Reasoning)100100100000000030.0%
Qwen 3.8 Flash (Reasoning)100100100000000030.0%
GPT-5.5 (Reasoning)100100100000000030.0%
Claude Opus 4.7 (Reasoning)100100100000000030.0%
GPT-5 Mini100100100000000030.0%
GPT-5.4 (Reasoning, Low)100100100000000030.0%
Claude Sonnet 5 (Reasoning)100100100000000030.0%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100000000030.0%
Gemma 4 26B (Reasoning)100100100000000030.0%
Muse Glimmer 30B (Reasoning, Medium)100100100000000030.0%
Qwen 3.6 35B100100100000000030.0%
Claude Sonnet 4.5505050505050000030.0%
Gemini 3.5 Flash Lite (Reasoning)505050505050000030.0%
Gemini 2.5 Flash Lite100100100000000030.0%
Thinking Machines Inkling505050505050000030.0%
WizardLM 2 8x22b505050505050000030.0%
Ministral 3 3B505050505050000030.0%
Mistral NeMO100100100000000030.0%
Gemini 3.1 Pro (Preview)1001000000000020.0%
GPT-5.6 Terra (Reasoning)1001000000000020.0%
Claude Sonnet 5 (Reasoning, Low)1001000000000020.0%
Gemma 4 31B (Reasoning)1001000000000020.0%
DeepSeek V4 Flash 0731 (Reasoning, High)1001000000000020.0%
Claude Sonnet 45050505000000020.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)5050505000000020.0%
DeepSeek V4 Pro5050505000000020.0%
GPT-4o, Aug. 6th (temp=1)5050505000000020.0%
Hermes 3 405B1001000000000020.0%
GPT-4o Mini (temp=1)5050505000000020.0%
Mistral Medium 3.15050505000000020.0%
Claude Opus 4505050000000015.0%
Z.AI GLM 4.5100500000000015.0%
Gemma 4 26B505050000000015.0%
Claude Haiku 4.5505050000000015.0%
DeepSeek V3.1505050000000015.0%
Llama 3.1 70B100500000000015.0%
Hermes 3 70B100500000000015.0%
Z.AI GLM 5.3 (Reasoning, Max)10000000000010.0%
DeepSeek V4.1 Flash (Reasoning, High)10000000000010.0%
Gemini 3.5 Flash (Reasoning)10000000000010.0%
Claude Opus 550500000000010.0%
Qwen 3.6 Flash10000000000010.0%
Z.AI GLM 4.710000000000010.0%
Gemma 4 31B50500000000010.0%
DeepSeek V3.250500000000010.0%
GPT-4.1 Mini50500000000010.0%
Grok 4.2050500000000010.0%
GPT-5.4 Mini10000000000010.0%
Grok 4.310000000000010.0%
Cohere Command R+ (Aug. 2024)10000000000010.0%
Qwen 3.5 122B500000000005.0%
Qwen 3.5 27B500000000005.0%
Gemini 3 Flash (Preview, Reasoning)500000000005.0%
Gemini 3.6 Flash (Reasoning, Minimal)500000000005.0%
Gemini 3.1 Flash Lite (Reasoning)500000000005.0%
ByteDance Seed 2.0 Mini500000000005.0%
Gemini 3 Flash (Preview)500000000005.0%
Gemini 3.1 Flash Lite500000000005.0%
DeepSeek V3 (2024-12-26)500000000005.0%
Qwen 3.7 Max00000000000.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)00000000000.0%
Qwen 3.6 Max Preview00000000000.0%
Qwen 3.8 27B (Reasoning, XHigh)00000000000.0%
Claude Opus 4.8 (Reasoning)00000000000.0%
Claude Opus 4.8 (Reasoning, Low)00000000000.0%
Qwen 3.5 397B A17B00000000000.0%
GPT-5.6 Sol00000000000.0%
MiniMax M300000000000.0%
GPT-5.4 Mini (Reasoning)00000000000.0%
GPT-5.500000000000.0%
Gemini 2.5 Pro00000000000.0%
GPT-5.6 Terra00000000000.0%
Thinking Machines Inkling Small (Reasoning, High)00000000000.0%
Qwen 3.5 35B00000000000.0%
Qwen 3.5 Plus (2026-02-15)00000000000.0%
Gemini 3.5 Flash (Reasoning, Minimal)00000000000.0%
Qwen 3.5 Flash00000000000.0%
Gemini 3.1 Flash Lite (Preview)00000000000.0%
GPT-5.6 Luna00000000000.0%
GPT-5.400000000000.0%
Mistral Large 300000000000.0%
ByteDance Seed 2.0 Lite00000000000.0%
DeepSeek-V2 Chat00000000000.0%
Qwen 3.5 9B00000000000.0%
GPT-4o, Aug. 6th (temp=0)00000000000.0%
Mistral Large 200000000000.0%
Gemini 2.5 Flash00000000000.0%
DeepSeek V3 (2025-03-24)00000000000.0%
Mistral Small 3.2 24B00000000000.0%
GPT-4o Mini (temp=0)00000000000.0%
Gemma 3 12B00000000000.0%
Gemma 3 27B00000000000.0%
Gemma 3 4B00000000000.0%
Model # 1 # 2 # 3 # 4 # 5 # 6 # 7 # 8 # 9 # 10 Avg ▼
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100100100100100100.0%
Gemini 3.8 Flash (Reasoning, Medium)100100100100100100100100100100100.0%
Z.AI GLM 5.3 (Reasoning, Max)100100100100100100100100100100100.0%
GPT-5.6 Sol (Reasoning)100100100100100100100100100100100.0%
Claude Opus 4.6 (Reasoning)100100100100100100100100100100100.0%
Gemini 3.7 Flash (Reasoning, Medium)100100100100100100100100100100100.0%
Hy4 Preview (Reasoning, High)100100100100100100100100100100100.0%
Muse Spark 1.2 (Reasoning, Medium)100100100100100100100100100100100.0%
Qwen 3.7 Max100100100100100100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100100100100100100100100100.0%
Qwen 3.8 Flash (Reasoning)100100100100100100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100100100100100100.0%
Muse Spark 1.1 (Reasoning, Medium)100100100100100100100100100100100.0%
Z.AI GLM 5.1100100100100100100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100100100100100100.0%
GPT-5.5 (Reasoning)100100100100100100100100100100100.0%
Claude Sonnet 4.6 (Reasoning)100100100100100100100100100100100.0%
Z.AI GLM 5.2 (Reasoning, High)100100100100100100100100100100100.0%
Z.AI GLM 5 Turbo100100100100100100100100100100100.0%
Kimi K3 (Reasoning, High)100100100100100100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100100100100100100.0%
Kimi K2.6100100100100100100100100100100100.0%
Claude Opus 4.7 (Reasoning)100100100100100100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100100100100100100.0%
GPT-5.6 Terra (Reasoning)100100100100100100100100100100100.0%
Kimi K3 (Reasoning, Low)100100100100100100100100100100100.0%
GPT-5100100100100100100100100100100100.0%
Muse Spark 1.1 (Reasoning, Minimal)100100100100100100100100100100100.0%
GPT-5 Mini100100100100100100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100100100100100100.0%
Kimi K2.5100100100100100100100100100100100.0%
Thinking Machines Inkling (Reasoning)100100100100100100100100100100100.0%
GPT-5.6 Sol100100100100100100100100100100100.0%
GPT-5.1100100100100100100100100100100100.0%
GPT-5.6 Luna (Reasoning)100100100100100100100100100100100.0%
MiniMax M3100100100100100100100100100100100.0%
Claude Sonnet 5 (Reasoning)100100100100100100100100100100100.0%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100100100100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100100100100100100.0%
Gemma 4 31B (Reasoning)100100100100100100100100100100100.0%
Z.AI GLM 5100100100100100100100100100100100.0%
ByteDance Seed 1.6100100100100100100100100100100100.0%
GPT-5.2100100100100100100100100100100100.0%
Gemma 4 26B (Reasoning)100100100100100100100100100100100.0%
Muse Glimmer 30B (Reasoning, Medium)100100100100100100100100100100100.0%
o4 Mini High100100100100100100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100100100100100100100100100.0%
Qwen 3.7 Flash (Reasoning)100100100100100100100100100100100.0%
Qwen 3.6 27B100100100100100100100100100100100.0%
GPT-5.6 Terra100100100100100100100100100100100.0%
DeepSeek V4 Flash (Reasoning)100100100100100100100100100100100.0%
DeepSeek V4 Flash 0731 (Reasoning, High)100100100100100100100100100100100.0%
Z.AI GLM 4.7100100100100100100100100100100100.0%
Thinking Machines Inkling Small (Reasoning, High)100100100100100100100100100100100.0%
GPT-4.1100100100100100100100100100100100.0%
Gemini 3.6 Flash (Reasoning, Minimal)100100100100100100100100100100100.0%
o4 Mini100100100100100100100100100100100.0%
MiniMax M2.7100100100100100100100100100100100.0%
Xiaomi MIMO v2.5 Pro100100100100100100100100100100100.0%
ByteDance Seed 2.0 Mini100100100100100100100100100100100.0%
Gemma 4 31B100100100100100100100100100100100.0%
GPT-5.6 Luna100100100100100100100100100100100.0%
GPT-OSS 120B100100100100100100100100100100100.0%
Gemini 2.5 Flash (Reasoning)100100100100100100100100100100100.0%
Xiaomi MIMO v2.5100100100100100100100100100100100.0%
Aion 3.0 Mini100100100100100100100100100100100.0%
GPT-5.4 Mini (Reasoning, Low)100100100100100100100100100100100.0%
Inception Mercury 2100100100100100100100100100100100.0%
Nemotron 3 Super100100100100100100100100100100100.0%
GPT-5 Nano100100100100100100100100100100100.0%
GPT-5.4 Nano (Reasoning)100100100100100100100100100100100.0%
GPT-5.4 Nano (Reasoning, Low)100100100100100100100100100100100.0%
Nemotron 3 Nano100100100100100100100100100100100.0%
ByteDance Seed 1.6 Flash100100100100100100100100100100100.0%
Claude Sonnet 4.61001001001001001001001001005095.0%
Mistral Medium 3.11001001001001001001001001005095.0%
GPT-4.1 Nano1001001001001001001001001005095.0%
Gemini 3.6 Flash (Reasoning)100100100100100100100100100090.0%
Claude Opus 5 (Reasoning)100100100100100100100100100090.0%
Qwen 3.6 Flash100100100100100100100100100090.0%
DeepSeek V4 Pro (Reasoning)100100100100100100100100100090.0%
Aion 2.0100100100100100100100100100090.0%
Gemini 2.5 Flash Lite (Reasoning)100100100100100100100100100090.0%
Z.AI GLM 4.5 Air100100100100100100100100100090.0%
Laguna S 2.1100100100100100100100100100090.0%
Ministral 3 8B100100100100100100100100100090.0%
Aion 3.010010010010010010010010050085.0%
Claude Opus 5 (Reasoning, Low)1001001001001001001001000080.0%
Claude Sonnet 5 (Reasoning, Low)1001001001001001001001000080.0%
Gemini 2.5 Pro1001001001001001001001000080.0%
Qwen 3.6 35B1001001001001001001001000080.0%
MiniMax M2.51001001001001001001001000080.0%
Gemini 3.1 Flash Lite1001001001001001001001000080.0%
Laguna XS 2.11001001001001001001001000080.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100100100100500075.0%
Ministral 8B100100100100100505050505075.0%
DeepSeek V4.1 Flash (Reasoning, High)10010010010010010010000070.0%
Gemini 3.5 Flash (Reasoning)10010010010010010010000070.0%
Gemini 2.5 Flash Lite10010010010010010010000070.0%
Mistral Small 3.2 24B10010010010010010010000070.0%
Hermes 3 70B10010010010010010050500070.0%
Gemini 3.1 Flash Lite (Preview)1001001001001001005000065.0%
Z.AI GLM 4.51001001001001005050500065.0%
GPT-5.4 Nano1001001001001001005000065.0%
Claude Opus 4.8 (Reasoning)100100100100100100000060.0%
Claude Opus 4.8 (Reasoning, Low)100100100100100100000060.0%
Mistral Small 4 (Reasoning)100100100100100100000060.0%
Qwen 3 32B100100100100100100000060.0%
Cydonia 24B V4.1100100100100100100000060.0%
Qwen 3.5 27B10010010010010050000055.0%
Z.AI GLM 4.610010010010050505000055.0%
Grok 4.2010010010010050505000055.0%
Claude Opus 4.75050505050505050505050.0%
Claude Haiku 4.55050505050505050505050.0%
Z.AI GLM 4.7 Flash1001001001001000000050.0%
Thinking Machines Inkling5050505050505050505050.0%
Claude Sonnet 4.5505050505050505050045.0%
DeepSeek V4 Flash505050505050505050045.0%
GPT-4.1 Mini505050505050505050045.0%
Writer: Palmyra X5505050505050505050045.0%
Ministral 3 3B505050505050505050045.0%
Ministral 3B505050505050505050045.0%
Gemini 3.1 Pro (Preview)10010010010000000040.0%
Qwen 3.5 397B A17B10010010010000000040.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)50505050505050500040.0%
DeepSeek V4 Pro50505050505050500040.0%
Arcee AI: Trinity Mini10010010010000000040.0%
Claude Opus 4.65050505050505000035.0%
Claude Sonnet 45050505050505000035.0%
Gemini 3.5 Flash Lite (Reasoning)5050505050505000035.0%
Qwen 3 235B A22B Instruct 25075050505050505000035.0%
GPT-4o Mini (temp=1)1005050505050000035.0%
Mistral Small 41005050505050000035.0%
Qwen 3.5 122B100100100000000030.0%
Claude Sonnet 5505050505050000030.0%
Claude Opus 4505050505050000030.0%
Qwen 3.5 35B100100100000000030.0%
Gemini 3.5 Flash (Reasoning, Minimal)100505050500000030.0%
Gemma 4 26B100505050500000030.0%
Qwen 3.5 9B100100100000000030.0%
WizardLM 2 8x22b100505050500000030.0%
Qwen 3.5 Plus (2026-02-15)50505050500000025.0%
DeepSeek V3.110050505000000025.0%
GPT-4o, Aug. 6th (temp=1)10050505000000025.0%
Qwen 2.5 72B10050505000000025.0%
DeepSeek V3.25050505000000020.0%
Mistral NeMO1001000000000020.0%
DeepSeek V3 (2025-03-24)505050000000015.0%
Grok 4.3100500000000015.0%
Ministral 3 14B505050000000015.0%
Gemini 3 Flash (Preview, Reasoning)10000000000010.0%
Claude Opus 4.550500000000010.0%
Qwen 3.5 Flash10000000000010.0%
Hermes 3 405B10000000000010.0%
GPT-5.4 Mini10000000000010.0%
Cohere Command R+ (Aug. 2024)10000000000010.0%
Claude Opus 5500000000005.0%
Gemini 3 Flash (Preview)500000000005.0%
DeepSeek-V2 Chat500000000005.0%
DeepSeek V3 (2024-12-26)500000000005.0%
Mistral Large 2500000000005.0%
Llama 3.1 70B500000000005.0%
GPT-5.500000000000.0%
GPT-5.400000000000.0%
Mistral Large 300000000000.0%
ByteDance Seed 2.0 Lite00000000000.0%
GPT-4o, Aug. 6th (temp=0)00000000000.0%
Gemini 2.5 Flash00000000000.0%
GPT-4o Mini (temp=0)00000000000.0%
Gemma 3 12B00000000000.0%
Gemma 3 27B00000000000.0%
Gemma 3 4B00000000000.0%
Model # 1 # 2 # 3 # 4 # 5 # 6 # 7 # 8 # 9 # 10 Avg ▼
Gemini 3.8 Flash (Reasoning, Medium)100100100100100100100100100100100.0%
Z.AI GLM 5.3 (Reasoning, Max)100100100100100100100100100100100.0%
Claude Opus 4.6 (Reasoning)100100100100100100100100100100100.0%
Gemini 3.6 Flash (Reasoning)100100100100100100100100100100100.0%
Gemini 3.7 Flash (Reasoning, Medium)100100100100100100100100100100100.0%
Qwen 3.7 Max100100100100100100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100100100100100100.0%
Muse Spark 1.1 (Reasoning, Medium)100100100100100100100100100100100.0%
Z.AI GLM 5.1100100100100100100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100100100100100100.0%
Claude Sonnet 4.6 (Reasoning)100100100100100100100100100100100.0%
Z.AI GLM 5.2 (Reasoning, High)100100100100100100100100100100100.0%
Gemini 3.5 Flash (Reasoning)100100100100100100100100100100100.0%
Z.AI GLM 5 Turbo100100100100100100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100100100100100100.0%
Claude Opus 4.7 (Reasoning)100100100100100100100100100100100.0%
Claude Opus 4.8 (Reasoning)100100100100100100100100100100100.0%
Claude Opus 4.6100100100100100100100100100100100.0%
Claude Opus 5 (Reasoning, Low)100100100100100100100100100100100.0%
Claude Opus 4.8 (Reasoning, Low)100100100100100100100100100100100.0%
GPT-5 Mini100100100100100100100100100100100.0%
Claude Opus 5 (Reasoning)100100100100100100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100100100100100100.0%
GPT-5.6 Sol100100100100100100100100100100100.0%
MiniMax M3100100100100100100100100100100100.0%
Claude Sonnet 5 (Reasoning)100100100100100100100100100100100.0%
Claude Sonnet 5 (Reasoning, Low)100100100100100100100100100100100.0%
Claude Opus 5100100100100100100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100100100100100100.0%
ByteDance Seed 1.6100100100100100100100100100100100.0%
GPT-5.5100100100100100100100100100100100.0%
Gemma 4 26B (Reasoning)100100100100100100100100100100100.0%
o4 Mini High100100100100100100100100100100100.0%
Qwen 3.6 27B100100100100100100100100100100100.0%
DeepSeek V4 Flash 0731 (Reasoning, High)100100100100100100100100100100100.0%
GPT-4.1100100100100100100100100100100100.0%
Gemini 3.6 Flash (Reasoning, Minimal)100100100100100100100100100100100.0%
o4 Mini100100100100100100100100100100100.0%
Gemma 4 31B100100100100100100100100100100100.0%
GPT-5.6 Luna100100100100100100100100100100100.0%
Gemini 2.5 Flash Lite (Reasoning)100100100100100100100100100100100.0%
Inception Mercury 2100100100100100100100100100100100.0%
Nemotron 3 Super100100100100100100100100100100100.0%
GPT-5.4 Nano (Reasoning)100100100100100100100100100100100.0%
Laguna XS 2.1100100100100100100100100100100100.0%
ByteDance Seed 1.6 Flash100100100100100100100100100100100.0%
Ministral 3 8B1001001001001001001001001005095.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100100100100100100100090.0%
Kimi K3 (Reasoning, Low)100100100100100100100100100090.0%
Grok 4.3 (Reasoning)100100100100100100100100100090.0%
GPT-5.1100100100100100100100100100090.0%
GPT-5.4 Mini (Reasoning)100100100100100100100100100090.0%
Gemma 4 31B (Reasoning)100100100100100100100100100090.0%
Qwen 3.6 Flash100100100100100100100100100090.0%
Muse Glimmer 30B (Reasoning, Medium)100100100100100100100100100090.0%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100100100100100100100090.0%
Aion 2.0100100100100100100100100100090.0%
MiniMax M2.7100100100100100100100100100090.0%
ByteDance Seed 2.0 Mini100100100100100100100100100090.0%
Gemma 4 26B100100100100100100100100100090.0%
Gemini 2.5 Flash (Reasoning)100100100100100100100100100090.0%
Z.AI GLM 4.5 Air100100100100100100100100505090.0%
Mistral Small 4 (Reasoning)100100100100100100100100100090.0%
Qwen 3 32B100100100100100100100100100090.0%
GPT-5.4 Nano (Reasoning, Low)100100100100100100100100100090.0%
Hy4 Preview (Reasoning, High)1001001001001001001001000080.0%
Muse Spark 1.2 (Reasoning, Medium)1001001001001001001001000080.0%
Muse Spark 1.1 (Reasoning, Minimal)1001001001001001001001000080.0%
Aion 3.01001001001001001001001000080.0%
Gemini 2.5 Pro1001001001001001001001000080.0%
DeepSeek V4 Flash (Reasoning)1001001001001001001001000080.0%
Qwen 3.6 35B1001001001001001001001000080.0%
Xiaomi MIMO v2.5 Pro1001001001001001001001000080.0%
GPT-5.4 Mini (Reasoning, Low)1001001001001001001001000080.0%
Z.AI GLM 4.7 Flash1001001001001001001001000080.0%
Laguna S 2.11001001001001001005050505080.0%
Nemotron 3 Nano1001001001001001001001000080.0%
Arcee AI: Trinity Mini1001001001001001001001000080.0%
Claude Opus 4.7100100100100100505050505075.0%
Claude Sonnet 4100100100100100100505050075.0%
Thinking Machines Inkling100100100100100100505050075.0%
GPT-5.4 Nano100100100100100100505050075.0%
Ministral 8B100100100100100100505050075.0%
DeepSeek V4.1 Flash (Reasoning, High)10010010010010010010000070.0%
Kimi K3 (Reasoning, High)10010010010010010010000070.0%
GPT-5.6 Luna (Reasoning)10010010010010010010000070.0%
Z.AI GLM 510010010010010010010000070.0%
GPT-5.210010010010010010010000070.0%
Qwen 3.7 Flash (Reasoning)10010010010010010010000070.0%
Xiaomi MIMO v2.510010010010010010010000070.0%
Aion 3.0 Mini10010010010010010010000070.0%
Hermes 3 405B10010010010010010010000070.0%
GPT-5 Nano10010010010010010010000070.0%
Hermes 3 70B1001001001001005050500065.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100000060.0%
Z.AI GLM 4.6100100100100100505000060.0%
MiniMax M2.5100100100100100100000060.0%
GPT-OSS 120B100100100100100100000060.0%
Cohere Command R+ (Aug. 2024)100100100100100100000060.0%
Claude Haiku 4.510050505050505050505055.0%
Thinking Machines Inkling (Reasoning)1001001001001000000050.0%
Qwen 3.5 9B1001001001001000000050.0%
DeepSeek V4 Pro1001005050505050500050.0%
Mistral Medium 3.15050505050505050505050.0%
Cydonia 24B V4.11001001001005050000050.0%
Ministral 3 3B5050505050505050505050.0%
Ministral 3B5050505050505050505050.0%
Claude Sonnet 4.6505050505050505050045.0%
GPT-4.1 Mini505050505050505050045.0%
GPT-4o, Aug. 6th (temp=1)100100100505050000045.0%
Qwen 2.5 72B100505050505050500045.0%
Kimi K2.610010010010000000040.0%
GPT-510010010010000000040.0%
Qwen 3.5 397B A17B10010010010000000040.0%
Kimi K2.510010010010000000040.0%
Qwen 3.5 27B10010010050500000040.0%
Gemini 3 Flash (Preview, Reasoning)10010010010000000040.0%
DeepSeek V4 Pro (Reasoning)10010010010000000040.0%
Z.AI GLM 4.710010010010000000040.0%
Thinking Machines Inkling Small (Reasoning, High)10010010010000000040.0%
Z.AI GLM 4.510010010050500000040.0%
DeepSeek V4 Flash50505050505050500040.0%
Ministral 3 14B50505050505050500040.0%
GPT-4.1 Nano10010010010000000040.0%
WizardLM 2 8x22b1005050505050000035.0%
GPT-5.5 (Reasoning)100100100000000030.0%
Qwen 3.5 122B100100100000000030.0%
Qwen 3.5 Plus (2026-02-15)505050505050000030.0%
Writer: Palmyra X5100100505000000030.0%
Mistral Large 350505050500000025.0%
Mistral Large 250505050500000025.0%
Grok 4.310010050000000025.0%
Mistral Small 450505050500000025.0%
Qwen 3.5 35B1001000000000020.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)5050505000000020.0%
Llama 3.1 70B1005050000000020.0%
Mistral NeMO1005050000000020.0%
DeepSeek V3.1505050000000015.0%
GPT-4o Mini (temp=0)505050000000015.0%
GPT-5.4 (Reasoning)10000000000010.0%
Qwen 3.8 27B (Reasoning, XHigh)10000000000010.0%
GPT-5.4 (Reasoning, Low)10000000000010.0%
Claude Opus 4.510000000000010.0%
GPT-5.6 Terra10000000000010.0%
Claude Sonnet 4.510000000000010.0%
Qwen 3.5 Flash10000000000010.0%
Gemini 3.1 Flash Lite (Preview)50500000000010.0%
ByteDance Seed 2.0 Lite10000000000010.0%
DeepSeek V3.250500000000010.0%
GPT-5.4 Mini10000000000010.0%
Qwen 3 235B A22B Instruct 250710000000000010.0%
GPT-4o Mini (temp=1)50500000000010.0%
Claude Sonnet 5500000000005.0%
Claude Opus 4500000000005.0%
Gemini 3.1 Flash Lite (Reasoning)500000000005.0%
Gemini 3.1 Flash Lite500000000005.0%
DeepSeek V3 (2024-12-26)500000000005.0%
GPT-4o, Aug. 6th (temp=0)500000000005.0%
Gemini 2.5 Flash500000000005.0%
Mistral Small 3.2 24B500000000005.0%
Gemma 3 12B500000000005.0%
Qwen 3.8 Max (Reasoning, XHigh)00000000000.0%
GPT-5.6 Sol (Reasoning)00000000000.0%
Qwen 3.8 Flash (Reasoning)00000000000.0%
GPT-5.5 (Reasoning, Low)00000000000.0%
GPT-5.6 Terra (Reasoning)00000000000.0%
DeepSeek V4 Pro 0813 (Reasoning, High)00000000000.0%
Gemini 3.5 Flash (Reasoning, Minimal)00000000000.0%
Gemini 3 Flash (Preview)00000000000.0%
Gemini 3.5 Flash Lite (Reasoning)00000000000.0%
GPT-5.400000000000.0%
DeepSeek-V2 Chat00000000000.0%
Grok 4.2000000000000.0%
DeepSeek V3 (2025-03-24)00000000000.0%
Gemini 2.5 Flash Lite00000000000.0%
Gemma 3 27B00000000000.0%
Gemma 3 4B00000000000.0%
Model # 1 # 2 # 3 # 4 # 5 # 6 # 7 # 8 # 9 # 10 Avg ▼
Gemini 3.8 Flash (Reasoning, Medium)100100100100100100100100100100100.0%
Z.AI GLM 5.3 (Reasoning, Max)100100100100100100100100100100100.0%
Claude Opus 4.6 (Reasoning)100100100100100100100100100100100.0%
Gemini 3.6 Flash (Reasoning)100100100100100100100100100100100.0%
Gemini 3.7 Flash (Reasoning, Medium)100100100100100100100100100100100.0%
Muse Spark 1.2 (Reasoning, Medium)100100100100100100100100100100100.0%
Qwen 3.7 Max100100100100100100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100100100100100100.0%
Z.AI GLM 5.1100100100100100100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100100100100100100.0%
Gemini 3.5 Flash (Reasoning)100100100100100100100100100100100.0%
Z.AI GLM 5 Turbo100100100100100100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100100100100100100.0%
Claude Opus 4.7 (Reasoning)100100100100100100100100100100100.0%
Claude Opus 4.8 (Reasoning)100100100100100100100100100100100.0%
Claude Opus 4.6100100100100100100100100100100100.0%
Kimi K3 (Reasoning, Low)100100100100100100100100100100100.0%
Claude Opus 5 (Reasoning, Low)100100100100100100100100100100100.0%
Claude Opus 4.8 (Reasoning, Low)100100100100100100100100100100100.0%
GPT-5 Mini100100100100100100100100100100100.0%
Claude Opus 5 (Reasoning)100100100100100100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100100100100100100.0%
GPT-5.6 Sol100100100100100100100100100100100.0%
GPT-5.6 Luna (Reasoning)100100100100100100100100100100100.0%
MiniMax M3100100100100100100100100100100100.0%
Claude Opus 5100100100100100100100100100100100.0%
Claude Opus 4.7100100100100100100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100100100100100100.0%
Gemma 4 31B (Reasoning)100100100100100100100100100100100.0%
ByteDance Seed 1.6100100100100100100100100100100100.0%
GPT-5.5100100100100100100100100100100100.0%
Gemma 4 26B (Reasoning)100100100100100100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100100100100100100100100100.0%
Gemini 3.6 Flash (Reasoning, Minimal)100100100100100100100100100100100.0%
o4 Mini100100100100100100100100100100100.0%
MiniMax M2.7100100100100100100100100100100100.0%
Gemini 3.5 Flash (Reasoning, Minimal)100100100100100100100100100100100.0%
Gemma 4 31B100100100100100100100100100100100.0%
GPT-5.6 Luna100100100100100100100100100100100.0%
Gemma 4 26B100100100100100100100100100100100.0%
Gemini 2.5 Flash (Reasoning)100100100100100100100100100100100.0%
Z.AI GLM 4.7 Flash100100100100100100100100100100100.0%
Inception Mercury 2100100100100100100100100100100100.0%
Nemotron 3 Super100100100100100100100100100100100.0%
Z.AI GLM 4.5 Air100100100100100100100100100100100.0%
GPT-5.4 Nano (Reasoning)100100100100100100100100100100100.0%
Mistral Small 4 (Reasoning)100100100100100100100100100100100.0%
GPT-5.4 Nano (Reasoning, Low)100100100100100100100100100100100.0%
ByteDance Seed 1.6 Flash100100100100100100100100100100100.0%
Z.AI GLM 4.61001001001001001001001001005095.0%
Laguna S 2.11001001001001001001001001005095.0%
DeepSeek V4.1 Flash (Reasoning, High)100100100100100100100100100090.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100100100100100100100090.0%
Z.AI GLM 5.2 (Reasoning, High)100100100100100100100100100090.0%
Kimi K3 (Reasoning, High)100100100100100100100100100090.0%
Muse Spark 1.1 (Reasoning, Minimal)100100100100100100100100100090.0%
GPT-5.1100100100100100100100100100090.0%
Z.AI GLM 5100100100100100100100100100090.0%
Qwen 3.6 Flash100100100100100100100100100090.0%
Muse Glimmer 30B (Reasoning, Medium)100100100100100100100100100090.0%
Aion 3.0100100100100100100100100100090.0%
o4 Mini High100100100100100100100100100090.0%
Qwen 3.7 Flash (Reasoning)100100100100100100100100100090.0%
MiniMax M2.5100100100100100100100100100090.0%
ByteDance Seed 2.0 Mini100100100100100100100100100090.0%
GPT-5.4 Mini (Reasoning, Low)100100100100100100100100100090.0%
Gemini 2.5 Flash Lite (Reasoning)100100100100100100100100100090.0%
Laguna XS 2.1100100100100100100100100100090.0%
Nemotron 3 Nano100100100100100100100100100090.0%
Muse Spark 1.1 (Reasoning, Medium)1001001001001001001001000080.0%
Claude Sonnet 4.6 (Reasoning)1001001001001001001001000080.0%
Grok 4.3 (Reasoning)1001001001001001001001000080.0%
Grok 4.5 (Reasoning, Low)100100100100