Matches Regex

Test: Voice/dialogue sheets

Avg. Score
66.6%
Scenarios
5

Overall Performance

Rank ▲ Model Score Avg. Cost Avg. Time Stability
1Gemma 4 31B100.0%$0.00018.3s100%
2Mistral Medium 3.5100.0%$0.00161.1s100%
3Mistral Medium 3.5 (Reasoning)100.0%$0.00161.2s100%
4Claude Sonnet 4.6100.0%$0.00331.9s100%
5Claude Sonnet 4100.0%$0.00332.8s100%
6Claude Opus 4.6100.0%$0.00553.9s100%
7Grok 4.5 (Reasoning, High)100.0%$0.00499.0s100%
8Claude Opus 4.6 (Reasoning)100.0%$0.00603.1s100%
9Claude Sonnet 598.0%$0.00324.2s72%
10GPT-4.196.0%$0.00172.6s61%
11Thinking Machines Inkling92.0%$0.00085.2s46%
12Mistral Large 4.090.0%$0.00052.4s40%
13ByteDance Seed 1.694.0%$0.001314.2s53%
14GPT-4o, Aug. 6th (temp=0)92.0%$0.00222.4s46%
15Gemini 2.5 Flash88.0%$0.0005933ms35%
16Gemma 4 26B88.0%$0.00014.5s35%
17Claude Sonnet 5 (Reasoning, Low)92.0%$0.00375.0s46%
18Qwen 3.5 Plus (2026-02-15)86.0%$0.00056.6s31%
19Grok 4.5 (Reasoning, Low)92.0%$0.003410.7s46%
20Grok 4.20 (Reasoning)92.0%$0.003512.9s46%
21DeepSeek V3 (2025-03-24)84.0%$0.00036.1s27%
22Claude Sonnet 5 (Reasoning)90.0%$0.00374.6s40%
23Claude Haiku 4.582.0%$0.00111.6s23%
24Gemini 3.5 Flash Lite (Reasoning, Minimal)80.0%$0.0005776ms20%
25Gemini 3.8 Flash (Reasoning, Medium)86.0%$0.00313.0s31%
26Gemini 3 Flash (Preview)80.0%$0.00061.8s20%
27Claude Sonnet 4.6 (Reasoning)90.0%$0.00533.3s40%
28Aion 3.5 (Reasoning, High)88.0%$0.003011.1s35%
29Mistral Large 380.0%$0.00044.1s20%
30Qwen 3.7 Flash (Reasoning)82.0%$0.000210.3s23%
31Gemini 3.1 Flash Lite (Reasoning)78.0%$0.00031.4s17%
32Gemini 3.6 Flash (Reasoning)92.0%$0.00713.8s46%
33DeepSeek-V2 Chat80.0%$0.00018.2s20%
34Gemma 4 31B (Reasoning)92.0%$0.000343.9s46%
35DeepSeek V4 Pro82.0%$0.000412.1s23%
36GPT-4o, Aug. 6th (temp=1)82.0%$0.00222.3s23%
37Claude Opus 5.5 (Reasoning)94.0%$0.00855.5s53%
38Claude Sonnet 4.584.0%$0.00332.8s27%
39Gemini 3.1 Flash Lite76.0%$0.00031.1s15%
40Z.AI GLM 5.3 Flash (Reasoning, Low)76.0%$0.00003.6s15%
41Qwen 3.8 Max (Reasoning, XHigh)94.0%$0.006322.4s53%
42GPT-4.1 Mini76.0%$0.00032.7s15%
43Gemini 3.7 Flash (Reasoning, Medium)82.0%$0.00283.3s23%
44Aion 3.5 Mini (Reasoning, High)82.0%$0.001015.7s23%
45Gemini 3.5 Flash Lite (Reasoning)74.0%$0.0005677ms12%
46Qwen 3.8 Flash (Reasoning)82.0%$0.000319.7s23%
47Z.AI GLM 4.576.0%$0.00045.3s15%
48GPT-5.6 Terra80.0%$0.00291.6s20%
49Grok 4.6 (Reasoning, High)92.0%$0.006716.1s46%
50Writer: Palmyra X578.0%$0.00108.1s17%
51DeepSeek V3.176.0%$0.00028.4s15%
52Xiaomi MIMO v2.6 Pro74.0%$0.00034.0s12%
53DeepSeek V3 (2024-12-26)74.0%$0.00034.6s12%
54Mistral Small 3.2 24B72.0%$0.00012.1s10%
55Llama 3.1 70B72.0%$0.00051.5s10%
56Qwen 3 235B A22B Instruct 250772.0%$0.00014.9s10%
57Z.AI GLM 5.3 (Reasoning, Max)84.0%$0.003314.1s27%
58Grok 4.2072.0%$0.00071.5s10%
59Gemini 3.1 Flash Lite (Preview)70.0%$0.0003979ms8%
60Qwen 3.8 27B (Reasoning, XHigh)84.0%$0.002918.3s27%
61Gemini 3.5 Flash (Reasoning, Minimal)74.0%$0.00181.2s12%
62Claude Sonnet 5.5 (Reasoning)80.0%$0.00392.9s20%
63GPT-6 Luna (Reasoning, Medium)70.0%$0.00013.8s8%
64Gemini 2.5 Flash Lite (Reasoning)70.0%$0.00032.7s8%
65GPT-6 Luna (Reasoning, High)70.0%$0.00014.3s8%
66DeepSeek V4 Flash (Reasoning)78.0%$0.000220.6s17%
67Kimi K3 (Reasoning, Low)80.0%$0.00337.5s20%
68Z.AI GLM 5.3 Flash (Reasoning, Max)74.0%$0.000213.0s12%
69Gemini 2.5 Flash Lite66.0%$0.0001610ms5%
70Z.AI GLM 5 Turbo78.0%$0.00307.7s17%
71Qwen 3.7 Max98.0%$0.01323.9s72%
72Hermes 3 70B68.0%$0.00026.0s7%
73ByteDance Seed 1.6 Flash66.0%$0.00024.5s5%
74GPT-5.4 (Reasoning)80.0%$0.00495.4s20%
75Xiaomi MIMO v2.5 Pro72.0%$0.00157.9s10%
76Xiaomi MIMO v2.570.0%$0.00136.2s8%
77Gemini 3 Flash (Preview, Reasoning)72.0%$0.00244.3s10%
78GPT-6 Sol70.0%$0.00213.3s8%
79Mistral Large 270.0%$0.00184.7s8%
80Cohere Command R+ (Aug. 2024)70.0%$0.00233.2s8%
81Qwen 3.5 122B88.0%$0.007317.5s35%
82DeepSeek V4 Flash62.0%$0.00013.7s3%
83Claude Haiku 5.5 (Reasoning, Max)73.7%$0.001615.2s12%
84Mistral Small 460.0%$0.00011.3s2%
85Gemini 3.5 Flash (Reasoning)86.0%$0.00874.2s31%
86ByteDance Seed 2.0 Lite76.0%$0.001820.6s15%
87GPT-5.6 Luna (Reasoning, Medium)66.0%$0.00163.0s5%
88GPT-5 Mini72.0%$0.001813.0s10%
89GPT-4o Mini (temp=0)60.0%$0.00013.7s2%
90GPT-5.6 Terra (Reasoning, Medium)70.0%$0.00312.2s8%
91Qwen 3.6 35B72.0%$0.002212.2s10%
92Thinking Machines Inkling (Reasoning)86.0%$0.003538.0s31%
93Qwen 3.5 35B82.0%$0.005117.7s23%
94 Kimi K3 (Reasoning, High)80.0%$0.005411.4s20%
95Grok 4.3 (Reasoning)80.0%$0.003820.2s20%
96Grok 4.360.0%$0.00081.7s2%
97Z.AI GLM 5.2 (Reasoning, High)74.0%$0.003310.5s12%
98GPT-6 Sol (Reasoning, Medium)68.0%$0.00263.9s7%
99Claude Opus 4.7 (Reasoning)82.0%$0.00801.8s23%
100Claude Opus 4.8 (Reasoning, Low)82.0%$0.00793.1s23%
101Aion 3.074.0%$0.003710.3s12%
102Z.AI GLM 4.7 Flash70.0%$0.000521.5s8%
103GPT-5.4 Mini (Reasoning)64.0%$0.00184.1s4%
104GPT-5.5 (Reasoning, Low)78.0%$0.00653.3s17%
105Xiaomi MIMO v2.6 Flash58.0%$0.00017.4s1%
106Claude Opus 4.780.0%$0.00802.2s20%
107Claude Opus 4.8 (Reasoning)80.0%$0.00793.2s20%
108Qwen 3.5 Flash70.0%$0.001222.0s8%
109DeepSeek V4.1 Flash (Reasoning, High)68.0%$0.001118.9s7%
110DeepSeek V4 Pro 0813 (Reasoning, High)80.0%$0.005419.2s20%
111Gemma 3 12B52.0%$0.00004.1s0%
112GPT-6.1 Sol (Reasoning, Medium)60.0%$0.00213.2s2%
113MiniMax M2.756.0%$0.00066.8s1%
114MiniMax M356.0%$0.00047.8s1%
115Qwen 3.6 Flash68.0%$0.003110.1s7%
116GPT-4o Mini (temp=1)60.0%$0.000115.0s2%
117Hermes 3 405B58.0%$0.000013.3s1%
118Z.AI GLM 5.182.0%$0.004533.2s23%
119DeepSeek V3.250.0%$0.00026.7s0%
120Claude Opus 4.570.0%$0.00552.9s8%
121Muse Glimmer 30B (Reasoning, Medium)54.0%$0.00078.3s0%
122Mistral Small 4 (Reasoning)48.0%$0.00044.2s0%
123Aion 2.066.0%$0.001520.9s5%
124GPT-5.4 Mini (Reasoning, Low)48.0%$0.00102.2s0%
125Cydonia 24B V4.144.0%$0.00013.6s0%
126Ministral 3 8B40.0%$0.00011.2s0%
127GPT-5.6 Sol68.0%$0.00582.1s7%
128Claude Haiku 5.5 (Adaptive)42.0%$0.00032.6s0%
129GPT-4.1 Nano40.0%$0.00012.0s0%
130Claude Haiku 5.5 (Reasoning, Low)40.0%$0.00021.7s0%
131GPT-5.4 Nano (Reasoning, Low)40.0%$0.00021.4s0%
132GPT-6 Luna40.0%$0.00012.3s0%
133GPT-5.254.0%$0.00252.1s0%
134MiniMax M2.548.0%$0.00067.7s0%
135Laguna XS 2.144.0%$0.00016.5s0%
136GPT-5.164.0%$0.00416.9s4%
137GPT-5.5 (Reasoning, Medium)76.0%$0.00834.6s15%
138GPT-5.4 (Reasoning, Low)58.0%$0.00343.2s1%
139Claude Haiku 5.5 (Reasoning, Medium)38.0%$0.00021.6s0%
140Grok 4.7 (Reasoning, High)66.0%$0.004210.5s5%
141GPT-5.6 Sol (Reasoning, Medium)68.0%$0.00632.7s7%
142GPT-5.6 Luna42.0%$0.00121.2s0%
143GPT-5.4 Mini40.0%$0.00091.1s0%
144Muse Spark 1.2 (Reasoning, Medium)60.0%$0.00395.0s2%
145Nemotron 3 Super42.0%$0.00009.8s0%
146Gemma 4 26B (Reasoning)60.0%$0.000327.8s2%
147WizardLM 2 8x22b42.0%$0.00047.6s0%
148o4 Mini60.0%$0.00368.6s2%
149Qwen 3.6 27B76.0%$0.005625.4s15%
150DeepSeek V4 Flash 0731 (Reasoning, High)58.0%$0.000227.3s1%
151Gemini 3.6 Flash (Reasoning, Minimal)40.0%$0.00161.1s0%
152Gemma 3 4B30.0%$0.00001.9s0%
153GPT-5.4 Nano30.0%$0.00021.4s0%
154Gemini 2.5 Flash (Reasoning)38.0%$0.00142.7s0%
155Muse Spark 1.1 (Reasoning, Minimal)46.0%$0.00273.3s0%
156ByteDance Seed 2.0 Mini64.0%$0.000737.7s4%
157Qwen 3.6 Max Preview96.0%$0.01446.9s61%
158GPT-5.560.0%$0.00582.3s2%
159Gemma 3 27B30.0%$0.00015.0s0%
160Claude Opus 5 (Reasoning, Low)74.0%$0.00964.6s12%
161Qwen 3.5 27B66.0%$0.004420.4s5%
162Inception Mercury 226.0%$0.0004823ms0%
163Z.AI GLM 4.5 Air36.0%$0.000511.1s0%
164Qwen 3.5 9B76.0%$0.00071.1m15%
165Qwen 3 32B50.0%$0.000624.6s0%
166GPT-5.4 Nano (Reasoning)24.0%$0.00031.5s0%
167Aion 3.0 Mini56.0%$0.001525.7s1%
168Muse Spark 1.1 (Reasoning, Medium)48.0%$0.00384.9s0%
169Mistral NeMO22.0%$0.00013.2s0%
170GPT-5 Nano44.0%$0.000721.1s0%
171Ministral 3 14B20.0%$0.00011.5s0%
172GPT-OSS 120B38.0%$0.000318.0s0%
173Laguna S 2.128.0%$0.000110.6s0%
174Mistral Medium 3.122.0%$0.00043.2s0%
175GPT-5.434.0%$0.00302.0s0%
176Qwen 2.5 72B20.0%$0.00024.9s0%
177Claude Opus 5 (Reasoning)68.0%$0.00944.5s7%
178Qwen 3.5 Plus (2026-04-20)64.0%$0.004229.1s4%
179Thinking Machines Inkling Small (Reasoning, High)50.0%$0.001726.4s0%
180Muse Spark 1.3 (Reasoning, Medium)58.0%$0.005613.8s1%
181Claude Opus 486.0%$0.0177.0s31%
182Ministral 3B10.0%$0.00001.1s0%
183Z.AI GLM 556.0%$0.003526.7s1%
184Nemotron 3 Nano22.0%$0.000213.0s0%
185Claude Opus 558.0%$0.00804.4s1%
186Ministral 8B8.0%$0.00011.5s0%
187Ministral 3 3B0.0%$0.0001835ms0%
188Arcee AI: Trinity Mini8.0%$0.00018.1s0%
189Z.AI GLM 4.654.0%$0.002539.8s0%
190Gemini 3.1 Pro (Preview)74.0%$0.01312.9s12%
191Kimi K2.550.0%$0.004030.8s0%
192Mistral Large 4.0 (Reasoning)52.0%$0.004432.9s0%
193DeepSeek V4 Pro (Reasoning)70.0%$0.00391.1m8%
194Qwen 3.5 397B A17B82.0%$0.00861.1m23%
195Z.AI GLM 4.760.0%$0.00271.1m2%
196GPT-558.0%$0.01119.2s1%
197o4 Mini High58.0%$0.005258.3s1%
198Gemini 2.5 Pro40.0%$0.0118.4s0%
199Kimi K2.650.0%$0.00661.1m0%
200Hy4 Preview (Reasoning, High)78.0%$0.0161.6m17%
66.60%

Individual Scenarios

Model # 1 # 2 # 3 # 4 # 5 # 6 # 7 # 8 # 9 # 10 Avg ▼
Gemini 3.8 Flash (Reasoning, Medium)100100100100100100100100100100100.0%
Claude Opus 4.6 (Reasoning)100100100100100100100100100100100.0%
Gemini 3.6 Flash (Reasoning)100100100100100100100100100100100.0%
Gemini 3.7 Flash (Reasoning, Medium)100100100100100100100100100100100.0%
Qwen 3.7 Max100100100100100100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100100100100100100.0%
Claude Sonnet 4.6 (Reasoning)100100100100100100100100100100100.0%
Gemini 3.5 Flash (Reasoning)100100100100100100100100100100100.0%
Claude Opus 4.7 (Reasoning)100100100100100100100100100100100.0%
Claude Opus 4.8 (Reasoning)100100100100100100100100100100100.0%
Claude Opus 4.6100100100100100100100100100100100.0%
Claude Opus 4.8 (Reasoning, Low)100100100100100100100100100100100.0%
Claude Sonnet 4.6100100100100100100100100100100100.0%
Claude Opus 4.7100100100100100100100100100100100.0%
Claude Sonnet 4100100100100100100100100100100100.0%
Claude Sonnet 4.5100100100100100100100100100100100.0%
Claude Opus 4100100100100100100100100100100100.0%
Qwen 3.5 Plus (2026-02-15)100100100100100100100100100100100.0%
Gemini 3.5 Flash (Reasoning, Minimal)100100100100100100100100100100100.0%
Gemini 3 Flash (Preview)100100100100100100100100100100100.0%
Mistral Medium 3.5 (Reasoning)100100100100100100100100100100100.0%
Gemma 4 31B100100100100100100100100100100100.0%
Gemma 4 26B100100100100100100100100100100100.0%
Mistral Large 4.0100100100100100100100100100100100.0%
Mistral Medium 3.5100100100100100100100100100100100.0%
ByteDance Seed 2.0 Lite100100100100100100100100100100100.0%
Claude Haiku 4.5100100100100100100100100100100100.0%
Mistral Large 2100100100100100100100100100100100.0%
Gemini 2.5 Flash100100100100100100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100100100100090.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100100100100090.0%
Qwen 3.5 122B100100100100100100100100100090.0%
Gemma 4 26B (Reasoning)100100100100100100100100100090.0%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100100100100100100100090.0%
Claude Sonnet 5100100100100100100100100100090.0%
GPT-4.1100100100100100100100100100090.0%
Xiaomi MIMO v2.5 Pro100100100100100100100100100090.0%
Gemini 2.5 Flash Lite (Reasoning)100100100100100100100100100090.0%
GPT-4.1 Mini100100100100100100100100100090.0%
Claude Opus 5.5 (Reasoning)1001001001001001001001000080.0%
Qwen 3.8 Max (Reasoning, XHigh)1001001001001001001001000080.0%
Qwen 3.8 Flash (Reasoning)1001001001001001001001000080.0%
Grok 4.6 (Reasoning, High)1001001001001001001001000080.0%
Claude Sonnet 5 (Reasoning)1001001001001001001001000080.0%
Claude Sonnet 5 (Reasoning, Low)1001001001001001001001000080.0%
Gemini 3 Flash (Preview, Reasoning)1001001001001001001001000080.0%
Gemma 4 31B (Reasoning)1001001001001001001001000080.0%
ByteDance Seed 1.61001001001001001001001000080.0%
DeepSeek V3.21001001001001001001001000080.0%
Thinking Machines Inkling1001001001001001001001000080.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)10010010010010010010000070.0%
Z.AI GLM 5.110010010010010010010000070.0%
Aion 3.5 Mini (Reasoning, High)10010010010010010010000070.0%
Kimi K3 (Reasoning, Low)10010010010010010010000070.0%
Aion 3.5 (Reasoning, High)10010010010010010010000070.0%
Xiaomi MIMO v2.6 Pro10010010010010010010000070.0%
Grok 4.5 (Reasoning, Low)10010010010010010010000070.0%
DeepSeek V4 Pro 0813 (Reasoning, High)10010010010010010010000070.0%
Aion 2.010010010010010010010000070.0%
GPT-5.6 Luna10010010010010010010000070.0%
DeepSeek V3.110010010010010010010000070.0%
Z.AI GLM 5.3 (Reasoning, Max)100100100100100100000060.0%
Hy4 Preview (Reasoning, High)100100100100100100000060.0%
Z.AI GLM 5 Turbo100100100100100100000060.0%
Qwen 3.5 397B A17B100100100100100100000060.0%
Grok 4.20 (Reasoning)100100100100100100000060.0%
Z.AI GLM 5100100100100100100000060.0%
Gemini 2.5 Flash (Reasoning)100100100100100100000060.0%
GPT-4o, Aug. 6th (temp=0)100100100100100100000060.0%
GPT-5.4 (Reasoning)1001001001001000000050.0%
Z.AI GLM 5.2 (Reasoning, High)1001001001001000000050.0%
Kimi K3 (Reasoning, High)1001001001001000000050.0%
Grok 4.3 (Reasoning)1001001001001000000050.0%
GPT-6 Sol1001001001001000000050.0%
Qwen 3.5 27B1001001001001000000050.0%
Claude Opus 4.51001001001001000000050.0%
Z.AI GLM 4.61001001001001000000050.0%
Xiaomi MIMO v2.51001001001001000000050.0%
DeepSeek V3 (2024-12-26)1001001001001000000050.0%
DeepSeek V4 Pro1001001001001000000050.0%
DeepSeek V3 (2025-03-24)1001001001001000000050.0%
Gemma 3 12B1001001001001000000050.0%
Grok 4.7 (Reasoning, High)10010010010000000040.0%
Thinking Machines Inkling (Reasoning)10010010010000000040.0%
DeepSeek V4 Pro (Reasoning)10010010010000000040.0%
Aion 3.010010010010000000040.0%
Gemini 2.5 Pro10010010010000000040.0%
Z.AI GLM 4.710010010010000000040.0%
Qwen 3.6 35B10010010010000000040.0%
Qwen 3.5 9B10010010010000000040.0%
Claude Haiku 5.5 (Reasoning, Max)10000 – – – – – – – 33.3%
GPT-6 Sol (Reasoning, Medium)100100100000000030.0%
Qwen 3.7 Flash (Reasoning)100100100000000030.0%
Qwen 3.6 27B100100100000000030.0%
DeepSeek V4 Flash (Reasoning)100100100000000030.0%
Qwen 3.5 35B100100100000000030.0%
MiniMax M2.5100100100000000030.0%
Gemini 3.1 Flash Lite (Preview)100100100000000030.0%
Gemini 3.1 Flash Lite100100100000000030.0%
Z.AI GLM 4.7 Flash100100100000000030.0%
GPT-4o, Aug. 6th (temp=1)100100100000000030.0%
Grok 4.3100100100000000030.0%
DeepSeek V4.1 Flash (Reasoning, High)1001000000000020.0%
Kimi K2.61001000000000020.0%
GPT-5.4 (Reasoning, Low)1001000000000020.0%
GPT-5.11001000000000020.0%
Qwen 3.5 Plus (2026-04-20)1001000000000020.0%
DeepSeek V4 Flash 0731 (Reasoning, High)1001000000000020.0%
ByteDance Seed 2.0 Mini1001000000000020.0%
Qwen 3.5 Flash1001000000000020.0%
Qwen 3 235B A22B Instruct 25071001000000000020.0%
ByteDance Seed 1.6 Flash1001000000000020.0%
Cohere Command R+ (Aug. 2024)1001000000000020.0%
GPT-5.5 (Reasoning, Medium)10000000000010.0%
Claude Opus 5 (Reasoning, Low)10000000000010.0%
Claude Opus 5 (Reasoning)10000000000010.0%
Kimi K2.510000000000010.0%
GPT-5.4 Mini (Reasoning)10000000000010.0%
GPT-5.210000000000010.0%
Qwen 3.6 Flash10000000000010.0%
Xiaomi MIMO v2.6 Flash10000000000010.0%
MiniMax M2.710000000000010.0%
Gemini 3.1 Flash Lite (Reasoning)10000000000010.0%
Z.AI GLM 4.510000000000010.0%
GPT-6 Luna10000000000010.0%
Aion 3.0 Mini10000000000010.0%
Gemini 2.5 Flash Lite10000000000010.0%
Cydonia 24B V4.110000000000010.0%
GPT-6.1 Sol (Reasoning, Medium)00000000000.0%
GPT-5.6 Sol (Reasoning, Medium)00000000000.0%
Muse Spark 1.2 (Reasoning, Medium)00000000000.0%
Muse Spark 1.3 (Reasoning, Medium)00000000000.0%
GPT-6 Luna (Reasoning, High)00000000000.0%
Muse Spark 1.1 (Reasoning, Medium)00000000000.0%
Claude Sonnet 5.5 (Reasoning)00000000000.0%
GPT-5.5 (Reasoning, Low)00000000000.0%
GPT-5.6 Terra (Reasoning, Medium)00000000000.0%
GPT-6 Luna (Reasoning, Medium)00000000000.0%
Mistral Large 4.0 (Reasoning)00000000000.0%
GPT-500000000000.0%
Muse Spark 1.1 (Reasoning, Minimal)00000000000.0%
GPT-5 Mini00000000000.0%
GPT-5.6 Sol00000000000.0%
GPT-5.6 Luna (Reasoning, Medium)00000000000.0%
MiniMax M300000000000.0%
Claude Opus 500000000000.0%
Claude Haiku 5.5 (Adaptive)00000000000.0%
GPT-5.500000000000.0%
Muse Glimmer 30B (Reasoning, Medium)00000000000.0%
o4 Mini High00000000000.0%
GPT-5.6 Terra00000000000.0%
Claude Haiku 5.5 (Reasoning, Low)0000 – – – – – – 0.0%
Thinking Machines Inkling Small (Reasoning, High)00000000000.0%
Gemini 3.6 Flash (Reasoning, Minimal)00000000000.0%
o4 Mini00000000000.0%
GPT-OSS 120B00000000000.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)00000000000.0%
Gemini 3.5 Flash Lite (Reasoning)00000000000.0%
GPT-5.400000000000.0%
Mistral Large 300000000000.0%
Claude Haiku 5.5 (Reasoning, Medium)00000000000.0%
DeepSeek-V2 Chat00000000000.0%
GPT-5.4 Mini (Reasoning, Low)00000000000.0%
DeepSeek V4 Flash00000000000.0%
Inception Mercury 200000000000.0%
Nemotron 3 Super00000000000.0%
Grok 4.2000000000000.0%
Hermes 3 405B00000000000.0%
Z.AI GLM 4.5 Air00000000000.0%
GPT-5.4 Mini00000000000.0%
GPT-5 Nano00000000000.0%
GPT-5.4 Nano (Reasoning)00000000000.0%
Laguna S 2.100000000000.0%
Mistral Small 4 (Reasoning)00000000000.0%
Qwen 3 32B00000000000.0%
Writer: Palmyra X500000000000.0%
GPT-4o Mini (temp=1)00000000000.0%
GPT-5.4 Nano (Reasoning, Low)00000000000.0%
Llama 3.1 70B00000000000.0%
Mistral Small 3.2 24B00000000000.0%
GPT-4o Mini (temp=0)00000000000.0%
Mistral Medium 3.100000000000.0%
Gemma 3 27B00000000000.0%
Laguna XS 2.100000000000.0%
Mistral Small 400000000000.0%
Nemotron 3 Nano00000000000.0%
Qwen 2.5 72B00000000000.0%
GPT-5.4 Nano00000000000.0%
WizardLM 2 8x22b00000000000.0%
Ministral 3 14B00000000000.0%
Ministral 3 8B00000000000.0%
GPT-4.1 Nano00000000000.0%
Hermes 3 70B00000000000.0%
Arcee AI: Trinity Mini00000000000.0%
Gemma 3 4B00000000000.0%
Ministral 3 3B00000000000.0%
Mistral NeMO00000000000.0%
Ministral 8B00000000000.0%
Ministral 3B00000000000.0%
Model # 1 # 2 # 3 # 4 # 5 # 6 # 7 # 8 # 9 # 10 Avg ▼
Claude Opus 5.5 (Reasoning)100100100100100100100100100100100.0%
Claude Opus 4.6 (Reasoning)100100100100100100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100100100100100100.0%
Claude Sonnet 4.6 (Reasoning)100100100100100100100100100100100.0%
Claude Sonnet 5.5 (Reasoning)100100100100100100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100100100100100100.0%
Claude Opus 4.8 (Reasoning)100100100100100100100100100100100.0%
Claude Opus 4.6100100100100100100100100100100100.0%
Claude Opus 4.8 (Reasoning, Low)100100100100100100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100100100100100100.0%
Claude Sonnet 4.6100100100100100100100100100100100.0%
GPT-5.6 Terra100100100100100100100100100100100.0%
Claude Sonnet 4100100100100100100100100100100100.0%
Claude Sonnet 5100100100100100100100100100100100.0%
Claude Opus 4100100100100100100100100100100100.0%
Qwen 3.5 Plus (2026-02-15)100100100100100100100100100100100.0%
Gemini 3.1 Flash Lite (Preview)100100100100100100100100100100100.0%
Mistral Medium 3.5 (Reasoning)100100100100100100100100100100100.0%
Gemma 4 31B100100100100100100100100100100100.0%
Z.AI GLM 4.5100100100100100100100100100100100.0%
Gemma 4 26B100100100100100100100100100100100.0%
Mistral Medium 3.5100100100100100100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100100100100100100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning)100100100100100100100100100100100.0%
Mistral Large 3100100100100100100100100100100100.0%
DeepSeek-V2 Chat100100100100100100100100100100100.0%
DeepSeek V3 (2024-12-26)100100100100100100100100100100100.0%
GPT-4o, Aug. 6th (temp=0)100100100100100100100100100100100.0%
DeepSeek V4 Flash100100100100100100100100100100100.0%
GPT-4o, Aug. 6th (temp=1)100100100100100100100100100100100.0%
Grok 4.20100100100100100100100100100100100.0%
Hermes 3 405B100100100100100100100100100100100.0%
Writer: Palmyra X5100100100100100100100100100100100.0%
GPT-4o Mini (temp=1)100100100100100100100100100100100.0%
GPT-4o Mini (temp=0)100100100100100100100100100100100.0%
Thinking Machines Inkling100100100100100100100100100100100.0%
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100100100100090.0%
Qwen 3.7 Max100100100100100100100100100090.0%
Z.AI GLM 5.1100100100100100100100100100090.0%
Qwen 3.6 Max Preview100100100100100100100100100090.0%
Z.AI GLM 5.2 (Reasoning, High)100100100100100100100100100090.0%
Grok 4.5 (Reasoning, Low)100100100100100100100100100090.0%
Thinking Machines Inkling (Reasoning)100100100100100100100100100090.0%
Gemma 4 31B (Reasoning)100100100100100100100100100090.0%
ByteDance Seed 1.6100100100100100100100100100090.0%
Qwen 3.7 Flash (Reasoning)100100100100100100100100100090.0%
GPT-4.1100100100100100100100100100090.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100100100100100100090.0%
Gemini 3.1 Flash Lite100100100100100100100100100090.0%
ByteDance Seed 2.0 Lite100100100100100100100100100090.0%
DeepSeek V3.1100100100100100100100100100090.0%
GPT-4.1 Mini100100100100100100100100100090.0%
DeepSeek V3 (2025-03-24)100100100100100100100100100090.0%
Gemini 2.5 Flash Lite100100100100100100100100100090.0%
Qwen 3 235B A22B Instruct 2507100100100100100100100100100090.0%
Mistral Small 4100100100100100100100100100090.0%
Gemini 3.7 Flash (Reasoning, Medium)1001001001001001001001000080.0%
Hy4 Preview (Reasoning, High)1001001001001001001001000080.0%
Qwen 3.8 27B (Reasoning, XHigh)1001001001001001001001000080.0%
Grok 4.6 (Reasoning, High)1001001001001001001001000080.0%
Aion 3.5 (Reasoning, High)1001001001001001001001000080.0%
GPT-5.6 Luna (Reasoning, Medium)1001001001001001001001000080.0%
Claude Sonnet 5 (Reasoning, Low)1001001001001001001001000080.0%
Qwen 3.6 Flash1001001001001001001001000080.0%
Aion 3.01001001001001001001001000080.0%
Qwen 3.6 27B1001001001001001001001000080.0%
Claude Sonnet 4.51001001001001001001001000080.0%
Qwen 3.5 35B1001001001001001001001000080.0%
Qwen 3.5 9B1001001001001001001001000080.0%
DeepSeek V4 Pro1001001001001001001001000080.0%
Cohere Command R+ (Aug. 2024)1001001001001001001001000080.0%
Gemini 3.8 Flash (Reasoning, Medium)10010010010010010010000070.0%
Z.AI GLM 5.3 (Reasoning, Max)10010010010010010010000070.0%
Gemini 3.6 Flash (Reasoning)10010010010010010010000070.0%
GPT-5.5 (Reasoning, Medium)10010010010010010010000070.0%
GPT-5 Mini10010010010010010010000070.0%
Claude Sonnet 5 (Reasoning)10010010010010010010000070.0%
DeepSeek V4 Flash (Reasoning)10010010010010010010000070.0%
DeepSeek V4 Flash 0731 (Reasoning, High)10010010010010010010000070.0%
Qwen 3.5 Flash10010010010010010010000070.0%
Z.AI GLM 4.7 Flash10010010010010010010000070.0%
Mistral Large 210010010010010010010000070.0%
Grok 4.310010010010010010010000070.0%
Llama 3.1 70B10010010010010010010000070.0%
ByteDance Seed 1.6 Flash10010010010010010010000070.0%
Claude Opus 5 (Reasoning, Low)100100100100100100000060.0%
Qwen 3.5 122B100100100100100100000060.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100000060.0%
Qwen 3.6 35B100100100100100100000060.0%
Aion 2.0100100100100100100000060.0%
MiniMax M2.7100100100100100100000060.0%
Xiaomi MIMO v2.5 Pro100100100100100100000060.0%
ByteDance Seed 2.0 Mini100100100100100100000060.0%
Mistral Large 4.0100100100100100100000060.0%
Xiaomi MIMO v2.5100100100100100100000060.0%
Gemini 2.5 Flash100100100100100100000060.0%
Mistral Small 3.2 24B100100100100100100000060.0%
Hermes 3 70B100100100100100100000060.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)1001001001001000000050.0%
Gemini 3.1 Pro (Preview)1001001001001000000050.0%
GPT-6 Luna (Reasoning, High)1001001001001000000050.0%
GPT-5.4 (Reasoning)1001001001001000000050.0%
Gemini 3.5 Flash (Reasoning)1001001001001000000050.0%
Kimi K3 (Reasoning, High)1001001001001000000050.0%
GPT-5.6 Terra (Reasoning, Medium)1001001001001000000050.0%
GPT-6 Luna (Reasoning, Medium)1001001001001000000050.0%
Aion 3.5 Mini (Reasoning, High)1001001001001000000050.0%
Kimi K3 (Reasoning, Low)1001001001001000000050.0%
Xiaomi MIMO v2.6 Pro1001001001001000000050.0%
Qwen 3.5 397B A17B1001001001001000000050.0%
Grok 4.3 (Reasoning)1001001001001000000050.0%
Qwen 3.5 27B1001001001001000000050.0%
MiniMax M2.51001001001001000000050.0%
DeepSeek V3.21001001001001000000050.0%
Qwen 3 32B1001001001001000000050.0%
GPT-5.6 Sol (Reasoning, Medium)10010010010000000040.0%
Qwen 3.8 Flash (Reasoning)10010010010000000040.0%
Mistral Large 4.0 (Reasoning)10010010010000000040.0%
GPT-5.6 Sol10010010010000000040.0%
DeepSeek V4 Pro 0813 (Reasoning, High)10010010010000000040.0%
GPT-5.210010010010000000040.0%
GPT-5.510010010010000000040.0%
Gemini 2.5 Flash Lite (Reasoning)10010010010000000040.0%
Laguna XS 2.110010010010000000040.0%
Gemma 3 4B10010010010000000040.0%
DeepSeek V4.1 Flash (Reasoning, High)100100100000000030.0%
Z.AI GLM 5 Turbo100100100000000030.0%
Claude Opus 5 (Reasoning)100100100000000030.0%
Gemini 3 Flash (Preview, Reasoning)100100100000000030.0%
Muse Glimmer 30B (Reasoning, Medium)100100100000000030.0%
Z.AI GLM 4.6100100100000000030.0%
Xiaomi MIMO v2.6 Flash100100100000000030.0%
Gemini 3 Flash (Preview)100100100000000030.0%
Mistral Small 4 (Reasoning)100100100000000030.0%
MiniMax M31001000000000020.0%
GPT-5.4 Mini (Reasoning)1001000000000020.0%
Z.AI GLM 51001000000000020.0%
DeepSeek V4 Pro (Reasoning)1001000000000020.0%
Gemma 4 26B (Reasoning)1001000000000020.0%
o4 Mini High1001000000000020.0%
Z.AI GLM 5.3 Flash (Reasoning, Low)1001000000000020.0%
Gemini 2.5 Pro1001000000000020.0%
Z.AI GLM 4.71001000000000020.0%
o4 Mini1001000000000020.0%
Gemini 3.5 Flash (Reasoning, Minimal)1001000000000020.0%
GPT-5.6 Luna1001000000000020.0%
GPT-6 Luna1001000000000020.0%
Aion 3.0 Mini1001000000000020.0%
GPT-5.4 Mini (Reasoning, Low)1001000000000020.0%
Laguna S 2.11001000000000020.0%
Gemma 3 27B1001000000000020.0%
Ministral 3B1001000000000020.0%
Muse Spark 1.2 (Reasoning, Medium)10000000000010.0%
GPT-6 Sol (Reasoning, Medium)10000000000010.0%
Claude Opus 4.7 (Reasoning)10000000000010.0%
Claude Haiku 5.5 (Adaptive)10000000000010.0%
Gemini 3.6 Flash (Reasoning, Minimal)10000000000010.0%
Gemini 2.5 Flash (Reasoning)10000000000010.0%
Claude Haiku 4.510000000000010.0%
Nemotron 3 Super10000000000010.0%
Cydonia 24B V4.110000000000010.0%
GPT-5.4 Nano10000000000010.0%
WizardLM 2 8x22b10000000000010.0%
Arcee AI: Trinity Mini10000000000010.0%
Ministral 8B10000000000010.0%
Claude Haiku 5.5 (Reasoning, Max)00 – – – – – – – – 0.0%
GPT-6.1 Sol (Reasoning, Medium)00000000000.0%
Muse Spark 1.3 (Reasoning, Medium)00000000000.0%
Muse Spark 1.1 (Reasoning, Medium)00000000000.0%
Grok 4.7 (Reasoning, High)00000000000.0%
Kimi K2.600000000000.0%
GPT-500000000000.0%
Muse Spark 1.1 (Reasoning, Minimal)00000000000.0%
GPT-5.4 (Reasoning, Low)00000000000.0%
Kimi K2.500000000000.0%
GPT-5.100000000000.0%
GPT-6 Sol00000000000.0%
Claude Opus 500000000000.0%
Claude Opus 4.700000000000.0%
Claude Opus 4.500000000000.0%
Claude Haiku 5.5 (Reasoning, Low)0000 – – – – – – 0.0%
Thinking Machines Inkling Small (Reasoning, High)00000000000.0%
GPT-OSS 120B00000000000.0%
GPT-5.400000000000.0%
Claude Haiku 5.5 (Reasoning, Medium)00000000000.0%
Inception Mercury 200000000000.0%
Z.AI GLM 4.5 Air00000000000.0%
GPT-5.4 Mini00000000000.0%
GPT-5 Nano00000000000.0%
GPT-5.4 Nano (Reasoning)00000000000.0%
GPT-5.4 Nano (Reasoning, Low)00000000000.0%
Mistral Medium 3.100000000000.0%
Gemma 3 12B00000000000.0%
Nemotron 3 Nano00000000000.0%
Qwen 2.5 72B00000000000.0%
Ministral 3 14B00000000000.0%
Ministral 3 8B00000000000.0%
GPT-4.1 Nano00000000000.0%
Ministral 3 3B00000000000.0%
Mistral NeMO00000000000.0%
Model # 1 # 2 # 3 # 4 # 5 # 6 # 7 # 8 # 9 # 10 Avg ▼
Claude Opus 5.5 (Reasoning)100100100100100100100100100100100.0%
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100100100100100100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100100100100100100.0%
Z.AI GLM 5.3 (Reasoning, Max)100100100100100100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100100100100100100.0%
Claude Opus 4.6 (Reasoning)100100100100100100100100100100100.0%
Gemini 3.6 Flash (Reasoning)100100100100100100100100100100100.0%
Qwen 3.7 Max100100100100100100100100100100100.0%
DeepSeek V4.1 Flash (Reasoning, High)100100100100100100100100100100100.0%
Qwen 3.8 Flash (Reasoning)100100100100100100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100100100100100100.0%
GPT-6 Luna (Reasoning, High)100100100100100100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100100100100100100.0%
GPT-5.5 (Reasoning, Medium)100100100100100100100100100100100.0%
Z.AI GLM 5 Turbo100100100100100100100100100100100.0%
Kimi K3 (Reasoning, High)100100100100100100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100100100100100100.0%
Claude Sonnet 5.5 (Reasoning)100100100100100100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100100100100100100.0%
Grok 4.7 (Reasoning, High)100100100100100100100100100100100.0%
Claude Opus 4.7 (Reasoning)100100100100100100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100100100100100100.0%
GPT-5.6 Terra (Reasoning, Medium)100100100100100100100100100100100.0%
GPT-6 Luna (Reasoning, Medium)100100100100100100100100100100100.0%
Aion 3.5 Mini (Reasoning, High)100100100100100100100100100100100.0%
Claude Opus 4.6100100100100100100100100100100100.0%
Claude Opus 5 (Reasoning, Low)100100100100100100100100100100100.0%
Claude Opus 4.8 (Reasoning, Low)100100100100100100100100100100100.0%
GPT-5100100100100100100100100100100100.0%
GPT-5 Mini100100100100100100100100100100100.0%
Claude Opus 5 (Reasoning)100100100100100100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100100100100100100.0%
Thinking Machines Inkling (Reasoning)100100100100100100100100100100100.0%
GPT-5.6 Sol100100100100100100100100100100100.0%
GPT-5.1100100100100100100100100100100100.0%
Claude Sonnet 4.6100100100100100100100100100100100.0%
Claude Sonnet 5 (Reasoning)100100100100100100100100100100100.0%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100100100100100100100100100.0%
Claude Sonnet 5 (Reasoning, Low)100100100100100100100100100100100.0%
GPT-6 Sol100100100100100100100100100100100.0%
Claude Opus 5100100100100100100100100100100100.0%
Claude Opus 4.7100100100100100100100100100100100.0%
Claude Opus 4.5100100100100100100100100100100100.0%
ByteDance Seed 1.6100100100100100100100100100100100.0%
GPT-5.5100100100100100100100100100100100.0%
DeepSeek V4 Pro (Reasoning)100100100100100100100100100100100.0%
o4 Mini High100100100100100100100100100100100.0%
Qwen 3.7 Flash (Reasoning)100100100100100100100100100100100.0%
Qwen 3.6 27B100100100100100100100100100100100.0%
GPT-5.6 Terra100100100100100100100100100100100.0%
DeepSeek V4 Flash (Reasoning)100100100100100100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Low)100100100 – – – – – – – 100.0%
Claude Sonnet 4100100100100100100100100100100100.0%
Claude Sonnet 4.5100100100100100100100100100100100.0%
Claude Sonnet 5100100100100100100100100100100100.0%
Claude Opus 4100100100100100100100100100100100.0%
Qwen 3.5 35B100100100100100100100100100100100.0%
GPT-4.1100100100100100100100100100100100.0%
o4 Mini100100100100100100100100100100100.0%
ByteDance Seed 2.0 Mini100100100100100100100100100100100.0%
Mistral Medium 3.5 (Reasoning)100100100100100100100100100100100.0%
Gemma 4 31B100100100100100100100100100100100.0%
Z.AI GLM 4.5100100100100100100100100100100100.0%
Mistral Large 4.0100100100100100100100100100100100.0%
Mistral Medium 3.5100100100100100100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100100100100100100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning)100100100100100100100100100100100.0%
Mistral Large 3100100100100100100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Medium)100100100100100100100100100100100.0%
DeepSeek-V2 Chat100100100100100100100100100100100.0%
Claude Haiku 4.5100100100100100100100100100100100.0%
GPT-4o, Aug. 6th (temp=0)100100100100100100100100100100100.0%
DeepSeek V4 Flash100100100100100100100100100100100.0%
GPT-4.1 Mini100100100100100100100100100100100.0%
GPT-4o, Aug. 6th (temp=1)100100100100100100100100100100100.0%
Grok 4.20100100100100100100100100100100100.0%
Gemini 2.5 Flash100100100100100100100100100100100.0%
GPT-5.4 Mini100100100100100100100100100100100.0%
DeepSeek V3 (2025-03-24)100100100100100100100100100100100.0%
Writer: Palmyra X5100100100100100100100100100100100.0%
Qwen 3 235B A22B Instruct 2507100100100100100100100100100100100.0%
GPT-4o Mini (temp=1)100100100100100100100100100100100.0%
Mistral Small 3.2 24B100100100100100100100100100100100.0%
GPT-4o Mini (temp=0)100100100100100100100100100100100.0%
Gemma 3 12B100100100100100100100100100100100.0%
Mistral Small 4100100100100100100100100100100100.0%
WizardLM 2 8x22b100100100100100100100100100100100.0%
Ministral 3 8B100100100100100100100100100100100.0%
GPT-4.1 Nano100100100100100100100100100100100.0%
Hermes 3 70B100100100100100100100100100100100.0%
Hy4 Preview (Reasoning, High)100100100100100100100100100090.0%
Muse Spark 1.2 (Reasoning, Medium)100100100100100100100100100090.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100100100100090.0%
Claude Sonnet 4.6 (Reasoning)100100100100100100100100100090.0%
Claude Opus 4.8 (Reasoning)100100100100100100100100100090.0%
Kimi K3 (Reasoning, Low)100100100100100100100100100090.0%
Aion 3.5 (Reasoning, High)100100100100100100100100100090.0%
GPT-5.6 Luna (Reasoning, Medium)100100100100100100100100100090.0%
Qwen 3.5 122B100100100100100100100100100090.0%
Gemini 3 Flash (Preview, Reasoning)100100100100100100100100100090.0%
GPT-5.4 Mini (Reasoning)100100100100100100100100100090.0%
Gemma 4 31B (Reasoning)100100100100100100100100100090.0%
Qwen 3.6 35B100100100100100100100100100090.0%
Qwen 3.5 Plus (2026-02-15)100100100100100100100100100090.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100100100100100100090.0%
Qwen 3.5 9B100100100100100100100100100090.0%
Xiaomi MIMO v2.5100100100100100100100100100090.0%
GPT-5.4 Mini (Reasoning, Low)100100100100100100100100100090.0%
DeepSeek V3.1100100100100100100100100100090.0%
DeepSeek V4 Pro100100100100100100100100100090.0%
Hermes 3 405B100100100100100100100100100090.0%
Gemini 2.5 Flash Lite100100100100100100100100100090.0%
Grok 4.3100100100100100100100100100090.0%
Llama 3.1 70B100100100100100100100100100090.0%
Laguna XS 2.1100100100100100100100100100090.0%
Thinking Machines Inkling100100100100100100100100100090.0%
Cydonia 24B V4.1100100100100100100100100100090.0%
ByteDance Seed 1.6 Flash100100100100100100100100100090.0%
Cohere Command R+ (Aug. 2024)100100100100100100100100100090.0%
Z.AI GLM 5.11001001001001001001001000080.0%
Gemini 3.5 Flash (Reasoning)1001001001001001001001000080.0%
MiniMax M31001001001001001001001000080.0%
GPT-5.21001001001001001001001000080.0%
Claude Haiku 5.5 (Adaptive)1001001001001001001001000080.0%
Z.AI GLM 5.3 Flash (Reasoning, Low)1001001001001001001001000080.0%
Gemini 3.1 Flash Lite1001001001001001001001000080.0%
GPT-5.41001001001001001001001000080.0%
Aion 3.0 Mini1001001001001001001001000080.0%
Mistral Large 21001001001001001001001000080.0%
Claude Haiku 5.5 (Reasoning, Max)1001001000 – – – – – – 75.0%
Gemini 3.8 Flash (Reasoning, Medium)10010010010010010010000070.0%
Gemini 3.7 Flash (Reasoning, Medium)10010010010010010010000070.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)10010010010010010010000070.0%
Z.AI GLM 5.2 (Reasoning, High)10010010010010010010000070.0%
GPT-5.4 (Reasoning, Low)10010010010010010010000070.0%
Qwen 3.5 Plus (2026-04-20)10010010010010010010000070.0%
Aion 3.010010010010010010010000070.0%
Thinking Machines Inkling Small (Reasoning, High)10010010010010010010000070.0%
Xiaomi MIMO v2.6 Flash10010010010010010010000070.0%
Qwen 3.5 Flash10010010010010010010000070.0%
Gemini 3 Flash (Preview)10010010010010010010000070.0%
Gemini 3.1 Flash Lite (Preview)10010010010010010010000070.0%
GPT-6 Luna10010010010010010010000070.0%
DeepSeek V3 (2024-12-26)10010010010010010010000070.0%
Z.AI GLM 4.5 Air10010010010010010010000070.0%
Laguna S 2.110010010010010010010000070.0%
Qwen 3 32B10010010010010010010000070.0%
GPT-5.4 Nano (Reasoning, Low)10010010010010010010000070.0%
Xiaomi MIMO v2.6 Pro100100100100100100000060.0%
Kimi K2.5100100100100100100000060.0%
Qwen 3.6 Flash100100100100100100000060.0%
DeepSeek V4 Flash 0731 (Reasoning, High)100100100100100100000060.0%
ByteDance Seed 2.0 Lite100100100100100100000060.0%
Z.AI GLM 4.7 Flash100100100100100100000060.0%
Mistral Small 4 (Reasoning)100100100100100100000060.0%
Gemini 3.1 Pro (Preview)1001001001001000000050.0%
Muse Spark 1.1 (Reasoning, Medium)1001001001001000000050.0%
Mistral Large 4.0 (Reasoning)1001001001001000000050.0%
Muse Glimmer 30B (Reasoning, Medium)1001001001001000000050.0%
Z.AI GLM 4.71001001001001000000050.0%
MiniMax M2.51001001001001000000050.0%
Aion 2.01001001001001000000050.0%
Xiaomi MIMO v2.5 Pro1001001001001000000050.0%
Gemini 3.5 Flash (Reasoning, Minimal)1001001001001000000050.0%
Gemma 4 26B1001001001001000000050.0%
GPT-OSS 120B1001001001001000000050.0%
DeepSeek V3.21001001001001000000050.0%
Nemotron 3 Super1001001001001000000050.0%
Kimi K2.610010010010000000040.0%
Qwen 3.5 27B10010010010000000040.0%
GPT-5 Nano10010010010000000040.0%
GPT-5.4 Nano (Reasoning)10010010010000000040.0%
Mistral NeMO10010010010000000040.0%
Muse Spark 1.1 (Reasoning, Minimal)100100100000000030.0%
Z.AI GLM 5100100100000000030.0%
Gemma 4 26B (Reasoning)100100100000000030.0%
Z.AI GLM 4.6100100100000000030.0%
Gemini 2.5 Flash Lite (Reasoning)100100100000000030.0%
MiniMax M2.71001000000000020.0%
GPT-5.6 Luna1001000000000020.0%
Mistral Medium 3.11001000000000020.0%
Ministral 3B1001000000000020.0%
Gemini 2.5 Pro10000000000010.0%
Gemini 3.6 Flash (Reasoning, Minimal)10000000000010.0%
Inception Mercury 210000000000010.0%
Nemotron 3 Nano10000000000010.0%
GPT-5.4 Nano10000000000010.0%
Gemma 3 4B10000000000010.0%
Gemini 2.5 Flash (Reasoning)00000000000.0%
Gemma 3 27B00000000000.0%
Qwen 2.5 72B00000000000.0%
Ministral 3 14B00000000000.0%
Arcee AI: Trinity Mini00000000000.0%
Ministral 3 3B00000000000.0%
Ministral 8B00000000000.0%
Model # 1 # 2 # 3 # 4 # 5 # 6 # 7 # 8 # 9 # 10 Avg ▼
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Max)100100100100100 – – – – – 100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100100100100100100.0%
Z.AI GLM 5.3 (Reasoning, Max)100100100100100100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100100100100100100.0%
Claude Opus 4.6 (Reasoning)100100100100100100100100100100100.0%
Muse Spark 1.2 (Reasoning, Medium)100100100100100100100100100100100.0%
Qwen 3.7 Max100100100100100100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100100100100100100.0%
GPT-6 Luna (Reasoning, High)100100100100100100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100100100100100100.0%
GPT-5.5 (Reasoning, Medium)100100100100100100100100100100100.0%
Gemini 3.5 Flash (Reasoning)100100100100100100100100100100100.0%
Z.AI GLM 5 Turbo100100100100100100100100100100100.0%
Kimi K3 (Reasoning, High)100100100100100100100100100100100.0%
Claude Sonnet 5.5 (Reasoning)100100100100100100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100100100100100100.0%
Claude Opus 4.7 (Reasoning)100100100100100100100100100100100.0%
GPT-5.6 Terra (Reasoning, Medium)100100100100100100100100100100100.0%
GPT-6 Luna (Reasoning, Medium)100100100100100100100100100100100.0%
Aion 3.5 Mini (Reasoning, High)100100100100100100100100100100100.0%
Claude Opus 4.8 (Reasoning)100100100100100100100100100100100.0%
Claude Opus 4.6100100100100100100100100100100100.0%
Kimi K3 (Reasoning, Low)100100100100100100100100100100100.0%
Claude Opus 5 (Reasoning, Low)100100100100100100100100100100100.0%
Aion 3.5 (Reasoning, High)100100100100100100100100100100100.0%
Claude Opus 4.8 (Reasoning, Low)100100100100100100100100100100100.0%
Xiaomi MIMO v2.6 Pro100100100100100100100100100100100.0%
Muse Spark 1.1 (Reasoning, Minimal)100100100100100100100100100100100.0%
Claude Opus 5 (Reasoning)100100100100100100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100100100100100100.0%
Thinking Machines Inkling (Reasoning)100100100100100100100100100100100.0%
GPT-5.6 Sol100100100100100100100100100100100.0%
GPT-5.1100100100100100100100100100100100.0%
Claude Sonnet 4.6100100100100100100100100100100100.0%
GPT-5.6 Luna (Reasoning, Medium)100100100100100100100100100100100.0%
MiniMax M3100100100100100100100100100100100.0%
Claude Sonnet 5 (Reasoning)100100100100100100100100100100100.0%
Qwen 3.5 122B100100100100100100100100100100100.0%
Claude Sonnet 5 (Reasoning, Low)100100100100100100100100100100100.0%
GPT-6 Sol100100100100100100100100100100100.0%
Claude Opus 4.7100100100100100100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100100100100100100.0%
Gemma 4 31B (Reasoning)100100100100100100100100100100100.0%
Claude Opus 4.5100100100100100100100100100100100.0%
ByteDance Seed 1.6100100100100100100100100100100100.0%
GPT-5.5100100100100100100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100100100100100100100100100.0%
GPT-5.6 Terra100100100100100100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Low)100100100100100 – – – – – 100.0%
Claude Sonnet 4100100100100100100100100100100100.0%
Claude Sonnet 4.5100100100100100100100100100100100.0%
Claude Sonnet 5100100100100100100100100100100100.0%
Xiaomi MIMO v2.6 Flash100100100100100100100100100100100.0%
Claude Opus 4100100100100100100100100100100100.0%
Qwen 3.5 35B100100100100100100100100100100100.0%
GPT-4.1100100100100100100100100100100100.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100100100100100100100100.0%
Gemini 3.5 Flash (Reasoning, Minimal)100100100100100100100100100100100.0%
ByteDance Seed 2.0 Mini100100100100100100100100100100100.0%
Gemini 3 Flash (Preview)100100100100100100100100100100100.0%
Mistral Medium 3.5 (Reasoning)100100100100100100100100100100100.0%
Gemma 4 31B100100100100100100100100100100100.0%
GPT-5.6 Luna100100100100100100100100100100100.0%
Z.AI GLM 4.5100100100100100100100100100100100.0%
Mistral Medium 3.5100100100100100100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100100100100100100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning)100100100100100100100100100100100.0%
Mistral Large 3100100100100100100100100100100100.0%
DeepSeek-V2 Chat100100100100100100100100100100100.0%
GPT-6 Luna100100100100100100100100100100100.0%
Aion 3.0 Mini100100100100100100100100100100100.0%
GPT-5.4 Mini (Reasoning, Low)100100100100100100100100100100100.0%
Claude Haiku 4.5100100100100100100100100100100100.0%
Z.AI GLM 4.7 Flash100100100100100100100100100100100.0%
GPT-4o, Aug. 6th (temp=0)100100100100100100100100100100100.0%
Mistral Large 2100100100100100100100100100100100.0%
GPT-4.1 Mini100100100100100100100100100100100.0%
GPT-4o, Aug. 6th (temp=1)100100100100100100100100100100100.0%
Grok 4.20100100100100100100100100100100100.0%
Hermes 3 405B100100100100100100100100100100100.0%
GPT-5.4 Mini100100100100100100100100100100100.0%
DeepSeek V3 (2025-03-24)100100100100100100100100100100100.0%
Writer: Palmyra X5100100100100100100100100100100100.0%
Qwen 3 235B A22B Instruct 2507100100100100100100100100100100100.0%
Grok 4.3100100100100100100100100100100100.0%
GPT-4o Mini (temp=1)100100100100100100100100100100100.0%
GPT-5.4 Nano (Reasoning, Low)100100100100100100100100100100100.0%
Llama 3.1 70B100100100100100100100100100100100.0%
Mistral Small 3.2 24B100100100100100100100100100100100.0%
GPT-4o Mini (temp=0)100100100100100100100100100100100.0%
Gemma 3 12B100100100100100100100100100100100.0%
Mistral Small 4100100100100100100100100100100100.0%
GPT-5.4 Nano100100100100100100100100100100100.0%
WizardLM 2 8x22b100100100100100100100100100100100.0%
Ministral 3 14B100100100100100100100100100100100.0%
Ministral 3 8B100100100100100100100100100100100.0%
GPT-4.1 Nano100100100100100100100100100100100.0%
Hermes 3 70B100100100100100100100100100100100.0%
Cohere Command R+ (Aug. 2024)100100100100100100100100100100100.0%
Gemma 3 4B100100100100100100100100100100100.0%
Claude Opus 5.5 (Reasoning)100100100100100100100100100090.0%
Gemini 3.8 Flash (Reasoning, Medium)100100100100100100100100100090.0%
Gemini 3.6 Flash (Reasoning)100100100100100100100100100090.0%
DeepSeek V4.1 Flash (Reasoning, High)100100100100100100100100100090.0%
Qwen 3.8 Flash (Reasoning)100100100100100100100100100090.0%
Muse Spark 1.1 (Reasoning, Medium)100100100100100100100100100090.0%
Grok 4.7 (Reasoning, High)100100100100100100100100100090.0%
Kimi K2.6100100100100100100100100100090.0%
GPT-5.5 (Reasoning, Low)100100100100100100100100100090.0%
GPT-5100100100100100100100100100090.0%
GPT-5 Mini100100100100100100100100100090.0%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100100100100100100100090.0%
Qwen 3.5 27B100100100100100100100100100090.0%
Claude Opus 5100100100100100100100100100090.0%
GPT-5.2100100100100100100100100100090.0%
Qwen 3.6 Flash100100100100100100100100100090.0%
DeepSeek V4 Pro (Reasoning)100100100100100100100100100090.0%
Muse Glimmer 30B (Reasoning, Medium)100100100100100100100100100090.0%
Qwen 3.7 Flash (Reasoning)100100100100100100100100100090.0%
DeepSeek V4 Flash (Reasoning)100100100100100100100100100090.0%
Z.AI GLM 4.7100100100100100100100100100090.0%
MiniMax M2.7100100100100100100100100100090.0%
Qwen 3.5 Flash100100100100100100100100100090.0%
Gemini 3.1 Flash Lite (Preview)100100100100100100100100100090.0%
Gemma 4 26B100100100100100100100100100090.0%
Mistral Large 4.0100100100100100100100100100090.0%
GPT-5.4100100100100100100100100100090.0%
Gemini 2.5 Flash Lite (Reasoning)100100100100100100100100100090.0%
DeepSeek V3 (2024-12-26)100100100100100100100100100090.0%
DeepSeek V4 Pro100100100100100100100100100090.0%
Gemini 2.5 Flash100100100100100100100100100090.0%
Mistral Medium 3.1100100100100100100100100100090.0%
Thinking Machines Inkling100100100100100100100100100090.0%
Cydonia 24B V4.1100100100100100100100100100090.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)1001001001001001001001000080.0%
Z.AI GLM 5.11001001001001001001001000080.0%
Kimi K2.51001001001001001001001000080.0%
Claude Haiku 5.5 (Adaptive)1001001001001001001001000080.0%
Aion 3.01001001001001001001001000080.0%
DeepSeek V4 Flash 0731 (Reasoning, High)1001001001001001001001000080.0%
Thinking Machines Inkling Small (Reasoning, High)1001001001001001001001000080.0%
Gemini 3.6 Flash (Reasoning, Minimal)1001001001001001001001000080.0%
o4 Mini1001001001001001001001000080.0%
Qwen 3.5 Plus (2026-02-15)1001001001001001001001000080.0%
Gemini 3.1 Flash Lite1001001001001001001001000080.0%
Claude Haiku 5.5 (Reasoning, Medium)1001001001001001001001000080.0%
Xiaomi MIMO v2.51001001001001001001001000080.0%
DeepSeek V3.11001001001001001001001000080.0%
GPT-5 Nano1001001001001001001001000080.0%
GPT-5.4 Nano (Reasoning)1001001001001001001001000080.0%
Qwen 3 32B1001001001001001001001000080.0%
Laguna XS 2.11001001001001001001001000080.0%
ByteDance Seed 1.6 Flash1001001001001001001001000080.0%
Gemini 3.1 Pro (Preview)10010010010010010010000070.0%
Mistral Large 4.0 (Reasoning)10010010010010010010000070.0%
Gemini 3 Flash (Preview, Reasoning)10010010010010010010000070.0%
Qwen 3.5 Plus (2026-04-20)10010010010010010010000070.0%
Z.AI GLM 510010010010010010010000070.0%
o4 Mini High10010010010010010010000070.0%
Qwen 3.6 27B10010010010010010010000070.0%
Qwen 3.6 35B10010010010010010010000070.0%
Xiaomi MIMO v2.5 Pro10010010010010010010000070.0%
Qwen 3.5 9B10010010010010010010000070.0%
DeepSeek V3.210010010010010010010000070.0%
DeepSeek V4 Flash10010010010010010010000070.0%
Z.AI GLM 4.5 Air10010010010010010010000070.0%
Gemini 2.5 Flash Lite10010010010010010010000070.0%
Mistral Small 4 (Reasoning)10010010010010010010000070.0%
Gemini 3.7 Flash (Reasoning, Medium)100100100100100100000060.0%
Hy4 Preview (Reasoning, High)100100100100100100000060.0%
Claude Sonnet 4.6 (Reasoning)100100100100100100000060.0%
Z.AI GLM 5.2 (Reasoning, High)100100100100100100000060.0%
Gemma 4 26B (Reasoning)100100100100100100000060.0%
Z.AI GLM 4.6100100100100100100000060.0%
Aion 2.0100100100100100100000060.0%
Mistral NeMO100100100100100100000060.0%
Qwen 3.8 27B (Reasoning, XHigh)1001001001001000000050.0%
Nemotron 3 Super1001001001001000000050.0%
GPT-OSS 120B10010010010000000040.0%
Gemini 2.5 Pro100100100000000030.0%
ByteDance Seed 2.0 Lite100100100000000030.0%
Gemma 3 27B100100100000000030.0%
Ministral 8B100100100000000030.0%
Gemini 2.5 Flash (Reasoning)1001000000000020.0%
Inception Mercury 21001000000000020.0%
Laguna S 2.11001000000000020.0%
MiniMax M2.510000000000010.0%
Nemotron 3 Nano10000000000010.0%
Ministral 3B10000000000010.0%
Qwen 2.5 72B00000000000.0%
Arcee AI: Trinity Mini00000000000.0%
Ministral 3 3B00000000000.0%
Model # 1 # 2 # 3 # 4 # 5 # 6 # 7 # 8 # 9 # 10 Avg ▼
Claude Opus 5.5 (Reasoning)100100100100100100100100100100100.0%
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Max)100100100100100 – – – – – 100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100100100100100100.0%
Gemini 3.8 Flash (Reasoning, Medium)100100100100100100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100100100100100100.0%
Claude Opus 4.6 (Reasoning)100100100100100100100100100100100.0%
Gemini 3.6 Flash (Reasoning)100100100100100100100100100100100.0%
Gemini 3.7 Flash (Reasoning, Medium)100100100100100100100100100100100.0%
Hy4 Preview (Reasoning, High)100100100100100100100100100100100.0%
Muse Spark 1.2 (Reasoning, Medium)100100100100100100100100100100100.0%
Qwen 3.7 Max100100100100100100100100100100100.0%
DeepSeek V4.1 Flash (Reasoning, High)100100100100100100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100100100100100100100100100.0%
Qwen 3.8 Flash (Reasoning)100100100100100100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100100100100100100.0%
GPT-6 Luna (Reasoning, High)100100100100100100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100100100100100100.0%
Muse Spark 1.1 (Reasoning, Medium)100100100100100100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100100100100100100.0%
GPT-5.5 (Reasoning, Medium)100100100100100100100100100100100.0%
Claude Sonnet 4.6 (Reasoning)100100100100100100100100100100100.0%
Z.AI GLM 5.2 (Reasoning, High)100100100100100100100100100100100.0%
Gemini 3.5 Flash (Reasoning)100100100100100100100100100100100.0%
Z.AI GLM 5 Turbo100100100100100100100100100100100.0%
Kimi K3 (Reasoning, High)100100100100100100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100100100100100100.0%
Claude Sonnet 5.5 (Reasoning)100100100100100100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100100100100100100.0%
Grok 4.7 (Reasoning, High)100100100100100100100100100100100.0%
Kimi K2.6100100100100100100100100100100100.0%
Claude Opus 4.7 (Reasoning)100100100100100100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100100100100100100.0%
GPT-5.6 Terra (Reasoning, Medium)100100100100100100100100100100100.0%
GPT-6 Luna (Reasoning, Medium)100100100100100100100100100100100.0%
Claude Opus 4.6100100100100100100100100100100100.0%
Mistral Large 4.0 (Reasoning)100100100100100100100100100100100.0%
Claude Opus 5 (Reasoning, Low)100100100100100100100100100100100.0%
Aion 3.5 (Reasoning, High)100100100100100100100100100100100.0%
GPT-5100100100100100100100100100100100.0%
Muse Spark 1.1 (Reasoning, Minimal)100100100100100100100100100100100.0%
GPT-5 Mini100100100100100100100100100100100.0%
Claude Opus 5 (Reasoning)100100100100100100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100100100100100100.0%
Kimi K2.5100100100100100100100100100100100.0%
Thinking Machines Inkling (Reasoning)100100100100100100100100100100100.0%
GPT-5.6 Sol100100100100100100100100100100100.0%
GPT-5.1100100100100100100100100100100100.0%
Claude Sonnet 4.6100100100100100100100100100100100.0%
Claude Sonnet 5 (Reasoning)100100100100100100100100100100100.0%
Qwen 3.5 122B100100100100100100100100100100100.0%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100100100100100100100100100.0%
Claude Sonnet 5 (Reasoning, Low)100100100100100100100100100100100.0%
GPT-6 Sol100100100100100100100100100100100.0%
Qwen 3.5 27B100100100100100100100100100100100.0%
Claude Opus 5100100100100100100100100100100100.0%
Claude Opus 4.7100100100100100100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100100100100100100.0%
Gemma 4 31B (Reasoning)100100100100100100100100100100100.0%
Claude Opus 4.5100100100100100100100100100100100.0%
Z.AI GLM 5100100100100100100100100100100100.0%
ByteDance Seed 1.6100100100100100100100100100100100.0%
Qwen 3.6 Flash100100100100100100100100100100100.0%
DeepSeek V4 Pro (Reasoning)100100100100100100100100100100100.0%
Gemma 4 26B (Reasoning)100100100100100100100100100100100.0%
Muse Glimmer 30B (Reasoning, Medium)100100100100100100100100100100100.0%
Aion 3.0100100100100100100100100100100100.0%
o4 Mini High100100100100100100100100100100100.0%
Qwen 3.7 Flash (Reasoning)100100100100100100100100100100100.0%
Gemini 2.5 Pro100100100100100100100100100100100.0%
Qwen 3.6 27B100100100100100100100100100100100.0%
GPT-5.6 Terra100100100100100100100100100100100.0%
DeepSeek V4 Flash (Reasoning)100100100100100100100100100100100.0%
Z.AI GLM 4.7100100100100100100100100100100100.0%
Qwen 3.6 35B100100100100100100100100100100100.0%
Z.AI GLM 4.6100100100100100100100100100100100.0%
Claude Sonnet 4100100100100100100100100100100100.0%
Thinking Machines Inkling Small (Reasoning, High)100100100100100100100100100100100.0%
Claude Sonnet 5100100100100100100100100100100100.0%
Qwen 3.5 35B100100100100100100100100100100100.0%
GPT-4.1100100100100100100100100100100100.0%
MiniMax M2.5100100100100100100100100100100100.0%
Gemini 3.6 Flash (Reasoning, Minimal)100100100100100100100100100100100.0%
o4 Mini100100100100100100100100100100100.0%
MiniMax M2.7100100100100100100100100100100100.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100100100100100100100100.0%
Gemini 3.5 Flash (Reasoning, Minimal)100100100100100100100100100100100.0%
Qwen 3.5 Flash100100100100100100100100100100100.0%
Gemini 3 Flash (Preview)100100100100100100100100100100100.0%
Mistral Medium 3.5 (Reasoning)100100100100100100100100100100100.0%
Gemma 4 31B100100100100100100100100100100100.0%
Gemini 3.1 Flash Lite100100100100100100100100100100100.0%
Gemma 4 26B100100100100100100100100100100100.0%
GPT-OSS 120B100100100100100100100100100100100.0%
Mistral Large 4.0100100100100100100100100100100100.0%
Mistral Medium 3.5100100100100100100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100100100100100100100100100100100.0%
Mistral Large 3100100100100100100100100100100100.0%
ByteDance Seed 2.0 Lite100100100100100100100100100100100.0%
Gemini 2.5 Flash (Reasoning)100100100100100100100100100100100.0%
DeepSeek-V2 Chat100100100100100100100100100100100.0%
Qwen 3.5 9B100100100100100100100100100100100.0%
Claude Haiku 4.5100100100100100100100100100100100.0%
Gemini 2.5 Flash Lite (Reasoning)100100100100100100100100100100100.0%
GPT-4o, Aug. 6th (temp=0)100100100100100100100100100100100.0%
DeepSeek V4 Pro100100100100100100100100100100100.0%
Inception Mercury 2100100100100100100100100100100100.0%
Nemotron 3 Super100100100100100100100100100100100.0%
GPT-5 Nano100100100100100100100100100100100.0%
Llama 3.1 70B100100100100100100100100100100100.0%
Mistral Small 3.2 24B100100100100100100100100100100100.0%
Gemma 3 27B100100100100100100100100100100100.0%
Thinking Machines Inkling100100100100100100100100100100100.0%
Qwen 2.5 72B100100100100100100100100100100100.0%
Z.AI GLM 5.3 (Reasoning, Max)100100100100100100100100100090.0%
Z.AI GLM 5.1100100100100100100100100100090.0%
Aion 3.5 Mini (Reasoning, High)100100100100100100100100100090.0%
Kimi K3 (Reasoning, Low)100100100100100100100100100090.0%
Xiaomi MIMO v2.6 Pro100100100100100100100100100090.0%
Gemini 3 Flash (Preview, Reasoning)100100100100100100100100100090.0%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100100100100100100100090.0%
Aion 2.0100100100100100100100100100090.0%
Xiaomi MIMO v2.5 Pro100100100100100100100100100090.0%
Z.AI GLM 4.7 Flash100100100100100100100100100090.0%
Gemini 2.5 Flash100100100100100100100100100090.0%
Writer: Palmyra X5100100100100100100100100100090.0%
Nemotron 3 Nano100100100100100100100100100090.0%
MiniMax M31001001001001001001001000080.0%
Xiaomi MIMO v2.6 Flash1001001001001001001001000080.0%
GPT-4o, Aug. 6th (temp=1)1001001001001001001001000080.0%
DeepSeek V3 (2025-03-24)1001001001001001001001000080.0%
Mistral Small 4 (Reasoning)1001001001001001001001000080.0%
Hermes 3 70B1001001001001001001001000080.0%
Z.AI GLM 4.510010010010010010010000070.0%
Gemini 3.5 Flash Lite (Reasoning)10010010010010010010000070.0%
Xiaomi MIMO v2.510010010010010010010000070.0%
Aion 3.0 Mini10010010010010010010000070.0%
Gemini 2.5 Flash Lite10010010010010010010000070.0%
ByteDance Seed 1.6 Flash10010010010010010010000070.0%
GPT-5.6 Luna (Reasoning, Medium)100100100100100100000060.0%
GPT-5.5100100100100100100000060.0%
DeepSeek V4 Flash 0731 (Reasoning, High)100100100100100100000060.0%
Qwen 3.5 Plus (2026-02-15)100100100100100100000060.0%
Gemini 3.1 Flash Lite (Preview)100100100100100100000060.0%
DeepSeek V3 (2024-12-26)100100100100100100000060.0%
Grok 4.20100100100100100100000060.0%
Cohere Command R+ (Aug. 2024)100100100100100100000060.0%
GPT-5.21001001001001000000050.0%
DeepSeek V3.11001001001001000000050.0%
Qwen 3 32B1001001001001000000050.0%
Qwen 3 235B A22B Instruct 25071001001001001000000050.0%
Claude Haiku 5.5 (Adaptive)10010010010000000040.0%
Claude Sonnet 4.510010010010000000040.0%
ByteDance Seed 2.0 Mini10010010010000000040.0%
DeepSeek V4 Flash10010010010000000040.0%
Z.AI GLM 4.5 Air10010010010000000040.0%
Claude Opus 4100100100000000030.0%
GPT-5.4 Mini (Reasoning, Low)100100100000000030.0%
Laguna S 2.1100100100000000030.0%
GPT-5.4 Nano (Reasoning, Low)100100100000000030.0%
GPT-5.4 Nano100100100000000030.0%
Arcee AI: Trinity Mini100100100000000030.0%
Cydonia 24B V4.11001000000000020.0%
Claude Opus 4.8 (Reasoning)10000000000010.0%
Claude Opus 4.8 (Reasoning, Low)10000000000010.0%
Claude Haiku 5.5 (Reasoning, Medium)10000000000010.0%
Grok 4.310000000000010.0%
Gemma 3 12B10000000000010.0%
Laguna XS 2.110000000000010.0%
Mistral Small 410000000000010.0%
Mistral NeMO10000000000010.0%
Claude Haiku 5.5 (Reasoning, Low)0000 – – – – – – 0.0%
GPT-5.6 Luna00000000000.0%
GPT-5.400000000000.0%
GPT-6 Luna00000000000.0%
DeepSeek V3.200000000000.0%
Mistral Large 200000000000.0%
GPT-4.1 Mini00000000000.0%
Hermes 3 405B00000000000.0%
GPT-5.4 Mini00000000000.0%
GPT-5.4 Nano (Reasoning)00000000000.0%
GPT-4o Mini (temp=1)00000000000.0%
GPT-4o Mini (temp=0)00000000000.0%
Mistral Medium 3.100000000000.0%
WizardLM 2 8x22b00000000000.0%
Ministral 3 14B00000000000.0%
Ministral 3 8B00000000000.0%
GPT-4.1 Nano00000000000.0%
Gemma 3 4B00000000000.0%
Ministral 3 3B00000000000.0%
Ministral 8B00000000000.0%
Ministral 3B00000000000.0%