Relationship endpoint integrity

Test: Relationship tree

Avg. Score
96.2%
Scenarios
2

Overall Performance

Rank ▲ Model Score Avg. Cost Avg. Time Stability
1Gemini 3.1 Flash Lite100.0%$0.00313.3s100%
2Gemini 3.1 Flash Lite (Reasoning)100.0%$0.00333.2s100%
3Gemini 3.1 Flash Lite (Preview)100.0%$0.00463.2s100%
4Gemini 2.5 Flash100.0%$0.00756.1s100%
5Gemini 3 Flash (Preview)100.0%$0.00877.1s100%
6Grok 4.3100.0%$0.00947.8s100%
7Claude Haiku 5.5 (Reasoning, Medium)100.0%$0.004616.7s100%
8GPT-4o Mini (temp=0)100.0%$0.001920.7s100%
9GPT-5.6 Luna100.0%$0.0128.7s100%
10Claude Haiku 5.5 (Reasoning, Low)100.0%$0.005019.9s100%
11DeepSeek V4 Pro100.0%$0.008317.3s100%
12Gemma 4 26B100.0%$0.001827.2s100%
13Mistral Large 3100.0%$0.009117.5s100%
14Grok 4.3 (Reasoning)100.0%$0.01313.9s100%
15GPT-4.1 Mini100.0%$0.004626.0s100%
16Grok 4.20100.0%$0.0207.5s100%
17Ministral 8B99.3%$0.001615.6s98%
18Claude Haiku 5.5 (Adaptive)100.0%$0.006429.8s100%
19Gemini 3.5 Flash (Reasoning, Minimal)100.0%$0.0246.3s100%
20DeepSeek V3.2100.0%$0.004633.9s100%
21DeepSeek-V2 Chat100.0%$0.004934.0s100%
22MiniMax M2.799.8%$0.006321.4s99%
23Mistral Large 4.0100.0%$0.008030.1s100%
24Claude Haiku 4.5100.0%$0.0248.2s100%
25Gemini 2.5 Flash Lite99.1%$0.00234.8s95%
26Z.AI GLM 5.3 Flash (Reasoning, Low)100.0%$0.001242.5s100%
27GPT-6 Luna99.3%$0.001212.1s96%
28DeepSeek V3 (2024-12-26)100.0%$0.004540.2s100%
29Gemini 3.6 Flash (Reasoning, Minimal)100.0%$0.0297.1s100%
30MiniMax M2.5100.0%$0.003645.0s100%
31Mistral Medium 3.5 (Reasoning)100.0%$0.0328.6s100%
32GPT-4o, Aug. 6th (temp=0)100.0%$0.0328.4s100%
33Mistral Medium 3.5100.0%$0.0338.3s100%
34GPT-5.4 Nano (Reasoning)100.0%$0.008841.7s100%
35DeepSeek V4 Flash100.0%$0.002051.4s100%
36GPT-5.6 Terra100.0%$0.0349.4s100%
37DeepSeek V3.1100.0%$0.005552.0s100%
38Muse Spark 1.1 (Reasoning, Minimal)100.0%$0.03018.2s100%
39GPT-5.199.8%$0.02517.7s99%
40GPT-4.199.6%$0.0248.5s97%
41Ministral 3 14B99.3%$0.003125.4s96%
42GPT-5.4100.0%$0.03317.4s100%
43Ministral 3 8B98.8%$0.002217.0s94%
44DeepSeek V4.1 Flash 1017 (Reasoning, High)100.0%$0.005658.2s100%
45GPT-6 Sol100.0%$0.03521.1s100%
46Mistral Large 2100.0%$0.03720.5s100%
47Xiaomi MIMO v2.5100.0%$0.00271.1m100%
48Gemini 4 Argon (Reasoning, Medium)100.0%$0.03919.1s100%
49Muse Glimmer 30B (Reasoning, Medium)100.0%$0.00621.1m100%
50Qwen 3.6 Flash100.0%$0.01551.7s100%
51GPT-6 Luna (Reasoning, Medium)100.0%$0.00351.1m100%
52Gemini 3.7 Flash (Reasoning, Medium)100.0%$0.03623.4s100%
53Z.AI GLM 4.599.7%$0.007548.1s98%
54Grok 4.20 (Reasoning)100.0%$0.02740.0s100%
55Gemini 3 Flash (Preview, Reasoning)100.0%$0.03040.3s100%
56Thinking Machines Inkling Small (Reasoning, High)100.0%$0.0131.1m100%
57ByteDance Seed 1.6100.0%$0.0141.2m100%
58Muse Spark 1.2 (Reasoning, Medium)100.0%$0.04629.8s100%
59Mistral Small 3.2 24B98.3%$0.001713.8s90%
60Muse Spark 1.1 (Reasoning, Medium)100.0%$0.04235.1s100%
61GPT-6 Luna (Reasoning, High)100.0%$0.00551.4m100%
62Ministral 3 3B96.8%$0.00079.9s90%
63GPT-4o, Aug. 6th (temp=1)98.9%$0.0299.1s93%
64Grok 4.5 (Reasoning, Low)100.0%$0.04049.7s100%
65DeepSeek V4.1 Flash (Reasoning, High)100.0%$0.0141.5m100%
66GPT-5.6 Terra (Reasoning, Medium)100.0%$0.06024.2s100%
67GPT-6.1 Sol (Reasoning, Medium)100.0%$0.04250.1s100%
68GPT-5.4 (Reasoning, Low)100.0%$0.05335.5s100%
69Claude Sonnet 5100.0%$0.06817.1s100%
70Qwen 3 235B A22B Instruct 250798.8%$0.00171.0m93%
71GPT-6 Sol (Reasoning, Medium)100.0%$0.05146.3s100%
72GPT-4o Mini (temp=1)97.6%$0.002633.4s90%
73Gemma 4 31B100.0%$0.00281.9m100%
74Laguna S 2.1100.0%$0.00062.0m100%
75Claude Sonnet 4.5100.0%$0.07718.6s100%
76GPT-5.4 Mini96.6%$0.00877.9s86%
77Ministral 3B95.7%$0.00079.8s86%
78Xiaomi MIMO v2.6 Pro100.0%$0.00712.0m100%
79Thinking Machines Inkling98.0%$0.01843.6s92%
80Gemini 3.8 Flash (Reasoning, Medium)100.0%$0.06742.1s100%
81Claude Sonnet 4.6100.0%$0.08123.3s100%
82GPT-5.2100.0%$0.06250.7s100%
83Qwen 3.5 35B100.0%$0.0152.0m100%
84GPT-5 Mini100.0%$0.0192.0m100%
85GPT-5 Nano100.0%$0.00802.2m100%
86GPT-5.6 Sol100.0%$0.09618.1s100%
87GPT-OSS 120B99.6%$0.00402.2m98%
88Kimi K3 (Reasoning, Low)100.0%$0.0591.2m100%
89Z.AI GLM 5.2 (Reasoning, High)100.0%$0.0391.8m100%
90DeepSeek V4 Pro (Reasoning)100.0%$0.0202.3m100%
91Claude Sonnet 5.5 (Reasoning)100.0%$0.10128.5s100%
92Gemini 3.6 Flash (Reasoning)100.0%$0.09641.4s100%
93GPT-5.5 (Reasoning, Low)100.0%$0.09742.6s100%
94Qwen 2.5 72B97.5%$0.00561.2m87%
95Muse Wonder (Reasoning, Medium)100.0%$0.11620.5s100%
96GPT-5.5100.0%$0.10537.1s100%
97Writer: Palmyra X596.4%$0.01618.4s80%
98Inception Mercury 295.3%$0.009612.8s79%
99Gemini 2.5 Pro100.0%$0.09958.2s100%
100Claude Opus 4.5100.0%$0.13119.8s100%
101GPT-4.1 Nano93.7%$0.00096.9s75%
102WizardLM 2 8x22b98.3%$0.00982.3m93%
103Gemini 3.5 Flash (Reasoning)100.0%$0.11349.4s100%
104Z.AI GLM 4.6100.0%$0.0183.0m100%
105Arcee AI: Trinity Mini98.1%$0.00371.9m88%
106o4 Mini97.4%$0.03745.7s84%
107Aion 2.0100.0%$0.0243.0m100%
108DeepSeek V4 Flash (Reasoning)100.0%$0.00413.5m100%
109Qwen 3.5 397B A17B100.0%$0.0452.6m100%
110Qwen 3.5 Plus (2026-04-20)100.0%$0.0233.1m100%
111Mistral Medium 3.195.7%$0.01021.2s74%
112o4 Mini High98.4%$0.0591.3m91%
113Gemma 3 4B92.8%$0.000727.5s75%
114Grok 4.5 (Reasoning, High)100.0%$0.0802.0m100%
115Qwen 3.5 Flash100.0%$0.00403.8m100%
116ByteDance Seed 2.0 Lite100.0%$0.0143.6m100%
117Qwen 3.6 27B99.3%$0.0342.7m96%
118Claude Opus 4.6100.0%$0.15431.4s100%
119Gemma 3 27B91.0%$0.001627.5s75%
120Laguna XS 2.194.7%$0.001241.3s73%
121GPT-5.4 Nano92.7%$0.002611.2s70%
122Xiaomi MIMO v2.5 Pro97.0%$0.00761.9m82%
123GPT-5100.0%$0.0922.3m100%
124Muse Spark 1.3 (Reasoning, Medium)98.3%$0.0551.9m90%
125Qwen 3.5 Plus (2026-02-15)100.0%$0.0213.9m100%
126Claude Opus 4.7100.0%$0.18224.3s100%
127Claude Opus 4.7 (Reasoning)100.0%$0.18425.0s100%
128Claude Opus 5100.0%$0.19526.4s100%
129DeepSeek V4 Pro 0813 (Reasoning, High)100.0%$0.0603.5m100%
130Mistral Large 4.0 (Reasoning)100.0%$0.0453.9m100%
131DeepSeek V3 (2025-03-24)92.6%$0.003750.3s69%
132Mistral NeMO88.5%$0.002415.4s67%
133Qwen 3.8 Flash (Reasoning)100.0%$0.0154.9m100%
134GPT-5.6 Sol (Reasoning, Medium)100.0%$0.18659.0s100%
135Z.AI GLM 4.7 Flash95.8%$0.00502.8m81%
136GPT-5.4 Mini (Reasoning, Low)91.6%$0.01414.4s64%
137GPT-5.6 Luna (Reasoning, Medium)94.0%$0.02718.6s64%
138Claude Opus 5.5 (Reasoning)100.0%$0.20340.6s100%
139Gemini 3.1 Pro (Preview)100.0%$0.1721.5m100%
140Z.AI GLM 5100.0%$0.0374.6m100%
141 Kimi K3 (Reasoning, High)100.0%$0.1023.1m100%
142Nemotron 3 Super100.0%$0.00005.5m100%
143Thinking Machines Inkling (Reasoning)100.0%$0.0604.1m100%
144Aion 3.0 Mini100.0%$0.0304.9m100%
145Qwen 3.6 Max Preview100.0%$0.0843.7m100%
146Claude Sonnet 5 (Reasoning)100.0%$0.1721.7m100%
147Gemini 3.5 Flash Lite (Reasoning)85.9%$0.00623.1s62%
148GPT-5.4 Nano (Reasoning, Low)92.6%$0.003813.8s56%
149Claude Sonnet 5 (Reasoning, Low)100.0%$0.1751.7m100%
150DeepSeek V4 Flash 0731 (Reasoning, High)100.0%$0.00735.6m100%
151Hy4 Preview (Reasoning, High)100.0%$0.0564.7m100%
152Grok 4.6 (Reasoning, High)100.0%$0.1043.7m100%
153Llama 3.1 70B92.7%$0.006434.0s56%
154Claude Opus 5 (Reasoning, Low)100.0%$0.24646.5s100%
155Claude Opus 5 (Reasoning)100.0%$0.24747.3s100%
156Z.AI GLM 4.796.9%$0.0253.7m81%
157GPT-5.4 (Reasoning)100.0%$0.1752.6m100%
158Kimi K2.6100.0%$0.0825.0m100%
159Xiaomi MIMO v2.6 Flash100.0%$0.00787.0m100%
160Qwen 3 32B92.5%$0.00422.9m66%
161Kimi K2.598.2%$0.0315.4m89%
162Aion 3.0100.0%$0.0745.8m100%
163Hermes 3 405B91.5%$0.0151.0m50%
164Claude Sonnet 492.2%$0.07217.5s53%
165GPT-5.5 (Reasoning, Medium)100.0%$0.2512.0m100%
166Z.AI GLM 5.3 Flash (Reasoning, Max)100.0%$0.00628.0m100%
167Mistral Small 4 (Reasoning)85.8%$0.005124.7s42%
168Ember-1 (Reasoning, Max)100.0%$0.2113.4m100%
169Grok 4.7 (Reasoning, High)100.0%$0.1315.4m100%
170Aion 3.5 Mini (Reasoning, High)100.0%$0.0367.7m100%
171Qwen 3.8 27B (Reasoning, XHigh)96.2%$0.0534.9m78%
172GPT-5.4 Mini (Reasoning)93.1%$0.1172.8m73%
173Z.AI GLM 5.1100.0%$0.0817.3m100%
174Aion 3.5 (Reasoning, High)97.9%$0.0836.1m87%
175Gemini 2.5 Flash Lite (Reasoning)76.9%$0.00731.0m41%
176ByteDance Seed 2.0 Mini98.3%$0.00628.7m90%
177Z.AI GLM 4.5 Air90.8%$0.00713.2m45%
178MiniMax M3100.0%$0.0369.3m100%
179Claude Opus 4.8 (Reasoning, Low)100.0%$0.3831.9m100%
180Claude Opus 4.8 (Reasoning)100.0%$0.3811.9m100%
181Claude Opus 4.6 (Reasoning)100.0%$0.3562.6m100%
182Gemma 4 31B (Reasoning)93.2%$0.00435.8m59%
183Gemini 3.5 Flash Lite (Reasoning, Minimal)69.3%$0.00573.2s27%
184Cydonia 24B V4.172.4%$0.00401.0m32%
185Qwen 3.5 27B90.0%$0.0293.7m40%
186Qwen 3.6 35B80.5%$0.0141.1m22%
187Z.AI GLM 5 Turbo90.0%$0.0443.6m40%
188Qwen 3.7 Flash (Reasoning)75.7%$0.001756.4s20%
189Qwen 3.5 122B90.0%$0.0354.0m40%
190Hermes 3 70B68.8%$0.004542.7s24%
191ByteDance Seed 1.6 Flash63.8%$0.002034.2s22%
192Qwen 3.5 9B86.5%$0.00407.8m64%
193Qwen 3.8 Max (Reasoning, XHigh)100.0%$0.1609.6m100%
194Gemma 4 26B (Reasoning)80.3%$0.00413.1m21%
195Z.AI GLM 5.3 (Reasoning, Max)100.0%$0.18710.3m100%
196Mistral Small 457.9%$0.00307.4s5%
197Qwen 3.7 Max80.2%$0.0453.5m21%
198Gemini 2.5 Flash (Reasoning)50.1%$0.02337.3s15%
199Claude Sonnet 4.6 (Reasoning)100.0%$0.4485.9m100%
200Claude Opus 492.3%$0.3682.4m54%
201Cohere Command R+ (Aug. 2024)57.4%$0.05756.5s4%
202Nemotron 3 Nano51.7%$0.00392.8m7%
203Gemma 3 12B10.0%$0.001430.4s0%
96.18%

Individual Scenarios

Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Claude Opus 5.5 (Reasoning)100100100100100100.0%
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100.0%
Gemini 3.8 Flash (Reasoning, Medium)100100100100100100.0%
Ember-1 (Reasoning, Max)100100100100100100.0%
Muse Wonder (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.3 (Reasoning, Max)100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100.0%
Claude Opus 4.6 (Reasoning)100100100100100100.0%
Gemini 3.6 Flash (Reasoning)100100100100100100.0%
Gemini 3.7 Flash (Reasoning, Medium)100100100100100100.0%
Hy4 Preview (Reasoning, High)100100100100100100.0%
Muse Spark 1.2 (Reasoning, Medium)100100100100100100.0%
Qwen 3.7 Max100100100100100100.0%
DeepSeek V4.1 Flash (Reasoning, High)100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100100100100.0%
Qwen 3.8 Flash (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100.0%
DeepSeek V4.1 Flash 1017 (Reasoning, High)100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, High)100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100.0%
Muse Spark 1.1 (Reasoning, Medium)100100100100100100.0%
Gemini 4 Argon (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.1100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100.0%
GPT-5.5 (Reasoning, Medium)100100100100100100.0%
Claude Sonnet 4.6 (Reasoning)100100100100100100.0%
Z.AI GLM 5.2 (Reasoning, High)100100100100100100.0%
Gemini 3.5 Flash (Reasoning)100100100100100100.0%
Z.AI GLM 5 Turbo100100100100100100.0%
Kimi K3 (Reasoning, High)100100100100100100.0%
Claude Sonnet 5.5 (Reasoning)100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100.0%
Grok 4.7 (Reasoning, High)100100100100100100.0%
Kimi K2.6100100100100100100.0%
Claude Opus 4.7 (Reasoning)100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100.0%
GPT-5.6 Terra (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, Medium)100100100100100100.0%
Aion 3.5 Mini (Reasoning, High)100100100100100100.0%
Claude Opus 4.8 (Reasoning)100100100100100100.0%
Claude Opus 4.6100100100100100100.0%
Mistral Large 4.0 (Reasoning)100100100100100100.0%
Kimi K3 (Reasoning, Low)100100100100100100.0%
Claude Opus 5 (Reasoning, Low)100100100100100100.0%
Aion 3.5 (Reasoning, High)100100100100100100.0%
Claude Opus 4.8 (Reasoning, Low)100100100100100100.0%
Xiaomi MIMO v2.6 Pro100100100100100100.0%
GPT-5100100100100100100.0%
Muse Spark 1.1 (Reasoning, Minimal)100100100100100100.0%
GPT-5 Mini100100100100100100.0%
Claude Opus 5 (Reasoning)100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100.0%
Kimi K2.5100100100100100100.0%
Thinking Machines Inkling (Reasoning)100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
GPT-5.1100100100100100100.0%
Claude Sonnet 4.6100100100100100100.0%
MiniMax M3100100100100100100.0%
Claude Sonnet 5 (Reasoning)100100100100100100.0%
Qwen 3.5 122B100100100100100100.0%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100100100100.0%
Claude Sonnet 5 (Reasoning, Low)100100100100100100.0%
GPT-6 Sol100100100100100100.0%
Claude Opus 5100100100100100100.0%
Gemini 3 Flash (Preview, Reasoning)100100100100100100.0%
Claude Opus 4.7100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100.0%
Claude Opus 4.5100100100100100100.0%
Z.AI GLM 5100100100100100100.0%
ByteDance Seed 1.6100100100100100100.0%
GPT-5.2100100100100100100.0%
Claude Haiku 5.5 (Adaptive)100100100100100100.0%
GPT-5.5100100100100100100.0%
Qwen 3.6 Flash100100100100100100.0%
DeepSeek V4 Pro (Reasoning)100100100100100100.0%
Gemma 4 26B (Reasoning)100100100100100100.0%
Muse Glimmer 30B (Reasoning, Medium)100100100100100100.0%
Aion 3.0100100100100100100.0%
o4 Mini High100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100100100100.0%
Gemini 2.5 Pro100100100100100100.0%
Qwen 3.6 27B100100100100100100.0%
GPT-5.6 Terra100100100100100100.0%
DeepSeek V4 Flash (Reasoning)100100100100100100.0%
DeepSeek V4 Flash 0731 (Reasoning, High)100100100100100100.0%
Qwen 3.6 35B100100100100100100.0%
Z.AI GLM 4.6100100100100100100.0%
Claude Sonnet 4.5100100100100100100.0%
Thinking Machines Inkling Small (Reasoning, High)100100100100100100.0%
Claude Sonnet 5100100100100100100.0%
Xiaomi MIMO v2.6 Flash100100100100100100.0%
Qwen 3.5 35B100100100100100100.0%
GPT-4.1100100100100100100.0%
MiniMax M2.5100100100100100100.0%
Gemini 3.6 Flash (Reasoning, Minimal)100100100100100100.0%
Aion 2.0100100100100100100.0%
o4 Mini100100100100100100.0%
MiniMax M2.7100100100100100100.0%
Qwen 3.5 Plus (2026-02-15)100100100100100100.0%
Xiaomi MIMO v2.5 Pro100100100100100100.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100100100.0%
Gemini 3.5 Flash (Reasoning, Minimal)100100100100100100.0%
ByteDance Seed 2.0 Mini100100100100100100.0%
Qwen 3.5 Flash100100100100100100.0%
Gemini 3 Flash (Preview)100100100100100100.0%
Gemini 3.1 Flash Lite (Preview)100100100100100100.0%
Mistral Medium 3.5 (Reasoning)100100100100100100.0%
Gemma 4 31B100100100100100100.0%
Gemini 3.1 Flash Lite100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
Z.AI GLM 4.5100100100100100100.0%
Gemma 4 26B100100100100100100.0%
GPT-OSS 120B100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Low)100100100100100100.0%
Mistral Large 4.0100100100100100100.0%
Mistral Medium 3.5100100100100100100.0%
GPT-5.4100100100100100100.0%
Mistral Large 3100100100100100100.0%
ByteDance Seed 2.0 Lite100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Medium)100100100100100100.0%
DeepSeek-V2 Chat100100100100100100.0%
Xiaomi MIMO v2.5100100100100100100.0%
GPT-6 Luna100100100100100100.0%
Aion 3.0 Mini100100100100100100.0%
Claude Haiku 4.5100100100100100100.0%
DeepSeek V3 (2024-12-26)100100100100100100.0%
DeepSeek V3.1100100100100100100.0%
DeepSeek V3.2100100100100100100.0%
GPT-4o, Aug. 6th (temp=0)100100100100100100.0%
DeepSeek V4 Pro100100100100100100.0%
DeepSeek V4 Flash100100100100100100.0%
Inception Mercury 2100100100100100100.0%
Nemotron 3 Super100100100100100100.0%
Mistral Large 2100100100100100100.0%
GPT-4.1 Mini100100100100100100.0%
GPT-4o, Aug. 6th (temp=1)100100100100100100.0%
Grok 4.20100100100100100100.0%
Hermes 3 405B100100100100100100.0%
Gemini 2.5 Flash100100100100100100.0%
GPT-5.4 Mini100100100100100100.0%
GPT-5 Nano100100100100100100.0%
GPT-5.4 Nano (Reasoning)100100100100100100.0%
Laguna S 2.1100100100100100100.0%
DeepSeek V3 (2025-03-24)100100100100100100.0%
Gemini 2.5 Flash Lite100100100100100100.0%
Mistral Small 4 (Reasoning)100100100100100100.0%
Qwen 3 32B100100100100100100.0%
Writer: Palmyra X5100100100100100100.0%
Qwen 3 235B A22B Instruct 2507100100100100100100.0%
Grok 4.3100100100100100100.0%
GPT-4o Mini (temp=1)100100100100100100.0%
Llama 3.1 70B100100100100100100.0%
GPT-4o Mini (temp=0)100100100100100100.0%
Gemma 3 27B100100100100100100.0%
Qwen 2.5 72B100100100100100100.0%
Ministral 3 14B100100100100100100.0%
Ministral 3 8B100100100100100100.0%
GPT-4.1 Nano100100100100100100.0%
Arcee AI: Trinity Mini100100100100100100.0%
Gemma 3 4B100100100100100100.0%
Mistral NeMO100100100100100100.0%
Ministral 8B100100100100100100.0%
Thinking Machines Inkling1001001001009398.7%
Laguna XS 2.11001001001009398.6%
WizardLM 2 8x22b1001001001009398.5%
Mistral Small 3.2 24B1001001001008396.5%
Ministral 3 3B100100100908594.9%
Z.AI GLM 4.7 Flash1001001001007094.0%
Z.AI GLM 4.71001001001006993.8%
Ministral 3B100100100867893.0%
Qwen 3.8 27B (Reasoning, XHigh)1001001001006492.8%
Qwen 3.7 Flash (Reasoning)1001001001005791.5%
Mistral Medium 3.11001001001005791.3%
Gemini 3.5 Flash Lite (Reasoning)1001001001004488.9%
GPT-5.4 Mini (Reasoning, Low)1001001001004288.4%
GPT-5.6 Luna (Reasoning, Medium)1001001001004088.1%
Gemma 4 31B (Reasoning)1001001001003286.3%
GPT-5.4 Nano100100100715685.4%
GPT-5.4 Nano (Reasoning, Low)1001001001002685.3%
Claude Opus 41001001001002384.6%
Claude Sonnet 41001001001002284.4%
Qwen 3.5 9B10010092675582.6%
Z.AI GLM 4.5 Air100100100100881.7%
Qwen 3.5 27B100100100100080.0%
Hermes 3 70B10010067524873.6%
Gemini 2.5 Flash Lite (Reasoning)10010055332462.3%
Cydonia 24B V4.1100956044059.9%
ByteDance Seed 1.6 Flash10010042341958.9%
Gemini 3.5 Flash Lite (Reasoning, Minimal)10010027232354.7%
Nemotron 3 Nano1001004812052.0%
Gemini 2.5 Flash (Reasoning)1002727252240.3%
Cohere Command R+ (Aug. 2024)10010000040.0%
Gemma 3 12B100000020.0%
Mistral Small 477200015.8%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Claude Opus 5.5 (Reasoning)100100100100100100.0%
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100.0%
Gemini 3.8 Flash (Reasoning, Medium)100100100100100100.0%
Ember-1 (Reasoning, Max)100100100100100100.0%
Muse Wonder (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.3 (Reasoning, Max)100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100.0%
Claude Opus 4.6 (Reasoning)100100100100100100.0%
Gemini 3.6 Flash (Reasoning)100100100100100100.0%
Gemini 3.7 Flash (Reasoning, Medium)100100100100100100.0%
Hy4 Preview (Reasoning, High)100100100100100100.0%
Muse Spark 1.2 (Reasoning, Medium)100100100100100100.0%
DeepSeek V4.1 Flash (Reasoning, High)100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100100100100.0%
Qwen 3.8 Flash (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100.0%
DeepSeek V4.1 Flash 1017 (Reasoning, High)100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100.0%
GPT-6 Luna (Reasoning, High)100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100.0%
Muse Spark 1.1 (Reasoning, Medium)100100100100100100.0%
Gemini 4 Argon (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.1100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100.0%
GPT-5.5 (Reasoning, Medium)100100100100100100.0%
Claude Sonnet 4.6 (Reasoning)100100100100100100.0%
Z.AI GLM 5.2 (Reasoning, High)100100100100100100.0%
Gemini 3.5 Flash (Reasoning)100100100100100100.0%
Kimi K3 (Reasoning, High)100100100100100100.0%
Claude Sonnet 5.5 (Reasoning)100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100.0%
Grok 4.7 (Reasoning, High)100100100100100100.0%
Kimi K2.6100100100100100100.0%
Claude Opus 4.7 (Reasoning)100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100.0%
GPT-5.6 Terra (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, Medium)100100100100100100.0%
Aion 3.5 Mini (Reasoning, High)100100100100100100.0%
Claude Opus 4.8 (Reasoning)100100100100100100.0%
Claude Opus 4.6100100100100100100.0%
Mistral Large 4.0 (Reasoning)100100100100100100.0%
Kimi K3 (Reasoning, Low)100100100100100100.0%
Claude Opus 5 (Reasoning, Low)100100100100100100.0%
Claude Opus 4.8 (Reasoning, Low)100100100100100100.0%
Xiaomi MIMO v2.6 Pro100100100100100100.0%
GPT-5100100100100100100.0%
Muse Spark 1.1 (Reasoning, Minimal)100100100100100100.0%
GPT-5 Mini100100100100100100.0%
Claude Opus 5 (Reasoning)100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100.0%
Thinking Machines Inkling (Reasoning)100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
Claude Sonnet 4.6100100100100100100.0%
GPT-5.6 Luna (Reasoning, Medium)100100100100100100.0%
MiniMax M3100100100100100100.0%
Claude Sonnet 5 (Reasoning)100100100100100100.0%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100100100100.0%
Claude Sonnet 5 (Reasoning, Low)100100100100100100.0%
GPT-6 Sol100100100100100100.0%
Qwen 3.5 27B100100100100100100.0%
Claude Opus 5100100100100100100.0%
Gemini 3 Flash (Preview, Reasoning)100100100100100100.0%
Claude Opus 4.7100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100.0%
Gemma 4 31B (Reasoning)100100100100100100.0%
Claude Opus 4.5100100100100100100.0%
Z.AI GLM 5100100100100100100.0%
ByteDance Seed 1.6100100100100100100.0%
GPT-5.2100100100100100100.0%
Claude Haiku 5.5 (Adaptive)100100100100100100.0%
GPT-5.5100100100100100100.0%
Qwen 3.6 Flash100100100100100100.0%
DeepSeek V4 Pro (Reasoning)100100100100100100.0%
Muse Glimmer 30B (Reasoning, Medium)100100100100100100.0%
Aion 3.0100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100100100100.0%
Gemini 2.5 Pro100100100100100100.0%
GPT-5.6 Terra100100100100100100.0%
DeepSeek V4 Flash (Reasoning)100100100100100100.0%
DeepSeek V4 Flash 0731 (Reasoning, High)100100100100100100.0%
Z.AI GLM 4.7100100100100100100.0%
Z.AI GLM 4.6100100100100100100.0%
Claude Sonnet 4100100100100100100.0%
Claude Sonnet 4.5100100100100100100.0%
Thinking Machines Inkling Small (Reasoning, High)100100100100100100.0%
Claude Sonnet 5100100100100100100.0%
Xiaomi MIMO v2.6 Flash100100100100100100.0%
Claude Opus 4100100100100100100.0%
Qwen 3.5 35B100100100100100100.0%
MiniMax M2.5100100100100100100.0%
Gemini 3.6 Flash (Reasoning, Minimal)100100100100100100.0%
Aion 2.0100100100100100100.0%
Qwen 3.5 Plus (2026-02-15)100100100100100100.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100100100.0%
Gemini 3.5 Flash (Reasoning, Minimal)100100100100100100.0%
Qwen 3.5 Flash100100100100100100.0%
Gemini 3 Flash (Preview)100100100100100100.0%
Gemini 3.1 Flash Lite (Preview)100100100100100100.0%
Mistral Medium 3.5 (Reasoning)100100100100100100.0%
Gemma 4 31B100100100100100100.0%
Gemini 3.1 Flash Lite100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
Gemma 4 26B100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Low)100100100100100100.0%
Mistral Large 4.0100100100100100100.0%
Mistral Medium 3.5100100100100100100.0%
GPT-5.4100100100100100100.0%
Mistral Large 3100100100100100100.0%
ByteDance Seed 2.0 Lite100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Medium)100100100100100100.0%
DeepSeek-V2 Chat100100100100100100.0%
Xiaomi MIMO v2.5100100100100100100.0%
Aion 3.0 Mini100100100100100100.0%
Claude Haiku 4.5100100100100100100.0%
DeepSeek V3 (2024-12-26)100100100100100100.0%
DeepSeek V3.1100100100100100100.0%
DeepSeek V3.2100100100100100100.0%
GPT-4o, Aug. 6th (temp=0)100100100100100100.0%
DeepSeek V4 Pro100100100100100100.0%
DeepSeek V4 Flash100100100100100100.0%
Nemotron 3 Super100100100100100100.0%
Mistral Large 2100100100100100100.0%
GPT-4.1 Mini100100100100100100.0%
Grok 4.20100100100100100100.0%
Z.AI GLM 4.5 Air100100100100100100.0%
Gemini 2.5 Flash100100100100100100.0%
GPT-5 Nano100100100100100100.0%
GPT-5.4 Nano (Reasoning)100100100100100100.0%
Laguna S 2.1100100100100100100.0%
Grok 4.3100100100100100100.0%
GPT-5.4 Nano (Reasoning, Low)100100100100100100.0%
Mistral Small 3.2 24B100100100100100100.0%
GPT-4o Mini (temp=0)100100100100100100.0%
Mistral Medium 3.1100100100100100100.0%
Mistral Small 4100100100100100100.0%
GPT-5.4 Nano100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)1001001001009999.7%
GPT-5.11001001001009899.7%
MiniMax M2.71001001001009899.5%
Z.AI GLM 4.51001001001009799.3%
GPT-OSS 120B1001001001009699.2%
GPT-4.11001001001009699.1%
Ministral 3 3B100100100989598.6%
GPT-6 Luna1001001001009398.6%
Qwen 3.6 27B1001001001009398.6%
Ministral 3 14B1001001001009398.6%
Ministral 8B10010098989798.5%
Ministral 3B100100100979498.4%
WizardLM 2 8x22b1001001001009198.2%
Gemini 2.5 Flash Lite100100100989298.1%
GPT-4o, Aug. 6th (temp=1)1001001001008997.8%
Z.AI GLM 4.7 Flash1001001001008897.7%
Qwen 3 235B A22B Instruct 25071001001001008897.6%
Ministral 3 8B100100100979197.6%
Thinking Machines Inkling1001001001008797.4%
o4 Mini High1001001001008496.9%
ByteDance Seed 2.0 Mini1001001001008396.7%
Muse Spark 1.3 (Reasoning, Medium)1001001001008396.6%
Kimi K2.51001001001008296.4%
Arcee AI: Trinity Mini1001001001008196.1%
Aion 3.5 (Reasoning, High)1001001001007995.7%
GPT-4o Mini (temp=1)100100100928495.2%
Qwen 2.5 72B100100100977894.9%
GPT-5.4 Mini (Reasoning, Low)1001001001007494.8%
o4 Mini1001001001007494.8%
Xiaomi MIMO v2.5 Pro1001001001007093.9%
GPT-5.4 Mini100100100838393.2%
Writer: Palmyra X5100100100976792.8%
Gemini 2.5 Flash Lite (Reasoning)100100100966191.5%
Laguna XS 2.11001001001005490.9%
Inception Mercury 2100100100886590.7%
Qwen 3.5 9B10010094867290.4%
ByteDance Seed 1.6 Flash88 – – – – 88.1%
GPT-4.1 Nano10010093846087.4%
GPT-5.4 Mini (Reasoning)100100100686486.3%
Gemma 3 4B10010089756485.5%
Llama 3.1 70B1001001001002785.4%
DeepSeek V3 (2025-03-24)100100100755185.2%
Cydonia 24B V4.110010094864585.0%
Qwen 3 32B1009695914385.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)10010074737183.8%
Gemini 3.5 Flash Lite (Reasoning)10010074726882.9%
Hermes 3 405B100100100981782.9%
Gemma 3 27B908584836781.9%
Z.AI GLM 5 Turbo100100100100080.0%
Qwen 3.5 122B100100100100080.0%
Mistral NeMO918981725377.0%
Cohere Command R+ (Aug. 2024)10010010074074.8%
Mistral Small 4 (Reasoning)100908978171.7%
Hermes 3 70B10010010020064.0%
Qwen 3.6 35B1001001005061.0%
Gemma 4 26B (Reasoning)1001001003060.7%
Qwen 3.7 Max1001001002060.4%
Qwen 3.7 Flash (Reasoning)1001001000060.0%
Gemini 2.5 Flash (Reasoning)100736859059.8%
Nemotron 3 Nano100100525051.5%
Gemma 3 12B000000.0%