XML structure

Test: Relationship tree

Avg. Score
93.5%
Scenarios
2

Overall Performance

Rank ▲ Model Score Avg. Cost Avg. Time Stability
1Gemini 3.1 Flash Lite100.0%$0.00313.3s100%
2Gemini 3.1 Flash Lite (Reasoning)100.0%$0.00333.2s100%
3Gemini 3.1 Flash Lite (Preview)100.0%$0.00463.2s100%
4Gemini 3.5 Flash Lite (Reasoning, Minimal)100.0%$0.00573.2s100%
5Gemini 3.5 Flash Lite (Reasoning)100.0%$0.00623.1s100%
6GPT-5.4 Nano100.0%$0.002611.2s100%
7Gemini 2.5 Flash100.0%$0.00756.1s100%
8GPT-5.4 Nano (Reasoning, Low)100.0%$0.003813.8s100%
9Gemini 3 Flash (Preview)100.0%$0.00877.1s100%
10GPT-5.6 Luna100.0%$0.0128.7s100%
11Inception Mercury 2100.0%$0.009612.8s100%
12DeepSeek V4 Pro100.0%$0.008317.3s100%
13GPT-5.4 Mini (Reasoning, Low)100.0%$0.01414.4s100%
14Grok 4.20100.0%$0.0207.5s100%
15Gemini 3.5 Flash (Reasoning, Minimal)100.0%$0.0246.3s100%
16DeepSeek V3.2100.0%$0.004633.9s100%
17Z.AI GLM 5.3 Flash (Reasoning, Low)100.0%$0.001242.5s100%
18MiniMax M2.5100.0%$0.003645.0s100%
19GPT-4o, Aug. 6th (temp=0)100.0%$0.0328.4s100%
20GPT-5.1100.0%$0.02517.7s100%
21GPT-5.4 Nano (Reasoning)100.0%$0.008841.7s100%
22GPT-5.6 Luna (Reasoning)100.0%$0.02718.6s100%
23Muse Spark 1.1 (Reasoning, Minimal)100.0%$0.03018.2s100%
24GPT-5.4100.0%$0.03317.4s100%
25Gemini 2.5 Flash (Reasoning)100.0%$0.02337.3s100%
26Muse Glimmer 30B (Reasoning, Medium)100.0%$0.00621.1m100%
27Qwen 3.6 Flash100.0%$0.01551.7s100%
28Gemini 3.7 Flash (Reasoning, Medium)100.0%$0.03623.4s100%
29Grok 4.20 (Reasoning)100.0%$0.02740.0s100%
30Gemini 3 Flash (Preview, Reasoning)100.0%$0.03040.3s100%
31Thinking Machines Inkling Small (Reasoning, High)100.0%$0.0131.1m100%
32ByteDance Seed 1.6100.0%$0.0141.2m100%
33Muse Spark 1.2 (Reasoning, Medium)100.0%$0.04629.8s100%
34Muse Spark 1.1 (Reasoning, Medium)100.0%$0.04235.1s100%
35o4 Mini100.0%$0.03745.7s100%
36GPT-5.4 (Reasoning, Low)100.0%$0.05335.5s100%
37Claude Sonnet 4100.0%$0.07217.5s100%
38Gemma 4 31B100.0%$0.00281.9m100%
39Xiaomi MIMO v2.5 Pro100.0%$0.00761.9m100%
40Gemini 3.8 Flash (Reasoning, Medium)100.0%$0.06742.1s100%
41Claude Sonnet 4.6100.0%$0.08123.3s100%
42GPT-5.2100.0%$0.06250.7s100%
43GPT-OSS 120B100.0%$0.00402.2m100%
44GPT-5 Mini100.0%$0.0192.0m100%
45GPT-5 Nano100.0%$0.00802.2m100%
46GPT-5.6 Sol100.0%$0.09618.1s100%
47Kimi K3 (Reasoning, Low)100.0%$0.0591.2m100%
48o4 Mini High100.0%$0.0591.3m100%
49Z.AI GLM 5.2 (Reasoning, High)100.0%$0.0391.8m100%
50DeepSeek V4 Pro (Reasoning)100.0%$0.0202.3m100%
51Gemini 3.6 Flash (Reasoning)100.0%$0.09641.4s100%
52GPT-5.5100.0%$0.10537.1s100%
53Muse Spark 1.3 (Reasoning, Medium)100.0%$0.0551.9m100%
54Gemma 4 26B (Reasoning)100.0%$0.00413.1m100%
55Gemini 2.5 Pro100.0%$0.09958.2s100%
56Xiaomi MIMO v2.597.0%$0.00271.1m88%
57Claude Opus 4.5100.0%$0.13119.8s100%
58Laguna S 2.198.5%$0.00062.0m91%
59Gemini 3.5 Flash (Reasoning)100.0%$0.11349.4s100%
60Qwen 3.6 27B100.0%$0.0342.7m100%
61Qwen 3.5 397B A17B100.0%$0.0452.6m100%
62DeepSeek-V2 Chat94.0%$0.004934.0s85%
63Qwen 3.5 35B98.5%$0.0152.0m91%
64Grok 4.5 (Reasoning, High)100.0%$0.0802.0m100%
65ByteDance Seed 2.0 Lite100.0%$0.0143.6m100%
66Claude Opus 4.6100.0%$0.15431.4s100%
67Gemma 4 26B96.0%$0.001827.2s76%
68MiniMax M2.796.0%$0.006321.4s76%
69Qwen 3.5 27B100.0%$0.0293.7m100%
70GPT-4o Mini (temp=1)96.0%$0.002633.4s76%
71Qwen 3.5 Plus (2026-02-15)100.0%$0.0213.9m100%
72Gemini 3.6 Flash (Reasoning, Minimal)96.0%$0.0297.1s76%
73Qwen 3.7 Max100.0%$0.0453.5m100%
74Claude Opus 4.7100.0%$0.18224.3s100%
75Gemini 2.5 Flash Lite93.0%$0.00234.8s75%
76Claude Opus 4.7 (Reasoning)100.0%$0.18425.0s100%
77GPT-5.6 Terra96.0%$0.0349.4s76%
78Claude Opus 5100.0%$0.19526.4s100%
79DeepSeek V4 Pro 0813 (Reasoning, High)100.0%$0.0603.5m100%
80GPT-4o, Aug. 6th (temp=1)94.5%$0.0299.1s75%
81Qwen 3.6 35B96.0%$0.0141.1m76%
82Qwen 3.8 Flash (Reasoning)100.0%$0.0154.9m100%
83GPT-5.6 Sol (Reasoning)100.0%$0.18659.0s100%
84Gemini 3.1 Pro (Preview)100.0%$0.1721.5m100%
85Mistral Large 385.0%$0.009117.5s85%
86 Kimi K3 (Reasoning, High)100.0%$0.1023.1m100%
87GPT-5.4 Mini (Reasoning)100.0%$0.1172.8m100%
88Grok 4.5 (Reasoning, Low)96.0%$0.04049.7s76%
89Thinking Machines Inkling (Reasoning)100.0%$0.0604.1m100%
90GPT-5.6 Terra (Reasoning)96.0%$0.06024.2s76%
91DeepSeek V3 (2024-12-26)91.5%$0.004540.2s75%
92Qwen 3.6 Max Preview100.0%$0.0843.7m100%
93Claude Haiku 4.585.0%$0.0248.2s85%
94DeepSeek V4 Flash (Reasoning)97.0%$0.00413.5m88%
95Claude Sonnet 5 (Reasoning)100.0%$0.1721.7m100%
96Claude Sonnet 5 (Reasoning, Low)100.0%$0.1751.7m100%
97Mistral Small 488.0%$0.00307.4s75%
98DeepSeek V4 Flash85.0%$0.002051.4s85%
99GPT-5.4 Mini92.0%$0.00877.9s68%
100Thinking Machines Inkling91.5%$0.01843.6s75%
101GPT-4o Mini (temp=0)92.0%$0.001920.7s68%
102Qwen 3.5 Flash97.0%$0.00403.8m88%
103Hy4 Preview (Reasoning, High)100.0%$0.0564.7m100%
104Grok 4.6 (Reasoning, High)100.0%$0.1043.7m100%
105GPT-4.1 Mini92.0%$0.004626.0s68%
106Kimi K2.5100.0%$0.0315.4m100%
107Mistral Large 285.0%$0.03720.5s85%
108GPT-4.192.0%$0.0248.5s68%
109WizardLM 2 8x22b96.0%$0.00982.3m76%
110Claude Opus 5 (Reasoning, Low)100.0%$0.24646.5s100%
111Claude Opus 5 (Reasoning)100.0%$0.24747.3s100%
112Z.AI GLM 4.592.0%$0.007548.1s68%
113Qwen 3.7 Flash (Reasoning)92.0%$0.001756.4s68%
114GPT-5.4 (Reasoning)100.0%$0.1752.6m100%
115Gemini 2.5 Flash Lite (Reasoning)92.0%$0.00731.0m68%
116Claude Sonnet 585.0%$0.06817.1s85%
117Kimi K2.6100.0%$0.0825.0m100%
118Z.AI GLM 4.5 Air94.5%$0.00713.2m75%
119Claude Sonnet 4.586.5%$0.07718.6s77%
120Laguna XS 2.188.0%$0.001241.3s63%
121GPT-5.5 (Reasoning)100.0%$0.2512.0m100%
122ByteDance Seed 1.6 Flash86.7%$0.002034.2s62%
123Z.AI GLM 5.3 Flash (Reasoning, Max)100.0%$0.00628.0m100%
124Z.AI GLM 5 Turbo96.0%$0.0443.6m76%
125Mistral Small 3.2 24B81.5%$0.001713.8s65%
126Ministral 8B80.0%$0.001615.6s68%
127Grok 4.384.0%$0.00947.8s61%
128Qwen 3.5 122B96.0%$0.0354.0m76%
129Llama 3.1 70B84.0%$0.006434.0s61%
130ByteDance Seed 2.0 Mini100.0%$0.00628.7m100%
131Grok 4.3 (Reasoning)91.0%$0.01313.9s46%
132Z.AI GLM 5.1100.0%$0.0817.3m100%
133Qwen 3.5 Plus (2026-04-20)92.0%$0.0233.1m68%
134Ministral 3 8B77.5%$0.002217.0s66%
135Qwen 2.5 72B84.0%$0.00561.2m61%
136DeepSeek V3.191.0%$0.005552.0s46%
137Mistral Medium 3.177.5%$0.01021.2s66%
138DeepSeek V4 Flash 0731 (Reasoning, High)96.0%$0.00735.6m76%
139Z.AI GLM 4.792.0%$0.0253.7m68%
140GPT-592.0%$0.0922.3m68%
141Z.AI GLM 4.7 Flash86.5%$0.00502.8m64%
142MiniMax M3100.0%$0.0369.3m100%
143Mistral Small 4 (Reasoning)85.0%$0.005124.7s44%
144Z.AI GLM 4.688.0%$0.0183.0m63%
145Claude Opus 4.8 (Reasoning)100.0%$0.3811.9m100%
146Claude Opus 4.6 (Reasoning)100.0%$0.3562.6m100%
147Claude Opus 4100.0%$0.3682.4m100%
148Arcee AI: Trinity Mini88.0%$0.00371.9m47%
149Qwen 3 32B84.0%$0.00422.9m61%
150Writer: Palmyra X580.0%$0.01618.4s48%
151GPT-5.5 (Reasoning, Low)91.0%$0.09742.6s46%
152Qwen 3.5 9B96.0%$0.00407.8m76%
153Gemma 3 27B77.5%$0.001627.5s47%
154Qwen 3.8 27B (Reasoning, XHigh)92.0%$0.0534.9m68%
155Hermes 3 405B83.0%$0.0151.0m42%
156Claude Opus 4.8 (Reasoning, Low)98.5%$0.3831.9m91%
157Gemma 3 12B76.5%$0.001430.4s44%
158Hermes 3 70B77.5%$0.004542.7s40%
159Ministral 3B70.0%$0.00079.8s45%
160Qwen 3.8 Max (Reasoning, XHigh)100.0%$0.1609.6m100%
161Ministral 3 3B67.5%$0.00079.9s46%
162Mistral NeMO60.0%$0.002415.4s60%
163Ministral 3 14B67.5%$0.003125.4s46%
164Z.AI GLM 591.0%$0.0374.6m46%
165Gemma 3 4B65.0%$0.000727.5s48%
166GPT-4.1 Nano64.0%$0.00096.9s46%
167Gemma 4 31B (Reasoning)91.0%$0.00435.8m46%
168Z.AI GLM 5.3 (Reasoning, Max)100.0%$0.18710.3m100%
169Nemotron 3 Nano82.0%$0.00392.8m28%
170Cydonia 24B V4.169.5%$0.00401.0m28%
171Claude Sonnet 4.6 (Reasoning)100.0%$0.4485.9m100%
172Qwen 3 235B A22B Instruct 250767.0%$0.00171.0m29%
173Cohere Command R+ (Aug. 2024)66.0%$0.05756.5s20%
174Aion 2.073.0%$0.0243.0m18%
175Aion 3.0 Mini76.0%$0.0304.9m28%
176Aion 3.080.5%$0.0745.8m29%
177DeepSeek V3 (2025-03-24)50.5%$0.003750.3s17%
178Nemotron 3 Super61.0%$0.00005.5m15%
93.47%

Individual Scenarios

Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100.0%
Gemini 3.8 Flash (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.3 (Reasoning, Max)100100100100100100.0%
GPT-5.6 Sol (Reasoning)100100100100100100.0%
Claude Opus 4.6 (Reasoning)100100100100100100.0%
Gemini 3.6 Flash (Reasoning)100100100100100100.0%
Gemini 3.7 Flash (Reasoning, Medium)100100100100100100.0%
Hy4 Preview (Reasoning, High)100100100100100100.0%
Muse Spark 1.2 (Reasoning, Medium)100100100100100100.0%
Qwen 3.7 Max100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100100100100.0%
Qwen 3.8 Flash (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100.0%
Muse Spark 1.1 (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.1100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100.0%
GPT-5.5 (Reasoning)100100100100100100.0%
Claude Sonnet 4.6 (Reasoning)100100100100100100.0%
Z.AI GLM 5.2 (Reasoning, High)100100100100100100.0%
Gemini 3.5 Flash (Reasoning)100100100100100100.0%
Z.AI GLM 5 Turbo100100100100100100.0%
Kimi K3 (Reasoning, High)100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100.0%
Kimi K2.6100100100100100100.0%
Claude Opus 4.7 (Reasoning)100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100.0%
GPT-5.6 Terra (Reasoning)100100100100100100.0%
Claude Opus 4.8 (Reasoning)100100100100100100.0%
Claude Opus 4.6100100100100100100.0%
Kimi K3 (Reasoning, Low)100100100100100100.0%
Claude Opus 5 (Reasoning, Low)100100100100100100.0%
Claude Opus 4.8 (Reasoning, Low)100100100100100100.0%
Muse Spark 1.1 (Reasoning, Minimal)100100100100100100.0%
GPT-5 Mini100100100100100100.0%
Claude Opus 5 (Reasoning)100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100.0%
Kimi K2.5100100100100100100.0%
Thinking Machines Inkling (Reasoning)100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
GPT-5.1100100100100100100.0%
Claude Sonnet 4.6100100100100100100.0%
GPT-5.6 Luna (Reasoning)100100100100100100.0%
MiniMax M3100100100100100100.0%
Claude Sonnet 5 (Reasoning)100100100100100100.0%
Qwen 3.5 122B100100100100100100.0%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100100100100.0%
Claude Sonnet 5 (Reasoning, Low)100100100100100100.0%
Qwen 3.5 27B100100100100100100.0%
Claude Opus 5100100100100100100.0%
Gemini 3 Flash (Preview, Reasoning)100100100100100100.0%
Claude Opus 4.7100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100.0%
Gemma 4 31B (Reasoning)100100100100100100.0%
Claude Opus 4.5100100100100100100.0%
Z.AI GLM 5100100100100100100.0%
ByteDance Seed 1.6100100100100100100.0%
GPT-5.2100100100100100100.0%
GPT-5.5100100100100100100.0%
Qwen 3.6 Flash100100100100100100.0%
DeepSeek V4 Pro (Reasoning)100100100100100100.0%
Gemma 4 26B (Reasoning)100100100100100100.0%
Muse Glimmer 30B (Reasoning, Medium)100100100100100100.0%
Aion 3.0100100100100100100.0%
o4 Mini High100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100100100100.0%
Qwen 3.7 Flash (Reasoning)100100100100100100.0%
Gemini 2.5 Pro100100100100100100.0%
Qwen 3.6 27B100100100100100100.0%
GPT-5.6 Terra100100100100100100.0%
DeepSeek V4 Flash 0731 (Reasoning, High)100100100100100100.0%
Qwen 3.6 35B100100100100100100.0%
Claude Sonnet 4100100100100100100.0%
Thinking Machines Inkling Small (Reasoning, High)100100100100100100.0%
Claude Opus 4100100100100100100.0%
GPT-4.1100100100100100100.0%
MiniMax M2.5100100100100100100.0%
Gemini 3.6 Flash (Reasoning, Minimal)100100100100100100.0%
o4 Mini100100100100100100.0%
Qwen 3.5 Plus (2026-02-15)100100100100100100.0%
Xiaomi MIMO v2.5 Pro100100100100100100.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100100100.0%
Gemini 3.5 Flash (Reasoning, Minimal)100100100100100100.0%
ByteDance Seed 2.0 Mini100100100100100100.0%
Qwen 3.5 Flash100100100100100100.0%
Gemini 3 Flash (Preview)100100100100100100.0%
Gemini 3.1 Flash Lite (Preview)100100100100100100.0%
Gemma 4 31B100100100100100100.0%
Gemini 3.1 Flash Lite100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
Gemma 4 26B100100100100100100.0%
GPT-OSS 120B100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning)100100100100100100.0%
GPT-5.4100100100100100100.0%
ByteDance Seed 2.0 Lite100100100100100100.0%
Gemini 2.5 Flash (Reasoning)100100100100100100.0%
GPT-5.4 Mini (Reasoning, Low)100100100100100100.0%
DeepSeek V3.2100100100100100100.0%
GPT-4o, Aug. 6th (temp=0)100100100100100100.0%
DeepSeek V4 Pro100100100100100100.0%
Inception Mercury 2100100100100100100.0%
Grok 4.20100100100100100100.0%
Hermes 3 405B100100100100100100.0%
Gemini 2.5 Flash100100100100100100.0%
GPT-5.4 Mini100100100100100100.0%
GPT-5 Nano100100100100100100.0%
GPT-5.4 Nano (Reasoning)100100100100100100.0%
Laguna S 2.1100100100100100100.0%
Gemini 2.5 Flash Lite100100100100100100.0%
GPT-4o Mini (temp=1)100100100100100100.0%
GPT-5.4 Nano (Reasoning, Low)100100100100100100.0%
Laguna XS 2.1100100100100100100.0%
Nemotron 3 Nano100100100100100100.0%
Qwen 2.5 72B100100100100100100.0%
GPT-5.4 Nano100100100100100100.0%
WizardLM 2 8x22b100100100100100100.0%
Hermes 3 70B100100100100100100.0%
Arcee AI: Trinity Mini100100100100100100.0%
Qwen 3.5 35B1001001001008597.0%
Aion 3.0 Mini1001001001008597.0%
DeepSeek V3 (2024-12-26)1001001001008597.0%
GPT-4o, Aug. 6th (temp=1)1001001001008597.0%
Thinking Machines Inkling1001001001008597.0%
DeepSeek V4 Flash (Reasoning)100100100858594.0%
DeepSeek-V2 Chat100100100858594.0%
Xiaomi MIMO v2.5100100100858594.0%
Z.AI GLM 4.71001001001006092.0%
Z.AI GLM 4.61001001001006092.0%
MiniMax M2.71001001001006092.0%
Z.AI GLM 4.51001001001006092.0%
Qwen 3.5 9B1001001001006092.0%
Gemini 2.5 Flash Lite (Reasoning)1001001001006092.0%
Z.AI GLM 4.7 Flash1001001001006092.0%
GPT-4.1 Mini1001001001006092.0%
Z.AI GLM 4.5 Air1001001001006092.0%
ByteDance Seed 1.6 Flash1001001001006092.0%
Claude Sonnet 4.51008585858588.0%
Claude Sonnet 5858585858585.0%
Mistral Large 3858585858585.0%
Claude Haiku 4.5858585858585.0%
DeepSeek V4 Flash858585858585.0%
Mistral Large 2858585858585.0%
Mistral Small 4858585858585.0%
GPT-5100100100606084.0%
Qwen 3 32B100100100606084.0%
Qwen 3 235B A22B Instruct 2507100100100606084.0%
GPT-4o Mini (temp=0)100100100606084.0%
Cohere Command R+ (Aug. 2024)100100100606084.0%
Mistral Small 3.2 24B1008585856083.0%
Grok 4.3 (Reasoning)1001001001001082.0%
DeepSeek V3.11001001001001082.0%
Cydonia 24B V4.110010085606081.0%
Ministral 8B858585856080.0%
Mistral Small 4 (Reasoning)10010085851076.0%
Writer: Palmyra X510010060606076.0%
Llama 3.1 70B10010060606076.0%
Mistral Medium 3.1858585606075.0%
Ministral 3 14B858585606075.0%
Ministral 3 8B858585606075.0%
Ministral 3 3B858585606075.0%
Ministral 3B858585606075.0%
Gemma 3 27B858585851070.0%
Gemma 3 4B858560606070.0%
Grok 4.31006060606068.0%
GPT-4.1 Nano1006060606068.0%
Nemotron 3 Super10010060601066.0%
Gemma 3 12B858585601065.0%
Mistral NeMO606060606060.0%
DeepSeek V3 (2025-03-24)10010060101056.0%
Aion 2.010010010101046.0%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100.0%
Gemini 3.8 Flash (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.3 (Reasoning, Max)100100100100100100.0%
GPT-5.6 Sol (Reasoning)100100100100100100.0%
Claude Opus 4.6 (Reasoning)100100100100100100.0%
Gemini 3.6 Flash (Reasoning)100100100100100100.0%
Gemini 3.7 Flash (Reasoning, Medium)100100100100100100.0%
Hy4 Preview (Reasoning, High)100100100100100100.0%
Muse Spark 1.2 (Reasoning, Medium)100100100100100100.0%
Qwen 3.7 Max100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100100100100.0%
Qwen 3.8 Flash (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100.0%
Muse Spark 1.1 (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.1100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100.0%
GPT-5.5 (Reasoning)100100100100100100.0%
Claude Sonnet 4.6 (Reasoning)100100100100100100.0%
Z.AI GLM 5.2 (Reasoning, High)100100100100100100.0%
Gemini 3.5 Flash (Reasoning)100100100100100100.0%
Kimi K3 (Reasoning, High)100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100.0%
Kimi K2.6100100100100100100.0%
Claude Opus 4.7 (Reasoning)100100100100100100.0%
Claude Opus 4.8 (Reasoning)100100100100100100.0%
Claude Opus 4.6100100100100100100.0%
Kimi K3 (Reasoning, Low)100100100100100100.0%
Claude Opus 5 (Reasoning, Low)100100100100100100.0%
GPT-5100100100100100100.0%
Muse Spark 1.1 (Reasoning, Minimal)100100100100100100.0%
GPT-5 Mini100100100100100100.0%
Claude Opus 5 (Reasoning)100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100.0%
Kimi K2.5100100100100100100.0%
Thinking Machines Inkling (Reasoning)100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
GPT-5.1100100100100100100.0%
Claude Sonnet 4.6100100100100100100.0%
GPT-5.6 Luna (Reasoning)100100100100100100.0%
MiniMax M3100100100100100100.0%
Claude Sonnet 5 (Reasoning)100100100100100100.0%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100100100100.0%
Claude Sonnet 5 (Reasoning, Low)100100100100100100.0%
Qwen 3.5 27B100100100100100100.0%
Claude Opus 5100100100100100100.0%
Gemini 3 Flash (Preview, Reasoning)100100100100100100.0%
Claude Opus 4.7100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100.0%
Claude Opus 4.5100100100100100100.0%
ByteDance Seed 1.6100100100100100100.0%
GPT-5.2100100100100100100.0%
GPT-5.5100100100100100100.0%
Qwen 3.6 Flash100100100100100100.0%
DeepSeek V4 Pro (Reasoning)100100100100100100.0%
Gemma 4 26B (Reasoning)100100100100100100.0%
Muse Glimmer 30B (Reasoning, Medium)100100100100100100.0%
o4 Mini High100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100100100100.0%
Gemini 2.5 Pro100100100100100100.0%
Qwen 3.6 27B100100100100100100.0%
DeepSeek V4 Flash (Reasoning)100100100100100100.0%
Claude Sonnet 4100100100100100100.0%
Thinking Machines Inkling Small (Reasoning, High)100100100100100100.0%
Claude Opus 4100100100100100100.0%
Qwen 3.5 35B100100100100100100.0%
MiniMax M2.5100100100100100100.0%
Aion 2.0100100100100100100.0%
o4 Mini100100100100100100.0%
MiniMax M2.7100100100100100100.0%
Qwen 3.5 Plus (2026-02-15)100100100100100100.0%
Xiaomi MIMO v2.5 Pro100100100100100100.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100100100.0%
Gemini 3.5 Flash (Reasoning, Minimal)100100100100100100.0%
ByteDance Seed 2.0 Mini100100100100100100.0%
Gemini 3 Flash (Preview)100100100100100100.0%
Gemini 3.1 Flash Lite (Preview)100100100100100100.0%
Gemma 4 31B100100100100100100.0%
Gemini 3.1 Flash Lite100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
GPT-OSS 120B100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning)100100100100100100.0%
GPT-5.4100100100100100100.0%
ByteDance Seed 2.0 Lite100100100100100100.0%
Gemini 2.5 Flash (Reasoning)100100100100100100.0%
Qwen 3.5 9B100100100100100100.0%
Xiaomi MIMO v2.5100100100100100100.0%
GPT-5.4 Mini (Reasoning, Low)100100100100100100.0%
DeepSeek V3.1100100100100100100.0%
DeepSeek V3.2100100100100100100.0%
GPT-4o, Aug. 6th (temp=0)100100100100100100.0%
DeepSeek V4 Pro100100100100100100.0%
Inception Mercury 2100100100100100100.0%
Grok 4.20100100100100100100.0%
Gemini 2.5 Flash100100100100100100.0%
GPT-5 Nano100100100100100100.0%
GPT-5.4 Nano (Reasoning)100100100100100100.0%
Grok 4.3100100100100100100.0%
GPT-5.4 Nano (Reasoning, Low)100100100100100100.0%
GPT-4o Mini (temp=0)100100100100100100.0%
GPT-5.4 Nano100100100100100100.0%
Claude Opus 4.8 (Reasoning, Low)1001001001008597.0%
Z.AI GLM 4.5 Air1001001001008597.0%
Laguna S 2.11001001001008597.0%
Qwen 3.5 Flash100100100858594.0%
DeepSeek-V2 Chat100100100858594.0%
Mistral Small 4 (Reasoning)100100100858594.0%
Z.AI GLM 5 Turbo1001001001006092.0%
GPT-5.6 Terra (Reasoning)1001001001006092.0%
Grok 4.5 (Reasoning, Low)1001001001006092.0%
Qwen 3.5 122B1001001001006092.0%
GPT-5.6 Terra1001001001006092.0%
DeepSeek V4 Flash 0731 (Reasoning, High)1001001001006092.0%
Z.AI GLM 4.71001001001006092.0%
Qwen 3.6 35B1001001001006092.0%
Gemini 3.6 Flash (Reasoning, Minimal)1001001001006092.0%
Z.AI GLM 4.51001001001006092.0%
Gemma 4 26B1001001001006092.0%
Gemini 2.5 Flash Lite (Reasoning)1001001001006092.0%
GPT-4.1 Mini1001001001006092.0%
GPT-4o, Aug. 6th (temp=1)1001001001006092.0%
GPT-4o Mini (temp=1)1001001001006092.0%
Llama 3.1 70B1001001001006092.0%
WizardLM 2 8x22b1001001001006092.0%
Mistral Small 410010085858591.0%
Gemma 3 12B1008585858588.0%
Gemini 2.5 Flash Lite10010085856086.0%
DeepSeek V3 (2024-12-26)10010085856086.0%
Thinking Machines Inkling10010085856086.0%
Claude Sonnet 4.5858585858585.0%
Claude Sonnet 5858585858585.0%
Mistral Large 3858585858585.0%
Claude Haiku 4.5858585858585.0%
DeepSeek V4 Flash858585858585.0%
Mistral Large 2858585858585.0%
Gemma 3 27B858585858585.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100606084.0%
Qwen 3.5 Plus (2026-04-20)100100100606084.0%
Qwen 3.7 Flash (Reasoning)100100100606084.0%
Z.AI GLM 4.6100100100606084.0%
GPT-4.1100100100606084.0%
GPT-5.4 Mini100100100606084.0%
Qwen 3 32B100100100606084.0%
Writer: Palmyra X5100100100606084.0%
GPT-5.5 (Reasoning, Low)1001001001001082.0%
Gemma 4 31B (Reasoning)1001001001001082.0%
Z.AI GLM 51001001001001082.0%
Z.AI GLM 4.7 Flash10010085606081.0%
Mistral Small 3.2 24B858585856080.0%
Mistral Medium 3.1858585856080.0%
Ministral 3 8B858585856080.0%
Ministral 8B858585856080.0%
Laguna XS 2.110010060606076.0%
Arcee AI: Trinity Mini10010085851076.0%
Qwen 2.5 72B1006060606068.0%
Hermes 3 405B10010060601066.0%
Ministral 3B856060606065.0%
Nemotron 3 Nano100100100101064.0%
Aion 3.010010085101061.0%
ByteDance Seed 1.6 Flash6060.0%
Ministral 3 14B606060606060.0%
GPT-4.1 Nano606060606060.0%
Gemma 3 4B606060606060.0%
Ministral 3 3B606060606060.0%
Mistral NeMO606060606060.0%
Cydonia 24B V4.11006060601058.0%
Nemotron 3 Super10010060101056.0%
Aion 3.0 Mini858585101055.0%
Hermes 3 70B856060601055.0%
Qwen 3 235B A22B Instruct 2507606060601050.0%
Cohere Command R+ (Aug. 2024)1006060101048.0%
DeepSeek V3 (2025-03-24)856060101045.0%