Tooling

15 scenarios across 1 subcategory. 200 models scored.

Subcategories

Subcategory Avg Score Best Model Best Score
XML 96.84% Claude Opus 5.5 (Reasoning) 100.00%

Model Leaderboard

All models ranked by their Tooling category score.

# Model Tooling XML Overall
1 Claude Opus 5.5 (Reasoning) 100.00% 100.00% 96.43%
2 Qwen 3.8 Max (Reasoning, XHigh) 100.00% 100.00% 96.21%
3 GPT-6.1 Sol (Reasoning, Medium) 100.00% 100.00% 95.88%
4 Gemini 3.8 Flash (Reasoning, Medium) 100.00% 100.00% 95.72%
5 Z.AI GLM 5.3 (Reasoning, Max) 100.00% 100.00% 95.20%
6 GPT-5.6 Sol (Reasoning, Medium) 100.00% 100.00% 95.15%
7 Claude Opus 4.6 (Reasoning) 100.00% 100.00% 95.06%
8 Gemini 3.6 Flash (Reasoning) 100.00% 100.00% 94.90%
9 Hy4 Preview (Reasoning, High) 100.00% 100.00% 94.80%
10 Muse Spark 1.2 (Reasoning, Medium) 100.00% 100.00% 94.71%
11 Qwen 3.7 Max 100.00% 100.00% 94.55%
12 DeepSeek V4.1 Flash (Reasoning, High) 100.00% 100.00% 94.30%
13 Z.AI GLM 5.3 Flash (Reasoning, Max) 100.00% 100.00% 94.28%
14 Muse Spark 1.3 (Reasoning, Medium) 100.00% 100.00% 94.06%
15 GPT-6 Luna (Reasoning, High) 100.00% 100.00% 93.95%
16 GPT-5.4 (Reasoning) 100.00% 100.00% 93.85%
17 Muse Spark 1.1 (Reasoning, Medium) 100.00% 100.00% 93.81%
18 Z.AI GLM 5.1 100.00% 100.00% 93.74%
19 Qwen 3.6 Max Preview 100.00% 100.00% 93.72%
20 GPT-5.5 (Reasoning, Medium) 100.00% 100.00% 93.72%
21 Claude Sonnet 4.6 (Reasoning) 100.00% 100.00% 93.64%
22 Gemini 3.5 Flash (Reasoning) 100.00% 100.00% 93.35%
23 Kimi K3 (Reasoning, High) 100.00% 100.00% 92.99%
24 Claude Sonnet 5.5 (Reasoning) 100.00% 100.00% 92.77%
25 Grok 4.6 (Reasoning, High) 100.00% 100.00% 92.76%
26 Grok 4.7 (Reasoning, High) 100.00% 100.00% 92.62%
27 Claude Opus 4.7 (Reasoning) 100.00% 100.00% 92.53%
28 Claude Opus 4.6 100.00% 100.00% 92.31%
29 Mistral Large 4.0 (Reasoning) 100.00% 100.00% 92.14%
30 Kimi K3 (Reasoning, Low) 100.00% 100.00% 92.07%
31 Xiaomi MIMO v2.6 Pro 100.00% 100.00% 91.50%
32 Grok 4.20 (Reasoning) 100.00% 100.00% 90.87%
33 Kimi K2.5 100.00% 100.00% 90.86%
34 Thinking Machines Inkling (Reasoning) 100.00% 100.00% 90.78%
35 GPT-5.6 Sol 100.00% 100.00% 90.76%
36 Claude Sonnet 4.6 100.00% 100.00% 90.66%
37 Gemini 3 Flash (Preview, Reasoning) 100.00% 100.00% 89.93%
38 GPT-5.4 Mini (Reasoning) 100.00% 100.00% 89.82%
39 Claude Opus 4.5 100.00% 100.00% 89.60%
40 GPT-5.2 100.00% 100.00% 89.45%
41 Claude Haiku 5.5 (Adaptive) 100.00% 100.00% 89.37%
42 GPT-5.5 100.00% 100.00% 89.37%
43 o4 Mini High 100.00% 100.00% 88.78%
44 Z.AI GLM 5.3 Flash (Reasoning, Low) 100.00% 100.00% 88.76%
45 Gemini 2.5 Pro 100.00% 100.00% 88.44%
46 Claude Sonnet 4 100.00% 100.00% 87.64%
47 Thinking Machines Inkling Small (Reasoning, High) 100.00% 100.00% 87.39%
48 Claude Opus 4 100.00% 100.00% 87.22%
49 o4 Mini 100.00% 100.00% 86.56%
50 Xiaomi MIMO v2.5 Pro 100.00% 100.00% 86.05%
51 Gemini 3.5 Flash (Reasoning, Minimal) 100.00% 100.00% 85.88%
52 Mistral Medium 3.5 (Reasoning) 100.00% 100.00% 85.32%
53 Gemma 4 31B 100.00% 100.00% 85.23%
54 GPT-OSS 120B 100.00% 100.00% 84.81%
55 Claude Haiku 5.5 (Reasoning, Low) 100.00% 100.00% 84.75%
56 Gemini 2.5 Flash (Reasoning) 100.00% 100.00% 84.14%
57 GPT-5.4 Mini (Reasoning, Low) 100.00% 100.00% 83.57%
58 Gemini 3.7 Flash (Reasoning, Medium) 99.99% 99.99% 94.85%
59 DeepSeek V3.2 99.99% 99.99% 82.22%
60 Grok 4.5 (Reasoning, High) 99.99% 99.99% 94.12%
61 GPT-5 Mini 99.99% 99.99% 91.31%
62 GPT-6 Luna (Reasoning, Medium) 99.99% 99.99% 92.40%
63 Gemini 3.1 Flash Lite (Preview) 99.98% 99.98% 85.41%
64 Gemini 3.1 Flash Lite 99.97% 99.97% 85.09%
65 GPT-5.4 (Reasoning, Low) 99.97% 99.97% 90.91%
66 GPT-5.6 Luna (Reasoning, Medium) 99.97% 99.97% 90.61%
67 Gemini 2.5 Flash 99.97% 99.97% 80.61%
68 MiniMax M3 99.96% 99.96% 90.45%
69 Gemini 3.5 Flash Lite (Reasoning) 99.96% 99.96% 84.34%
70 GPT-4o, Aug. 6th (temp=0) 99.96% 99.96% 82.18%
71 GPT-6 Sol (Reasoning, Medium) 99.95% 99.95% 92.63%
72 GPT-6 Sol 99.95% 99.95% 90.05%
73 ByteDance Seed 2.0 Lite 99.93% 99.93% 84.27%
74 Gemini 3.1 Pro (Preview) 99.92% 99.92% 94.08%
75 GPT-5.6 Luna 99.90% 99.90% 85.06%
76 Gemini 3.5 Flash Lite (Reasoning, Minimal) 99.89% 99.89% 84.45%
77 Kimi K2.6 99.81% 99.81% 92.57%
78 Qwen 3.5 397B A17B 99.81% 99.81% 91.09%
79 Gemini 3.1 Flash Lite (Reasoning) 99.81% 99.81% 85.91%
80 Mistral Large 4.0 99.81% 99.81% 84.72%
81 DeepSeek V4 Pro 0813 (Reasoning, High) 99.79% 99.79% 90.21%
82 Qwen 3.5 Plus (2026-02-15) 99.78% 99.78% 86.17%
83 Qwen 3.6 Flash 99.78% 99.78% 89.31%
84 Xiaomi MIMO v2.6 Flash 99.77% 99.77% 87.31%
85 Claude Opus 5 99.77% 99.77% 89.97%
86 Claude Opus 5 (Reasoning, Low) 99.75% 99.75% 92.06%
87 ByteDance Seed 2.0 Mini 99.70% 99.70% 85.69%
88 Claude Opus 5 (Reasoning) 99.58% 99.58% 91.15%
89 DeepSeek V4 Pro 99.57% 99.57% 82.05%
90 Claude Opus 4.8 (Reasoning) 99.53% 99.53% 92.33%
91 Claude Sonnet 5 (Reasoning, Low) 99.52% 99.52% 90.16%
92 Claude Opus 4.8 (Reasoning, Low) 99.48% 99.48% 91.89%
93 Claude Opus 4.7 99.48% 99.48% 89.90%
94 Xiaomi MIMO v2.5 99.46% 99.46% 83.95%
95 DeepSeek V4 Pro (Reasoning) 99.40% 99.40% 89.28%
96 GPT-5 Nano 99.34% 99.34% 80.16%
97 Qwen 3.5 122B 99.33% 99.33% 90.32%
98 GPT-5.6 Terra 99.33% 99.33% 88.23%
99 Gemini 3.6 Flash (Reasoning, Minimal) 99.33% 99.33% 86.68%
100 GPT-6 Luna 99.33% 99.33% 83.73%
101 Grok 4.5 (Reasoning, Low) 99.33% 99.33% 90.94%
102 MiniMax M2.7 99.32% 99.32% 86.23%
103 GPT-5.6 Terra (Reasoning, Medium) 99.31% 99.31% 92.49%
104 Claude Sonnet 5 (Reasoning) 99.17% 99.17% 90.40%
105 Qwen 3.5 27B 99.17% 99.17% 90.05%
106 DeepSeek V4 Flash 0731 (Reasoning, High) 99.13% 99.13% 87.97%
107 Gemma 4 26B (Reasoning) 99.04% 99.04% 89.02%
108 GPT-4o, Aug. 6th (temp=1) 98.86% 98.86% 81.28%
109 Laguna S 2.1 98.80% 98.80% 79.99%
110 DeepSeek-V2 Chat 98.80% 98.80% 84.09%
111 Z.AI GLM 4.5 Air 98.75% 98.75% 80.74%
112 GPT-4o Mini (temp=1) 98.71% 98.71% 77.82%
113 GPT-5 98.67% 98.67% 91.48%
114 Z.AI GLM 4.7 98.67% 98.67% 87.67%
115 DeepSeek V3 (2024-12-26) 98.58% 98.58% 82.62%
116 Z.AI GLM 4.5 98.58% 98.58% 84.95%
117 GPT-5.4 Mini 98.55% 98.55% 80.45%
118 GPT-5.5 (Reasoning, Low) 98.50% 98.50% 92.51%
119 Gemma 4 31B (Reasoning) 98.50% 98.50% 89.64%
120 Z.AI GLM 5 98.50% 98.50% 89.60%
121 Grok 4.3 (Reasoning) 98.47% 98.47% 90.99%
122 Z.AI GLM 5.2 (Reasoning, High) 98.33% 98.33% 93.41%
123 Muse Spark 1.1 (Reasoning, Minimal) 98.33% 98.33% 91.43%
124 GPT-5.1 98.33% 98.33% 90.73%
125 ByteDance Seed 1.6 98.33% 98.33% 89.59%
126 Inception Mercury 2 98.33% 98.33% 81.99%
127 Gemini 2.5 Flash Lite (Reasoning) 98.28% 98.28% 83.10%
128 MiniMax M2.5 98.27% 98.27% 86.71%
129 Claude Haiku 5.5 (Reasoning, Max) 98.25% 98.25% 94.65%
130 Aion 3.5 Mini (Reasoning, High) 98.04% 98.04% 92.36%
131 GPT-5.4 98.04% 98.04% 84.31%
132 Gemini 3 Flash (Preview) 98.04% 98.04% 85.47%
133 Mistral Medium 3.5 98.00% 98.00% 84.52%
134 Z.AI GLM 4.6 97.99% 97.99% 87.64%
135 Qwen 3.6 27B 97.91% 97.91% 88.33%
136 Claude Sonnet 4.5 97.75% 97.75% 87.54%
137 GPT-4.1 97.71% 97.71% 86.82%
138 GPT-4o Mini (temp=0) 97.45% 97.45% 76.86%
139 Aion 3.5 (Reasoning, High) 97.42% 97.42% 91.90%
140 Mistral Large 2 97.31% 97.31% 81.50%
141 Mistral Small 4 (Reasoning) 97.28% 97.28% 79.48%
142 Mistral Large 3 97.22% 97.22% 84.29%
143 Hermes 3 405B 96.98% 96.98% 80.80%
144 GPT-4.1 Mini 96.94% 96.94% 81.40%
145 Qwen 3.5 9B 96.84% 96.84% 84.05%
146 Mistral Small 3.2 24B 96.82% 96.82% 77.36%
147 Qwen 2.5 72B 96.82% 96.82% 73.17%
148 DeepSeek V3.1 96.80% 96.80% 82.35%
149 Claude Haiku 4.5 96.75% 96.75% 83.36%
150 Aion 3.0 96.54% 96.54% 88.78%
151 GPT-5.4 Nano (Reasoning) 96.43% 96.43% 80.02%
152 DeepSeek V4 Flash (Reasoning) 96.17% 96.17% 88.06%
153 Gemma 3 27B 96.15% 96.15% 75.70%
154 Writer: Palmyra X5 96.12% 96.12% 78.11%
155 Gemini 2.5 Flash Lite 96.00% 96.00% 79.91%
156 Claude Sonnet 5 95.99% 95.99% 87.34%
157 Ministral 3 8B 95.77% 95.77% 69.98%
158 Arcee AI: Trinity Mini 95.64% 95.64% 67.68%
159 Qwen 3.5 Plus (2026-04-20) 95.33% 95.33% 89.79%
160 Qwen 3 32B 95.19% 95.19% 79.37%
161 Aion 2.0 95.10% 95.10% 86.66%
162 Claude Haiku 5.5 (Reasoning, Medium) 95.00% 95.00% 84.17%
163 Grok 4.20 95.00% 95.00% 81.21%
164 Qwen 3.5 35B 94.74% 94.74% 87.01%
165 Hermes 3 70B 94.47% 94.47% 69.74%
166 Z.AI GLM 5 Turbo 94.30% 94.30% 93.29%
167 Mistral Medium 3.1 94.17% 94.17% 76.08%
168 Gemma 3 12B 94.16% 94.16% 76.07%
169 DeepSeek V4 Flash 94.00% 94.00% 82.02%
170 Qwen 3 235B A22B Instruct 2507 93.86% 93.86% 78.07%
171 Mistral Small 4 93.85% 93.85% 75.23%
172 Qwen 3.8 27B (Reasoning, XHigh) 93.67% 93.67% 92.91%
173 Muse Glimmer 30B (Reasoning, Medium) 93.33% 93.33% 88.81%
174 Z.AI GLM 4.7 Flash 92.53% 92.53% 82.21%
175 Gemma 3 4B 92.40% 92.40% 66.33%
176 Gemma 4 26B 91.94% 91.94% 84.89%
177 GPT-5.4 Nano 91.85% 91.85% 72.16%
178 GPT-5.4 Nano (Reasoning, Low) 91.46% 91.46% 77.46%
179 WizardLM 2 8x22b 91.22% 91.22% 71.45%
180 Grok 4.3 91.21% 91.21% 78.00%
181 Qwen 3.8 Flash (Reasoning) 90.00% 90.00% 94.24%
182 Ministral 3 3B 89.41% 89.41% 65.02%
183 Qwen 3.5 Flash 89.39% 89.39% 85.66%
184 Laguna XS 2.1 88.97% 88.97% 75.42%
185 Qwen 3.7 Flash (Reasoning) 88.67% 88.67% 88.56%
186 Nemotron 3 Super 88.08% 88.08% 81.69%
187 Ministral 3 14B 87.84% 87.84% 70.45%
188 Llama 3.1 70B 87.82% 87.82% 77.41%
189 Cohere Command R+ (Aug. 2024) 87.53% 87.53% 67.04%
190 Cydonia 24B V4.1 86.72% 86.72% 72.68%
191 DeepSeek V3 (2025-03-24) 86.36% 86.36% 79.93%
192 Ministral 3B 84.70% 84.70% 59.25%
193 Ministral 8B 84.65% 84.65% 63.77%
194 Nemotron 3 Nano 83.65% 83.65% 74.50%
195 Qwen 3.6 35B 82.67% 82.67% 87.66%
196 Mistral NeMO 79.34% 79.34% 63.80%
197 GPT-4.1 Nano 78.47% 78.47% 69.90%
198 Aion 3.0 Mini 75.94% 75.94% 83.69%
199 Thinking Machines Inkling 56.68% 56.68% 73.96%
200 ByteDance Seed 1.6 Flash 47.33% 47.33% 70.92%