Comprehension

Subcategory of Language. 202 models scored.

Model Leaderboard

All models ranked by their Comprehension subcategory score.

# Model Comprehension Language Overall
1 Claude Opus 5.5 (Reasoning) 100.00% 99.76% 96.43%
2 Qwen 3.8 Max (Reasoning, XHigh) 100.00% 98.22% 96.21%
3 GPT-6.1 Sol (Reasoning, Medium) 100.00% 100.00% 95.88%
4 Gemini 3.8 Flash (Reasoning, Medium) 100.00% 98.16% 95.72%
5 Ember-1 (Reasoning, Max) 100.00% 98.20% 95.52%
6 Muse Wonder (Reasoning, Medium) 100.00% 99.93% 95.47%
7 Z.AI GLM 5.3 (Reasoning, Max) 100.00% 96.87% 95.20%
8 GPT-5.6 Sol (Reasoning, Medium) 100.00% 99.93% 95.15%
9 Claude Opus 4.6 (Reasoning) 100.00% 96.12% 95.06%
10 Gemini 3.6 Flash (Reasoning) 100.00% 98.22% 94.90%
11 Gemini 3.7 Flash (Reasoning, Medium) 100.00% 100.00% 94.85%
12 Hy4 Preview (Reasoning, High) 100.00% 97.11% 94.80%
13 Muse Spark 1.2 (Reasoning, Medium) 100.00% 100.00% 94.71%
14 Qwen 3.7 Max 100.00% 97.05% 94.55%
15 Z.AI GLM 5.3 Flash (Reasoning, Max) 100.00% 98.73% 94.28%
16 Qwen 3.8 Flash (Reasoning) 100.00% 99.75% 94.24%
17 Grok 4.5 (Reasoning, High) 100.00% 99.82% 94.12%
18 GPT-6 Luna (Reasoning, High) 100.00% 99.78% 93.95%
19 Qwen 3.6 Max Preview 100.00% 100.00% 93.72%
20 GPT-5.5 (Reasoning, Medium) 100.00% 99.69% 93.72%
21 Claude Sonnet 4.6 (Reasoning) 100.00% 97.58% 93.64%
22 Z.AI GLM 5.2 (Reasoning, High) 100.00% 99.82% 93.41%
23 Z.AI GLM 5 Turbo 100.00% 99.90% 93.29%
24 Kimi K3 (Reasoning, High) 100.00% 100.00% 92.99%
25 GPT-6 Sol (Reasoning, Medium) 100.00% 100.00% 92.63%
26 Kimi K2.6 100.00% 96.77% 92.57%
27 Claude Opus 4.7 (Reasoning) 100.00% 98.77% 92.53%
28 GPT-5.5 (Reasoning, Low) 100.00% 99.24% 92.51%
29 GPT-6 Luna (Reasoning, Medium) 100.00% 99.78% 92.40%
30 Aion 3.5 Mini (Reasoning, High) 100.00% 98.85% 92.36%
31 Claude Opus 4.6 100.00% 96.13% 92.31%
32 Mistral Large 4.0 (Reasoning) 100.00% 97.47% 92.14%
33 Kimi K3 (Reasoning, Low) 100.00% 99.90% 92.07%
34 Claude Opus 5 (Reasoning, Low) 100.00% 99.46% 92.06%
35 Aion 3.5 (Reasoning, High) 100.00% 99.90% 91.90%
36 Claude Opus 5 (Reasoning) 100.00% 99.37% 91.15%
37 Qwen 3.5 397B A17B 100.00% 95.01% 91.09%
38 Kimi K2.5 100.00% 97.10% 90.86%
39 Thinking Machines Inkling (Reasoning) 100.00% 95.61% 90.78%
40 Claude Sonnet 4.6 100.00% 100.00% 90.66%
41 MiniMax M3 100.00% 94.71% 90.45%
42 Claude Sonnet 5 (Reasoning) 100.00% 99.04% 90.40%
43 Qwen 3.5 122B 100.00% 95.01% 90.32%
44 Claude Sonnet 5 (Reasoning, Low) 100.00% 98.06% 90.16%
45 GPT-6 Sol 100.00% 100.00% 90.05%
46 Qwen 3.5 27B 100.00% 95.52% 90.05%
47 Claude Opus 5 100.00% 99.73% 89.97%
48 GPT-5.4 Mini (Reasoning) 100.00% 98.12% 89.82%
49 Qwen 3.5 Plus (2026-04-20) 100.00% 97.14% 89.79%
50 Claude Opus 4.5 100.00% 99.66% 89.60%
51 ByteDance Seed 1.6 100.00% 95.63% 89.59%
52 Claude Haiku 5.5 (Adaptive) 100.00% 99.77% 89.37%
53 Muse Glimmer 30B (Reasoning, Medium) 100.00% 99.91% 88.81%
54 DeepSeek V4 Flash (Reasoning) 100.00% 94.76% 88.06%
55 Z.AI GLM 4.6 100.00% 96.60% 87.64%
56 Claude Opus 4 100.00% 93.01% 87.22%
57 Qwen 3.5 35B 100.00% 91.95% 87.01%
58 Aion 2.0 100.00% 96.17% 86.66%
59 MiniMax M2.7 100.00% 84.80% 86.23%
60 Qwen 3.5 Plus (2026-02-15) 100.00% 95.10% 86.17%
61 Mistral Medium 3.5 (Reasoning) 100.00% 93.44% 85.32%
62 GPT-5.6 Luna 100.00% 99.33% 85.06%
63 Claude Haiku 5.5 (Reasoning, Low) 100.00% 99.90% 84.75%
64 Mistral Large 4.0 100.00% 90.42% 84.72%
65 Mistral Medium 3.5 100.00% 94.72% 84.52%
66 Mistral Large 3 100.00% 92.02% 84.29%
67 ByteDance Seed 2.0 Lite 100.00% 96.80% 84.27%
68 Claude Haiku 5.5 (Reasoning, Medium) 100.00% 100.00% 84.17%
69 DeepSeek-V2 Chat 100.00% 100.00% 84.09%
70 DeepSeek V3 (2024-12-26) 100.00% 87.88% 82.62%
71 Mistral Large 2 100.00% 85.22% 81.50%
72 Hermes 3 405B 100.00% 99.57% 80.80%
73 Laguna S 2.1 100.00% 97.91% 79.99%
74 DeepSeek V3 (2025-03-24) 100.00% 86.42% 79.93%
75 Ministral 3 3B 100.00% 68.10% 65.02%
76 DeepSeek V4.1 Flash (Reasoning, High) 95.00% 97.50% 94.30%
77 Gemini 3.1 Pro (Preview) 95.00% 94.90% 94.08%
78 GPT-5.4 (Reasoning) 95.00% 94.90% 93.85%
79 Muse Spark 1.1 (Reasoning, Medium) 95.00% 97.50% 93.81%
80 Gemini 4 Argon (Reasoning, Medium) 95.00% 97.50% 93.81%
81 Gemini 3.5 Flash (Reasoning) 95.00% 94.41% 93.35%
82 Claude Sonnet 5.5 (Reasoning) 95.00% 96.13% 92.77%
83 Grok 4.6 (Reasoning, High) 95.00% 95.04% 92.76%
84 Grok 4.7 (Reasoning, High) 95.00% 97.50% 92.62%
85 GPT-5.6 Terra (Reasoning, Medium) 95.00% 97.22% 92.49%
86 Claude Opus 4.8 (Reasoning) 95.00% 96.38% 92.33%
87 Claude Opus 4.8 (Reasoning, Low) 95.00% 96.31% 91.89%
88 Muse Spark 1.1 (Reasoning, Minimal) 95.00% 97.50% 91.43%
89 GPT-5 Mini 95.00% 96.49% 91.31%
90 Grok 4.3 (Reasoning) 95.00% 97.50% 90.99%
91 Grok 4.5 (Reasoning, Low) 95.00% 94.50% 90.94%
92 Grok 4.20 (Reasoning) 95.00% 96.61% 90.87%
93 GPT-5.6 Luna (Reasoning, Medium) 95.00% 96.67% 90.61%
94 Gemini 3 Flash (Preview, Reasoning) 95.00% 94.93% 89.93%
95 Z.AI GLM 5 95.00% 92.06% 89.60%
96 Gemma 4 26B (Reasoning) 95.00% 95.20% 89.02%
97 Z.AI GLM 5.3 Flash (Reasoning, Low) 95.00% 97.14% 88.76%
98 Claude Sonnet 4.5 95.00% 92.39% 87.54%
99 Thinking Machines Inkling Small (Reasoning, High) 95.00% 94.83% 87.39%
100 Claude Sonnet 5 95.00% 95.50% 87.34%
101 MiniMax M2.5 95.00% 96.05% 86.71%
102 Gemini 3.6 Flash (Reasoning, Minimal) 95.00% 97.50% 86.68%
103 Gemini 3.1 Flash Lite (Reasoning) 95.00% 96.70% 85.91%
104 Gemini 3.5 Flash (Reasoning, Minimal) 95.00% 97.50% 85.88%
105 Qwen 3.5 Flash 95.00% 91.94% 85.66%
106 Gemini 3.1 Flash Lite (Preview) 95.00% 94.98% 85.41%
107 Z.AI GLM 4.5 95.00% 97.33% 84.95%
108 GPT-OSS 120B 95.00% 97.18% 84.81%
109 Claude Haiku 4.5 95.00% 91.84% 83.36%
110 DeepSeek V3.1 95.00% 96.87% 82.35%
111 Z.AI GLM 4.7 Flash 95.00% 87.67% 82.21%
112 Z.AI GLM 4.5 Air 95.00% 95.05% 80.74%
113 Cydonia 24B V4.1 95.00% 72.49% 72.68%
114 WizardLM 2 8x22b 95.00% 78.05% 71.45%
115 Mistral NeMO 95.00% 80.80% 63.80%
116 Qwen 3.8 27B (Reasoning, XHigh) 90.00% 93.95% 92.91%
117 Xiaomi MIMO v2.6 Pro 90.00% 94.88% 91.50%
118 GPT-5.6 Sol 90.00% 94.60% 90.76%
119 GPT-5.1 90.00% 93.64% 90.73%
120 GPT-5.5 90.00% 94.15% 89.37%
121 Gemini 2.5 Pro 90.00% 92.57% 88.44%
122 Qwen 3.6 27B 90.00% 89.01% 88.33%
123 Qwen 3.6 35B 90.00% 93.56% 87.66%
124 Claude Sonnet 4 90.00% 91.31% 87.64%
125 Xiaomi MIMO v2.6 Flash 90.00% 88.24% 87.31%
126 GPT-4.1 90.00% 93.91% 86.82%
127 ByteDance Seed 2.0 Mini 90.00% 90.12% 85.69%
128 Gemini 3 Flash (Preview) 90.00% 95.00% 85.47%
129 Gemma 4 26B 90.00% 92.02% 84.89%
130 Qwen 3.5 9B 90.00% 88.18% 84.05%
131 GPT-6 Luna 90.00% 92.49% 83.73%
132 Aion 3.0 Mini 90.00% 93.68% 83.69%
133 DeepSeek V4 Flash 90.00% 88.50% 82.02%
134 Qwen 3 32B 90.00% 84.61% 79.37%
135 Z.AI GLM 5.1 85.00% 91.57% 93.74%
136 GPT-5 85.00% 91.50% 91.48%
137 DeepSeek V4 Pro 0813 (Reasoning, High) 85.00% 88.93% 90.21%
138 GPT-5.2 85.00% 91.19% 89.45%
139 Qwen 3.7 Flash (Reasoning) 85.00% 91.33% 88.56%
140 Xiaomi MIMO v2.5 Pro 85.00% 87.69% 86.05%
141 Gemini 3.1 Flash Lite 85.00% 90.90% 85.09%
142 GPT-5.4 (Reasoning, Low) 85.00% 90.79% 90.91%
143 Claude Opus 4.7 85.00% 92.32% 89.90%
144 Qwen 3.6 Flash 85.00% 89.33% 89.31%
145 DeepSeek V4 Pro (Reasoning) 85.00% 88.51% 89.28%
146 GPT-5.6 Terra 85.00% 91.87% 88.23%
147 GPT-5.4 Mini (Reasoning, Low) 85.00% 92.45% 83.57%
148 Muse Spark 1.3 (Reasoning, Medium) 80.00% 90.00% 94.06%
149 Aion 3.0 80.00% 86.85% 88.78%
150 DeepSeek V4 Flash 0731 (Reasoning, High) 80.00% 82.60% 87.97%
151 Z.AI GLM 4.7 80.00% 85.46% 87.67%
152 Gemini 3.5 Flash Lite (Reasoning, Minimal) 80.00% 87.22% 84.45%
153 Gemini 3.5 Flash Lite (Reasoning) 80.00% 87.69% 84.34%
154 DeepSeek V3.2 80.00% 85.01% 82.22%
155 GPT-4.1 Mini 80.00% 89.64% 81.40%
156 GPT-5.4 Mini 80.00% 88.75% 80.45%
157 Gemini 2.5 Flash Lite 80.00% 82.75% 79.91%
158 Nemotron 3 Nano 80.00% 87.63% 74.50%
159 Gemma 4 31B (Reasoning) 75.00% 83.82% 89.64%
160 Gemini 2.5 Flash (Reasoning) 75.00% 86.06% 84.14%
161 Inception Mercury 2 75.00% 87.32% 81.99%
162 Gemini 2.5 Flash 75.00% 86.23% 80.61%
163 Qwen 3 235B A22B Instruct 2507 75.00% 60.83% 78.07%
164 Grok 4.3 75.00% 84.74% 78.00%
165 Llama 3.1 70B 75.00% 80.18% 77.41%
166 Mistral Small 3.2 24B 75.00% 72.77% 77.36%
167 Hermes 3 70B 75.00% 81.66% 69.74%
168 DeepSeek V4 Pro 70.00% 72.80% 82.05%
169 GPT-5.4 Nano (Reasoning) 70.00% 83.99% 80.02%
170 Writer: Palmyra X5 70.00% 56.58% 78.11%
171 GPT-5.4 Nano (Reasoning, Low) 70.00% 81.87% 77.46%
172 Gemma 3 12B 70.00% 80.10% 76.07%
173 Qwen 2.5 72B 70.00% 68.95% 73.17%
174 GPT-5.4 Nano 70.00% 80.82% 72.16%
175 Gemma 3 4B 70.00% 72.28% 66.33%
176 GPT-5.4 65.00% 81.49% 84.31%
177 Gemini 2.5 Flash Lite (Reasoning) 65.00% 74.36% 83.10%
178 Nemotron 3 Super 65.00% 81.41% 81.69%
179 GPT-4o, Aug. 6th (temp=1) 65.00% 82.21% 81.28%
180 Grok 4.20 65.00% 78.86% 81.21%
181 Gemma 3 27B 65.00% 77.21% 75.70%
182 GPT-4.1 Nano 65.00% 78.95% 69.90%
183 Xiaomi MIMO v2.5 65.00% 76.33% 83.95%
184 Thinking Machines Inkling 60.00% 76.49% 73.96%
185 Arcee AI: Trinity Mini 60.00% 70.59% 67.68%
186 o4 Mini High 60.00% 79.76% 88.78%
187 o4 Mini 60.00% 80.00% 86.56%
188 Cohere Command R+ (Aug. 2024) 60.00% 66.58% 67.04%
189 GPT-5 Nano 55.00% 77.18% 80.16%
190 GPT-4o Mini (temp=1) 55.00% 77.50% 77.82%
191 Mistral Small 4 55.00% 51.96% 75.23%
192 Ministral 8B 55.00% 53.91% 63.77%
193 Gemma 4 31B 50.00% 75.00% 85.23%
194 GPT-4o, Aug. 6th (temp=0) 50.00% 75.00% 82.18%
195 Mistral Small 4 (Reasoning) 50.00% 60.53% 79.48%
196 GPT-4o Mini (temp=0) 50.00% 75.00% 76.86%
197 Mistral Medium 3.1 50.00% 49.50% 76.08%
198 Ministral 3 14B 50.00% 30.00% 70.45%
199 Ministral 3 8B 50.00% 48.96% 69.98%
200 ByteDance Seed 1.6 Flash 40.00% 61.23% 70.92%
201 Laguna XS 2.1 35.00% 64.47% 75.42%
202 Ministral 3B 25.00% 42.25% 59.25%