Language

9 scenarios across 2 subcategories. 161 models scored.

Subcategories

Subcategory Avg Score Best Model Best Score
Comprehension 85.50% GPT-5.6 Sol (Reasoning) 100.00%
Generation 89.89% Muse Spark 1.1 (Reasoning, Medium) 100.00%

Model Leaderboard

All models ranked by their Language category score.

# Model Language Comprehension Generation Overall
1 Qwen3.6 Max Preview 100.00% 100.00% 100.00% 93.72%
2 MoonshotAI: Kimi K3 (Reasoning, High) 100.00% 100.00% 100.00% 92.99%
3 Claude Sonnet 4.6 100.00% 100.00% 100.00% 90.66%
4 DeepSeek-V2 Chat 100.00% 100.00% 100.00% 84.09%
5 GPT-5.6 Sol (Reasoning) 99.93% 100.00% 99.86% 95.15%
6 Z.AI GLM 5 Turbo 99.90% 100.00% 99.80% 93.29%
7 MoonshotAI: Kimi K3 (Reasoning, Low) 99.90% 100.00% 99.80% 92.07%
8 Grok 4.5 (Reasoning, High) 99.82% 100.00% 99.64% 94.12%
9 Z.AI GLM 5.2 (Reasoning, High) 99.82% 100.00% 99.64% 93.41%
10 Claude Opus 5 99.73% 100.00% 99.47% 89.97%
11 GPT-5.5 (Reasoning) 99.69% 100.00% 99.37% 93.72%
12 Claude Opus 4.5 99.66% 100.00% 99.31% 89.60%
13 Hermes 3 405B 99.57% 100.00% 99.14% 80.80%
14 Claude Opus 5 (Reasoning, Low) 99.46% 100.00% 98.92% 92.06%
15 Claude Opus 5 (Reasoning) 99.37% 100.00% 98.74% 91.15%
16 GPT-5.6 Luna 99.33% 100.00% 98.66% 85.06%
17 GPT-5.5 (Reasoning, Low) 99.24% 100.00% 98.49% 92.51%
18 Claude Sonnet 5 (Reasoning) 99.04% 100.00% 98.08% 90.40%
19 Claude Opus 4.7 (Reasoning) 98.77% 100.00% 97.53% 92.53%
20 Gemini 3.6 Flash (Reasoning) 98.22% 100.00% 96.43% 94.90%
21 GPT-5.4 Mini (Reasoning) 98.12% 100.00% 96.25% 89.82%
22 Claude Sonnet 5 (Reasoning, Low) 98.06% 100.00% 96.12% 90.16%
23 Laguna S 2.1 97.91% 100.00% 95.82% 79.98%
24 Claude Sonnet 4.6 (Reasoning) 97.58% 100.00% 95.15% 93.64%
25 Muse Spark 1.1 (Reasoning, Medium) 97.50% 95.00% 100.00% 93.81%
26 Muse Spark 1.1 (Reasoning, Minimal) 97.50% 95.00% 100.00% 91.43%
27 Grok 4.3 (Reasoning) 97.50% 95.00% 100.00% 90.99%
28 Gemini 3.6 Flash (Reasoning, Minimal) 97.50% 95.00% 100.00% 86.68%
29 Gemini 3.5 Flash (Reasoning, Minimal) 97.50% 95.00% 100.00% 85.88%
30 Z.AI GLM 4.5 97.33% 95.00% 99.67% 84.95%
31 GPT-5.6 Terra (Reasoning) 97.22% 95.00% 99.44% 92.49%
32 GPT-OSS 120B 97.18% 95.00% 99.36% 84.81%
33 Qwen 3.5 Plus (2026-04-20) 97.14% 100.00% 94.29% 89.79%
34 MoonshotAI: Kimi K2.5 97.10% 100.00% 94.19% 90.86%
35 Qwen3.7 Max 97.05% 100.00% 94.10% 94.55%
36 DeepSeek V3.1 96.87% 95.00% 98.74% 82.35%
37 ByteDance Seed 2.0 Lite 96.80% 100.00% 93.60% 84.27%
38 MoonshotAI: Kimi K2.6 96.77% 100.00% 93.53% 92.57%
39 Gemini 3.1 Flash Lite (Reasoning) 96.70% 95.00% 98.40% 85.91%
40 GPT-5.6 Luna (Reasoning) 96.67% 95.00% 98.34% 90.61%
41 Grok 4.20 (Reasoning) 96.61% 95.00% 98.22% 90.87%
42 Z.AI GLM 4.6 96.60% 100.00% 93.20% 87.64%
43 GPT-5 Mini 96.49% 95.00% 97.98% 91.31%
44 Claude Opus 4.8 (Reasoning) 96.38% 95.00% 97.76% 92.33%
45 Claude Opus 4.8 (Reasoning, Low) 96.31% 95.00% 97.63% 91.89%
46 Aion 2.0 96.17% 100.00% 92.34% 86.66%
47 Claude Opus 4.6 96.13% 100.00% 92.27% 92.31%
48 Claude Opus 4.6 (Reasoning) 96.12% 100.00% 92.23% 95.06%
49 MiniMax M2.5 96.05% 95.00% 97.10% 86.71%
50 ByteDance Seed 1.6 95.63% 100.00% 91.26% 89.59%
51 Thinking Machines Inkling (Reasoning) 95.61% 100.00% 91.22% 90.78%
52 Qwen 3.5 27B 95.52% 100.00% 91.05% 90.05%
53 Claude Sonnet 5 95.50% 95.00% 96.00% 87.34%
54 Gemma 4 26B (Reasoning) 95.20% 95.00% 95.40% 89.02%
55 Qwen 3.5 Plus (2026-02-15) 95.10% 100.00% 90.21% 86.17%
56 Z.AI GLM 4.5 Air 95.05% 95.00% 95.10% 80.74%
57 Qwen 3.5 122B 95.01% 100.00% 90.03% 90.32%
58 Qwen 3.5 397B A17B 95.01% 100.00% 90.03% 91.09%
59 Gemini 3 Flash (Preview) 95.00% 90.00% 100.00% 85.47%
60 Gemini 3.1 Flash Lite (Preview) 94.98% 95.00% 94.95% 85.41%
61 Gemini 3 Flash (Preview, Reasoning) 94.93% 95.00% 94.87% 89.93%
62 GPT-5.4 (Reasoning) 94.90% 95.00% 94.80% 93.85%
63 Gemini 3.1 Pro (Preview) 94.90% 95.00% 94.80% 94.08%
64 DeepSeek V4 Flash (Reasoning) 94.76% 100.00% 89.51% 88.06%
65 MiniMax M3 94.71% 100.00% 89.43% 90.45%
66 GPT-5.6 Sol 94.60% 90.00% 99.20% 90.76%
67 Grok 4.5 (Reasoning, Low) 94.50% 95.00% 94.00% 90.94%
68 Gemini 3.5 Flash (Reasoning) 94.41% 95.00% 93.83% 93.35%
69 GPT-5.5 94.15% 90.00% 98.29% 89.37%
70 GPT-4.1 93.91% 90.00% 97.82% 86.82%
71 Aion 3.0 Mini 93.68% 90.00% 97.35% 83.69%
72 GPT-5.1 93.64% 90.00% 97.28% 90.73%
73 Qwen 3.6 35B 93.56% 90.00% 97.12% 87.66%
74 Claude Opus 4 93.01% 100.00% 86.02% 87.22%
75 Gemini 2.5 Pro 92.57% 90.00% 95.14% 88.44%
76 GPT-5.4 Mini (Reasoning, Low) 92.45% 85.00% 99.89% 83.57%
77 Claude Sonnet 4.5 92.39% 95.00% 89.77% 87.54%
78 Claude Opus 4.7 92.32% 85.00% 99.65% 89.90%
79 Z.AI GLM 5 92.06% 95.00% 89.12% 89.60%
80 Mistral Large 3 92.02% 100.00% 84.05% 84.29%
81 Gemma 4 26B 92.02% 90.00% 94.03% 84.89%
82 Qwen 3.5 35B 91.95% 100.00% 83.90% 87.01%
83 Qwen 3.5 Flash 91.94% 95.00% 88.89% 85.66%
84 GPT-5.6 Terra 91.87% 85.00% 98.75% 88.23%
85 Claude Haiku 4.5 91.84% 95.00% 88.67% 83.36%
86 Z.AI GLM 5.1 91.57% 85.00% 98.14% 93.74%
87 GPT-5 91.50% 85.00% 98.01% 91.48%
88 Claude Sonnet 4 91.31% 90.00% 92.61% 87.64%
89 GPT-5.2 91.19% 85.00% 97.39% 89.45%
90 Gemini 3.1 Flash Lite 90.90% 85.00% 96.80% 85.09%
91 GPT-5.4 (Reasoning, Low) 90.79% 85.00% 96.58% 90.91%
92 ByteDance Seed 2.0 Mini 90.12% 90.00% 90.24% 85.69%
93 GPT-4.1 Mini 89.64% 80.00% 99.27% 81.40%
94 Qwen 3.6 Flash 89.33% 85.00% 93.66% 89.31%
95 Qwen 3.6 27B 89.01% 90.00% 88.01% 88.33%
96 GPT-5.4 Mini 88.75% 80.00% 97.50% 80.45%
97 DeepSeek V4 Pro (Reasoning) 88.51% 85.00% 92.02% 89.28%
98 DeepSeek V4 Flash 88.50% 90.00% 87.00% 82.02%
99 Qwen 3.5 9B 88.18% 90.00% 86.36% 84.05%
100 DeepSeek V3 (2024-12-26) 87.88% 100.00% 75.76% 82.62%
101 Gemini 3.5 Flash Lite (Reasoning) 87.69% 80.00% 95.38% 84.34%
102 Xiaomi MIMO v2.5 Pro 87.69% 85.00% 90.37% 86.05%
103 Z.AI GLM 4.7 Flash 87.67% 95.00% 80.35% 82.21%
104 Nemotron 3 Nano 87.63% 80.00% 95.26% 74.50%
105 Inception Mercury 2 87.32% 75.00% 99.64% 81.99%
106 Gemini 3.5 Flash Lite (Reasoning, Minimal) 87.22% 80.00% 94.43% 84.45%
107 Aion 3.0 86.85% 80.00% 93.70% 88.78%
108 DeepSeek V3 (2025-03-24) 86.42% 100.00% 72.83% 79.93%
109 Gemini 2.5 Flash 86.23% 75.00% 97.46% 80.61%
110 Gemini 2.5 Flash (Reasoning) 86.06% 75.00% 97.13% 84.14%
111 Z.AI GLM 4.7 85.46% 80.00% 90.93% 87.67%
112 Mistral Large 2 85.22% 100.00% 70.43% 81.50%
113 DeepSeek V3.2 85.01% 80.00% 90.03% 82.22%
114 MiniMax M2.7 84.80% 100.00% 69.59% 86.23%
115 Grok 4.3 84.74% 75.00% 94.47% 78.00%
116 Qwen 3 32B 84.61% 90.00% 79.21% 79.37%
117 GPT-5.4 Nano (Reasoning) 83.99% 70.00% 97.99% 80.02%
118 Gemma 4 31B (Reasoning) 83.82% 75.00% 92.64% 89.64%
119 Gemini 2.5 Flash Lite 82.75% 80.00% 85.50% 79.91%
120 GPT-4o, Aug. 6th (temp=1) 82.21% 65.00% 99.43% 81.28%
121 GPT-5.4 Nano (Reasoning, Low) 81.87% 70.00% 93.74% 77.46%
122 Hermes 3 70B 81.66% 75.00% 88.33% 69.74%
123 GPT-5.4 81.49% 65.00% 97.98% 84.31%
124 Nemotron 3 Super 81.41% 65.00% 97.82% 81.69%
125 GPT-5.4 Nano 80.82% 70.00% 91.64% 72.16%
126 Mistral NeMO 80.80% 95.00% 66.60% 63.80%
127 Llama 3.1 70B 80.18% 75.00% 85.36% 77.41%
128 Gemma 3 12B 80.10% 70.00% 90.19% 76.07%
129 o4 Mini 80.00% 60.00% 100.00% 86.56%
130 o4 Mini High 79.76% 60.00% 99.51% 88.78%
131 GPT-4.1 Nano 78.95% 65.00% 92.91% 69.90%
132 Grok 4.20 78.86% 65.00% 92.72% 81.21%
133 WizardLM 2 8x22b 78.05% 95.00% 61.10% 71.45%
134 GPT-4o Mini (temp=1) 77.50% 55.00% 100.00% 77.82%
135 Gemma 3 27B 77.21% 65.00% 89.42% 75.70%
136 GPT-5 Nano 77.18% 55.00% 99.35% 80.16%
137 Thinking Machines Inkling 76.49% 60.00% 92.99% 73.96%
138 Xiaomi MIMO v2.5 76.33% 65.00% 87.66% 83.95%
139 Gemma 4 31B 75.00% 50.00% 100.00% 85.23%
140 GPT-4o, Aug. 6th (temp=0) 75.00% 50.00% 100.00% 82.18%
141 GPT-4o Mini (temp=0) 75.00% 50.00% 100.00% 76.86%
142 Gemini 2.5 Flash Lite (Reasoning) 74.36% 65.00% 83.71% 83.10%
143 DeepSeek V4 Pro 72.80% 70.00% 75.59% 82.05%
144 Mistral Small 3.2 24B 72.77% 75.00% 70.53% 77.36%
145 Cydonia 24B V4.1 72.49% 95.00% 49.98% 72.68%
146 Gemma 3 4B 72.28% 70.00% 74.56% 66.33%
147 Arcee AI: Trinity Mini 70.59% 60.00% 81.18% 67.68%
148 Qwen 2.5 72B 68.95% 70.00% 67.91% 73.17%
149 Ministral 3 3B 68.10% 100.00% 36.20% 65.02%
150 Cohere Command R+ (Aug. 2024) 66.58% 60.00% 73.15% 67.04%
151 Laguna XS 2.1 64.47% 35.00% 93.93% 75.42%
152 ByteDance Seed 1.6 Flash 61.23% 40.00% 82.45% 70.92%
153 Qwen3 235B A22B Instruct 2507 60.83% 75.00% 46.67% 78.07%
154 Mistral Small 4 (Reasoning) 60.53% 50.00% 71.06% 79.48%
155 Writer: Palmyra X5 56.58% 70.00% 43.16% 78.11%
156 Ministral 8B 53.91% 55.00% 52.81% 63.77%
157 Mistral Small 4 51.96% 55.00% 48.93% 75.23%
158 Mistral Medium 3.1 49.50% 50.00% 49.00% 76.08%
159 Ministral 3 8B 48.96% 50.00% 47.92% 69.98%
160 Ministral 3B 42.25% 25.00% 59.49% 59.25%
161 Ministral 3 14B 30.00% 50.00% 10.00% 70.45%