Language
9 scenarios across 2 subcategories. 155 models scored.
Subcategories
| Subcategory | Avg Score | Best Model | Best Score |
|---|---|---|---|
| Comprehension | 83.58% | Qwen3.7 Max | 100.00% |
| Generation | 87.20% | Qwen3.6 Max Preview | 100.00% |
Model Leaderboard
All models ranked by their Language category score.
| # | Model | Language | Comprehension | Generation | Overall |
|---|---|---|---|---|---|
| 1 | Qwen3.6 Max Preview | 100.00% | 100.00% | 100.00% | 94.54% |
| 2 | Claude Sonnet 4.6 | 100.00% | 100.00% | 100.00% | 91.15% |
| 3 | DeepSeek-V2 Chat | 100.00% | 100.00% | 100.00% | 84.83% |
| 4 | Z.AI GLM 5 Turbo | 99.90% | 100.00% | 99.80% | 94.27% |
| 5 | GPT-5.5 (Reasoning) | 99.69% | 100.00% | 99.37% | 92.98% |
| 6 | Claude Opus 4.5 | 99.66% | 100.00% | 99.31% | 89.69% |
| 7 | Hermes 3 405B | 99.57% | 100.00% | 99.14% | 82.86% |
| 8 | GPT-5.5 (Reasoning, Low) | 99.24% | 100.00% | 98.49% | 92.59% |
| 9 | Grok 4.20 (Beta, Reasoning) | 99.08% | 100.00% | 98.15% | 91.49% |
| 10 | Claude Opus 4.7 (Reasoning) | 98.77% | 100.00% | 97.53% | 93.23% |
| 11 | GPT-4o, May 13th (temp=0) | 98.72% | 100.00% | 97.44% | 85.36% |
| 12 | GPT-5.4 Mini (Reasoning) | 98.12% | 100.00% | 96.25% | 90.65% |
| 13 | Claude Sonnet 4.6 (Reasoning) | 97.58% | 100.00% | 95.15% | 93.66% |
| 14 | Grok 4.3 (Reasoning) | 97.50% | 95.00% | 100.00% | 93.60% |
| 15 | Gemini 3.5 Flash (Reasoning, Minimal) | 97.50% | 95.00% | 100.00% | 86.47% |
| 16 | Z.AI GLM 4.5 | 97.33% | 95.00% | 99.67% | 86.27% |
| 17 | GPT-OSS 120B | 97.18% | 95.00% | 99.36% | 86.44% |
| 18 | Qwen 3.5 Plus (2026-04-20) | 97.14% | 100.00% | 94.29% | 91.51% |
| 19 | MoonshotAI: Kimi K2.5 | 97.10% | 100.00% | 94.19% | 91.04% |
| 20 | Qwen3.7 Max | 97.05% | 100.00% | 94.10% | 95.75% |
| 21 | DeepSeek V3.1 | 96.87% | 95.00% | 98.74% | 82.39% |
| 22 | ByteDance Seed 2.0 Lite | 96.80% | 100.00% | 93.60% | 84.80% |
| 23 | MoonshotAI: Kimi K2.6 | 96.77% | 100.00% | 93.53% | 92.31% |
| 24 | Gemini 3.1 Flash Lite (Reasoning) | 96.70% | 95.00% | 98.40% | 86.41% |
| 25 | Grok 4.20 (Reasoning) | 96.61% | 95.00% | 98.22% | 91.39% |
| 26 | Z.AI GLM 4.6 | 96.60% | 100.00% | 93.20% | 89.11% |
| 27 | GPT-5 Mini | 96.49% | 95.00% | 97.98% | 92.62% |
| 28 | Claude Opus 4.8 (Reasoning) | 96.38% | 95.00% | 97.76% | 92.22% |
| 29 | Claude Opus 4.8 (Reasoning, Low) | 96.31% | 95.00% | 97.63% | 92.14% |
| 30 | Aion 2.0 | 96.17% | 100.00% | 92.34% | 89.21% |
| 31 | Claude Opus 4.6 | 96.13% | 100.00% | 92.27% | 92.35% |
| 32 | Claude Opus 4.6 (Reasoning) | 96.12% | 100.00% | 92.23% | 95.02% |
| 33 | MiniMax M2.5 | 96.05% | 95.00% | 97.10% | 88.71% |
| 34 | ByteDance Seed 1.6 | 95.63% | 100.00% | 91.26% | 90.70% |
| 35 | Qwen 3.5 27B | 95.53% | 100.00% | 91.05% | 90.85% |
| 36 | Gemma 4 26B (Reasoning) | 95.20% | 95.00% | 95.40% | 91.49% |
| 37 | Qwen 3.5 Plus (2026-02-15) | 95.10% | 100.00% | 90.21% | 85.96% |
| 38 | Z.AI GLM 4.5 Air | 95.05% | 95.00% | 95.10% | 83.12% |
| 39 | Qwen 3.5 122B | 95.01% | 100.00% | 90.03% | 91.53% |
| 40 | Qwen 3.5 397B A17B | 95.01% | 100.00% | 90.03% | 91.73% |
| 41 | Gemini 3 Flash (Preview) | 95.00% | 90.00% | 100.00% | 85.35% |
| 42 | Gemini 3.1 Flash Lite (Preview) | 94.98% | 95.00% | 94.95% | 85.87% |
| 43 | Gemini 3 Flash (Preview, Reasoning) | 94.93% | 95.00% | 94.87% | 90.50% |
| 44 | GPT-5.4 (Reasoning) | 94.90% | 95.00% | 94.80% | 93.24% |
| 45 | Gemini 3.1 Pro (Preview) | 94.90% | 95.00% | 94.80% | 94.37% |
| 46 | DeepSeek V4 Flash (Reasoning) | 94.76% | 100.00% | 89.51% | 89.01% |
| 47 | MiniMax M3 | 94.71% | 100.00% | 89.43% | 90.88% |
| 48 | Gemini 3.5 Flash (Reasoning) | 94.41% | 95.00% | 93.83% | 94.08% |
| 49 | GPT-5.5 | 94.15% | 90.00% | 98.29% | 89.09% |
| 50 | GPT-4.1 | 93.91% | 90.00% | 97.82% | 88.68% |
| 51 | GPT-5.1 | 93.64% | 90.00% | 97.28% | 92.54% |
| 52 | Qwen 3.6 35B | 93.56% | 90.00% | 97.12% | 89.05% |
| 53 | Stealth: Hunter Alpha | 93.35% | 95.00% | 91.70% | 87.34% |
| 54 | Claude Opus 4 | 93.01% | 100.00% | 86.02% | 87.69% |
| 55 | Claude 3.7 Sonnet | 92.95% | 90.00% | 95.89% | 83.39% |
| 56 | Gemini 2.5 Pro | 92.57% | 90.00% | 95.14% | 88.53% |
| 57 | GPT-4o, May 13th (temp=1) | 92.52% | 95.00% | 90.04% | 83.80% |
| 58 | Stealth: Aurora Alpha | 92.50% | 85.00% | 100.00% | 83.79% |
| 59 | GPT-5.4 Mini (Reasoning, Low) | 92.45% | 85.00% | 99.89% | 85.75% |
| 60 | Claude Sonnet 4.5 | 92.39% | 95.00% | 89.77% | 88.03% |
| 61 | Claude Opus 4.7 | 92.32% | 85.00% | 99.65% | 89.93% |
| 62 | Z.AI GLM 5 | 92.06% | 95.00% | 89.12% | 91.23% |
| 63 | Mistral Large 3 | 92.02% | 100.00% | 84.05% | 85.43% |
| 64 | Gemma 4 26B | 92.02% | 90.00% | 94.03% | 85.84% |
| 65 | Qwen 3.5 35B | 91.95% | 100.00% | 83.90% | 88.00% |
| 66 | Qwen 3.5 Flash | 91.94% | 95.00% | 88.89% | 86.38% |
| 67 | Claude Haiku 4.5 | 91.84% | 95.00% | 88.67% | 85.14% |
| 68 | Z.AI GLM 5.1 | 91.57% | 85.00% | 98.14% | 94.37% |
| 69 | GPT-5 | 91.50% | 85.00% | 98.01% | 91.93% |
| 70 | Claude Sonnet 4 | 91.31% | 90.00% | 92.61% | 88.72% |
| 71 | GPT-5.2 | 91.19% | 85.00% | 97.39% | 90.26% |
| 72 | Grok 4.20 (Beta) | 91.17% | 85.00% | 97.34% | 83.85% |
| 73 | Gemini 3.1 Flash Lite | 90.90% | 85.00% | 96.80% | 85.75% |
| 74 | GPT-5.4 (Reasoning, Low) | 90.79% | 85.00% | 96.58% | 91.41% |
| 75 | Grok 4 | 90.61% | 85.00% | 96.22% | 88.12% |
| 76 | ByteDance Seed 2.0 Mini | 90.12% | 90.00% | 90.24% | 86.91% |
| 77 | Gemini 3 Pro (Preview) | 89.64% | 95.00% | 84.29% | 88.79% |
| 78 | GPT-4.1 Mini | 89.64% | 80.00% | 99.27% | 83.20% |
| 79 | Qwen 3.6 Flash | 89.33% | 85.00% | 93.66% | 90.65% |
| 80 | Qwen 3.6 27B | 89.01% | 90.00% | 88.01% | 89.72% |
| 81 | Grok 4.1 Fast | 88.76% | 90.00% | 87.51% | 89.55% |
| 82 | GPT-5.4 Mini | 88.75% | 80.00% | 97.50% | 82.43% |
| 83 | Mistral Large | 88.64% | 90.00% | 87.27% | 80.15% |
| 84 | DeepSeek V4 Pro (Reasoning) | 88.51% | 85.00% | 92.02% | 90.10% |
| 85 | DeepSeek V4 Flash | 88.50% | 90.00% | 87.00% | 82.02% |
| 86 | Stealth: Healer Alpha | 88.45% | 90.00% | 86.90% | 85.93% |
| 87 | Qwen 3.5 9B | 88.18% | 90.00% | 86.36% | 86.05% |
| 88 | DeepSeek V3 (2024-12-26) | 87.88% | 100.00% | 75.76% | 83.68% |
| 89 | Xiaomi MIMO v2.5 Pro | 87.69% | 85.00% | 90.37% | 87.36% |
| 90 | Z.AI GLM 4.7 Flash | 87.67% | 95.00% | 80.35% | 84.82% |
| 91 | Nemotron 3 Nano | 87.63% | 80.00% | 95.26% | 77.73% |
| 92 | Inception Mercury 2 | 87.32% | 75.00% | 99.64% | 83.85% |
| 93 | DeepSeek V3 (2025-03-24) | 86.42% | 100.00% | 72.83% | 81.99% |
| 94 | Gemini 2.5 Flash | 86.23% | 75.00% | 97.46% | 80.60% |
| 95 | Gemini 2.5 Flash (Reasoning) | 86.06% | 75.00% | 97.13% | 86.51% |
| 96 | Claude 3.5 Sonnet | 85.62% | 75.00% | 96.24% | 84.24% |
| 97 | Z.AI GLM 4.7 | 85.46% | 80.00% | 90.93% | 88.69% |
| 98 | Mistral Large 2 | 85.22% | 100.00% | 70.43% | 82.41% |
| 99 | DeepSeek V3.2 | 85.01% | 80.00% | 90.03% | 82.25% |
| 100 | MiniMax M2.7 | 84.80% | 100.00% | 69.59% | 89.10% |
| 101 | Grok 4.3 | 84.74% | 75.00% | 94.47% | 78.66% |
| 102 | Grok 4 Fast | 84.61% | 85.00% | 84.22% | 86.15% |
| 103 | Qwen 3 32B | 84.61% | 90.00% | 79.21% | 82.21% |
| 104 | GPT-5.4 Nano (Reasoning) | 83.99% | 70.00% | 97.99% | 81.36% |
| 105 | Gemma 4 31B (Reasoning) | 83.82% | 75.00% | 92.64% | 91.71% |
| 106 | Gemini 2.5 Flash Lite | 82.75% | 80.00% | 85.50% | 81.08% |
| 107 | GPT-4o, Aug. 6th (temp=1) | 82.21% | 65.00% | 99.43% | 82.62% |
| 108 | GPT-5.4 Nano (Reasoning, Low) | 81.87% | 70.00% | 93.74% | 79.48% |
| 109 | Hermes 3 70B | 81.66% | 75.00% | 88.33% | 72.57% |
| 110 | GPT-5.4 | 81.49% | 65.00% | 97.98% | 84.32% |
| 111 | Nemotron 3 Super | 81.41% | 65.00% | 97.82% | 84.56% |
| 112 | GPT-5.4 Nano | 80.82% | 70.00% | 91.64% | 74.40% |
| 113 | Mistral NeMO | 80.80% | 95.00% | 66.60% | 65.04% |
| 114 | Inception Mercury | 80.37% | 65.00% | 95.74% | 79.50% |
| 115 | Llama 3.1 70B | 80.18% | 75.00% | 85.36% | 78.40% |
| 116 | Gemma 3 12B | 80.10% | 70.00% | 90.19% | 78.41% |
| 117 | o4 Mini | 80.00% | 60.00% | 100.00% | 88.35% |
| 118 | o4 Mini High | 79.76% | 60.00% | 99.51% | 90.29% |
| 119 | GPT-4.1 Nano | 78.95% | 65.00% | 92.91% | 71.94% |
| 120 | Grok 4.20 | 78.86% | 65.00% | 92.72% | 81.70% |
| 121 | Arcee AI: Trinity Large (Preview) | 78.38% | 80.00% | 76.76% | 73.33% |
| 122 | WizardLM 2 8x22b | 78.05% | 95.00% | 61.10% | 71.06% |
| 123 | GPT-4o Mini (temp=1) | 77.50% | 55.00% | 100.00% | 79.08% |
| 124 | Gemma 3 27B | 77.21% | 65.00% | 89.42% | 77.85% |
| 125 | GPT-5 Nano | 77.18% | 55.00% | 99.35% | 82.60% |
| 126 | Xiaomi MIMO v2.5 | 76.33% | 65.00% | 87.66% | 85.05% |
| 127 | Gemma 4 31B | 75.00% | 50.00% | 100.00% | 86.91% |
| 128 | GPT-4o, Aug. 6th (temp=0) | 75.00% | 50.00% | 100.00% | 82.45% |
| 129 | GPT-4o Mini (temp=0) | 75.00% | 50.00% | 100.00% | 78.29% |
| 130 | Gemini 2.5 Flash Lite (Reasoning) | 74.36% | 65.00% | 83.71% | 85.75% |
| 131 | Skyfall 36B V2 | 73.94% | 80.00% | 67.88% | 65.76% |
| 132 | DeepSeek V4 Pro | 72.80% | 70.00% | 75.59% | 82.63% |
| 133 | Mistral Small 3.2 24B | 72.77% | 75.00% | 70.53% | 78.58% |
| 134 | Claude 3 Haiku | 72.76% | 65.00% | 80.53% | 71.19% |
| 135 | Cydonia 24B V4.1 | 72.49% | 95.00% | 49.98% | 75.09% |
| 136 | Gemma 3 4B | 72.28% | 70.00% | 74.56% | 68.57% |
| 137 | Arcee AI: Trinity Mini | 70.59% | 60.00% | 81.18% | 70.90% |
| 138 | Qwen 2.5 72B | 68.95% | 70.00% | 67.91% | 75.46% |
| 139 | Ministral 3 3B | 68.10% | 100.00% | 36.20% | 67.22% |
| 140 | Cohere Command R+ (Aug. 2024) | 66.58% | 60.00% | 73.15% | 69.03% |
| 141 | LFM2 24B | 64.64% | 65.00% | 64.28% | 58.77% |
| 142 | Llama 3.1 8B | 64.06% | 55.00% | 73.13% | 63.35% |
| 143 | Rocinante 12B | 63.45% | 75.00% | 51.90% | 54.54% |
| 144 | ByteDance Seed 1.6 Flash | 61.23% | 40.00% | 82.45% | 73.27% |
| 145 | Qwen3 235B A22B Instruct 2507 | 60.83% | 75.00% | 46.67% | 80.10% |
| 146 | Mistral Small 4 (Reasoning) | 60.53% | 50.00% | 71.06% | 82.39% |
| 147 | Writer: Palmyra X5 | 56.58% | 70.00% | 43.16% | 79.57% |
| 148 | Ministral 8B | 53.91% | 55.00% | 52.81% | 64.87% |
| 149 | Mistral Small 4 | 51.96% | 55.00% | 48.93% | 76.46% |
| 150 | Mistral Medium 3.1 | 49.50% | 50.00% | 49.00% | 77.83% |
| 151 | Ministral 3 8B | 48.96% | 50.00% | 47.92% | 71.76% |
| 152 | Llama 3.1 Nemotron 70B | 46.80% | 60.00% | 33.61% | 74.70% |
| 153 | Ministral 3B | 42.25% | 25.00% | 59.49% | 61.29% |
| 154 | Mistral Small Creative | 41.85% | 50.00% | 33.69% | 73.27% |
| 155 | Ministral 3 14B | 30.00% | 50.00% | 10.00% | 72.54% |