Generation

Subcategory of Language. 146 models scored.

Model Leaderboard

All models ranked by their Generation subcategory score.

# Model Generation Language Overall
1 Qwen3.6 Max Preview 100.00% 100.00% 93.72%
2 Grok 4.3 (Reasoning) 100.00% 97.50% 90.99%
3 Claude Sonnet 4.6 100.00% 100.00% 90.66%
4 o4 Mini 100.00% 80.00% 86.56%
5 Gemini 3.5 Flash (Reasoning, Minimal) 100.00% 97.50% 85.88%
6 Gemini 3 Flash (Preview) 100.00% 95.00% 85.47%
7 Gemma 4 31B 100.00% 75.00% 85.23%
8 DeepSeek-V2 Chat 100.00% 100.00% 84.09%
9 GPT-4o, Aug. 6th (temp=0) 100.00% 75.00% 82.18%
10 GPT-4o Mini (temp=1) 100.00% 77.50% 77.82%
11 GPT-4o Mini (temp=0) 100.00% 75.00% 76.86%
12 GPT-5.4 Mini (Reasoning, Low) 99.89% 92.45% 83.57%
13 GPT-5.6 Sol (Reasoning) 99.86% 99.93% 95.15%
14 Z.AI GLM 5 Turbo 99.80% 99.90% 93.29%
15 Z.AI GLM 4.5 99.67% 97.33% 84.95%
16 Claude Opus 4.7 99.65% 92.32% 89.90%
17 Grok 4.5 (Reasoning, High) 99.64% 99.82% 94.12%
18 Inception Mercury 2 99.64% 87.32% 81.99%
19 Z.AI GLM 5.2 (Reasoning, High) 99.64% 99.82% 93.41%
20 o4 Mini High 99.51% 79.76% 88.78%
21 GPT-5.6 Terra (Reasoning) 99.44% 97.22% 92.49%
22 GPT-4o, Aug. 6th (temp=1) 99.43% 82.21% 81.28%
23 GPT-5.5 (Reasoning) 99.37% 99.69% 93.72%
24 GPT-OSS 120B 99.36% 97.18% 84.81%
25 GPT-5 Nano 99.35% 77.18% 80.16%
26 Claude Opus 4.5 99.31% 99.66% 89.60%
27 GPT-4.1 Mini 99.27% 89.64% 81.40%
28 GPT-5.6 Sol 99.20% 94.60% 90.76%
29 Hermes 3 405B 99.14% 99.57% 80.80%
30 GPT-5.6 Terra 98.75% 91.87% 88.23%
31 DeepSeek V3.1 98.74% 96.87% 82.35%
32 GPT-5.6 Luna 98.66% 99.33% 85.06%
33 GPT-5.5 (Reasoning, Low) 98.49% 99.24% 92.51%
34 Gemini 3.1 Flash Lite (Reasoning) 98.40% 96.70% 85.91%
35 GPT-5.6 Luna (Reasoning) 98.34% 96.67% 90.61%
36 GPT-5.5 98.29% 94.15% 89.37%
37 Grok 4.20 (Reasoning) 98.22% 96.61% 90.87%
38 Z.AI GLM 5.1 98.14% 91.57% 93.74%
39 Claude Sonnet 5 (Reasoning) 98.08% 99.04% 90.40%
40 GPT-5 98.01% 91.50% 91.48%
41 GPT-5.4 Nano (Reasoning) 97.99% 83.99% 80.02%
42 GPT-5.4 97.98% 81.49% 84.31%
43 GPT-5 Mini 97.98% 96.49% 91.31%
44 GPT-4.1 97.82% 93.91% 86.82%
45 Nemotron 3 Super 97.82% 81.41% 81.69%
46 Claude Opus 4.8 (Reasoning) 97.76% 96.38% 92.33%
47 Claude Opus 4.8 (Reasoning, Low) 97.63% 96.31% 91.89%
48 Claude Opus 4.7 (Reasoning) 97.53% 98.77% 92.53%
49 GPT-5.4 Mini 97.50% 88.75% 80.45%
50 Gemini 2.5 Flash 97.46% 86.23% 80.61%
51 GPT-5.2 97.39% 91.19% 89.45%
52 Aion 3.0 Mini 97.35% 93.68% 83.69%
53 GPT-5.1 97.28% 93.64% 90.73%
54 Gemini 2.5 Flash (Reasoning) 97.13% 86.06% 84.14%
55 Qwen 3.6 35B 97.12% 93.56% 87.66%
56 MiniMax M2.5 97.10% 96.05% 86.71%
57 Gemini 3.1 Flash Lite 96.80% 90.90% 85.09%
58 GPT-5.4 (Reasoning, Low) 96.58% 90.79% 90.91%
59 GPT-5.4 Mini (Reasoning) 96.25% 98.12% 89.82%
60 Claude Sonnet 5 (Reasoning, Low) 96.12% 98.06% 90.16%
61 Claude Sonnet 5 96.00% 95.50% 87.34%
62 Gemma 4 26B (Reasoning) 95.40% 95.20% 89.02%
63 Nemotron 3 Nano 95.26% 87.63% 74.50%
64 Claude Sonnet 4.6 (Reasoning) 95.15% 97.58% 93.64%
65 Gemini 2.5 Pro 95.14% 92.57% 88.44%
66 Z.AI GLM 4.5 Air 95.10% 95.05% 80.74%
67 Gemini 3.1 Flash Lite (Preview) 94.95% 94.98% 85.41%
68 Gemini 3 Flash (Preview, Reasoning) 94.87% 94.93% 89.93%
69 GPT-5.4 (Reasoning) 94.80% 94.90% 93.85%
70 Gemini 3.1 Pro (Preview) 94.80% 94.90% 94.08%
71 Grok 4.3 94.47% 84.74% 78.00%
72 Qwen 3.5 Plus (2026-04-20) 94.29% 97.14% 89.79%
73 MoonshotAI: Kimi K2.5 94.19% 97.10% 90.86%
74 Qwen3.7 Max 94.10% 97.05% 94.55%
75 Gemma 4 26B 94.03% 92.02% 84.89%
76 Grok 4.5 (Reasoning, Low) 94.00% 94.50% 90.94%
77 Gemini 3.5 Flash (Reasoning) 93.83% 94.41% 93.35%
78 GPT-5.4 Nano (Reasoning, Low) 93.74% 81.87% 77.46%
79 Aion 3.0 93.70% 86.85% 88.78%
80 Qwen 3.6 Flash 93.66% 89.33% 89.31%
81 ByteDance Seed 2.0 Lite 93.60% 96.80% 84.27%
82 MoonshotAI: Kimi K2.6 93.53% 96.77% 92.57%
83 Z.AI GLM 4.6 93.20% 96.60% 87.64%
84 GPT-4.1 Nano 92.91% 78.95% 69.90%
85 Grok 4.20 92.72% 78.86% 81.21%
86 Gemma 4 31B (Reasoning) 92.64% 83.82% 89.64%
87 Claude Sonnet 4 92.61% 91.31% 87.64%
88 Aion 2.0 92.34% 96.17% 86.66%
89 Claude Opus 4.6 92.27% 96.13% 92.31%
90 Claude Opus 4.6 (Reasoning) 92.23% 96.12% 95.06%
91 DeepSeek V4 Pro (Reasoning) 92.02% 88.51% 89.28%
92 GPT-5.4 Nano 91.64% 80.82% 72.16%
93 ByteDance Seed 1.6 91.26% 95.63% 89.59%
94 Qwen 3.5 27B 91.05% 95.52% 90.05%
95 Z.AI GLM 4.7 90.93% 85.46% 87.67%
96 Xiaomi MIMO v2.5 Pro 90.37% 87.69% 86.05%
97 ByteDance Seed 2.0 Mini 90.24% 90.12% 85.69%
98 Qwen 3.5 Plus (2026-02-15) 90.21% 95.10% 86.17%
99 Gemma 3 12B 90.19% 80.10% 76.07%
100 Qwen 3.5 122B 90.03% 95.01% 90.32%
101 Qwen 3.5 397B A17B 90.03% 95.01% 91.09%
102 DeepSeek V3.2 90.03% 85.01% 82.22%
103 Claude Sonnet 4.5 89.77% 92.39% 87.54%
104 DeepSeek V4 Flash (Reasoning) 89.51% 94.76% 88.06%
105 MiniMax M3 89.43% 94.71% 90.45%
106 Gemma 3 27B 89.42% 77.21% 75.70%
107 Z.AI GLM 5 89.12% 92.06% 89.60%
108 Qwen 3.5 Flash 88.89% 91.94% 85.66%
109 Claude Haiku 4.5 88.67% 91.84% 83.36%
110 Hermes 3 70B 88.33% 81.66% 69.74%
111 Qwen 3.6 27B 88.01% 89.01% 88.33%
112 Xiaomi MIMO v2.5 87.66% 76.33% 83.95%
113 DeepSeek V4 Flash 87.00% 88.50% 82.02%
114 Qwen 3.5 9B 86.36% 88.18% 84.05%
115 Claude Opus 4 86.02% 93.01% 87.22%
116 Gemini 2.5 Flash Lite 85.50% 82.75% 79.91%
117 Llama 3.1 70B 85.36% 80.18% 77.41%
118 Mistral Large 3 84.05% 92.02% 84.29%
119 Qwen 3.5 35B 83.90% 91.95% 87.01%
120 Gemini 2.5 Flash Lite (Reasoning) 83.71% 74.36% 83.10%
121 ByteDance Seed 1.6 Flash 82.45% 61.23% 70.92%
122 Arcee AI: Trinity Mini 81.18% 70.59% 67.68%
123 Z.AI GLM 4.7 Flash 80.35% 87.67% 82.21%
124 Qwen 3 32B 79.21% 84.61% 79.37%
125 DeepSeek V3 (2024-12-26) 75.76% 87.88% 82.62%
126 DeepSeek V4 Pro 75.59% 72.80% 82.05%
127 Gemma 3 4B 74.56% 72.28% 66.33%
128 Cohere Command R+ (Aug. 2024) 73.15% 66.58% 67.04%
129 DeepSeek V3 (2025-03-24) 72.83% 86.42% 79.93%
130 Mistral Small 4 (Reasoning) 71.06% 60.53% 79.48%
131 Mistral Small 3.2 24B 70.53% 72.77% 77.36%
132 Mistral Large 2 70.43% 85.22% 81.50%
133 MiniMax M2.7 69.59% 84.80% 86.23%
134 Qwen 2.5 72B 67.91% 68.95% 73.17%
135 Mistral NeMO 66.60% 80.80% 63.80%
136 WizardLM 2 8x22b 61.10% 78.05% 71.45%
137 Ministral 3B 59.49% 42.25% 59.25%
138 Ministral 8B 52.81% 53.91% 63.77%
139 Cydonia 24B V4.1 49.98% 72.49% 72.68%
140 Mistral Medium 3.1 49.00% 49.50% 76.08%
141 Mistral Small 4 48.93% 51.96% 75.23%
142 Ministral 3 8B 47.92% 48.96% 69.98%
143 Qwen3 235B A22B Instruct 2507 46.67% 60.83% 78.07%
144 Writer: Palmyra X5 43.16% 56.58% 78.11%
145 Ministral 3 3B 36.20% 68.10% 65.02%
146 Ministral 3 14B 10.00% 30.00% 70.45%