Constraint Adherence
Subcategory of Rule Following. 202 models scored.
Model Leaderboard
All models ranked by their Constraint Adherence subcategory score.
| # | Model | Constraint Adherence | Rule Following | Overall |
|---|---|---|---|---|
| 1 | Qwen 3.8 Max (Reasoning, XHigh) | 96.73% | 96.73% | 96.21% |
| 2 | Qwen 3.7 Max | 95.76% | 95.76% | 94.55% |
| 3 | Gemini 3.8 Flash (Reasoning, Medium) | 92.86% | 92.86% | 95.72% |
| 4 | Qwen 3.8 Flash (Reasoning) | 92.86% | 92.86% | 94.24% |
| 5 | Gemini 3.5 Flash (Reasoning) | 92.04% | 92.04% | 93.35% |
| 6 | Hy4 Preview (Reasoning, High) | 91.44% | 91.44% | 94.80% |
| 7 | Gemini 3.1 Pro (Preview) | 91.21% | 91.21% | 94.08% |
| 8 | Gemini 3.6 Flash (Reasoning) | 90.57% | 90.57% | 94.90% |
| 9 | Claude Opus 5.5 (Reasoning) | 90.06% | 90.06% | 96.43% |
| 10 | Claude Opus 4.6 (Reasoning) | 89.78% | 89.78% | 95.06% |
| 11 | Ember-1 (Reasoning, Max) | 89.70% | 89.70% | 95.52% |
| 12 | Qwen 3.8 27B (Reasoning, XHigh) | 89.21% | 89.21% | 92.91% |
| 13 | Z.AI GLM 5.3 (Reasoning, Max) | 89.17% | 89.17% | 95.20% |
| 14 | Z.AI GLM 5.1 | 88.41% | 88.41% | 93.74% |
| 15 | Muse Wonder (Reasoning, Medium) | 86.82% | 86.82% | 95.47% |
| 16 | Grok 4.5 (Reasoning, High) | 86.79% | 86.79% | 94.12% |
| 17 | Z.AI GLM 5 Turbo | 86.78% | 86.78% | 93.29% |
| 18 | GPT-6.1 Sol (Reasoning, Medium) | 86.06% | 86.06% | 95.88% |
| 19 | Muse Spark 1.2 (Reasoning, Medium) | 85.94% | 85.94% | 94.71% |
| 20 | GPT-5.6 Sol (Reasoning, Medium) | 85.88% | 85.88% | 95.15% |
| 21 | Claude Sonnet 4.6 (Reasoning) | 85.73% | 85.73% | 93.64% |
| 22 | Muse Spark 1.3 (Reasoning, Medium) | 85.64% | 85.64% | 94.06% |
| 23 | Z.AI GLM 5.2 (Reasoning, High) | 85.18% | 85.18% | 93.41% |
| 24 | Gemini 3.7 Flash (Reasoning, Medium) | 85.14% | 85.14% | 94.85% |
| 25 | Gemma 4 31B (Reasoning) | 85.00% | 85.00% | 89.64% |
| 26 | Z.AI GLM 5.3 Flash (Reasoning, Max) | 83.32% | 83.32% | 94.28% |
| 27 | Claude Opus 4.6 | 83.11% | 83.11% | 92.31% |
| 28 | Grok 4.3 (Reasoning) | 82.80% | 82.80% | 90.99% |
| 29 | Qwen 3.6 Max Preview | 82.79% | 82.79% | 93.72% |
| 30 | Claude Sonnet 4.6 | 82.50% | 82.50% | 90.66% |
| 31 | Grok 4.20 (Reasoning) | 82.04% | 82.04% | 90.87% |
| 32 | DeepSeek V4.1 Flash (Reasoning, High) | 81.84% | 81.84% | 94.30% |
| 33 | Claude Sonnet 4 | 81.52% | 81.52% | 87.64% |
| 34 | Grok 4.6 (Reasoning, High) | 81.19% | 81.19% | 92.76% |
| 35 | GPT-6 Luna (Reasoning, High) | 80.63% | 80.63% | 93.95% |
| 36 | Muse Spark 1.1 (Reasoning, Medium) | 80.48% | 80.48% | 93.81% |
| 37 | Qwen 3.5 122B | 80.00% | 80.00% | 90.32% |
| 38 | GPT-5.5 (Reasoning, Medium) | 79.40% | 79.40% | 93.72% |
| 39 | Qwen 3.5 397B A17B | 79.39% | 79.39% | 91.09% |
| 40 | GPT-5.4 (Reasoning) | 79.29% | 79.29% | 93.85% |
| 41 | Gemini 4 Argon (Reasoning, Medium) | 79.27% | 79.27% | 93.81% |
| 42 | Qwen 3.7 Flash (Reasoning) | 78.68% | 78.68% | 88.56% |
| 43 | Aion 3.5 Mini (Reasoning, High) | 77.84% | 77.84% | 92.36% |
| 44 | ByteDance Seed 1.6 | 77.71% | 77.71% | 89.59% |
| 45 | Qwen 3.6 35B | 77.34% | 77.34% | 87.66% |
| 46 | GPT-5 | 77.13% | 77.13% | 91.48% |
| 47 | Kimi K2.6 | 76.94% | 76.94% | 92.57% |
| 48 | GPT-5.5 (Reasoning, Low) | 76.90% | 76.90% | 92.51% |
| 49 | Claude Sonnet 4.5 | 76.80% | 76.80% | 87.54% |
| 50 | DeepSeek V4 Pro 0813 (Reasoning, High) | 76.72% | 76.72% | 90.21% |
| 51 | Thinking Machines Inkling (Reasoning) | 76.65% | 76.65% | 90.78% |
| 52 | Grok 4.5 (Reasoning, Low) | 76.44% | 76.44% | 90.94% |
| 53 | GPT-5 Mini | 76.44% | 76.44% | 91.31% |
| 54 | Mistral Large 4.0 (Reasoning) | 76.35% | 76.35% | 92.14% |
| 55 | Aion 3.5 (Reasoning, High) | 76.25% | 76.25% | 91.90% |
| 56 | Qwen 3.5 27B | 76.04% | 76.04% | 90.05% |
| 57 | Kimi K3 (Reasoning, High) | 75.43% | 75.43% | 92.99% |
| 58 | Gemma 4 26B (Reasoning) | 74.75% | 74.75% | 89.02% |
| 59 | Gemini 3 Flash (Preview, Reasoning) | 74.48% | 74.48% | 89.93% |
| 60 | GPT-5.6 Sol | 74.47% | 74.47% | 90.76% |
| 61 | Claude Sonnet 5 | 74.36% | 74.36% | 87.34% |
| 62 | GPT-4o, Aug. 6th (temp=0) | 74.19% | 74.19% | 82.18% |
| 63 | GPT-5.1 | 74.05% | 74.05% | 90.73% |
| 64 | Claude Sonnet 5.5 (Reasoning) | 74.05% | 74.05% | 92.77% |
| 65 | Claude Opus 4.7 (Reasoning) | 74.04% | 74.04% | 92.53% |
| 66 | Mistral Medium 3.5 (Reasoning) | 73.42% | 73.42% | 85.32% |
| 67 | GPT-6 Luna (Reasoning, Medium) | 73.20% | 73.20% | 92.40% |
| 68 | GPT-5.6 Terra (Reasoning, Medium) | 72.99% | 72.99% | 92.49% |
| 69 | GPT-5.6 Terra | 72.82% | 72.82% | 88.23% |
| 70 | Xiaomi MIMO v2.6 Pro | 72.78% | 72.78% | 91.50% |
| 71 | DeepSeek V4 Pro (Reasoning) | 72.74% | 72.74% | 89.28% |
| 72 | Gemma 4 31B | 72.72% | 72.72% | 85.23% |
| 73 | o4 Mini High | 72.70% | 72.70% | 88.78% |
| 74 | Claude Opus 4.5 | 72.61% | 72.61% | 89.60% |
| 75 | Claude Opus 5 (Reasoning, Low) | 72.36% | 72.36% | 92.06% |
| 76 | GPT-5.5 | 72.34% | 72.34% | 89.37% |
| 77 | Kimi K2.5 | 72.03% | 72.03% | 90.86% |
| 78 | Muse Spark 1.1 (Reasoning, Minimal) | 71.80% | 71.80% | 91.43% |
| 79 | Gemma 4 26B | 71.75% | 71.75% | 84.89% |
| 80 | Qwen 3.6 Flash | 71.50% | 71.50% | 89.31% |
| 81 | Qwen 3.6 27B | 71.37% | 71.37% | 88.33% |
| 82 | Kimi K3 (Reasoning, Low) | 71.20% | 71.20% | 92.07% |
| 83 | Mistral Medium 3.5 | 71.09% | 71.09% | 84.52% |
| 84 | Grok 4.7 (Reasoning, High) | 70.68% | 70.68% | 92.62% |
| 85 | Claude Opus 4.8 (Reasoning, Low) | 70.56% | 70.56% | 91.89% |
| 86 | Claude Opus 4 | 70.37% | 70.37% | 87.22% |
| 87 | Claude Haiku 4.5 | 70.35% | 70.35% | 83.36% |
| 88 | Claude Opus 4.8 (Reasoning) | 70.27% | 70.27% | 92.33% |
| 89 | GPT-5.4 (Reasoning, Low) | 70.02% | 70.02% | 90.91% |
| 90 | GPT-6 Sol (Reasoning, Medium) | 69.71% | 69.71% | 92.63% |
| 91 | MiniMax M3 | 69.18% | 69.18% | 90.45% |
| 92 | Z.AI GLM 4.7 | 69.16% | 69.16% | 87.67% |
| 93 | Claude Opus 5 (Reasoning) | 69.11% | 69.11% | 91.15% |
| 94 | MiniMax M2.7 | 68.90% | 68.90% | 86.23% |
| 95 | Aion 3.0 | 68.80% | 68.80% | 88.78% |
| 96 | DeepSeek-V2 Chat | 68.78% | 68.78% | 84.09% |
| 97 | Claude Sonnet 5 (Reasoning) | 68.34% | 68.34% | 90.40% |
| 98 | Claude Opus 4.7 | 68.08% | 68.08% | 89.90% |
| 99 | DeepSeek V3 (2025-03-24) | 67.94% | 67.94% | 79.93% |
| 100 | GPT-4o, Aug. 6th (temp=1) | 67.91% | 67.91% | 81.28% |
| 101 | Z.AI GLM 5 | 67.78% | 67.78% | 89.60% |
| 102 | Qwen 3.5 Plus (2026-04-20) | 67.53% | 67.53% | 89.79% |
| 103 | Qwen 3.5 35B | 67.42% | 67.42% | 87.01% |
| 104 | GPT-6 Sol | 67.23% | 67.23% | 90.05% |
| 105 | Writer: Palmyra X5 | 67.19% | 67.19% | 78.11% |
| 106 | GPT-5.2 | 67.10% | 67.10% | 89.45% |
| 107 | Gemini 2.5 Flash Lite (Reasoning) | 66.81% | 66.81% | 83.10% |
| 108 | GPT-4.1 | 66.78% | 66.78% | 86.82% |
| 109 | Claude Sonnet 5 (Reasoning, Low) | 66.62% | 66.62% | 90.16% |
| 110 | DeepSeek V3 (2024-12-26) | 66.39% | 66.39% | 82.62% |
| 111 | DeepSeek V3.1 | 66.15% | 66.15% | 82.35% |
| 112 | Z.AI GLM 4.6 | 65.85% | 65.85% | 87.64% |
| 113 | Z.AI GLM 4.7 Flash | 65.63% | 65.63% | 82.21% |
| 114 | Qwen 3 235B A22B Instruct 2507 | 65.42% | 65.42% | 78.07% |
| 115 | Gemini 3 Flash (Preview) | 65.14% | 65.14% | 85.47% |
| 116 | Gemini 3.5 Flash Lite (Reasoning, Minimal) | 64.95% | 64.95% | 84.45% |
| 117 | GPT-5.6 Luna (Reasoning, Medium) | 64.83% | 64.83% | 90.61% |
| 118 | Z.AI GLM 5.3 Flash (Reasoning, Low) | 64.71% | 64.71% | 88.76% |
| 119 | o4 Mini | 64.61% | 64.61% | 86.56% |
| 120 | DeepSeek V4 Flash (Reasoning) | 64.50% | 64.50% | 88.06% |
| 121 | Thinking Machines Inkling Small (Reasoning, High) | 64.42% | 64.42% | 87.39% |
| 122 | Mistral Large 3 | 64.41% | 64.41% | 84.29% |
| 123 | Xiaomi MIMO v2.5 Pro | 64.29% | 64.29% | 86.05% |
| 124 | Qwen 3.5 Plus (2026-02-15) | 64.21% | 64.21% | 86.17% |
| 125 | Mistral Small 3.2 24B | 64.08% | 64.08% | 77.36% |
| 126 | Claude Opus 5 | 64.01% | 64.01% | 89.97% |
| 127 | Z.AI GLM 4.5 | 63.79% | 63.79% | 84.95% |
| 128 | Aion 2.0 | 63.77% | 63.77% | 86.66% |
| 129 | DeepSeek V4 Pro | 63.74% | 63.74% | 82.05% |
| 130 | Muse Glimmer 30B (Reasoning, Medium) | 63.51% | 63.51% | 88.81% |
| 131 | Llama 3.1 70B | 63.45% | 63.45% | 77.41% |
| 132 | Qwen 3.5 Flash | 63.19% | 63.19% | 85.66% |
| 133 | Mistral Large 2 | 63.05% | 63.05% | 81.50% |
| 134 | MiniMax M2.5 | 62.69% | 62.69% | 86.71% |
| 135 | Gemini 3.1 Flash Lite (Reasoning) | 62.26% | 62.26% | 85.91% |
| 136 | Gemini 3.5 Flash Lite (Reasoning) | 62.22% | 62.22% | 84.34% |
| 137 | Mistral Small 4 | 62.17% | 62.17% | 75.23% |
| 138 | Thinking Machines Inkling | 61.48% | 61.48% | 73.96% |
| 139 | Gemini 3.1 Flash Lite | 61.21% | 61.21% | 85.09% |
| 140 | Gemma 3 12B | 61.05% | 61.05% | 76.07% |
| 141 | Aion 3.0 Mini | 60.98% | 60.98% | 83.69% |
| 142 | Qwen 3.5 9B | 60.98% | 60.98% | 84.05% |
| 143 | Gemini 2.5 Pro | 60.89% | 60.89% | 88.44% |
| 144 | Xiaomi MIMO v2.5 | 60.75% | 60.75% | 83.95% |
| 145 | Gemini 3.5 Flash (Reasoning, Minimal) | 60.38% | 60.38% | 85.88% |
| 146 | Mistral Small 4 (Reasoning) | 60.28% | 60.28% | 79.48% |
| 147 | DeepSeek V4 Flash 0731 (Reasoning, High) | 60.15% | 60.15% | 87.97% |
| 148 | Gemini 2.5 Flash (Reasoning) | 59.97% | 59.97% | 84.14% |
| 149 | Gemini 2.5 Flash Lite | 59.96% | 59.96% | 79.91% |
| 150 | Grok 4.20 | 59.71% | 59.71% | 81.21% |
| 151 | Hermes 3 405B | 59.17% | 59.17% | 80.80% |
| 152 | Gemini 3.1 Flash Lite (Preview) | 59.04% | 59.04% | 85.41% |
| 153 | GPT-4o Mini (temp=0) | 58.84% | 58.84% | 76.86% |
| 154 | ByteDance Seed 2.0 Mini | 58.77% | 58.77% | 85.69% |
| 155 | Cohere Command R+ (Aug. 2024) | 58.70% | 58.70% | 67.04% |
| 156 | GPT-4.1 Mini | 58.59% | 58.59% | 81.40% |
| 157 | Mistral Large 4.0 | 58.46% | 58.46% | 84.72% |
| 158 | GPT-5.4 | 58.11% | 58.11% | 84.31% |
| 159 | GPT-5 Nano | 57.57% | 57.57% | 80.16% |
| 160 | Gemini 2.5 Flash | 57.47% | 57.47% | 80.61% |
| 161 | Nemotron 3 Super | 57.43% | 57.43% | 81.69% |
| 162 | GPT-5.4 Mini (Reasoning) | 57.38% | 57.38% | 89.82% |
| 163 | DeepSeek V4 Flash | 57.32% | 57.32% | 82.02% |
| 164 | GPT-4o Mini (temp=1) | 56.50% | 56.50% | 77.82% |
| 165 | Claude Haiku 5.5 (Adaptive) | 56.33% | 56.33% | 89.37% |
| 166 | GPT-OSS 120B | 55.03% | 55.03% | 84.81% |
| 167 | GPT-5.6 Luna | 54.70% | 54.70% | 85.06% |
| 168 | Inception Mercury 2 | 54.41% | 54.41% | 81.99% |
| 169 | Gemini 3.6 Flash (Reasoning, Minimal) | 54.33% | 54.33% | 86.68% |
| 170 | DeepSeek V3.2 | 53.75% | 53.75% | 82.22% |
| 171 | Hermes 3 70B | 53.00% | 53.00% | 69.74% |
| 172 | Xiaomi MIMO v2.6 Flash | 52.54% | 52.54% | 87.31% |
| 173 | GPT-6 Luna | 51.69% | 51.69% | 83.73% |
| 174 | Ministral 3 14B | 50.83% | 50.83% | 70.45% |
| 175 | Cydonia 24B V4.1 | 50.36% | 50.36% | 72.68% |
| 176 | Grok 4.3 | 49.02% | 49.02% | 78.00% |
| 177 | Mistral Medium 3.1 | 48.60% | 48.60% | 76.08% |
| 178 | Gemma 3 27B | 47.98% | 47.98% | 75.70% |
| 179 | ByteDance Seed 1.6 Flash | 47.15% | 47.15% | 70.92% |
| 180 | Qwen 3 32B | 46.83% | 46.83% | 79.37% |
| 181 | Laguna XS 2.1 | 46.56% | 46.56% | 75.42% |
| 182 | GPT-5.4 Mini | 46.32% | 46.32% | 80.45% |
| 183 | Z.AI GLM 4.5 Air | 44.11% | 44.11% | 80.74% |
| 184 | Nemotron 3 Nano | 43.47% | 43.47% | 74.50% |
| 185 | GPT-4.1 Nano | 40.88% | 40.88% | 69.90% |
| 186 | ByteDance Seed 2.0 Lite | 36.85% | 36.85% | 84.27% |
| 187 | Claude Haiku 5.5 (Reasoning, Medium) | 35.05% | 35.05% | 84.17% |
| 188 | Mistral NeMO | 34.11% | 34.11% | 63.80% |
| 189 | GPT-5.4 Mini (Reasoning, Low) | 33.99% | 33.99% | 83.57% |
| 190 | Claude Haiku 5.5 (Reasoning, Low) | 33.56% | 33.56% | 84.75% |
| 191 | Laguna S 2.1 | 33.30% | 33.30% | 79.99% |
| 192 | GPT-5.4 Nano (Reasoning, Low) | 31.65% | 31.65% | 77.46% |
| 193 | Qwen 2.5 72B | 31.55% | 31.55% | 73.17% |
| 194 | Ministral 3 8B | 31.34% | 31.34% | 69.98% |
| 195 | WizardLM 2 8x22b | 28.27% | 28.27% | 71.45% |
| 196 | GPT-5.4 Nano (Reasoning) | 27.15% | 27.15% | 80.02% |
| 197 | Gemma 3 4B | 26.37% | 26.37% | 66.33% |
| 198 | Ministral 3B | 24.45% | 24.45% | 59.25% |
| 199 | Arcee AI: Trinity Mini | 23.57% | 23.57% | 67.68% |
| 200 | GPT-5.4 Nano | 20.94% | 20.94% | 72.16% |
| 201 | Ministral 3 3B | 15.87% | 15.87% | 65.02% |
| 202 | Ministral 8B | 15.27% | 15.27% | 63.77% |