Utility
32 scenarios across 5 subcategories. 161 models scored.
Subcategories
| Subcategory | Avg Score | Best Model | Best Score |
|---|---|---|---|
| Word Counting | 68.51% | Gemini 3.1 Pro (Preview) | 99.56% |
| Sentence Counting | 91.52% | Gemini 3.6 Flash (Reasoning) | 100.00% |
| Paragraph Counting | 97.20% | GPT-5.6 Sol (Reasoning) | 100.00% |
| Structural Counting | 77.14% | Claude Opus 4.6 (Reasoning) | 100.00% |
| Data Extraction | 98.54% | GPT-5.6 Sol (Reasoning) | 100.00% |
Model Leaderboard
All models ranked by their Utility category score.
| # | Model | Utility | Word Counting | Sentence Counting | Paragraph Counting | Structural Counting | Data Extraction | Overall |
|---|---|---|---|---|---|---|---|---|
| 1 | Gemini 3.1 Pro (Preview) | 99.91% | 99.56% | 100.00% | 100.00% | 100.00% | 100.00% | 94.08% |
| 2 | Qwen3.7 Max | 99.54% | 97.69% | 100.00% | 100.00% | 100.00% | 100.00% | 94.55% |
| 3 | Muse Spark 1.1 (Reasoning, Medium) | 99.40% | 96.99% | 100.00% | 100.00% | 100.00% | 100.00% | 93.81% |
| 4 | Claude Opus 4.8 (Reasoning) | 99.26% | 97.26% | 99.07% | 100.00% | 100.00% | 100.00% | 92.33% |
| 5 | Claude Opus 4.6 (Reasoning) | 98.93% | 94.65% | 100.00% | 100.00% | 100.00% | 100.00% | 95.06% |
| 6 | Gemini 3.5 Flash (Reasoning) | 98.86% | 96.80% | 100.00% | 100.00% | 97.50% | 100.00% | 93.35% |
| 7 | o4 Mini High | 98.67% | 95.97% | 99.90% | 100.00% | 97.50% | 100.00% | 88.78% |
| 8 | Gemini 3.6 Flash (Reasoning) | 98.56% | 92.82% | 100.00% | 100.00% | 100.00% | 100.00% | 94.90% |
| 9 | GPT-5 Mini | 98.39% | 97.93% | 100.00% | 100.00% | 94.00% | 100.00% | 91.31% |
| 10 | Muse Spark 1.1 (Reasoning, Minimal) | 98.38% | 91.92% | 100.00% | 100.00% | 100.00% | 100.00% | 91.43% |
| 11 | Qwen3.6 Max Preview | 98.34% | 91.71% | 100.00% | 100.00% | 100.00% | 100.00% | 93.72% |
| 12 | Claude Opus 4.8 (Reasoning, Low) | 98.00% | 97.54% | 98.48% | 100.00% | 94.00% | 100.00% | 91.89% |
| 13 | Claude Sonnet 4.6 (Reasoning) | 97.88% | 90.42% | 99.96% | 100.00% | 99.00% | 100.00% | 93.64% |
| 14 | Claude Opus 4.7 (Reasoning) | 97.87% | 89.46% | 99.91% | 100.00% | 100.00% | 100.00% | 92.53% |
| 15 | Z.AI GLM 5.1 | 97.51% | 92.55% | 100.00% | 100.00% | 95.00% | 100.00% | 93.74% |
| 16 | GPT-5.6 Sol (Reasoning) | 97.51% | 97.53% | 100.00% | 100.00% | 90.00% | 100.00% | 95.15% |
| 17 | Qwen 3.5 397B A17B | 97.50% | 87.52% | 100.00% | 100.00% | 100.00% | 100.00% | 91.09% |
| 18 | MoonshotAI: Kimi K2.6 | 97.42% | 90.45% | 100.00% | 96.67% | 100.00% | 100.00% | 92.57% |
| 19 | Gemini 3 Flash (Preview, Reasoning) | 97.20% | 86.00% | 100.00% | 100.00% | 100.00% | 100.00% | 89.93% |
| 20 | GPT-5.4 (Reasoning) | 96.89% | 84.46% | 100.00% | 100.00% | 100.00% | 100.00% | 93.85% |
| 21 | MoonshotAI: Kimi K2.5 | 96.63% | 83.17% | 100.00% | 100.00% | 100.00% | 100.00% | 90.86% |
| 22 | GPT-5.5 (Reasoning) | 96.60% | 83.08% | 99.93% | 100.00% | 100.00% | 100.00% | 93.72% |
| 23 | Qwen 3.5 Plus (2026-04-20) | 96.42% | 84.60% | 100.00% | 100.00% | 97.50% | 100.00% | 89.79% |
| 24 | Qwen 3.5 35B | 96.42% | 82.08% | 100.00% | 100.00% | 100.00% | 100.00% | 87.01% |
| 25 | Z.AI GLM 5 Turbo | 96.36% | 95.82% | 100.00% | 100.00% | 96.00% | 90.00% | 93.29% |
| 26 | Qwen 3.5 122B | 96.36% | 81.81% | 100.00% | 100.00% | 100.00% | 100.00% | 90.32% |
| 27 | GPT-5.5 (Reasoning, Low) | 96.36% | 81.80% | 100.00% | 100.00% | 100.00% | 100.00% | 92.51% |
| 28 | Gemma 4 31B (Reasoning) | 96.32% | 84.12% | 99.99% | 100.00% | 97.50% | 100.00% | 89.64% |
| 29 | o4 Mini | 96.31% | 90.72% | 98.35% | 100.00% | 92.50% | 100.00% | 86.56% |
| 30 | Z.AI GLM 5.2 (Reasoning, High) | 96.31% | 89.64% | 97.93% | 100.00% | 94.00% | 100.00% | 93.41% |
| 31 | GPT-5.2 | 96.22% | 84.32% | 99.77% | 100.00% | 97.00% | 100.00% | 89.45% |
| 32 | Qwen 3.6 35B | 96.20% | 83.01% | 98.00% | 100.00% | 100.00% | 100.00% | 87.66% |
| 33 | MoonshotAI: Kimi K3 (Reasoning, High) | 96.19% | 85.93% | 100.00% | 100.00% | 95.00% | 100.00% | 92.99% |
| 34 | Qwen 3.5 Flash | 96.11% | 80.57% | 100.00% | 100.00% | 100.00% | 100.00% | 85.66% |
| 35 | Qwen 3.6 Flash | 96.09% | 82.44% | 100.00% | 100.00% | 98.00% | 100.00% | 89.31% |
| 36 | Claude Opus 4.7 | 95.77% | 87.30% | 99.57% | 100.00% | 92.00% | 100.00% | 89.90% |
| 37 | Gemma 4 26B (Reasoning) | 95.69% | 83.45% | 100.00% | 100.00% | 95.00% | 100.00% | 89.02% |
| 38 | Qwen 3.5 27B | 95.67% | 85.82% | 92.55% | 100.00% | 100.00% | 100.00% | 90.05% |
| 39 | GPT-5.6 Terra (Reasoning) | 95.58% | 80.91% | 100.00% | 100.00% | 97.00% | 100.00% | 92.49% |
| 40 | MiniMax M2.7 | 95.50% | 94.05% | 95.47% | 100.00% | 88.00% | 100.00% | 86.23% |
| 41 | GPT-5.1 | 95.33% | 85.32% | 99.80% | 100.00% | 91.50% | 100.00% | 90.73% |
| 42 | GPT-5.4 (Reasoning, Low) | 95.32% | 76.62% | 100.00% | 100.00% | 100.00% | 100.00% | 90.91% |
| 43 | Nemotron 3 Super | 95.29% | 93.51% | 97.96% | 100.00% | 85.00% | 100.00% | 81.69% |
| 44 | GPT-5.4 Mini (Reasoning) | 94.44% | 81.72% | 100.00% | 100.00% | 90.50% | 100.00% | 89.82% |
| 45 | Qwen 3.6 27B | 94.32% | 81.10% | 100.00% | 100.00% | 95.50% | 95.00% | 88.33% |
| 46 | Z.AI GLM 4.7 | 94.31% | 78.57% | 99.99% | 100.00% | 93.00% | 100.00% | 87.67% |
| 47 | Z.AI GLM 5 | 94.11% | 75.55% | 100.00% | 100.00% | 95.00% | 100.00% | 89.60% |
| 48 | MoonshotAI: Kimi K3 (Reasoning, Low) | 94.04% | 81.21% | 100.00% | 100.00% | 89.00% | 100.00% | 92.07% |
| 49 | Qwen 3.5 9B | 94.02% | 74.59% | 100.00% | 100.00% | 95.50% | 100.00% | 84.05% |
| 50 | Gemini 3.1 Flash Lite (Preview) | 94.00% | 89.38% | 98.60% | 100.00% | 82.00% | 100.00% | 85.41% |
| 51 | GPT-5 Nano | 93.91% | 86.54% | 97.99% | 100.00% | 85.00% | 100.00% | 80.16% |
| 52 | MiniMax M3 | 93.59% | 82.35% | 92.60% | 100.00% | 93.00% | 100.00% | 90.45% |
| 53 | Aion 3.0 | 93.57% | 73.83% | 97.99% | 100.00% | 96.00% | 100.00% | 88.78% |
| 54 | Claude Sonnet 5 (Reasoning, Low) | 93.53% | 75.96% | 91.69% | 100.00% | 100.00% | 100.00% | 90.16% |
| 55 | GPT-5 | 93.53% | 96.13% | 100.00% | 100.00% | 76.50% | 95.00% | 91.48% |
| 56 | Claude Opus 5 (Reasoning) | 93.39% | 89.97% | 99.99% | 100.00% | 77.00% | 100.00% | 91.15% |
| 57 | GPT-5.4 Nano (Reasoning) | 93.34% | 84.86% | 95.83% | 100.00% | 91.00% | 95.00% | 80.02% |
| 58 | DeepSeek V4 Pro (Reasoning) | 93.24% | 75.21% | 99.51% | 100.00% | 91.50% | 100.00% | 89.28% |
| 59 | Thinking Machines Inkling (Reasoning) | 93.19% | 76.89% | 94.91% | 96.67% | 97.50% | 100.00% | 90.78% |
| 60 | Grok 4.3 (Reasoning) | 92.94% | 91.18% | 100.00% | 100.00% | 73.50% | 100.00% | 90.99% |
| 61 | Claude Sonnet 5 (Reasoning) | 92.87% | 77.27% | 88.06% | 100.00% | 99.00% | 100.00% | 90.40% |
| 62 | Inception Mercury 2 | 92.86% | 93.76% | 97.02% | 100.00% | 73.50% | 100.00% | 81.99% |
| 63 | Gemini 3.1 Flash Lite | 92.77% | 87.68% | 94.68% | 100.00% | 81.50% | 100.00% | 85.09% |
| 64 | Claude Opus 5 (Reasoning, Low) | 92.75% | 90.25% | 100.00% | 100.00% | 73.50% | 100.00% | 92.06% |
| 65 | Grok 4.20 (Reasoning) | 92.61% | 75.57% | 100.00% | 100.00% | 87.50% | 100.00% | 90.87% |
| 66 | Gemini 3.1 Flash Lite (Reasoning) | 92.32% | 89.98% | 90.14% | 100.00% | 81.50% | 100.00% | 85.91% |
| 67 | ByteDance Seed 2.0 Lite | 92.23% | 73.68% | 99.96% | 100.00% | 87.50% | 100.00% | 84.27% |
| 68 | Gemini 2.5 Pro | 92.18% | 66.47% | 99.43% | 100.00% | 100.00% | 95.00% | 88.44% |
| 69 | GPT-5.6 Luna (Reasoning) | 92.18% | 83.38% | 100.00% | 100.00% | 77.50% | 100.00% | 90.61% |
| 70 | GPT-OSS 120B | 92.03% | 87.79% | 96.88% | 100.00% | 75.50% | 100.00% | 84.81% |
| 71 | ByteDance Seed 2.0 Mini | 91.88% | 73.92% | 99.96% | 100.00% | 85.50% | 100.00% | 85.69% |
| 72 | GPT-5.4 Nano (Reasoning, Low) | 91.42% | 73.42% | 93.19% | 100.00% | 90.50% | 100.00% | 77.46% |
| 73 | Aion 2.0 | 90.91% | 65.48% | 89.10% | 100.00% | 100.00% | 100.00% | 86.66% |
| 74 | ByteDance Seed 1.6 | 90.83% | 74.14% | 100.00% | 100.00% | 80.00% | 100.00% | 89.59% |
| 75 | Aion 3.0 Mini | 90.76% | 65.24% | 96.54% | 100.00% | 92.00% | 100.00% | 83.69% |
| 76 | Claude Opus 4.6 | 90.72% | 83.65% | 99.93% | 100.00% | 70.00% | 100.00% | 92.31% |
| 77 | GPT-4.1 | 90.57% | 81.33% | 86.01% | 100.00% | 85.50% | 100.00% | 86.82% |
| 78 | Claude Opus 5 | 90.50% | 77.05% | 96.97% | 100.00% | 78.50% | 100.00% | 89.97% |
| 79 | MiniMax M2.5 | 90.42% | 86.03% | 75.58% | 100.00% | 90.50% | 100.00% | 86.71% |
| 80 | Claude Opus 4.5 | 89.84% | 80.83% | 95.88% | 100.00% | 72.50% | 100.00% | 89.60% |
| 81 | Gemini 2.5 Flash Lite (Reasoning) | 89.63% | 55.13% | 96.54% | 100.00% | 96.50% | 100.00% | 83.10% |
| 82 | Z.AI GLM 4.7 Flash | 88.98% | 68.93% | 100.00% | 100.00% | 81.00% | 95.00% | 82.21% |
| 83 | Claude Opus 4 | 88.81% | 74.37% | 80.19% | 100.00% | 89.50% | 100.00% | 87.22% |
| 84 | Z.AI GLM 4.6 | 88.58% | 47.21% | 97.70% | 100.00% | 98.00% | 100.00% | 87.64% |
| 85 | Claude Sonnet 5 | 88.57% | 59.02% | 84.82% | 100.00% | 99.00% | 100.00% | 87.34% |
| 86 | Claude Sonnet 4.6 | 88.52% | 71.94% | 94.66% | 100.00% | 76.00% | 100.00% | 90.66% |
| 87 | GPT-5.4 Mini (Reasoning, Low) | 88.49% | 75.01% | 99.92% | 100.00% | 67.50% | 100.00% | 83.57% |
| 88 | DeepSeek V4 Flash (Reasoning) | 87.53% | 49.57% | 93.07% | 100.00% | 95.00% | 100.00% | 88.06% |
| 89 | Grok 4.5 (Reasoning, High) | 86.69% | 86.29% | 97.97% | 96.67% | 52.50% | 100.00% | 94.12% |
| 90 | Gemma 4 31B | 86.69% | 64.43% | 99.99% | 100.00% | 69.00% | 100.00% | 85.23% |
| 91 | Qwen 3.5 Plus (2026-02-15) | 86.65% | 44.24% | 100.00% | 100.00% | 89.00% | 100.00% | 86.17% |
| 92 | Gemini 3 Flash (Preview) | 86.39% | 83.97% | 99.99% | 100.00% | 48.00% | 100.00% | 85.47% |
| 93 | Nemotron 3 Nano | 86.00% | 86.70% | 92.81% | 100.00% | 50.50% | 100.00% | 74.50% |
| 94 | Mistral Small 4 (Reasoning) | 85.61% | 56.00% | 96.06% | 100.00% | 76.00% | 100.00% | 79.48% |
| 95 | Gemini 3.5 Flash Lite (Reasoning) | 85.46% | 54.88% | 90.94% | 100.00% | 81.50% | 100.00% | 84.34% |
| 96 | Mistral Large 3 | 84.91% | 52.60% | 99.95% | 100.00% | 72.00% | 100.00% | 84.29% |
| 97 | Gemini 3.6 Flash (Reasoning, Minimal) | 84.77% | 70.95% | 87.91% | 100.00% | 65.00% | 100.00% | 86.68% |
| 98 | Gemini 3.5 Flash Lite (Reasoning, Minimal) | 84.58% | 56.05% | 87.84% | 100.00% | 79.00% | 100.00% | 84.45% |
| 99 | ByteDance Seed 1.6 Flash | 84.16% | 48.55% | 82.27% | 100.00% | 90.00% | 100.00% | 70.92% |
| 100 | Grok 4.20 | 84.11% | 62.89% | 99.17% | 100.00% | 58.50% | 100.00% | 81.21% |
| 101 | Claude Sonnet 4 | 84.02% | 53.92% | 84.17% | 100.00% | 82.00% | 100.00% | 87.64% |
| 102 | Gemini 3.5 Flash (Reasoning, Minimal) | 83.90% | 73.28% | 79.24% | 100.00% | 67.00% | 100.00% | 85.88% |
| 103 | DeepSeek-V2 Chat | 83.82% | 41.72% | 97.87% | 100.00% | 79.50% | 100.00% | 84.09% |
| 104 | Claude Sonnet 4.5 | 83.78% | 58.93% | 91.98% | 100.00% | 68.00% | 100.00% | 87.54% |
| 105 | DeepSeek V4 Flash | 83.26% | 54.98% | 99.32% | 100.00% | 62.00% | 100.00% | 82.02% |
| 106 | Gemma 4 26B | 83.17% | 66.29% | 89.58% | 100.00% | 60.00% | 100.00% | 84.89% |
| 107 | Qwen3 235B A22B Instruct 2507 | 83.15% | 40.15% | 80.58% | 100.00% | 95.00% | 100.00% | 78.07% |
| 108 | Grok 4.5 (Reasoning, Low) | 82.63% | 73.36% | 95.81% | 90.00% | 54.00% | 100.00% | 90.94% |
| 109 | Xiaomi MIMO v2.5 Pro | 82.62% | 52.55% | 83.55% | 100.00% | 77.00% | 100.00% | 86.05% |
| 110 | GPT-4o, Aug. 6th (temp=1) | 82.44% | 77.45% | 74.24% | 100.00% | 60.50% | 100.00% | 81.28% |
| 111 | GPT-4.1 Mini | 82.30% | 66.59% | 79.41% | 100.00% | 65.50% | 100.00% | 81.40% |
| 112 | Gemini 2.5 Flash (Reasoning) | 82.25% | 46.02% | 85.21% | 100.00% | 90.00% | 90.00% | 84.14% |
| 113 | GPT-4o Mini (temp=1) | 82.16% | 78.18% | 79.62% | 100.00% | 53.00% | 100.00% | 77.82% |
| 114 | GPT-4o, Aug. 6th (temp=0) | 82.11% | 77.04% | 74.00% | 100.00% | 59.50% | 100.00% | 82.18% |
| 115 | GPT-5.4 | 81.95% | 64.23% | 100.00% | 100.00% | 45.50% | 100.00% | 84.31% |
| 116 | GPT-5.5 | 81.88% | 71.88% | 100.00% | 100.00% | 37.50% | 100.00% | 89.37% |
| 117 | DeepSeek V3 (2024-12-26) | 81.87% | 58.30% | 88.56% | 100.00% | 62.50% | 100.00% | 82.62% |
| 118 | Laguna S 2.1 | 81.67% | 35.95% | 82.39% | 100.00% | 90.00% | 100.00% | 79.98% |
| 119 | Qwen 3 32B | 81.66% | 31.96% | 95.82% | 100.00% | 80.50% | 100.00% | 79.37% |
| 120 | DeepSeek V3.2 | 81.58% | 45.81% | 92.09% | 100.00% | 70.00% | 100.00% | 82.22% |
| 121 | GPT-4o Mini (temp=0) | 81.43% | 82.65% | 79.49% | 100.00% | 45.00% | 100.00% | 76.86% |
| 122 | Xiaomi MIMO v2.5 | 81.15% | 54.18% | 86.72% | 93.33% | 71.50% | 100.00% | 83.95% |
| 123 | Llama 3.1 70B | 81.03% | 56.62% | 80.53% | 100.00% | 68.00% | 100.00% | 77.41% |
| 124 | DeepSeek V3 (2025-03-24) | 80.62% | 58.32% | 97.96% | 93.33% | 53.50% | 100.00% | 79.93% |
| 125 | GPT-5.6 Sol | 80.44% | 69.68% | 100.00% | 100.00% | 32.50% | 100.00% | 90.76% |
| 126 | Gemini 2.5 Flash Lite | 80.14% | 53.37% | 73.32% | 100.00% | 74.00% | 100.00% | 79.91% |
| 127 | Mistral Medium 3.1 | 80.13% | 64.40% | 97.23% | 100.00% | 39.00% | 100.00% | 76.08% |
| 128 | Writer: Palmyra X5 | 79.71% | 35.61% | 79.93% | 100.00% | 83.00% | 100.00% | 78.11% |
| 129 | GPT-5.4 Mini | 79.37% | 66.13% | 98.23% | 100.00% | 32.50% | 100.00% | 80.45% |
| 130 | Gemma 3 12B | 79.28% | 46.84% | 80.06% | 100.00% | 69.50% | 100.00% | 76.07% |
| 131 | Z.AI GLM 4.5 | 79.19% | 38.11% | 74.82% | 100.00% | 83.00% | 100.00% | 84.95% |
| 132 | Ministral 3 14B | 79.03% | 47.57% | 92.10% | 100.00% | 55.50% | 100.00% | 70.45% |
| 133 | Laguna XS 2.1 | 78.98% | 51.03% | 74.37% | 100.00% | 69.50% | 100.00% | 75.42% |
| 134 | GPT-5.4 Nano | 78.57% | 47.90% | 93.46% | 100.00% | 51.50% | 100.00% | 72.16% |
| 135 | Mistral Small 4 | 78.28% | 46.07% | 85.82% | 100.00% | 59.50% | 100.00% | 75.23% |
| 136 | DeepSeek V4 Pro | 77.57% | 45.34% | 90.01% | 100.00% | 52.50% | 100.00% | 82.05% |
| 137 | GPT-5.6 Terra | 77.09% | 58.47% | 100.00% | 100.00% | 27.00% | 100.00% | 88.23% |
| 138 | Gemma 3 27B | 76.82% | 45.66% | 95.44% | 100.00% | 43.00% | 100.00% | 75.70% |
| 139 | DeepSeek V3.1 | 76.65% | 47.10% | 83.32% | 93.33% | 59.50% | 100.00% | 82.35% |
| 140 | Z.AI GLM 4.5 Air | 76.57% | 34.68% | 83.68% | 100.00% | 64.50% | 100.00% | 80.74% |
| 141 | Qwen 2.5 72B | 76.43% | 51.43% | 66.70% | 100.00% | 64.00% | 100.00% | 73.17% |
| 142 | GPT-5.6 Luna | 75.00% | 50.02% | 99.99% | 100.00% | 25.00% | 100.00% | 85.06% |
| 143 | Ministral 3 8B | 74.43% | 38.01% | 74.12% | 100.00% | 60.00% | 100.00% | 69.98% |
| 144 | Mistral Small 3.2 24B | 73.17% | 42.38% | 99.97% | 100.00% | 23.50% | 100.00% | 77.36% |
| 145 | Claude Haiku 4.5 | 72.48% | 51.60% | 70.28% | 70.00% | 70.50% | 100.00% | 83.36% |
| 146 | Ministral 3 3B | 72.38% | 37.04% | 74.85% | 100.00% | 50.00% | 100.00% | 65.02% |
| 147 | Cydonia 24B V4.1 | 69.32% | 36.47% | 85.28% | 93.33% | 46.50% | 85.00% | 72.68% |
| 148 | Mistral Large 2 | 69.19% | 21.18% | 58.78% | 100.00% | 66.00% | 100.00% | 81.50% |
| 149 | Hermes 3 405B | 69.02% | 51.42% | 79.99% | 86.67% | 37.00% | 90.00% | 80.80% |
| 150 | GPT-4.1 Nano | 68.45% | 64.57% | 75.17% | 100.00% | 52.50% | 50.00% | 69.90% |
| 151 | WizardLM 2 8x22b | 67.14% | 20.73% | 71.48% | 90.00% | 53.50% | 100.00% | 71.45% |
| 152 | Grok 4.3 | 66.41% | 33.50% | 89.39% | 86.67% | 27.50% | 95.00% | 78.00% |
| 153 | Thinking Machines Inkling | 65.97% | 27.40% | 69.78% | 66.67% | 66.00% | 100.00% | 73.96% |
| 154 | Gemini 2.5 Flash | 61.45% | 38.47% | 64.79% | 100.00% | 54.00% | 50.00% | 80.61% |
| 155 | Hermes 3 70B | 61.15% | 28.43% | 58.14% | 66.67% | 52.50% | 100.00% | 69.74% |
| 156 | Gemma 3 4B | 60.30% | 22.12% | 95.04% | 53.33% | 31.00% | 100.00% | 66.33% |
| 157 | Arcee AI: Trinity Mini | 59.94% | 26.25% | 43.97% | 80.00% | 49.50% | 100.00% | 67.68% |
| 158 | Cohere Command R+ (Aug. 2024) | 59.51% | 35.13% | 60.43% | 90.00% | 42.00% | 70.00% | 67.04% |
| 159 | Mistral NeMO | 51.55% | 15.70% | 47.57% | 40.00% | 54.50% | 100.00% | 63.80% |
| 160 | Ministral 3B | 49.17% | 17.87% | 62.17% | 33.33% | 47.50% | 85.00% | 59.25% |
| 161 | Ministral 8B | 46.82% | 21.93% | 60.35% | 33.33% | 33.50% | 85.00% | 63.77% |