Vendors
Model creators/vendors and how their models compare across the benchmark.
| Vendor | Models | Avg Score | Best Score ▼ | Best Model |
|---|---|---|---|---|
| OpenAI | 33 | 85.76% | 95.15% | GPT-5.6 Sol (Reasoning) |
| Anthropic | 19 | 90.25% | 95.06% | Claude Opus 4.6 (Reasoning) |
| 24 | 84.94% | 94.90% | Gemini 3.6 Flash (Reasoning) | |
| Qwen | 16 | 86.77% | 94.55% | Qwen3.7 Max |
| xAI | 6 | 87.69% | 94.12% | Grok 4.5 (Reasoning, High) |
| meta | 2 | 92.62% | 93.81% | Muse Spark 1.1 (Reasoning, Medium) |
| Z.AI | 9 | 88.14% | 93.74% | Z.AI GLM 5.1 |
| MoonshotAI | 4 | 92.12% | 92.99% | MoonshotAI: Kimi K3 (Reasoning, High) |
| thinkingmachines | 2 | 82.37% | 90.78% | Thinking Machines Inkling (Reasoning) |
| minimax | 3 | 87.80% | 90.45% | MiniMax M3 |
| bytedance-seed | 4 | 82.62% | 89.59% | ByteDance Seed 1.6 |
| DeepSeek | 9 | 83.63% | 89.28% | DeepSeek V4 Pro (Reasoning) |
| aion-labs | 3 | 86.38% | 88.78% | Aion 3.0 |
| xiaomi | 2 | 85.00% | 86.05% | Xiaomi MIMO v2.5 Pro |
| Mistral AI | 12 | 72.18% | 84.29% | Mistral Large 3 |
| inception | 1 | 81.99% | 81.99% | Inception Mercury 2 |
| NVIDIA | 2 | 78.10% | 81.69% | Nemotron 3 Super |
| Nous Research | 2 | 75.27% | 80.80% | Hermes 3 405B |
| poolside | 2 | 77.70% | 79.98% | Laguna S 2.1 |
| Writer | 1 | 78.11% | 78.11% | Writer: Palmyra X5 |
| Meta | 1 | 77.41% | 77.41% | Llama 3.1 70B |
| TheDrummer | 1 | 72.68% | 72.68% | Cydonia 24B V4.1 |
| Microsoft | 1 | 71.45% | 71.45% | WizardLM 2 8x22b |
| arcee-ai | 1 | 67.68% | 67.68% | Arcee AI: Trinity Mini |
| Cohere | 1 | 67.04% | 67.04% | Cohere Command R+ (Aug. 2024) |