| 1 | Claude 3 Haiku | 100.0% | $0.0025 | 14.9s | 100% |
| 2 | Qwen 2.5 72B | 99.6% | $0.0010 | 36.7s | 95% |
| 3 | GPT-4o Mini (temp=0) | 99.6% | $0.0012 | 34.8s | 93% |
| 4 | o4 Mini High | 100.0% | $0.025 | 47.2s | 100% |
| 5 | Mistral NeMO | 98.0% | $0.0005 | 10.1s | 77% |
| 6 | Llama 3.1 70B | 98.1% | $0.0015 | 29.4s | 81% |
| 7 | GPT-4o, Aug. 6th (temp=0) | 98.6% | $0.023 | 22.7s | 84% |
| 8 | Hermes 3 405B | 98.6% | $0.0032 | 53.2s | 82% |
| 9 | Gemini 3 Flash (Preview) | 96.5% | $0.0078 | 19.6s | 75% |
| 10 | GPT-4o Mini (temp=1) | 97.0% | $0.0012 | 34.8s | 71% |
| 11 | Stealth: Aurora Alpha | 95.7% | $0.0000 | 9.8s | 63% |
| 12 | Llama 3.1 8B | 98.2% | $0.0003 | 1.3m | 77% |
| 13 | GPT-4o, May 13th (temp=0) | 97.6% | $0.035 | 14.1s | 74% |
| 14 | Hermes 3 70B | 96.8% | $0.0010 | 1.2m | 76% |
| 15 | o4 Mini | 96.1% | $0.015 | 25.7s | 68% |
| 16 | Mistral Large | 95.2% | $0.014 | 30.9s | 63% |
| 17 | GPT-4o, May 13th (temp=1) | 96.0% | $0.033 | 14.4s | 64% |
| 18 | Ministral 8B | 90.7% | $0.0004 | 10.4s | 49% |
| 19 | Mistral Large 2 | 93.5% | $0.013 | 29.4s | 57% |
| 20 | Grok 4.1 Fast | 92.9% | $0.0018 | 37.8s | 53% |
| 21 | Ministral 3 14B | 89.6% | $0.0007 | 11.7s | 47% |
| 22 | Rocinante 12B | 92.6% | $0.0014 | 38.4s | 51% |
| 23 | Llama 3.1 Nemotron 70B | 90.7% | $0.0038 | 31.7s | 48% |
| 24 | Gemma 3 12B | 91.4% | $0.0004 | 41.3s | 47% |
| 25 | Mistral Large 3 | 90.1% | $0.0033 | 30.3s | 47% |
| 26 | DeepSeek V3 (2024-12-26) | 91.9% | $0.0021 | 54.6s | 51% |
| 27 | Z.AI GLM 4.7 | 93.7% | $0.010 | 1.4m | 61% |
| 28 | Cohere Command R+ (Aug. 2024) | 92.4% | $0.020 | 52.5s | 56% |
| 29 | Ministral 3 8B | 88.1% | $0.0008 | 19.6s | 41% |
| 30 | Z.AI GLM 4.5 | 89.1% | $0.0051 | 42.1s | 43% |
| 31 | ByteDance Seed 1.6 | 97.2% | $0.013 | 2.5m | 70% |
| 32 | Mistral Small Creative | 85.1% | $0.0007 | 9.1s | 35% |
| 33 | Ministral 3B | 84.2% | $0.0001 | 8.1s | 35% |
| 34 | Gemini 3.1 Pro (Preview) | 99.9% | $0.107 | 1.8m | 98% |
| 35 | Z.AI GLM 4.7 Flash | 88.9% | $0.0017 | 1.2m | 47% |
| 36 | DeepSeek-V2 Chat | 88.4% | $0.0021 | 53.3s | 42% |
| 37 | GPT-4.1 Nano | 84.7% | $0.0007 | 13.3s | 32% |
| 38 | Qwen 3.5 Plus (2026-02-15) | 82.1% | $0.0060 | 31.5s | 42% |
| 39 | Ministral 3 3B | 82.7% | $0.0005 | 11.1s | 32% |
| 40 | Arcee AI: Trinity Large (Preview) | 85.9% | $0.0000 | 43.6s | 37% |
| 41 | GPT-4o, Aug. 6th (temp=1) | 87.1% | $0.018 | 24.4s | 37% |
| 42 | Gemini 3 Pro (Preview) | 92.1% | $0.055 | 54.4s | 57% |
| 43 | Mistral Medium 3.1 | 85.5% | $0.0048 | 36.5s | 36% |
| 44 | Z.AI GLM 5 | 89.0% | $0.0084 | 1.2m | 44% |
| 45 | Claude 3.5 Sonnet | 89.5% | $0.048 | 35.5s | 50% |
| 46 | GPT-4.1 Mini | 82.0% | $0.0027 | 19.0s | 30% |
| 47 | Minimax M2.5 | 87.5% | $0.0034 | 1.3m | 40% |
| 48 | GPT-5.1 | 92.4% | $0.054 | 1.8m | 62% |
| 49 | Mistral Small 3.2 24B | 100.0% | $0.0069 | 5.7m | 100% |
| 50 | Arcee AI: Trinity Mini | 74.9% | $0.0003 | 9.2s | 26% |
| 51 | Gemma 3 4B | 78.3% | $0.0002 | 20.0s | 25% |
| 52 | Z.AI GLM 4.6 | 82.9% | $0.0065 | 51.5s | 32% |
| 53 | Gemma 3 27B | 81.9% | $0.0006 | 52.6s | 28% |
| 54 | DeepSeek V3 (2025-03-24) | 81.5% | $0.0014 | 39.4s | 25% |
| 55 | WizardLM 2 8x22b | 85.6% | $0.0026 | 1.8m | 41% |
| 56 | Gemini 2.5 Pro | 83.6% | $0.036 | 36.2s | 37% |
| 57 | Qwen 3.5 397B A17B | 92.9% | $0.014 | 3.0m | 58% |
| 58 | Claude Sonnet 4.5 | 84.3% | $0.035 | 38.1s | 34% |
| 59 | ByteDance Seed 1.6 Flash | 75.9% | $0.0013 | 27.3s | 25% |
| 60 | Claude Haiku 4.5 | 77.7% | $0.011 | 21.6s | 24% |
| 61 | Grok 4 Fast | 73.3% | $0.0017 | 24.1s | 23% |
| 62 | Claude 3.5 Haiku | 76.7% | $0.0035 | 10.8s | 16% |
| 63 | Claude Sonnet 4 | 83.6% | $0.032 | 43.7s | 31% |
| 64 | Gemini 2.5 Flash Lite | 72.2% | $0.0009 | 9.5s | 18% |
| 65 | DeepSeek V3.1 | 82.8% | $0.0020 | 1.8m | 35% |
| 66 | Claude Opus 4.5 | 88.2% | $0.070 | 53.4s | 44% |
| 67 | GPT-4.1 | 79.3% | $0.018 | 44.7s | 26% |
| 68 | Gemini 2.5 Flash | 70.9% | $0.0052 | 10.6s | 19% |
| 69 | Claude Sonnet 4.6 | 80.4% | $0.031 | 39.3s | 26% |
| 70 | Writer: Palmyra X5 | 70.8% | $0.011 | 22.0s | 16% |
| 71 | Claude 3.7 Sonnet | 78.2% | $0.042 | 46.7s | 25% |
| 72 | GPT-5 Mini | 69.0% | $0.0100 | 57.4s | 19% |
| 73 | Grok 4 | 82.3% | $0.048 | 1.7m | 33% |
| 74 | Claude Opus 4.6 | 81.3% | $0.078 | 1.2m | 37% |
| 75 | DeepSeek V3.2 | 71.2% | $0.0014 | 1.9m | 21% |
| 76 | GPT-5 | 89.3% | $0.065 | 2.8m | 47% |
| 77 | GPT-5.2 | 76.9% | $0.056 | 1.5m | 26% |
| 78 | MoonshotAI: Kimi K2.5 | 59.6% | $0.019 | 3.2m | 10% |
| 79 | Claude Opus 4 | 86.4% | $0.209 | 1.4m | 37% |
| 80 | GPT-5 Nano | 14.2% | $0.0042 | 1.4m | 0% |