| 1 | GPT-5.4 Mini | 97.4% | $0.015 | 16.8s | 81% |
| 2 | GPT-5.4 Mini (Reasoning) | 98.0% | $0.022 | 28.1s | 85% |
| 3 | GPT-5.4 Mini (Reasoning, Low) | 95.0% | $0.015 | 16.8s | 72% |
| 4 | Mistral NeMO | 95.0% | $0.0005 | 10.1s | 63% |
| 5 | Qwen 3.5 Flash | 94.4% | $0.0025 | 47.5s | 67% |
| 6 | Qwen 2.5 72B | 93.0% | $0.0010 | 36.7s | 64% |
| 7 | Qwen 3.5 9B | 95.9% | $0.0011 | 1.4m | 72% |
| 8 | GPT-4o, May 13th (temp=0) | 92.9% | $0.035 | 14.1s | 64% |
| 9 | Qwen 3.5 122B | 94.6% | $0.025 | 1.1m | 69% |
| 10 | Qwen 3.5 35B | 94.3% | $0.018 | 1.0m | 64% |
| 11 | Gemini 2.5 Flash | 86.7% | $0.0052 | 10.6s | 51% |
| 12 | Gemini 2.5 Flash Lite | 82.2% | $0.0009 | 9.5s | 48% |
| 13 | Qwen 3.5 27B | 94.5% | $0.020 | 1.6m | 66% |
| 14 | Qwen 3.5 397B A17B | 98.3% | $0.014 | 3.0m | 78% |
| 15 | Gemini 2.5 Flash (Reasoning) | 83.4% | $0.011 | 21.5s | 42% |
| 16 | Z.AI GLM 4.6 | 84.0% | $0.0065 | 51.5s | 43% |
| 17 | Gemini 2.5 Pro | 83.7% | $0.036 | 36.2s | 50% |
| 18 | GPT-5.4 (Reasoning, Low) | 91.3% | $0.055 | 1.4m | 62% |
| 19 | Inception Mercury | 82.3% | $0.011 | 17.6s | 30% |
| 20 | GPT-5.4 | 88.6% | $0.049 | 1.4m | 52% |
| 21 | GPT-4o, Aug. 6th (temp=0) | 79.3% | $0.023 | 22.7s | 30% |
| 22 | Gemma 3 27B | 73.5% | $0.0006 | 52.6s | 30% |
| 23 | Gemini 3.1 Pro (Preview) | 95.9% | $0.107 | 1.8m | 67% |
| 24 | Qwen 3.5 Plus (2026-02-15) | 71.3% | $0.0060 | 31.5s | 22% |
| 25 | Hermes 3 405B | 73.8% | $0.0032 | 53.2s | 24% |
| 26 | ByteDance Seed 2.0 Lite | 83.7% | $0.012 | 2.2m | 38% |
| 27 | GPT-4o Mini (temp=0) | 66.3% | $0.0012 | 34.8s | 24% |
| 28 | GPT-5.4 (Reasoning) | 91.6% | $0.089 | 2.6m | 63% |
| 29 | Claude 3 Haiku | 60.2% | $0.0025 | 14.9s | 12% |
| 30 | Grok 4.20 (Beta) | 64.3% | $0.018 | 15.8s | 9% |
| 31 | Gemini 2.5 Flash Lite (Reasoning) | 50.7% | $0.0028 | 30.8s | 15% |
| 32 | Stealth: Aurora Alpha | 50.9% | $0.0000 | 9.8s | 8% |
| 33 | Inception Mercury 2 | 52.0% | $0.0032 | 7.0s | 7% |
| 34 | Z.AI GLM 4.7 | 64.3% | $0.010 | 1.4m | 17% |
| 35 | Grok 4.20 (Beta, Reasoning) | 69.7% | $0.039 | 34.0s | 10% |
| 36 | Llama 3.1 70B | 54.4% | $0.0015 | 29.4s | 6% |
| 37 | Cohere Command R+ (Aug. 2024) | 60.2% | $0.020 | 52.5s | 12% |
| 38 | DeepSeek V3.2 | 60.4% | $0.0014 | 1.9m | 19% |
| 39 | DeepSeek V3.1 | 59.9% | $0.0020 | 1.8m | 19% |
| 40 | Hermes 3 70B | 57.7% | $0.0010 | 1.2m | 11% |
| 41 | Z.AI GLM 5 Turbo | 55.8% | $0.0081 | 33.2s | 6% |
| 42 | Aion 2.0 | 55.9% | $0.0064 | 1.3m | 13% |
| 43 | GPT-5.4 Nano (Reasoning, Low) | 47.6% | $0.0055 | 20.6s | 3% |
| 44 | Stealth: Healer Alpha | 41.4% | $0.0000 | 23.7s | 7% |
| 45 | GPT-5.4 Nano | 46.2% | $0.0057 | 26.3s | 4% |
| 46 | GPT-5.4 Nano (Reasoning) | 45.9% | $0.0061 | 24.5s | 3% |
| 47 | Rocinante 12B | 46.1% | $0.0014 | 38.4s | 4% |
| 48 | Gemma 3 12B | 41.2% | $0.0004 | 41.3s | 8% |
| 49 | Z.AI GLM 4.7 Flash | 47.2% | $0.0017 | 1.2m | 8% |
| 50 | GPT-5.1 | 69.9% | $0.054 | 1.8m | 18% |
| 51 | Mistral Small 3.2 24B | 88.0% | $0.0069 | 5.7m | 43% |
| 52 | WizardLM 2 8x22b | 54.5% | $0.0026 | 1.8m | 11% |
| 53 | Arcee AI: Trinity Mini | 32.0% | $0.0003 | 9.2s | 2% |
| 54 | Gemini 3 Flash (Preview, Reasoning) | 41.5% | $0.012 | 30.1s | 4% |
| 55 | Arcee AI: Trinity Large (Preview) | 39.9% | $0.0000 | 43.6s | 3% |
| 56 | MiniMax M2.7 | 46.7% | $0.0040 | 1.1m | 3% |
| 57 | Llama 3.1 Nemotron 70B | 34.5% | $0.0038 | 31.7s | 3% |
| 58 | o4 Mini | 38.1% | $0.015 | 25.7s | 2% |
| 59 | GPT-4o, May 13th (temp=1) | 40.0% | $0.033 | 14.4s | 5% |
| 60 | Stealth: Hunter Alpha | 36.1% | $0.0000 | 55.0s | 5% |
| 61 | Claude 3.5 Haiku | 26.7% | $0.0035 | 10.8s | 0% |
| 62 | Claude Sonnet 4.5 | 46.5% | $0.035 | 38.1s | 2% |
| 63 | o4 Mini High | 42.8% | $0.025 | 47.2s | 4% |
| 64 | Gemini 3.1 Flash Lite (Preview) | 24.7% | $0.0030 | 8.4s | 0% |
| 65 | Ministral 3 3B | 22.9% | $0.0005 | 11.1s | 0% |
| 66 | Z.AI GLM 5 | 41.9% | $0.0084 | 1.2m | 0% |
| 67 | Gemini 3 Flash (Preview) | 25.7% | $0.0078 | 19.6s | 0% |
| 68 | Claude Haiku 4.5 | 27.6% | $0.011 | 21.6s | 0% |
| 69 | Z.AI GLM 4.5 | 28.3% | $0.0051 | 42.1s | 2% |
| 70 | Ministral 3B | 17.9% | $0.0001 | 8.1s | 0% |
| 71 | Ministral 3 8B | 20.2% | $0.0008 | 19.6s | 0% |
| 72 | Mistral Large 3 | 23.8% | $0.0033 | 30.3s | 0% |
| 73 | LFM2 24B | 20.6% | $0.0002 | 28.4s | 0% |
| 74 | Nemotron 3 Nano | 32.5% | $0.0010 | 1.1m | 0% |
| 75 | Mistral Large 2 | 25.7% | $0.013 | 29.4s | 0% |
| 76 | GPT-5.2 | 56.0% | $0.056 | 1.5m | 7% |
| 77 | Ministral 8B | 14.0% | $0.0004 | 10.4s | 0% |
| 78 | Claude Sonnet 4.6 | 36.5% | $0.031 | 39.3s | 0% |
| 79 | DeepSeek V3 (2024-12-26) | 27.1% | $0.0021 | 54.6s | 0% |
| 80 | Mistral Large | 25.4% | $0.014 | 30.9s | 0% |
| 81 | Grok 4.1 Fast | 21.2% | $0.0018 | 37.8s | 0% |
| 82 | Mistral Small Creative | 12.2% | $0.0007 | 9.1s | 0% |
| 83 | GPT-5 | 69.5% | $0.065 | 2.8m | 18% |
| 84 | Claude Sonnet 4 | 36.4% | $0.032 | 43.7s | 0% |
| 85 | DeepSeek-V2 Chat | 24.3% | $0.0021 | 53.3s | 1% |
| 86 | Claude 3.5 Sonnet | 40.3% | $0.048 | 35.5s | 0% |
| 87 | Llama 3.1 8B | 29.3% | $0.0003 | 1.3m | 0% |
| 88 | GPT-5 Mini | 27.9% | $0.0100 | 57.4s | 0% |
| 89 | Gemma 3 4B | 11.5% | $0.0002 | 20.0s | 0% |
| 90 | Ministral 3 14B | 8.0% | $0.0007 | 11.7s | 0% |
| 91 | MiniMax M2.5 | 24.0% | $0.0034 | 1.3m | 0% |
| 92 | GPT-4o Mini (temp=1) | 10.0% | $0.0012 | 34.8s | 0% |
| 93 | GPT-4.1 Mini | 5.0% | $0.0027 | 19.0s | 0% |
| 94 | Mistral Small 4 | 4.0% | $0.0014 | 18.2s | 0% |
| 95 | GPT-4.1 Nano | 2.2% | $0.0007 | 13.3s | 0% |
| 96 | Writer: Palmyra X5 | 8.0% | $0.011 | 22.0s | 0% |
| 97 | Mistral Medium 3.1 | 9.1% | $0.0048 | 36.5s | 0% |
| 98 | ByteDance Seed 1.6 Flash | 4.7% | $0.0013 | 27.3s | 0% |
| 99 | Qwen 3 32B | 12.3% | $0.0015 | 54.6s | 0% |
| 100 | Gemini 3 Pro (Preview) | 33.2% | $0.055 | 54.4s | 3% |
| 101 | Mistral Small 4 (Reasoning) | 4.2% | $0.0022 | 30.2s | 0% |
| 102 | DeepSeek V3 (2025-03-24) | 6.3% | $0.0014 | 39.4s | 0% |
| 103 | Grok 4 Fast | 1.4% | $0.0017 | 24.1s | 0% |
| 104 | Nemotron 3 Super | 17.5% | $0.0000 | 1.4m | 0% |
| 105 | GPT-4o, Aug. 6th (temp=1) | 7.0% | $0.018 | 24.4s | 0% |
| 106 | Qwen3 235B A22B Instruct 2507 | 6.9% | $0.0011 | 59.2s | 0% |
| 107 | Claude Opus 4.5 | 36.6% | $0.070 | 53.4s | 0% |
| 108 | Claude Sonnet 4.6 (Reasoning) | 33.3% | $0.060 | 1.2m | 0% |
| 109 | GPT-4.1 | 5.6% | $0.018 | 44.7s | 0% |
| 110 | Claude 3.7 Sonnet | 9.6% | $0.042 | 46.7s | 0% |
| 111 | Claude Opus 4.6 | 33.4% | $0.078 | 1.2m | 0% |
| 112 | GPT-5 Nano | 0.8% | $0.0042 | 1.4m | 0% |
| 113 | MoonshotAI: Kimi K2.5 | 37.7% | $0.019 | 3.2m | 0% |
| 114 | Claude Opus 4.6 (Reasoning) | 33.9% | $0.088 | 1.4m | 0% |
| 115 | ByteDance Seed 2.0 Mini | 42.2% | $0.0045 | 4.9m | 3% |
| 116 | Grok 4 | 5.5% | $0.048 | 1.7m | 0% |
| 117 | ByteDance Seed 1.6 | 0.0% | $0.013 | 2.5m | 0% |
| 118 | Claude Opus 4 | 34.6% | $0.209 | 1.4m | 0% |