| 1 | GPT-4o Mini (temp=1) | 82.2% | $0.0012 | 34.8s | 66% |
| 2 | GPT-4o, Aug. 6th (temp=1) | 84.8% | $0.018 | 24.4s | 66% |
| 3 | Gemini 3.5 Flash Lite (Reasoning, Minimal) | 80.0% | $0.0035 | 6.3s | 56% |
| 4 | Cydonia 24B V4.1 | 80.1% | $0.0014 | 44.8s | 58% |
| 5 | Claude Sonnet 5 (Reasoning, Low) | 79.9% | $0.031 | 38.4s | 62% |
| 6 | Gemini 3.5 Flash Lite (Reasoning) | 79.0% | $0.0035 | 6.6s | 54% |
| 7 | Hermes 3 405B | 78.7% | $0.0032 | 53.2s | 57% |
| 8 | DeepSeek V3 (2025-03-24) | 77.8% | $0.0014 | 39.4s | 56% |
| 9 | Claude Sonnet 5 | 77.5% | $0.027 | 33.5s | 59% |
| 10 | Claude Sonnet 5 (Reasoning) | 78.8% | $0.030 | 38.9s | 59% |
| 11 | GPT-4.1 Mini | 69.6% | $0.0027 | 19.0s | 55% |
| 12 | Claude Sonnet 4 | 75.8% | $0.032 | 43.7s | 58% |
| 13 | Claude Sonnet 4.5 | 72.8% | $0.035 | 38.1s | 58% |
| 14 | Laguna S 2.1 | 67.5% | $0.0005 | 22.1s | 51% |
| 15 | Cohere Command R+ (Aug. 2024) | 73.8% | $0.020 | 52.5s | 52% |
| 16 | Hermes 3 70B | 75.6% | $0.0010 | 1.2m | 49% |
| 17 | GPT-4.1 Nano | 64.7% | $0.0007 | 13.3s | 51% |
| 18 | MoonshotAI: Kimi K3 (Reasoning, Low) | 73.7% | $0.028 | 1.1m | 54% |
| 19 | Z.AI GLM 4.5 | 68.1% | $0.0051 | 42.1s | 50% |
| 20 | Grok 4.5 (Reasoning, High) | 72.4% | $0.030 | 1.6m | 57% |
| 21 | GPT-4.1 | 65.8% | $0.018 | 44.7s | 54% |
| 22 | Grok 4.5 (Reasoning, Low) | 69.1% | $0.018 | 1.1m | 53% |
| 23 | Gemma 3 27B | 65.9% | $0.0006 | 52.6s | 48% |
| 24 | Gemma 3 12B | 63.1% | $0.0004 | 41.3s | 49% |
| 25 | Claude Opus 4.8 (Reasoning) | 70.6% | $0.071 | 41.7s | 56% |
| 26 | Claude Haiku 4.5 | 63.3% | $0.011 | 21.6s | 49% |
| 27 | Claude Opus 4.8 (Reasoning, Low) | 70.1% | $0.071 | 41.9s | 56% |
| 28 | Laguna XS 2.1 | 61.5% | $0.0003 | 14.4s | 46% |
| 29 | DeepSeek V3 (2024-12-26) | 63.9% | $0.0021 | 54.6s | 47% |
| 30 | Z.AI GLM 5 Turbo | 62.5% | $0.0081 | 33.2s | 47% |
| 31 | Claude Opus 4.7 | 69.1% | $0.069 | 30.4s | 53% |
| 32 | GPT-4o Mini (temp=0) | 62.1% | $0.0012 | 34.8s | 45% |
| 33 | DeepSeek-V2 Chat | 63.5% | $0.0021 | 53.3s | 46% |
| 34 | Z.AI GLM 5 | 63.0% | $0.0084 | 1.2m | 48% |
| 35 | Claude Opus 5 (Reasoning) | 72.8% | $0.098 | 1.0m | 55% |
| 36 | Writer: Palmyra X5 | 58.2% | $0.011 | 22.0s | 47% |
| 37 | Gemma 3 4B | 57.9% | $0.0002 | 20.0s | 44% |
| 38 | Llama 3.1 70B | 60.5% | $0.0015 | 29.4s | 43% |
| 39 | Muse Spark 1.1 (Reasoning, Minimal) | 57.5% | $0.012 | 19.2s | 45% |
| 40 | Claude Opus 5 (Reasoning, Low) | 72.1% | $0.097 | 1.0m | 54% |
| 41 | Qwen3 235B A22B Instruct 2507 | 58.7% | $0.0011 | 59.2s | 46% |
| 42 | Z.AI GLM 4.5 Air | 61.8% | $0.0029 | 58.2s | 43% |
| 43 | Claude Opus 4.7 (Reasoning) | 65.9% | $0.076 | 32.0s | 50% |
| 44 | Gemini 3.6 Flash (Reasoning, Minimal) | 62.0% | $0.017 | 14.3s | 41% |
| 45 | Gemini 2.5 Flash Lite | 56.3% | $0.0009 | 9.5s | 42% |
| 46 | Gemini 3.6 Flash (Reasoning) | 62.5% | $0.044 | 32.5s | 47% |
| 47 | Grok 4.3 | 56.6% | $0.0069 | 30.5s | 44% |
| 48 | Grok 4.20 | 56.1% | $0.0093 | 45.7s | 46% |
| 49 | Claude Opus 5 | 67.9% | $0.082 | 50.1s | 49% |
| 50 | Claude Sonnet 4.6 | 62.6% | $0.031 | 39.3s | 43% |
| 51 | Gemini 3.5 Flash (Reasoning, Minimal) | 57.5% | $0.018 | 12.0s | 42% |
| 52 | Gemini 2.5 Flash | 58.2% | $0.0052 | 10.6s | 39% |
| 53 | Qwen 3.5 Plus (2026-02-15) | 54.6% | $0.0060 | 31.5s | 43% |
| 54 | Grok 4.20 (Reasoning) | 59.0% | $0.018 | 1.5m | 48% |
| 55 | MoonshotAI: Kimi K3 (Reasoning, High) | 64.9% | $0.044 | 1.8m | 50% |
| 56 | DeepSeek V4 Flash | 59.4% | $0.0006 | 31.6s | 38% |
| 57 | Z.AI GLM 5.1 | 62.2% | $0.014 | 1.5m | 44% |
| 58 | Qwen 3 32B | 58.5% | $0.0015 | 54.6s | 41% |
| 59 | o4 Mini | 53.0% | $0.015 | 25.7s | 45% |
| 60 | DeepSeek V4 Pro | 61.4% | $0.0048 | 1.3m | 42% |
| 61 | Gemini 2.5 Flash (Reasoning) | 55.3% | $0.011 | 21.5s | 42% |
| 62 | Mistral Small 4 | 54.9% | $0.0014 | 18.2s | 40% |
| 63 | Muse Spark 1.1 (Reasoning, Medium) | 55.4% | $0.015 | 23.9s | 42% |
| 64 | Claude Opus 4.5 | 62.7% | $0.070 | 53.4s | 49% |
| 65 | GPT-4o, Aug. 6th (temp=0) | 57.0% | $0.023 | 22.7s | 42% |
| 66 | Z.AI GLM 5.2 (Reasoning, High) | 57.0% | $0.011 | 1.0m | 43% |
| 67 | DeepSeek V4 Flash (Reasoning) | 57.1% | $0.0007 | 31.1s | 38% |
| 68 | Qwen 2.5 72B | 52.8% | $0.0010 | 36.7s | 42% |
| 69 | MiniMax M2.7 | 57.3% | $0.0040 | 1.1m | 41% |
| 70 | Gemini 2.5 Flash Lite (Reasoning) | 53.0% | $0.0028 | 30.8s | 40% |
| 71 | Arcee AI: Trinity Mini | 55.9% | $0.0003 | 9.2s | 36% |
| 72 | Mistral Medium 3.1 | 52.0% | $0.0048 | 36.5s | 42% |
| 73 | MiniMax M2.5 | 56.9% | $0.0034 | 1.3m | 41% |
| 74 | Mistral Large 2 | 51.7% | $0.013 | 29.4s | 42% |
| 75 | Thinking Machines Inkling | 57.2% | $0.0075 | 1.5m | 42% |
| 76 | GPT-5.6 Luna | 47.5% | $0.015 | 15.8s | 42% |
| 77 | Mistral Large 3 | 49.7% | $0.0033 | 30.3s | 40% |
| 78 | Aion 3.0 Mini | 58.2% | $0.0053 | 1.2m | 38% |
| 79 | Mistral Small 4 (Reasoning) | 50.1% | $0.0022 | 30.2s | 39% |
| 80 | ByteDance Seed 1.6 Flash | 50.8% | $0.0013 | 27.3s | 37% |
| 81 | WizardLM 2 8x22b | 57.4% | $0.0026 | 1.8m | 40% |
| 82 | GPT-5.4 Mini (Reasoning, Low) | 46.4% | $0.015 | 16.8s | 41% |
| 83 | GPT-5.4 Mini | 46.6% | $0.015 | 16.8s | 41% |
| 84 | Ministral 3 14B | 48.2% | $0.0007 | 11.7s | 37% |
| 85 | Claude Sonnet 4.6 (Reasoning) | 61.1% | $0.060 | 1.2m | 43% |
| 86 | GPT-5.6 Luna (Reasoning) | 46.7% | $0.017 | 18.0s | 41% |
| 87 | o4 Mini High | 53.1% | $0.025 | 47.2s | 40% |
| 88 | GPT-5.4 | 55.7% | $0.049 | 1.4m | 46% |
| 89 | Xiaomi MIMO v2.5 Pro | 50.4% | $0.0085 | 53.5s | 39% |
| 90 | Ministral 3 8B | 45.3% | $0.0008 | 19.6s | 38% |
| 91 | Ministral 3B | 46.8% | $0.0001 | 8.1s | 36% |
| 92 | GPT-5.6 Terra (Reasoning) | 50.7% | $0.044 | 35.2s | 43% |
| 93 | Xiaomi MIMO v2.5 | 47.2% | $0.0054 | 31.8s | 38% |
| 94 | GPT-5.4 Mini (Reasoning) | 47.7% | $0.022 | 28.1s | 40% |
| 95 | Ministral 8B | 44.3% | $0.0004 | 10.4s | 37% |
| 96 | Nemotron 3 Super | 48.5% | $0.0000 | 1.4m | 41% |
| 97 | Aion 3.0 | 53.0% | $0.024 | 1.0m | 38% |
| 98 | Mistral NeMO | 46.4% | $0.0005 | 10.1s | 34% |
| 99 | Ministral 3 3B | 44.7% | $0.0005 | 11.1s | 35% |
| 100 | Aion 2.0 | 49.4% | $0.0064 | 1.3m | 39% |
| 101 | Gemini 2.5 Pro | 50.7% | $0.036 | 36.2s | 39% |
| 102 | GPT-5.4 Nano (Reasoning) | 41.2% | $0.0061 | 24.5s | 39% |
| 103 | GPT-5.4 Nano (Reasoning, Low) | 40.7% | $0.0055 | 20.6s | 39% |
| 104 | GPT-5.4 (Reasoning, Low) | 53.8% | $0.055 | 1.4m | 44% |
| 105 | Inception Mercury 2 | 41.1% | $0.0032 | 7.0s | 36% |
| 106 | GPT-5.4 Nano | 40.5% | $0.0057 | 26.3s | 39% |
| 107 | Claude Opus 4 | 72.7% | $0.209 | 1.4m | 57% |
| 108 | GPT-5.6 Terra | 47.7% | $0.046 | 36.9s | 41% |
| 109 | Z.AI GLM 4.6 | 47.4% | $0.0065 | 51.5s | 36% |
| 110 | DeepSeek V3.2 | 47.8% | $0.0014 | 1.9m | 40% |
| 111 | GPT-5.1 | 54.4% | $0.054 | 1.8m | 44% |
| 112 | Gemini 3.1 Flash Lite | 43.6% | $0.0030 | 12.1s | 33% |
| 113 | Gemini 3 Flash (Preview) | 43.7% | $0.0078 | 19.6s | 34% |
| 114 | MoonshotAI: Kimi K2.5 | 57.7% | $0.019 | 3.2m | 42% |
| 115 | Gemini 3.1 Flash Lite (Reasoning) | 43.4% | $0.0030 | 11.9s | 32% |
| 116 | Gemini 3.1 Flash Lite (Preview) | 43.2% | $0.0030 | 8.4s | 32% |
| 117 | DeepSeek V4 Pro (Reasoning) | 57.6% | $0.015 | 3.1m | 40% |
| 118 | Claude Opus 4.6 | 55.1% | $0.078 | 1.2m | 42% |
| 119 | Claude Opus 4.6 (Reasoning) | 57.2% | $0.088 | 1.4m | 43% |
| 120 | Gemini 3 Flash (Preview, Reasoning) | 43.5% | $0.012 | 30.1s | 33% |
| 121 | Grok 4.3 (Reasoning) | 53.5% | $0.021 | 2.3m | 38% |
| 122 | DeepSeek V3.1 | 51.6% | $0.0020 | 1.8m | 33% |
| 123 | Z.AI GLM 4.7 | 45.1% | $0.010 | 1.4m | 37% |
| 124 | GPT-5 Mini | 41.9% | $0.0100 | 57.4s | 36% |
| 125 | GPT-OSS 120B | 43.5% | $0.0015 | 1.8m | 37% |
| 126 | Z.AI GLM 4.7 Flash | 43.1% | $0.0017 | 1.2m | 34% |
| 127 | Qwen 3.6 Flash | 46.5% | $0.010 | 41.4s | 31% |
| 128 | Gemini 3.5 Flash (Reasoning) | 50.3% | $0.071 | 37.6s | 38% |
| 129 | ByteDance Seed 2.0 Lite | 55.7% | $0.012 | 2.2m | 32% |
| 130 | Gemma 4 26B | 39.7% | $0.0009 | 55.1s | 33% |
| 131 | Qwen 3.5 Flash | 38.0% | $0.0025 | 47.5s | 34% |
| 132 | Nemotron 3 Nano | 40.9% | $0.0010 | 1.1m | 33% |
| 133 | GPT-5.6 Sol | 51.9% | $0.105 | 1.2m | 44% |
| 134 | Gemma 4 31B | 43.1% | $0.0010 | 1.6m | 34% |
| 135 | ByteDance Seed 1.6 | 51.7% | $0.013 | 2.5m | 34% |
| 136 | GPT-5.6 Sol (Reasoning) | 50.8% | $0.108 | 1.2m | 44% |
| 137 | Qwen 3.6 35B | 43.0% | $0.0083 | 1.0m | 30% |
| 138 | GPT-5.2 | 42.7% | $0.056 | 1.5m | 41% |
| 139 | Qwen 3.5 Plus (2026-04-20) | 47.5% | $0.017 | 1.8m | 32% |
| 140 | MiniMax M3 | 50.9% | $0.0060 | 3.1m | 34% |
| 141 | Gemma 4 31B (Reasoning) | 41.0% | $0.0014 | 2.2m | 34% |
| 142 | GPT-5.4 (Reasoning) | 53.8% | $0.089 | 2.6m | 42% |
| 143 | Qwen 3.5 122B | 37.9% | $0.025 | 1.1m | 33% |
| 144 | Qwen 3.6 27B | 46.7% | $0.025 | 2.3m | 33% |
| 145 | Gemma 4 26B (Reasoning) | 39.8% | $0.0013 | 2.0m | 32% |
| 146 | Qwen 3.5 9B | 37.1% | $0.0011 | 1.4m | 30% |
| 147 | Qwen 3.5 35B | 35.7% | $0.018 | 1.0m | 31% |
| 148 | Qwen 3.5 27B | 37.5% | $0.020 | 1.6m | 33% |
| 149 | Thinking Machines Inkling (Reasoning) | 56.9% | $0.025 | 5.1m | 39% |
| 150 | GPT-5 Nano | 33.5% | $0.0042 | 1.4m | 31% |
| 151 | Qwen 3.5 397B A17B | 42.7% | $0.014 | 3.0m | 34% |
| 152 | Gemini 3.1 Pro (Preview) | 49.1% | $0.107 | 1.8m | 37% |
| 153 | ByteDance Seed 2.0 Mini | 50.8% | $0.0045 | 4.9m | 36% |
| 154 | Qwen3.7 Max | 45.2% | $0.068 | 2.3m | 35% |
| 155 | Qwen3.6 Max Preview | 48.2% | $0.050 | 3.5m | 35% |
| 156 | GPT-5.5 (Reasoning) | 48.3% | $0.142 | 1.8m | 41% |
| 157 | GPT-5 | 44.5% | $0.065 | 2.8m | 36% |
| 158 | GPT-5.5 (Reasoning, Low) | 48.4% | $0.139 | 1.8m | 40% |
| 159 | GPT-5.5 | 48.2% | $0.139 | 1.7m | 39% |
| 160 | MoonshotAI: Kimi K2.6 | 52.9% | $0.058 | 6.5m | 39% |
| 161 | Mistral Small 3.2 24B | 37.6% | $0.0068 | 5.6m | 30% |