| 98 | Claude Opus 4.6 (Reasoning) | $0.040 | 21.2s | 100% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% |
| 104 | Qwen3.7 Max | $0.031 | 53.4s | 100% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% |
| 103 | Gemini 3.1 Pro (Preview) | $0.039 | 33.4s | 100% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% |
| 58 | GPT-5.4 (Reasoning) | $0.017 | 16.9s | 100% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% |
| 87 | Z.AI GLM 5.1 | $0.013 | 1.0m | 100% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% |
| 114 | Qwen3.6 Max Preview | $0.026 | 1.6m | 100% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% |
| 49 | Z.AI GLM 5.2 (Reasoning, High) | $0.0088 | 27.2s | 100% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% |
| 70 | Gemini 3.5 Flash (Reasoning) | $0.025 | 10.6s | 100% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% |
| 35 | Z.AI GLM 5 Turbo | $0.0065 | 16.9s | 100% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% |
| 73 | MoonshotAI: Kimi K2.6 | $0.0087 | 51.5s | 100% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% |
| 60 | GPT-5.5 (Reasoning, Low) | $0.021 | 9.3s | 100% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% |
| 52 | GPT-5 | $0.012 | 21.4s | 100% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% |
| 27 | GPT-5 Mini | $0.0029 | 16.1s | 100% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% |
| 119 | Qwen 3.5 397B A17B | $0.017 | 2.0m | 100% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% |
| 54 | Grok 4.3 (Reasoning) | $0.0067 | 39.3s | 100% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% |
| 24 | Grok 4.20 (Beta, Reasoning) | $0.0065 | 4.9s | 100% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% |
| 32 | GPT-5.4 (Reasoning, Low) | $0.0091 | 8.6s | 100% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% |
| 25 | Grok 4.20 (Reasoning) | $0.0038 | 11.7s | 100% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% |
| 43 | Claude Sonnet 4.6 | $0.013 | 11.2s | 100% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% |
| 131 | Qwen 3.5 122B | $0.041 | 1.8m | 100% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% |
| 82 | Qwen 3.5 27B | $0.011 | 56.7s | 100% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% |
| 40 | Gemini 3 Flash (Preview, Reasoning) | $0.0098 | 16.9s | 100% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% |
| 20 | GPT-5.4 Mini (Reasoning) | $0.0044 | 7.9s | 100% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% |
| 75 | Qwen 3.5 Plus (2026-04-20) | $0.0088 | 51.8s | 100% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% |
| 63 | Z.AI GLM 5 | $0.0081 | 41.3s | 100% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% |
| 51 | ByteDance Seed 1.6 | $0.0040 | 40.4s | 100% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% |
| 61 | GPT-5.5 | $0.020 | 11.3s | 100% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% |
| 33 | Qwen 3.6 Flash | $0.0055 | 18.3s | 100% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% |
| 116 | DeepSeek V4 Pro (Reasoning) | $0.0086 | 2.3m | 100% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% |
| 113 | Gemma 4 26B (Reasoning) | $0.0013 | 2.4m | 100% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% |
| 84 | Gemini 3 Pro (Preview) | $0.029 | 17.7s | 100% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% |
| 81 | Qwen 3.6 27B | $0.012 | 53.1s | 100% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% |
| 4 | DeepSeek V4 Flash (Reasoning) | $0.0002 | 6.2s | 100% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% |
| 46 | Qwen 3.6 35B | $0.0070 | 29.3s | 100% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% |
| 64 | Qwen 3.5 35B | $0.011 | 35.6s | 100% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% |
| 26 | Qwen 3.5 Plus (2026-02-15) | $0.0016 | 17.7s | 100% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% |
| 48 | Qwen 3.5 Flash | $0.0024 | 41.3s | 100% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% |
| 29 | GPT-5.4 | $0.0081 | 9.6s | 100% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% |
| 13 | Mistral Large 3 | $0.0014 | 7.7s | 100% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% |
| 88 | ByteDance Seed 2.0 Lite | $0.0070 | 1.3m | 100% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% |
| 28 | DeepSeek-V2 Chat | $0.0004 | 27.1s | 100% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% |
| 85 | Qwen 3.5 9B | $0.0011 | 1.4m | 100% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% |
| 12 | GPT-5.4 Mini (Reasoning, Low) | $0.0029 | 3.0s | 100% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% |
| 7 | Grok 4.20 (Beta) | $0.0025 | 1.6s | 100% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% |
| 1 | DeepSeek V4 Flash | $0.0002 | 5.3s | 100% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% |
| 11 | GPT-5.4 Mini | $0.0027 | 2.8s | 100% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% |
| 2 | Mistral Small 3.2 24B | $0.0003 | 5.5s | 100% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% |
| 74 | Claude Sonnet 4.6 (Reasoning) | $0.022 | 19.6s | 100% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% |
| 44 | MoonshotAI: Kimi K2.5 | $0.0047 | 32.6s | 100% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% |
| 76 | Gemma 4 31B (Reasoning) | $0.0010 | 1.2m | 100% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% |
| 38 | o4 Mini | $0.0078 | 17.5s | 100% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% |
| 10 | Gemini 3 Flash (Preview) | $0.0021 | 3.9s | 100% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% |
| 39 | Z.AI GLM 4.7 Flash | $0.0010 | 37.9s | 100% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% |
| 36 | GPT-5 Nano | $0.0011 | 31.8s | 100% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% |
| 22 | DeepSeek V3 (2025-03-24) | $0.0007 | 17.4s | 100% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% |
| 78 | Claude Opus 4.8 (Reasoning) | $0.028 | 10.3s | 100% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% |
| 83 | Z.AI GLM 4.7 | $0.0042 | 1.3m | 100% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% |
| 90 | ByteDance Seed 2.0 Mini | $0.0017 | 1.6m | 100% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% |
| 41 | Gemma 4 31B | $0.0004 | 39.4s | 100% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% |
| 57 | Gemini 2.5 Pro | $0.018 | 14.3s | 100% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% |
| 71 | Claude Opus 4.7 (Reasoning) | $0.026 | 7.7s | 100% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% |
| 37 | Aion 2.0 | $0.0031 | 28.0s | 100% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% |
| 55 | Claude Opus 4.5 | $0.019 | 11.4s | 100% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% |
| 18 | Llama 3.1 Nemotron 70B | $0.0007 | 14.8s | 100% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% |
| 68 | Claude Opus 4.7 | $0.026 | 7.6s | 100% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% |
| 5 | Gemma 3 4B | $0.0001 | 6.6s | 100% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% |
| 86 | GPT-5.5 (Reasoning) | $0.030 | 13.6s | 99% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 98 | 100% |
| 16 | Grok 4.20 | $0.0027 | 5.4s | 99% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 98 | 100% |
| 21 | Nemotron 3 Super | $0.0000 | 17.3s | 99% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 98 | 100% |
| 14 | Grok 4.3 | $0.0027 | 4.7s | 99% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 98 | 100% |
| 42 | o4 Mini High | $0.0084 | 19.1s | 99% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 98 | 100% |
| 3 | Gemini 3.1 Flash Lite (Preview) | $0.0010 | 2.3s | 99% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 98 | 100% |
| 6 | Gemini 3.1 Flash Lite (Reasoning) | $0.0010 | 3.3s | 99% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 98 | 100% |
| 67 | Claude Opus 4.6 | $0.021 | 14.2s | 99% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 98 | 98 | 100% |
| 80 | Claude Opus 4.8 (Reasoning, Low) | $0.029 | 10.6s | 99% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 98 | 98 | 100% |
| 9 | Grok 4 Fast | $0.0005 | 5.3s | 99% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 98 | 98 | 100% |
| 8 | Gemini 3.1 Flash Lite | $0.0010 | 3.4s | 99% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 98 | 98 | 98 | 99% |
| 31 | GPT-5.2 | $0.0074 | 9.0s | 98% | 100 | 100 | 100 | 100 | 100 | 100 | 98 | 98 | 98 | 98 | 99% |
| 59 | GPT-5.1 | $0.014 | 18.4s | 95% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 92 | 99% |
| 17 | Gemma 4 26B | $0.0003 | 8.1s | 95% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 92 | 99% |
| 19 | GPT-5.4 Nano (Reasoning) | $0.0013 | 6.1s | 95% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 98 | 92 | 99% |
| 23 | Gemini 2.5 Flash Lite (Reasoning) | $0.0009 | 10.2s | 95% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 98 | 92 | 99% |
| 69 | Z.AI GLM 4.6 | $0.0031 | 54.3s | 95% | 100 | 100 | 100 | 100 | 100 | 100 | 98 | 98 | 98 | 92 | 99% |
| 15 | GPT-5.4 Nano | $0.0009 | 2.8s | 95% | 100 | 100 | 100 | 100 | 100 | 100 | 98 | 98 | 98 | 92 | 99% |
| 65 | GPT-OSS 120B | $0.0006 | 51.1s | 94% | 100 | 100 | 100 | 100 | 100 | 100 | 98 | 98 | 92 | 92 | 98% |
| 47 | GPT-4o Mini (temp=1) | $0.0005 | 34.2s | 94% | 100 | 100 | 100 | 100 | 100 | 100 | 98 | 98 | 92 | 92 | 98% |
| 66 | GPT-4o Mini (temp=0) | $0.0004 | 52.5s | 93% | 100 | 100 | 98 | 98 | 98 | 98 | 98 | 98 | 92 | 92 | 97% |
| 45 | Qwen 3 32B | $0.0005 | 21.0s | 87% | 100 | 100 | 100 | 100 | 100 | 100 | 98 | 98 | 98 | 77 | 97% |
| 53 | Claude Sonnet 4.5 | $0.011 | 9.0s | 92% | 100 | 100 | 98 | 98 | 98 | 98 | 98 | 92 | 92 | 92 | 97% |
| 30 | Inception Mercury | $0.0005 | 2.1s | 85% | 100 | 100 | 100 | 100 | 98 | 98 | 98 | 98 | 92 | 77 | 96% |
| 34 | Inception Mercury 2 | $0.0012 | 1.7s | 85% | 100 | 100 | 100 | 100 | 98 | 98 | 98 | 92 | 92 | 77 | 96% |
| 62 | Mistral Small 4 (Reasoning) | $0.0011 | 11.3s | 72% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 98 | 54 | 95% |
| 129 | Claude Opus 4 | $0.060 | 20.1s | 82% | 100 | 100 | 100 | 100 | 100 | 100 | 98 | 92 | 77 | 77 | 95% |
| 56 | Stealth: Healer Alpha | $0.0000 | 9.4s | 72% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 98 | 92 | 54 | 94% |
| 77 | Stealth: Aurora Alpha | — | 9.2s | 72% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 92 | 92 | 54 | 94% |
| 50 | GPT-5.4 Nano (Reasoning, Low) | $0.0009 | 3.2s | 77% | 100 | 100 | 100 | 98 | 92 | 92 | 92 | 92 | 77 | 77 | 92% |
| 91 | Xiaomi MIMO v2.5 | $0.0016 | 8.2s | 46% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 98 | 9 | 91% |
| 93 | GPT-4.1 | $0.0045 | 5.8s | 46% | 100 | 100 | 100 | 100 | 100 | 100 | 98 | 98 | 98 | 9 | 90% |
| 108 | Claude Sonnet 4 | $0.013 | 13.2s | 45% | 100 | 100 | 100 | 100 | 100 | 98 | 98 | 98 | 98 | 9 | 90% |
| 95 | Stealth: Hunter Alpha | $0.0000 | 10.4s | 41% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 2 | 90% |
| 79 | Llama 3.1 8B | $0.0004 | 2.3s | 56% | 100 | 100 | 100 | 100 | 100 | 98 | 98 | 98 | 77 | 27 | 90% |
| 96 | DeepSeek V3.1 | $0.0010 | 8.1s | 40% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 98 | 98 | 0 | 90% |
| 97 | ByteDance Seed 1.6 Flash | $0.0007 | 10.2s | 41% | 100 | 100 | 100 | 100 | 100 | 100 | 98 | 98 | 92 | 0 | 89% |
| 72 | Cydonia 24B V4.1 | $0.0006 | 9.7s | 69% | 100 | 100 | 100 | 100 | 100 | 100 | 77 | 77 | 77 | 54 | 89% |
| 89 | Grok 4.1 Fast | $0.0006 | 7.5s | 51% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 54 | 27 | 88% |
| 105 | DeepSeek V3.2 | $0.0007 | 26.4s | 41% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 98 | 77 | 2 | 88% |
| 106 | DeepSeek V4 Pro | $0.0020 | 40.4s | 51% | 100 | 100 | 100 | 100 | 98 | 98 | 98 | 92 | 54 | 27 | 87% |
| 99 | Mistral Medium 3.1 | $0.0017 | 10.2s | 40% | 100 | 100 | 100 | 100 | 100 | 98 | 98 | 92 | 77 | 0 | 87% |
| 92 | Gemini 3.5 Flash (Reasoning, Minimal) | $0.0060 | 3.0s | 52% | 98 | 98 | 98 | 98 | 98 | 98 | 98 | 92 | 54 | 27 | 86% |
| 115 | MiniMax M2.7 | $0.0038 | 49.3s | 45% | 100 | 100 | 100 | 98 | 98 | 92 | 92 | 92 | 77 | 9 | 86% |
| 101 | Z.AI GLM 4.5 Air | $0.0009 | 13.8s | 41% | 100 | 100 | 100 | 100 | 98 | 98 | 92 | 92 | 77 | 0 | 86% |
| 110 | MiniMax M3 | $0.0015 | 33.8s | 42% | 100 | 100 | 100 | 100 | 100 | 100 | 98 | 92 | 54 | 9 | 85% |
| 102 | Gemma 3 27B | $0.0003 | 16.4s | 42% | 100 | 100 | 100 | 100 | 98 | 98 | 98 | 92 | 54 | 9 | 85% |
| 94 | Mistral Small Creative | $0.0003 | 2.7s | 43% | 100 | 100 | 100 | 98 | 98 | 98 | 92 | 92 | 54 | 9 | 84% |
| 100 | DeepSeek V3 (2024-12-26) | $0.0009 | 12.7s | 43% | 100 | 100 | 100 | 100 | 98 | 98 | 92 | 92 | 27 | 27 | 84% |
| 107 | Nemotron 3 Nano | $0.0004 | 27.1s | 43% | 100 | 100 | 100 | 100 | 100 | 100 | 98 | 77 | 27 | 27 | 83% |
| 127 | Grok 4 | $0.012 | 18.0s | 20% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 0 | 0 | 80% |
| 117 | Writer: Palmyra X5 | $0.0034 | 7.7s | 20% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 0 | 0 | 80% |
| 109 | Xiaomi MIMO v2.5 Pro | $0.0020 | 11.0s | 36% | 100 | 100 | 100 | 100 | 100 | 98 | 77 | 54 | 54 | 0 | 78% |
| 137 | Claude 3.5 Sonnet | $0.011 | 53.6s | 27% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 27 | 27 | 9 | 76% |
| 122 | Gemma 3 12B | $0.0002 | 14.1s | 21% | 100 | 100 | 100 | 100 | 100 | 100 | 98 | 54 | 2 | 0 | 75% |
| 112 | Ministral 3 8B | $0.0003 | 3.1s | 27% | 100 | 100 | 100 | 100 | 92 | 77 | 77 | 77 | 9 | 9 | 74% |
| 111 | Llama 3.1 70B | $0.0018 | 3.9s | 32% | 100 | 100 | 98 | 92 | 92 | 92 | 77 | 54 | 27 | 2 | 73% |
| 123 | Gemini 2.5 Flash (Reasoning) | $0.0053 | 10.0s | 30% | 100 | 100 | 98 | 92 | 92 | 92 | 77 | 27 | 27 | 9 | 72% |
| 120 | GPT-4o, Aug. 6th (temp=1) | $0.0073 | 4.4s | 31% | 100 | 100 | 98 | 92 | 77 | 77 | 77 | 54 | 27 | 9 | 71% |
| 138 | GPT-4o, May 13th (temp=1) | $0.013 | 51.2s | 28% | 100 | 100 | 100 | 98 | 92 | 77 | 54 | 54 | 27 | 2 | 70% |
| 118 | GPT-4o, Aug. 6th (temp=0) | $0.0069 | 4.1s | 32% | 100 | 98 | 98 | 98 | 92 | 77 | 54 | 27 | 27 | 27 | 70% |
| 130 | Hermes 3 405B | $0.0000 | 24.7s | 8% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 0 | 0 | 0 | 70% |
| 128 | WizardLM 2 8x22b | $0.0019 | 30.9s | 22% | 100 | 100 | 98 | 98 | 92 | 92 | 77 | 27 | 9 | 2 | 70% |
| 121 | GPT-4.1 Mini | $0.0010 | 6.7s | 26% | 100 | 100 | 92 | 92 | 92 | 77 | 54 | 27 | 27 | 0 | 66% |
| 126 | Z.AI GLM 4.5 | $0.0012 | 9.2s | 14% | 100 | 100 | 100 | 100 | 98 | 77 | 77 | 9 | 0 | 0 | 66% |
| 125 | Ministral 3 3B | $0.0002 | 2.3s | 12% | 100 | 100 | 100 | 100 | 100 | 92 | 54 | 2 | 2 | 0 | 65% |
| 124 | Ministral 3 14B | $0.0004 | 4.2s | 23% | 100 | 92 | 92 | 77 | 77 | 54 | 54 | 54 | 9 | 0 | 61% |
| 135 | GPT-4o, May 13th (temp=0) | $0.012 | 15.2s | 22% | 98 | 92 | 92 | 92 | 54 | 54 | 27 | 27 | 27 | 27 | 59% |
| 139 | MiniMax M2.5 | $0.0018 | 28.7s | 3% | 100 | 100 | 100 | 100 | 98 | 92 | 0 | 0 | 0 | 0 | 59% |
| 136 | Qwen3 235B A22B Instruct 2507 | $0.0004 | 10.4s | 3% | 100 | 100 | 100 | 100 | 100 | 27 | 2 | 0 | 0 | 0 | 53% |
| 133 | Mistral Small 4 | $0.0006 | 5.3s | 9% | 100 | 100 | 98 | 92 | 54 | 54 | 27 | 0 | 0 | 0 | 52% |
| 132 | Claude Haiku 4.5 | $0.0036 | 5.5s | 16% | 98 | 92 | 77 | 77 | 77 | 27 | 27 | 27 | 9 | 0 | 51% |
| 134 | Gemini 2.5 Flash | $0.0016 | 3.2s | 15% | 92 | 92 | 54 | 54 | 54 | 27 | 27 | 9 | 9 | 0 | 42% |
| 145 | Rocinante 12B | $0.0007 | 32.3s | 4% | 100 | 100 | 92 | 54 | 54 | 0 | 0 | 0 | 0 | 0 | 40% |
| 141 | Qwen 2.5 72B | $0.0008 | 9.8s | 8% | 98 | 98 | 54 | 54 | 27 | 27 | 9 | 0 | 0 | 0 | 37% |
| 140 | Ministral 3B | $0.0001 | 1.9s | 4% | 100 | 98 | 77 | 27 | 27 | 9 | 0 | 0 | 0 | 0 | 34% |
| 142 | GPT-4.1 Nano | $0.0003 | 6.7s | 3% | 100 | 77 | 54 | 54 | 9 | 9 | 2 | 0 | 0 | 0 | 30% |
| 155 | Claude 3 Haiku | $0.0009 | 1.3m | 0% | 100 | 100 | 100 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 30% |
| 156 | Mistral Large | $0.023 | 49.1s | 12% | 92 | 54 | 54 | 27 | 27 | 27 | 9 | 2 | 0 | 0 | 29% |
| 143 | Ministral 8B | $0.0002 | 3.5s | 0% | 100 | 98 | 54 | 27 | 0 | 0 | 0 | 0 | 0 | 0 | 28% |
| 144 | Gemini 2.5 Flash Lite | $0.0004 | 2.6s | 0% | 100 | 100 | 54 | 2 | 0 | 0 | 0 | 0 | 0 | 0 | 26% |
| 146 | LFM2 24B | $0.0001 | 12.9s | 0% | 100 | 98 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 20% |
| 147 | Skyfall 36B V2 | $0.0009 | 5.9s | 0% | 100 | 9 | 2 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 11% |
| 148 | Hermes 3 70B | $0.0007 | 10.6s | 0% | 100 | 9 | 2 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 11% |
| 152 | Cohere Command R+ (Aug. 2024) | $0.0065 | 5.2s | 0% | 77 | 9 | 2 | 2 | 0 | 0 | 0 | 0 | 0 | 0 | 9% |
| 153 | Mistral Large 2 | $0.0050 | 6.6s | 0% | 9 | 2 | 2 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1% |
| 150 | Arcee AI: Trinity Large (Preview) | $0.0000 | 7.3s | 0% | 9 | 2 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1% |
| 154 | Claude 3.7 Sonnet | $0.0099 | 8.6s | 0% | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0% |
| 149 | Mistral NeMO | $0.0003 | 3.4s | 0% | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0% |
| 151 | Arcee AI: Trinity Mini | $0.0002 | 6.1s | 0% | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0% |