| 66 | Gemini 3.1 Pro (Preview) | $0.117 | 1.7m | 94% | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 89 | 99% |
| 1 | GPT-4o Mini (temp=0) | $0.0002 | 4.6s | 90% | 100 | 100 | 100 | 100 | 100 | 99 | 99 | 98 | 97 | 84 | 97% |
| 3 | Claude Opus 4.6 (Reasoning) | $0.011 | 11.8s | 83% | 100 | 100 | 100 | 100 | 98 | 98 | 95 | 88 | 81 | 80 | 94% |
| 2 | Claude Opus 4.6 | $0.0084 | 10.9s | 82% | 100 | 100 | 100 | 99 | 99 | 96 | 95 | 85 | 82 | 79 | 94% |
| 15 | Qwen 3.5 27B | $0.024 | 1.6m | 70% | 100 | 100 | 100 | 100 | 99 | 99 | 97 | 95 | 94 | 50 | 93% |
| 35 | MiniMax M2.7 | $0.015 | 2.5m | 60% | 100 | 100 | 100 | 100 | 99 | 99 | 98 | 96 | 50 | 50 | 89% |
| 13 | GPT-5.2 | $0.032 | 39.2s | 67% | 100 | 99 | 99 | 98 | 98 | 96 | 89 | 83 | 68 | 50 | 88% |
| 112 | Qwen 3.5 397B A17B | $0.043 | 5.2m | 57% | 100 | 100 | 100 | 98 | 91 | 87 | 83 | 83 | 50 | 50 | 84% |
| 4 | Inception Mercury 2 | $0.0027 | 4.1s | 56% | 99 | 99 | 99 | 98 | 94 | 92 | 88 | 62 | 50 | 50 | 83% |
| 19 | GPT-5.4 (Reasoning) | $0.024 | 30.0s | 57% | 100 | 100 | 99 | 99 | 93 | 89 | 71 | 68 | 68 | 40 | 83% |
| 17 | Nemotron 3 Super | $0.0000 | 1.2m | 54% | 100 | 100 | 100 | 99 | 95 | 84 | 79 | 71 | 50 | 46 | 82% |
| 22 | Qwen 3.5 Flash | $0.0057 | 1.4m | 52% | 100 | 100 | 100 | 99 | 99 | 95 | 87 | 50 | 50 | 41 | 82% |
| 47 | Qwen 3.5 122B | $0.034 | 1.4m | 52% | 100 | 100 | 100 | 94 | 93 | 92 | 76 | 50 | 50 | 45 | 80% |
| 37 | MoonshotAI: Kimi K2.5 | $0.013 | 1.8m | 54% | 100 | 98 | 97 | 92 | 91 | 84 | 68 | 55 | 52 | 50 | 79% |
| 11 | Grok 4 | $0.0083 | 19.1s | 52% | 100 | 99 | 94 | 90 | 84 | 76 | 74 | 63 | 55 | 48 | 78% |
| 7 | Claude Opus 4.5 | $0.0085 | 9.8s | 57% | 96 | 95 | 93 | 93 | 92 | 91 | 63 | 60 | 49 | 49 | 78% |
| 14 | GPT-5.4 (Reasoning, Low) | $0.013 | 16.2s | 53% | 100 | 100 | 88 | 83 | 83 | 83 | 76 | 76 | 51 | 40 | 78% |
| 33 | GPT-5.1 | $0.020 | 33.6s | 45% | 100 | 100 | 98 | 89 | 74 | 68 | 68 | 68 | 68 | 38 | 77% |
| 6 | Claude Sonnet 4.6 | $0.0050 | 8.7s | 60% | 99 | 84 | 84 | 83 | 75 | 73 | 73 | 67 | 67 | 67 | 77% |
| 18 | GPT-5.4 Nano (Reasoning) | $0.0038 | 20.7s | 46% | 100 | 100 | 97 | 86 | 80 | 70 | 68 | 50 | 50 | 50 | 75% |
| 55 | o4 Mini High | $0.033 | 1.3m | 49% | 99 | 98 | 89 | 82 | 77 | 76 | 68 | 53 | 50 | 50 | 74% |
| 24 | Gemini 3 Flash (Preview, Reasoning) | $0.014 | 23.7s | 46% | 100 | 98 | 96 | 89 | 86 | 79 | 50 | 49 | 49 | 43 | 74% |
| 25 | DeepSeek V3.2 | $0.0002 | 23.1s | 34% | 99 | 99 | 98 | 98 | 93 | 88 | 75 | 49 | 18 | 18 | 73% |
| 12 | GPT-5.4 Mini | $0.0015 | 2.3s | 46% | 100 | 93 | 92 | 84 | 83 | 64 | 59 | 58 | 50 | 46 | 73% |
| 16 | DeepSeek-V2 Chat | $0.0001 | 20.6s | 48% | 99 | 94 | 89 | 87 | 83 | 76 | 50 | 50 | 49 | 49 | 73% |
| 75 | Qwen 3.5 35B | $0.026 | 1.2m | 32% | 100 | 100 | 98 | 96 | 90 | 83 | 64 | 50 | 43 | 0 | 72% |
| 32 | Claude Sonnet 4.6 (Reasoning) | $0.018 | 17.0s | 44% | 100 | 97 | 90 | 75 | 72 | 63 | 60 | 56 | 53 | 50 | 72% |
| 9 | Gemini 2.5 Flash Lite | $0.0001 | 1.7s | 51% | 95 | 88 | 84 | 76 | 72 | 72 | 72 | 59 | 50 | 49 | 72% |
| 27 | DeepSeek V3.1 | $0.0003 | 13.8s | 32% | 100 | 99 | 98 | 97 | 67 | 65 | 62 | 59 | 50 | 18 | 71% |
| 39 | Claude Opus 4 | $0.027 | 19.9s | 45% | 94 | 93 | 86 | 85 | 80 | 80 | 65 | 52 | 51 | 21 | 71% |
| 20 | Grok 4.1 Fast | $0.0003 | 7.5s | 41% | 99 | 93 | 85 | 82 | 72 | 66 | 64 | 53 | 51 | 29 | 69% |
| 83 | Grok 4.20 (Beta, Reasoning) | $0.048 | 37.1s | 32% | 100 | 99 | 96 | 94 | 93 | 50 | 50 | 50 | 31 | 30 | 69% |
| 36 | Z.AI GLM 5 Turbo | $0.010 | 24.8s | 37% | 100 | 100 | 86 | 83 | 68 | 66 | 59 | 50 | 49 | 28 | 69% |
| 10 | GPT-4o Mini (temp=1) | $0.0002 | 4.4s | 53% | 95 | 68 | 68 | 68 | 68 | 68 | 68 | 67 | 66 | 44 | 68% |
| 46 | Z.AI GLM 5 | $0.0055 | 55.8s | 35% | 100 | 97 | 93 | 83 | 80 | 52 | 48 | 46 | 42 | 42 | 68% |
| 26 | Claude Haiku 4.5 | $0.0016 | 4.6s | 35% | 99 | 97 | 88 | 87 | 71 | 53 | 52 | 50 | 44 | 39 | 68% |
| 5 | GPT-4o, Aug. 6th (temp=0) | $0.0032 | 4.0s | 67% | 68 | 68 | 68 | 68 | 68 | 68 | 68 | 68 | 68 | 66 | 68% |
| 8 | GPT-4o, Aug. 6th (temp=1) | $0.0032 | 4.1s | 61% | 68 | 68 | 68 | 68 | 67 | 65 | 64 | 62 | 59 | 59 | 65% |
| 42 | Inception Mercury | $0.0002 | 4.7s | 24% | 98 | 93 | 91 | 91 | 63 | 50 | 50 | 50 | 45 | 2 | 63% |
| 28 | Claude 3.7 Sonnet | $0.0049 | 7.2s | 42% | 95 | 84 | 64 | 60 | 60 | 59 | 52 | 52 | 50 | 50 | 63% |
| 97 | GPT-5 | $0.041 | 1.2m | 27% | 100 | 97 | 89 | 68 | 68 | 51 | 50 | 50 | 50 | 2 | 63% |
| 59 | GPT-5 Mini | $0.0082 | 43.0s | 30% | 100 | 100 | 72 | 50 | 50 | 50 | 50 | 50 | 50 | 50 | 62% |
| 81 | MiniMax M2.5 | $0.0088 | 1.8m | 31% | 100 | 100 | 64 | 59 | 50 | 50 | 50 | 50 | 50 | 50 | 62% |
| 23 | GPT-4o, May 13th (temp=0) | $0.0049 | 7.3s | 48% | 68 | 68 | 68 | 68 | 68 | 68 | 68 | 68 | 52 | 18 | 62% |
| 29 | Llama 3.1 70B | $0.0003 | 3.6s | 37% | 87 | 83 | 68 | 68 | 68 | 67 | 65 | 57 | 44 | 2 | 61% |
| 34 | GPT-5.4 Mini (Reasoning) | $0.0042 | 5.3s | 39% | 97 | 77 | 73 | 73 | 68 | 62 | 50 | 40 | 35 | 33 | 61% |
| 86 | GPT-5 Nano | $0.0043 | 1.8m | 23% | 98 | 98 | 98 | 50 | 50 | 50 | 50 | 50 | 50 | 13 | 61% |
| 52 | GPT-4.1 Nano | $0.0001 | 3.8s | 18% | 100 | 99 | 96 | 92 | 63 | 58 | 41 | 22 | 18 | 2 | 59% |
| 21 | GPT-4.1 | $0.0026 | 4.9s | 50% | 68 | 68 | 68 | 68 | 68 | 59 | 50 | 49 | 44 | 43 | 59% |
| 69 | Z.AI GLM 4.7 | $0.0033 | 1.0m | 31% | 96 | 84 | 78 | 68 | 66 | 59 | 50 | 40 | 18 | 18 | 58% |
| 56 | Qwen 2.5 72B | $0.0001 | 8.7s | 20% | 100 | 100 | 79 | 72 | 50 | 50 | 50 | 50 | 20 | 0 | 57% |
| 87 | ByteDance Seed 1.6 | $0.0056 | 1.1m | 15% | 100 | 99 | 96 | 84 | 56 | 50 | 43 | 40 | 0 | 0 | 57% |
| 40 | Arcee AI: Trinity Large (Preview) | $0.0000 | 8.4s | 34% | 97 | 75 | 67 | 60 | 60 | 50 | 50 | 45 | 38 | 26 | 57% |
| 96 | Stealth: Aurora Alpha | — | 4.8s | 22% | 95 | 94 | 77 | 72 | 62 | 59 | 56 | 50 | 0 | 0 | 56% |
| 80 | o4 Mini | $0.015 | 32.9s | 23% | 100 | 96 | 82 | 60 | 55 | 50 | 40 | 34 | 24 | 14 | 55% |
| 54 | Ministral 8B | $0.0000 | 2.5s | 21% | 95 | 95 | 78 | 68 | 51 | 50 | 49 | 44 | 18 | 0 | 55% |
| 53 | Qwen 3.5 Plus (2026-02-15) | $0.0008 | 12.7s | 26% | 89 | 87 | 80 | 75 | 64 | 49 | 44 | 19 | 18 | 18 | 54% |
| 51 | Writer: Palmyra X5 | $0.0023 | 6.5s | 26% | 100 | 84 | 55 | 52 | 51 | 50 | 50 | 50 | 49 | 0 | 54% |
| 61 | Stealth: Hunter Alpha | $0.0000 | 11.4s | 22% | 98 | 92 | 80 | 50 | 50 | 49 | 48 | 38 | 20 | 7 | 53% |
| 43 | Gemini 3 Flash (Preview) | $0.0010 | 3.4s | 34% | 92 | 68 | 62 | 59 | 56 | 56 | 56 | 36 | 26 | 23 | 53% |
| 38 | GPT-5.4 Mini (Reasoning, Low) | $0.0017 | 3.0s | 38% | 70 | 68 | 68 | 66 | 63 | 57 | 53 | 39 | 35 | 10 | 53% |
| 67 | Grok 4.20 (Beta) | $0.0017 | 1.9s | 18% | 100 | 99 | 68 | 67 | 50 | 50 | 48 | 43 | 0 | 0 | 53% |
| 110 | Nemotron 3 Nano | $0.0024 | 3.5m | 27% | 87 | 86 | 50 | 50 | 50 | 50 | 50 | 50 | 50 | 0 | 52% |
| 41 | Claude Sonnet 4.5 | $0.0049 | 7.7s | 41% | 75 | 57 | 53 | 50 | 50 | 50 | 49 | 49 | 47 | 36 | 52% |
| 76 | DeepSeek V3 (2024-12-26) | $0.0004 | 12.3s | 15% | 100 | 100 | 88 | 70 | 50 | 48 | 26 | 25 | 6 | 0 | 51% |
| 71 | Claude 3.5 Sonnet | $0.0051 | 18.3s | 25% | 92 | 91 | 65 | 56 | 56 | 44 | 32 | 32 | 19 | 18 | 51% |
| 49 | GPT-4o, May 13th (temp=1) | $0.0051 | 8.8s | 34% | 68 | 68 | 68 | 66 | 56 | 52 | 52 | 26 | 23 | 18 | 50% |
| 31 | Mistral NeMO | $0.0000 | 3.5s | 49% | 50 | 50 | 50 | 50 | 50 | 50 | 50 | 49 | 47 | 46 | 49% |
| 30 | Gemini 3.1 Flash Lite (Preview) | $0.0004 | 2.0s | 49% | 50 | 50 | 50 | 50 | 50 | 50 | 50 | 48 | 47 | 47 | 49% |
| 58 | Qwen3 235B A22B Instruct 2507 | $0.0001 | 8.8s | 27% | 80 | 67 | 67 | 62 | 50 | 50 | 48 | 44 | 19 | 0 | 49% |
| 48 | Gemini 2.5 Flash | $0.0009 | 2.7s | 31% | 68 | 68 | 67 | 65 | 50 | 50 | 49 | 29 | 21 | 18 | 49% |
| 45 | Gemma 3 12B | $0.0001 | 7.2s | 38% | 67 | 57 | 51 | 50 | 50 | 50 | 50 | 50 | 44 | 16 | 49% |
| 68 | Gemini 2.5 Flash Lite (Reasoning) | $0.0024 | 21.8s | 28% | 99 | 58 | 50 | 50 | 49 | 46 | 42 | 40 | 32 | 18 | 48% |
| 57 | GPT-5.4 Nano (Reasoning, Low) | $0.0017 | 8.9s | 29% | 100 | 52 | 50 | 50 | 50 | 50 | 49 | 36 | 27 | 18 | 48% |
| 72 | Mistral Medium 3.1 | $0.0006 | 5.2s | 20% | 91 | 80 | 79 | 50 | 48 | 42 | 33 | 30 | 17 | 2 | 47% |
| 62 | Mistral Small 3.2 24B | $0.0001 | 5.6s | 26% | 95 | 55 | 54 | 48 | 48 | 48 | 47 | 41 | 26 | 1 | 46% |
| 64 | DeepSeek V3 (2025-03-24) | $0.0004 | 11.6s | 27% | 86 | 71 | 53 | 50 | 50 | 50 | 47 | 32 | 22 | 0 | 46% |
| 44 | Gemma 3 4B | $0.0000 | 3.1s | 40% | 50 | 50 | 50 | 50 | 50 | 50 | 50 | 48 | 43 | 18 | 46% |
| 70 | GPT-5.4 | $0.0049 | 10.3s | 29% | 68 | 65 | 62 | 56 | 44 | 44 | 44 | 28 | 18 | 18 | 45% |
| 79 | Z.AI GLM 4.6 | $0.0035 | 1.1m | 35% | 68 | 51 | 50 | 50 | 50 | 48 | 48 | 43 | 18 | 18 | 45% |
| 65 | GPT-4.1 Mini | $0.0005 | 4.6s | 26% | 68 | 68 | 67 | 67 | 59 | 36 | 23 | 19 | 18 | 18 | 45% |
| 63 | Gemini 2.5 Flash (Reasoning) | $0.010 | 18.3s | 39% | 53 | 50 | 50 | 50 | 49 | 49 | 49 | 38 | 37 | 18 | 44% |
| 60 | Aion 2.0 | $0.0010 | 15.2s | 34% | 59 | 55 | 51 | 50 | 47 | 43 | 42 | 39 | 32 | 15 | 43% |
| 74 | Llama 3.1 Nemotron 70B | $0.0001 | 9.3s | 25% | 96 | 50 | 50 | 50 | 50 | 49 | 44 | 23 | 18 | 0 | 43% |
| 84 | Z.AI GLM 4.7 Flash | $0.0010 | 58.4s | 26% | 95 | 56 | 52 | 50 | 50 | 47 | 18 | 18 | 18 | 18 | 42% |
| 73 | Z.AI GLM 4.5 | $0.0005 | 5.8s | 25% | 94 | 64 | 50 | 50 | 50 | 50 | 20 | 18 | 18 | 10 | 42% |
| 92 | Gemini 2.5 Pro | $0.026 | 21.5s | 28% | 80 | 57 | 55 | 53 | 49 | 45 | 28 | 18 | 18 | 18 | 42% |
| 50 | Gemma 3 27B | $0.0001 | 9.2s | 37% | 50 | 50 | 50 | 49 | 49 | 49 | 45 | 39 | 18 | 18 | 42% |
| 78 | Hermes 3 70B | $0.0001 | 13.4s | 24% | 78 | 67 | 64 | 50 | 50 | 48 | 28 | 27 | 2 | 0 | 41% |
| 85 | Stealth: Healer Alpha | $0.0000 | 27.3s | 19% | 93 | 64 | 62 | 48 | 43 | 43 | 18 | 16 | 3 | 0 | 39% |
| 77 | Hermes 3 405B | $0.0000 | 19.1s | 29% | 60 | 55 | 51 | 51 | 45 | 41 | 34 | 26 | 14 | 10 | 39% |
| 91 | Mistral Small 4 (Reasoning) | $0.0024 | 24.5s | 17% | 98 | 60 | 50 | 50 | 49 | 48 | 0 | 0 | 0 | 0 | 36% |
| 88 | Grok 4 Fast | $0.0003 | 4.9s | 16% | 77 | 56 | 51 | 43 | 31 | 25 | 18 | 11 | 11 | 2 | 33% |
| 93 | GPT-5.4 Nano | $0.0005 | 4.9s | 13% | 68 | 59 | 50 | 47 | 25 | 23 | 18 | 18 | 4 | 0 | 31% |
| 82 | Llama 3.1 8B | $0.0001 | 1.4s | 21% | 62 | 50 | 50 | 50 | 38 | 38 | 18 | 7 | 0 | 0 | 31% |
| 94 | Ministral 3B | $0.0000 | 1.5s | 13% | 84 | 50 | 46 | 30 | 30 | 21 | 18 | 15 | 0 | 0 | 29% |
| 89 | LFM2 24B | $0.0000 | 8.2s | 19% | 62 | 50 | 40 | 38 | 31 | 30 | 27 | 14 | 0 | 0 | 29% |
| 118 | ByteDance Seed 2.0 Mini | $0.0032 | 3.7m | 8% | 87 | 63 | 50 | 49 | 38 | 2 | 0 | 0 | 0 | 0 | 29% |
| 103 | Gemini 3 Pro (Preview) | $0.022 | 18.6s | 19% | 50 | 50 | 50 | 49 | 48 | 18 | 14 | 5 | 2 | 2 | 29% |
| 101 | ByteDance Seed 2.0 Lite | $0.0028 | 33.5s | 13% | 64 | 59 | 50 | 50 | 45 | 9 | 3 | 2 | 0 | 0 | 28% |
| 90 | Claude 3 Haiku | $0.0004 | 2.9s | 18% | 50 | 50 | 48 | 47 | 38 | 22 | 18 | 7 | 1 | 0 | 28% |
| 117 | Qwen 3.5 9B | $0.0022 | 3.3m | 13% | 80 | 52 | 50 | 40 | 33 | 23 | 1 | 0 | 0 | 0 | 28% |
| 95 | Mistral Large | $0.0088 | 7.5s | 23% | 50 | 50 | 47 | 41 | 41 | 38 | 12 | 0 | 0 | 0 | 28% |
| 99 | Mistral Small 4 | $0.0002 | 3.4s | 10% | 51 | 50 | 47 | 41 | 19 | 14 | 10 | 3 | 3 | 2 | 24% |
| 98 | Arcee AI: Trinity Mini | $0.0001 | 4.5s | 13% | 50 | 49 | 39 | 33 | 27 | 12 | 11 | 7 | 5 | 0 | 23% |
| 100 | Claude Sonnet 4 | $0.0047 | 7.2s | 15% | 49 | 28 | 21 | 19 | 19 | 19 | 19 | 18 | 18 | 18 | 23% |
| 102 | Mistral Large 2 | $0.0018 | 8.2s | 9% | 50 | 49 | 49 | 39 | 24 | 7 | 2 | 1 | 1 | 0 | 22% |
| 104 | Ministral 3 14B | $0.0001 | 6.9s | 6% | 50 | 47 | 43 | 28 | 10 | 10 | 7 | 3 | 1 | 1 | 20% |
| 107 | Qwen 3 32B | $0.0004 | 16.9s | 3% | 57 | 47 | 45 | 37 | 7 | 4 | 0 | 0 | 0 | 0 | 20% |
| 108 | Rocinante 12B | $0.0001 | 13.3s | 3% | 49 | 49 | 46 | 18 | 7 | 5 | 0 | 0 | 0 | 0 | 18% |
| 111 | ByteDance Seed 1.6 Flash | $0.0003 | 7.7s | 0% | 63 | 56 | 28 | 14 | 0 | 0 | 0 | 0 | 0 | 0 | 16% |
| 106 | Claude 3.5 Haiku | $0.0013 | 4.6s | 5% | 50 | 41 | 27 | 19 | 7 | 7 | 5 | 2 | 1 | 0 | 16% |
| 109 | Ministral 3 3B | $0.0000 | 1.3s | 0% | 68 | 48 | 22 | 14 | 1 | 0 | 0 | 0 | 0 | 0 | 15% |
| 105 | Mistral Large 3 | $0.0006 | 7.8s | 8% | 49 | 26 | 26 | 26 | 22 | 1 | 0 | 0 | 0 | 0 | 15% |
| 114 | WizardLM 2 8x22b | $0.0004 | 16.4s | 0% | 50 | 44 | 6 | 4 | 1 | 0 | 0 | 0 | 0 | 0 | 11% |
| 113 | Mistral Small Creative | $0.0001 | 2.2s | 1% | 47 | 23 | 18 | 5 | 4 | 0 | 0 | 0 | 0 | 0 | 10% |
| 116 | Cohere Command R+ (Aug. 2024) | $0.0037 | 8.3s | 0% | 31 | 14 | 10 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 6% |
| 115 | Ministral 3 8B | $0.0001 | 2.5s | 0% | 54 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 6% |