Language Comprehension
Does the model understand more than just English?
Performance Score Distribution (Top 20)
Click a model name to view its detail page.
Price-Performance Score Distribution (Top 20)
Click a model name to view its detail page.
| Score | Cost | Time | ||
|---|---|---|---|---|
| Mistral NeMO | 95% | $0.0000 | 625ms | |
| Ministral 3 3B | 100% | $0.0000 | 833ms | |
| Ministral 8B | 55% | $0.0000 | 540ms | |
| Gemini 2.5 Flash Lite | 80% | $0.0001 | 648ms | |
| GPT-4o Mini (temp=1) | 55% | $0.0000 | 942ms | |
| GPT-6 Luna | 90% | $0.0000 | 1.6s | |
| GPT-5.4 Nano | 70% | $0.0001 | 990ms | |
| Gemini 3.1 Flash Lite (Preview) | 95% | $0.0001 | 975ms | |
| Gemini 3.1 Flash Lite (Reasoning) | 95% | $0.0002 | 1.6s | |
| Gemma 3 4B | 70% | $0.0000 | 1.7s | |
| Gemini 3.1 Flash Lite | 85% | $0.0001 | 905ms | |
| GPT-5.4 Mini | 80% | $0.0002 | 747ms | |
| Mistral Small 3.2 24B | 75% | $0.0000 | 2.4s | |
| Cydonia 24B V4.1 | 95% | $0.0001 | 2.2s | |
| GPT-4.1 Nano | 65% | $0.0000 | 1.7s | |
| Mistral Small 4 | 55% | $0.0001 | 1.1s | |
| DeepSeek V4 Flash | 90% | $0.0000 | 21.6s | |
| GPT-5.6 Luna | 100% | $0.0003 | 911ms | |
| Inception Mercury 2 | 75% | $0.0003 | 771ms | |
| Gemini 2.5 Flash | 75% | $0.0002 | 817ms | |
Cost vs Performance
Compares total cost for this test against the test score. Quadrant lines are drawn at the median values. Only models with available cost data are shown.
10 low-scoring outliers hidden: Gemma 4 31B (50.0%), GPT-4o, Aug. 6th (temp=0) (50.0%), Mistral Small 4 (Reasoning) (50.0%), GPT-4o Mini (temp=0) (50.0%), Mistral Medium 3.1 (50.0%), Ministral 3 14B (50.0%), Ministral 3 8B (50.0%), ByteDance Seed 1.6 Flash (40.0%), Laguna XS 2.1 (35.0%), Ministral 3B (25.0%).
Most Stable Models (Top 20)
Ranked by stability (median × consistency). Click a model name to view its detail page.
| Score | Consistency | Stability | ||
|---|---|---|---|---|
| Claude Opus 5.5 (Reasoning) | 100% | 100% | 100% | |
| Kimi K3.1 Pro (Reasoning, Max) | 100% | 100% | 100% | |
| Qwen 3.8 Max (Reasoning, XHigh) | 100% | 100% | 100% | |
| GPT-6.1 Sol (Reasoning, Medium) | 100% | 100% | 100% | |
| Gemini 3.8 Flash (Reasoning, Medium) | 100% | 100% | 100% | |
| Ember-1 (Reasoning, Max) | 100% | 100% | 100% | |
| Muse Wonder (Reasoning, Medium) | 100% | 100% | 100% | |
| Z.AI GLM 5.3 (Reasoning, Max) | 100% | 100% | 100% | |
| GPT-5.6 Sol (Reasoning, Medium) | 100% | 100% | 100% | |
| Claude Opus 4.6 (Reasoning) | 100% | 100% | 100% | |
| GPT-6.1 Terra (Reasoning, Medium) | 100% | 100% | 100% | |
| Gemini 3.6 Flash (Reasoning) | 100% | 100% | 100% | |
| Gemini 3.7 Flash (Reasoning, Medium) | 100% | 100% | 100% | |
| Hy4 Preview (Reasoning, High) | 100% | 100% | 100% | |
| Muse Spark 1.2 (Reasoning, Medium) | 100% | 100% | 100% | |
| Qwen 3.7 Max | 100% | 100% | 100% | |
| Z.AI GLM 5.3 Flash (Reasoning, Max) | 100% | 100% | 100% | |
| Qwen 3.8 Flash (Reasoning) | 100% | 100% | 100% | |
| Grok 4.5 (Reasoning, High) | 100% | 100% | 100% | |
| DeepSeek V4.1 Flash 1017 (Reasoning, High) | 100% | 100% | 100% | |
Top Overall Models (Top 20)
Ranked by composite score (performance, cost, speed & stability). Click a model name to view its detail page.
| Score | Cost | Speed | Stability | ||
|---|---|---|---|---|---|
| Ministral 3 3B | 100% | $0.0000 | 833ms | 100% | |
| GPT-5.6 Luna | 100% | $0.0003 | 911ms | 100% | |
| Claude Haiku 5.5 (Adaptive) | 100% | $0.0002 | 2.7s | 100% | |
| GPT-6 Sol | 100% | $0.0004 | 2.1s | 100% | |
| Mistral Large 3 | 100% | $0.0002 | 3.7s | 100% | |
| GPT-6 Luna (Reasoning, Medium) | 100% | $0.0001 | 4.3s | 100% | |
| Claude Haiku 5.5 (Reasoning, Low) | 100% | $0.0002 | 4.0s | 100% | |
| Claude Haiku 5.5 (Reasoning, Medium) | 100% | $0.0002 | 4.2s | 100% | |
| Mistral Large 4.0 | 100% | $0.0003 | 3.4s | 100% | |
| Mistral Medium 3.5 | 100% | $0.0007 | 912ms | 100% | |
| Mistral Medium 3.5 (Reasoning) | 100% | $0.0007 | 1.0s | 100% | |
| GPT-6.1 Terra (Reasoning, Medium) | 100% | $0.0005 | 2.8s | 100% | |
| DeepSeek V3 (2024-12-26) | 100% | $0.0002 | 4.8s | 100% | |
| GPT-6 Luna (Reasoning, High) | 100% | $0.0001 | 5.0s | 100% | |
| Qwen 3.5 Plus (2026-02-15) | 100% | $0.0003 | 4.8s | 100% | |
| DeepSeek-V2 Chat | 100% | $0.0000 | 6.6s | 100% | |
| DeepSeek V3 (2025-03-24) | 100% | $0.0001 | 7.5s | 100% | |
| GPT-6.1 Sol (Reasoning, Medium) | 100% | $0.0008 | 4.0s | 100% | |
| DeepSeek V4.1 Flash 1017 (Reasoning, High) | 100% | $0.0004 | 6.7s | 100% | |
| Mistral Large 2 | 100% | $0.0009 | 3.8s | 100% | |
| Model | Total â–¼ | Friend got new kittens (Tagalog) | Friend got new kittens (German) | Asking for directions (German) | Asking for directions (Dutch) |
|---|---|---|---|---|---|
| Claude Opus 5.5 (Reasoning) | 100% | 100% | 100% | 100% | 100% |
| Kimi K3.1 Pro (Reasoning, Max) | 100% | 100% | 100% | 100% | 100% |
| Qwen 3.8 Max (Reasoning, XHigh) | 100% | 100% | 100% | 100% | 100% |
| GPT-6.1 Sol (Reasoning, Medium) | 100% | 100% | 100% | 100% | 100% |
| Gemini 3.8 Flash (Reasoning, Medium) | 100% | 100% | 100% | 100% | 100% |
| Ember-1 (Reasoning, Max) | 100% | 100% | 100% | 100% | 100% |
| Muse Wonder (Reasoning, Medium) | 100% | 100% | 100% | 100% | 100% |
| Z.AI GLM 5.3 (Reasoning, Max) | 100% | 100% | 100% | 100% | 100% |
| GPT-5.6 Sol (Reasoning, Medium) | 100% | 100% | 100% | 100% | 100% |
| Claude Opus 4.6 (Reasoning) | 100% | 100% | 100% | 100% | 100% |
| GPT-6.1 Terra (Reasoning, Medium) | 100% | 100% | 100% | 100% | 100% |
| Gemini 3.6 Flash (Reasoning) | 100% | 100% | 100% | 100% | 100% |
| Gemini 3.7 Flash (Reasoning, Medium) | 100% | 100% | 100% | 100% | 100% |
| Hy4 Preview (Reasoning, High) | 100% | 100% | 100% | 100% | 100% |
| Muse Spark 1.2 (Reasoning, Medium) | 100% | 100% | 100% | 100% | 100% |
1–15 of 205
Page 1 / 14
Friend got new kittens (Tagalog)
Performance Score Distribution (Top 20)
Click a model name to view its detail page.
Price-Performance Score Distribution (Top 20)
Click a model name to view its detail page.
| Score | Cost | Time | ||
|---|---|---|---|---|
| Mistral NeMO | 100% | $0.0000 | 515ms | |
| Gemini 2.5 Flash Lite | 100% | $0.0000 | 505ms | |
| Gemini 2.5 Flash | 100% | $0.0001 | 518ms | |
| Ministral 3 3B | 100% | $0.0000 | 715ms | |
| Gemma 3 4B | 100% | $0.0000 | 903ms | |
| GPT-4o Mini (temp=1) | 100% | $0.0000 | 883ms | |
| GPT-5.4 Nano | 100% | $0.0001 | 759ms | |
| GPT-5.4 Nano (Reasoning, Low) | 100% | $0.0001 | 955ms | |
| Ministral 3 8B | 100% | $0.0000 | 1.2s | |
| Gemma 4 26B | 100% | $0.0000 | 4.0s | |
| Mistral Small 4 | 100% | $0.0001 | 997ms | |
| GPT-4.1 Nano | 100% | $0.0000 | 1.4s | |
| GPT-4o Mini (temp=0) | 100% | $0.0000 | 1.2s | |
| Gemini 3.5 Flash Lite (Reasoning, Minimal) | 100% | $0.0002 | 560ms | |
| GPT-6 Luna | 100% | $0.0000 | 1.2s | |
| Gemini 3.5 Flash Lite (Reasoning) | 100% | $0.0001 | 642ms | |
| Ministral 3 14B | 100% | $0.0000 | 1.3s | |
| Gemini 3.1 Flash Lite | 100% | $0.0001 | 940ms | |
| GPT-5.4 Mini | 100% | $0.0002 | 597ms | |
| Inception Mercury 2 | 100% | $0.0002 | 614ms | |
Most Stable Models (Top 20)
Ranked by stability (median × consistency). Click a model name to view its detail page.
| Score | Consistency | Stability | ||
|---|---|---|---|---|
| Claude Opus 5.5 (Reasoning) | 100% | 100% | 100% | |
| Kimi K3.1 Pro (Reasoning, Max) | 100% | 100% | 100% | |
| Qwen 3.8 Max (Reasoning, XHigh) | 100% | 100% | 100% | |
| GPT-6.1 Sol (Reasoning, Medium) | 100% | 100% | 100% | |
| Gemini 3.8 Flash (Reasoning, Medium) | 100% | 100% | 100% | |
| Ember-1 (Reasoning, Max) | 100% | 100% | 100% | |
| Muse Wonder (Reasoning, Medium) | 100% | 100% | 100% | |
| Z.AI GLM 5.3 (Reasoning, Max) | 100% | 100% | 100% | |
| GPT-5.6 Sol (Reasoning, Medium) | 100% | 100% | 100% | |
| Claude Opus 4.6 (Reasoning) | 100% | 100% | 100% | |
| GPT-6.1 Terra (Reasoning, Medium) | 100% | 100% | 100% | |
| Gemini 3.6 Flash (Reasoning) | 100% | 100% | 100% | |
| Gemini 3.7 Flash (Reasoning, Medium) | 100% | 100% | 100% | |
| Hy4 Preview (Reasoning, High) | 100% | 100% | 100% | |
| Muse Spark 1.2 (Reasoning, Medium) | 100% | 100% | 100% | |
| Qwen 3.7 Max | 100% | 100% | 100% | |
| DeepSeek V4.1 Flash (Reasoning, High) | 100% | 100% | 100% | |
| Z.AI GLM 5.3 Flash (Reasoning, Max) | 100% | 100% | 100% | |
| Qwen 3.8 Flash (Reasoning) | 100% | 100% | 100% | |
| Grok 4.5 (Reasoning, High) | 100% | 100% | 100% | |
Top Overall Models (Top 20)
Ranked by composite score (performance, cost, speed & stability). Click a model name to view its detail page.
| Score | Cost | Speed | Stability | ||
|---|---|---|---|---|---|
| Mistral NeMO | 100% | $0.0000 | 515ms | 100% | |
| Gemini 2.5 Flash Lite | 100% | $0.0000 | 505ms | 100% | |
| Ministral 3 3B | 100% | $0.0000 | 715ms | 100% | |
| Gemini 2.5 Flash | 100% | $0.0001 | 518ms | 100% | |
| Gemma 3 4B | 100% | $0.0000 | 903ms | 100% | |
| GPT-5.4 Nano | 100% | $0.0001 | 759ms | 100% | |
| GPT-4o Mini (temp=1) | 100% | $0.0000 | 883ms | 100% | |
| GPT-5.4 Nano (Reasoning, Low) | 100% | $0.0001 | 955ms | 100% | |
| Gemini 3.5 Flash Lite (Reasoning) | 100% | $0.0001 | 642ms | 100% | |
| GPT-6 Luna | 100% | $0.0000 | 1.2s | 100% | |
| Mistral Small 4 | 100% | $0.0001 | 997ms | 100% | |
| Ministral 3 8B | 100% | $0.0000 | 1.2s | 100% | |
| Gemini 3.5 Flash Lite (Reasoning, Minimal) | 100% | $0.0002 | 560ms | 100% | |
| GPT-4o Mini (temp=0) | 100% | $0.0000 | 1.2s | 100% | |
| Ministral 3 14B | 100% | $0.0000 | 1.3s | 100% | |
| GPT-4.1 Nano | 100% | $0.0000 | 1.4s | 100% | |
| Inception Mercury 2 | 100% | $0.0002 | 614ms | 100% | |
| Gemini 3.1 Flash Lite | 100% | $0.0001 | 940ms | 100% | |
| GPT-5.4 Mini | 100% | $0.0002 | 597ms | 100% | |
| Gemini 3.1 Flash Lite (Reasoning) | 100% | $0.0002 | 981ms | 100% | |
| Median | Evaluator | Top 3 | Flop 3 |
|---|---|---|---|
| 100.0% | Contains a count of nouns |
Friend got new kittens (German)
Performance Score Distribution (Top 20)
Click a model name to view its detail page.
Price-Performance Score Distribution (Top 20)
Click a model name to view its detail page.
| Score | Cost | Time | ||
|---|---|---|---|---|
| Ministral 8B | 80% | $0.0000 | 733ms | |
| Ministral 3 3B | 100% | $0.0000 | 995ms | |
| Ministral 3 8B | 100% | $0.0000 | 1.0s | |
| GPT-6 Luna | 100% | $0.0000 | 1.6s | |
| Mistral NeMO | 100% | $0.0000 | 1.2s | |
| Ministral 3 14B | 100% | $0.0000 | 1.6s | |
| Mistral Small 4 | 100% | $0.0001 | 1.2s | |
| Gemini 3.1 Flash Lite (Reasoning) | 80% | $0.0001 | 827ms | |
| Gemini 3.1 Flash Lite | 60% | $0.0001 | 725ms | |
| Gemini 3.1 Flash Lite (Preview) | 80% | $0.0001 | 841ms | |
| GPT-5.4 Nano | 100% | $0.0001 | 989ms | |
| Mistral Small 3.2 24B | 100% | $0.0001 | 2.3s | |
| GPT-4.1 Nano | 100% | $0.0000 | 2.4s | |
| Cydonia 24B V4.1 | 100% | $0.0001 | 2.0s | |
| Gemma 3 12B | 80% | $0.0000 | 3.6s | |
| Hermes 3 70B | 100% | $0.0001 | 3.1s | |
| GPT-4.1 Mini | 100% | $0.0001 | 2.0s | |
| GPT-6 Luna (Reasoning, Medium) | 100% | $0.0001 | 3.3s | |
| GPT-5.4 Mini | 80% | $0.0002 | 896ms | |
| GPT-6 Luna (Reasoning, High) | 100% | $0.0001 | 3.8s | |
Most Stable Models (Top 20)
Ranked by stability (median × consistency). Click a model name to view its detail page.
| Score | Consistency | Stability | ||
|---|---|---|---|---|
| Claude Opus 5.5 (Reasoning) | 100% | 100% | 100% | |
| Kimi K3.1 Pro (Reasoning, Max) | 100% | 100% | 100% | |
| Qwen 3.8 Max (Reasoning, XHigh) | 100% | 100% | 100% | |
| GPT-6.1 Sol (Reasoning, Medium) | 100% | 100% | 100% | |
| Gemini 3.8 Flash (Reasoning, Medium) | 100% | 100% | 100% | |
| Ember-1 (Reasoning, Max) | 100% | 100% | 100% | |
| Muse Wonder (Reasoning, Medium) | 100% | 100% | 100% | |
| Z.AI GLM 5.3 (Reasoning, Max) | 100% | 100% | 100% | |
| GPT-5.6 Sol (Reasoning, Medium) | 100% | 100% | 100% | |
| Claude Opus 4.6 (Reasoning) | 100% | 100% | 100% | |
| GPT-6.1 Terra (Reasoning, Medium) | 100% | 100% | 100% | |
| Gemini 3.6 Flash (Reasoning) | 100% | 100% | 100% | |
| Gemini 3.7 Flash (Reasoning, Medium) | 100% | 100% | 100% | |
| Hy4 Preview (Reasoning, High) | 100% | 100% | 100% | |
| Muse Spark 1.2 (Reasoning, Medium) | 100% | 100% | 100% | |
| Qwen 3.7 Max | 100% | 100% | 100% | |
| DeepSeek V4.1 Flash (Reasoning, High) | 100% | 100% | 100% | |
| Z.AI GLM 5.3 Flash (Reasoning, Max) | 100% | 100% | 100% | |
| Qwen 3.8 Flash (Reasoning) | 100% | 100% | 100% | |
| Grok 4.5 (Reasoning, High) | 100% | 100% | 100% | |
Top Overall Models (Top 20)
Ranked by composite score (performance, cost, speed & stability). Click a model name to view its detail page.
| Score | Cost | Speed | Stability | ||
|---|---|---|---|---|---|
| Ministral 3 3B | 100% | $0.0000 | 995ms | 100% | |
| Ministral 3 8B | 100% | $0.0000 | 1.0s | 100% | |
| Mistral NeMO | 100% | $0.0000 | 1.2s | 100% | |
| GPT-5.4 Nano | 100% | $0.0001 | 989ms | 100% | |
| Mistral Small 4 | 100% | $0.0001 | 1.2s | 100% | |
| GPT-6 Luna | 100% | $0.0000 | 1.6s | 100% | |
| Ministral 3 14B | 100% | $0.0000 | 1.6s | 100% | |
| Cydonia 24B V4.1 | 100% | $0.0001 | 2.0s | 100% | |
| Mistral Small 3.2 24B | 100% | $0.0001 | 2.3s | 100% | |
| GPT-4.1 Nano | 100% | $0.0000 | 2.4s | 100% | |
| GPT-4.1 Mini | 100% | $0.0001 | 2.0s | 100% | |
| Mistral Medium 3.1 | 100% | $0.0003 | 1.6s | 100% | |
| GPT-5.6 Luna | 100% | $0.0003 | 1.3s | 100% | |
| Hermes 3 70B | 100% | $0.0001 | 3.1s | 100% | |
| GPT-6 Sol | 100% | $0.0004 | 1.8s | 100% | |
| GPT-6 Luna (Reasoning, Medium) | 100% | $0.0001 | 3.3s | 100% | |
| Mistral Large 3 | 100% | $0.0002 | 2.7s | 100% | |
| GPT-6 Luna (Reasoning, High) | 100% | $0.0001 | 3.8s | 100% | |
| GPT-4o, Aug. 6th (temp=1) | 100% | $0.0006 | 1.3s | 100% | |
| Qwen 2.5 72B | 100% | $0.0001 | 3.9s | 100% | |
| Median | Evaluator | Top 3 | Flop 3 |
|---|---|---|---|
| 100.0% | Contains a count of nouns |
Asking for directions (German)
Performance Score Distribution (Top 20)
Click a model name to view its detail page.
Price-Performance Score Distribution (Top 20)
Click a model name to view its detail page.
| Score | Cost | Time | ||
|---|---|---|---|---|
| Mistral NeMO | 100% | $0.0000 | 321ms | |
| Ministral 8B | 60% | $0.0000 | 341ms | |
| Ministral 3 3B | 100% | $0.0000 | 691ms | |
| GPT-4o Mini (temp=0) | 100% | $0.0000 | 728ms | |
| GPT-4o Mini (temp=1) | 100% | $0.0000 | 800ms | |
| Mistral Large 3 | 100% | $0.0001 | 7.5s | |
| Gemini 2.5 Flash Lite | 100% | $0.0001 | 722ms | |
| Mistral Small 3.2 24B | 100% | $0.0000 | 1.6s | |
| Gemma 4 26B | 100% | $0.0000 | 11.1s | |
| GPT-5.4 Mini | 80% | $0.0002 | 812ms | |
| GPT-6 Luna | 80% | $0.0000 | 2.3s | |
| Gemma 3 4B | 100% | $0.0000 | 2.4s | |
| Grok 4.3 | 60% | $0.0002 | 740ms | |
| Gemini 3.1 Flash Lite | 80% | $0.0002 | 922ms | |
| Gemini 3.1 Flash Lite (Reasoning) | 100% | $0.0002 | 3.5s | |
| Cydonia 24B V4.1 | 100% | $0.0001 | 2.1s | |
| Gemini 3.5 Flash Lite (Reasoning, Minimal) | 100% | $0.0003 | 693ms | |
| DeepSeek V3 (2025-03-24) | 100% | $0.0001 | 7.5s | |
| Gemini 3.1 Flash Lite (Preview) | 100% | $0.0002 | 995ms | |
| Hermes 3 70B | 80% | $0.0001 | 3.2s | |
Most Stable Models (Top 20)
Ranked by stability (median × consistency). Click a model name to view its detail page.
| Score | Consistency | Stability | ||
|---|---|---|---|---|
| Claude Opus 5.5 (Reasoning) | 100% | 100% | 100% | |
| Kimi K3.1 Pro (Reasoning, Max) | 100% | 100% | 100% | |
| Qwen 3.8 Max (Reasoning, XHigh) | 100% | 100% | 100% | |
| GPT-6.1 Sol (Reasoning, Medium) | 100% | 100% | 100% | |
| Gemini 3.8 Flash (Reasoning, Medium) | 100% | 100% | 100% | |
| Ember-1 (Reasoning, Max) | 100% | 100% | 100% | |
| Muse Wonder (Reasoning, Medium) | 100% | 100% | 100% | |
| Z.AI GLM 5.3 (Reasoning, Max) | 100% | 100% | 100% | |
| GPT-5.6 Sol (Reasoning, Medium) | 100% | 100% | 100% | |
| Claude Opus 4.6 (Reasoning) | 100% | 100% | 100% | |
| GPT-6.1 Terra (Reasoning, Medium) | 100% | 100% | 100% | |
| Gemini 3.6 Flash (Reasoning) | 100% | 100% | 100% | |
| Gemini 3.7 Flash (Reasoning, Medium) | 100% | 100% | 100% | |
| Hy4 Preview (Reasoning, High) | 100% | 100% | 100% | |
| Muse Spark 1.2 (Reasoning, Medium) | 100% | 100% | 100% | |
| Qwen 3.7 Max | 100% | 100% | 100% | |
| DeepSeek V4.1 Flash (Reasoning, High) | 100% | 100% | 100% | |
| Z.AI GLM 5.3 Flash (Reasoning, Max) | 100% | 100% | 100% | |
| Qwen 3.8 Flash (Reasoning) | 100% | 100% | 100% | |
| Grok 4.5 (Reasoning, High) | 100% | 100% | 100% | |
Top Overall Models (Top 20)
Ranked by composite score (performance, cost, speed & stability). Click a model name to view its detail page.
| Score | Cost | Speed | Stability | ||
|---|---|---|---|---|---|
| Mistral NeMO | 100% | $0.0000 | 321ms | 100% | |
| Ministral 3 3B | 100% | $0.0000 | 691ms | 100% | |
| GPT-4o Mini (temp=0) | 100% | $0.0000 | 728ms | 100% | |
| GPT-4o Mini (temp=1) | 100% | $0.0000 | 800ms | 100% | |
| Gemini 2.5 Flash Lite | 100% | $0.0001 | 722ms | 100% | |
| Mistral Small 3.2 24B | 100% | $0.0000 | 1.6s | 100% | |
| Gemini 3.1 Flash Lite (Preview) | 100% | $0.0002 | 995ms | 100% | |
| Gemma 3 4B | 100% | $0.0000 | 2.4s | 100% | |
| Gemini 3.5 Flash Lite (Reasoning, Minimal) | 100% | $0.0003 | 693ms | 100% | |
| Cydonia 24B V4.1 | 100% | $0.0001 | 2.1s | 100% | |
| GPT-5.6 Luna | 100% | $0.0003 | 709ms | 100% | |
| Gemini 3.5 Flash Lite (Reasoning) | 100% | $0.0004 | 740ms | 100% | |
| Gemini 3 Flash (Preview) | 100% | $0.0003 | 1.3s | 100% | |
| DeepSeek V3.1 | 100% | $0.0002 | 2.4s | 100% | |
| DeepSeek V3 (2024-12-26) | 100% | $0.0001 | 3.2s | 100% | |
| Claude Haiku 5.5 (Adaptive) | 100% | $0.0002 | 2.7s | 100% | |
| Mistral Medium 3.5 | 100% | $0.0006 | 719ms | 100% | |
| Llama 3.1 70B | 100% | $0.0002 | 3.3s | 100% | |
| GPT-6 Sol | 100% | $0.0004 | 1.9s | 100% | |
| Mistral Medium 3.5 (Reasoning) | 100% | $0.0006 | 868ms | 100% | |
| Median | Evaluator | Top 3 | Flop 3 |
|---|---|---|---|
| 100.0% | Matches Regex |
Asking for directions (Dutch)
Performance Score Distribution (Top 20)
Click a model name to view its detail page.
Price-Performance Score Distribution (Top 20)
Click a model name to view its detail page.
| Score | Cost | Time | ||
|---|---|---|---|---|
| Mistral NeMO | 80% | $0.0000 | 440ms | |
| Ministral 3 3B | 100% | $0.0000 | 930ms | |
| Gemini 2.5 Flash Lite | 80% | $0.0001 | 735ms | |
| GPT-6 Luna | 80% | $0.0000 | 1.3s | |
| Mistral Large 3 | 100% | $0.0001 | 984ms | |
| Gemini 3.1 Flash Lite (Preview) | 100% | $0.0001 | 954ms | |
| GPT-5.4 Mini | 60% | $0.0001 | 685ms | |
| Gemma 4 31B | 100% | $0.0000 | 2.2s | |
| Gemma 3 4B | 60% | $0.0000 | 2.0s | |
| Gemini 3.1 Flash Lite | 100% | $0.0002 | 1.0s | |
| Gemini 3.1 Flash Lite (Reasoning) | 100% | $0.0002 | 1.1s | |
| Thinking Machines Inkling | 80% | $0.0003 | 1.7s | |
| Gemma 4 26B | 100% | $0.0000 | 7.2s | |
| Grok 4.3 | 80% | $0.0003 | 1.1s | |
| Z.AI GLM 4.5 | 100% | $0.0001 | 2.4s | |
| GPT-5.6 Luna | 100% | $0.0003 | 1.0s | |
| Gemini 2.5 Flash | 80% | $0.0002 | 796ms | |
| Gemini 3 Flash (Preview) | 80% | $0.0003 | 1.2s | |
| Claude Haiku 5.5 (Adaptive) | 100% | $0.0002 | 2.6s | |
| Z.AI GLM 5.3 Flash (Reasoning, Low) | 80% | $0.0005 | 48.9s | |
Most Stable Models (Top 20)
Ranked by stability (median × consistency). Click a model name to view its detail page.
| Score | Consistency | Stability | ||
|---|---|---|---|---|
| Claude Opus 5.5 (Reasoning) | 100% | 100% | 100% | |
| Kimi K3.1 Pro (Reasoning, Max) | 100% | 100% | 100% | |
| Qwen 3.8 Max (Reasoning, XHigh) | 100% | 100% | 100% | |
| GPT-6.1 Sol (Reasoning, Medium) | 100% | 100% | 100% | |
| Gemini 3.8 Flash (Reasoning, Medium) | 100% | 100% | 100% | |
| Ember-1 (Reasoning, Max) | 100% | 100% | 100% | |
| Muse Wonder (Reasoning, Medium) | 100% | 100% | 100% | |
| Z.AI GLM 5.3 (Reasoning, Max) | 100% | 100% | 100% | |
| GPT-5.6 Sol (Reasoning, Medium) | 100% | 100% | 100% | |
| Claude Opus 4.6 (Reasoning) | 100% | 100% | 100% | |
| GPT-6.1 Terra (Reasoning, Medium) | 100% | 100% | 100% | |
| Gemini 3.6 Flash (Reasoning) | 100% | 100% | 100% | |
| Gemini 3.7 Flash (Reasoning, Medium) | 100% | 100% | 100% | |
| Hy4 Preview (Reasoning, High) | 100% | 100% | 100% | |
| Muse Spark 1.2 (Reasoning, Medium) | 100% | 100% | 100% | |
| Qwen 3.7 Max | 100% | 100% | 100% | |
| Z.AI GLM 5.3 Flash (Reasoning, Max) | 100% | 100% | 100% | |
| Qwen 3.8 Flash (Reasoning) | 100% | 100% | 100% | |
| Grok 4.5 (Reasoning, High) | 100% | 100% | 100% | |
| DeepSeek V4.1 Flash 1017 (Reasoning, High) | 100% | 100% | 100% | |
Top Overall Models (Top 20)
Ranked by composite score (performance, cost, speed & stability). Click a model name to view its detail page.
| Score | Cost | Speed | Stability | ||
|---|---|---|---|---|---|
| Ministral 3 3B | 100% | $0.0000 | 930ms | 100% | |
| Mistral Large 3 | 100% | $0.0001 | 984ms | 100% | |
| Gemini 3.1 Flash Lite (Preview) | 100% | $0.0001 | 954ms | 100% | |
| Gemma 4 31B | 100% | $0.0000 | 2.2s | 100% | |
| Gemini 3.1 Flash Lite (Reasoning) | 100% | $0.0002 | 1.1s | 100% | |
| Gemini 3.1 Flash Lite | 100% | $0.0002 | 1.0s | 100% | |
| GPT-5.6 Luna | 100% | $0.0003 | 1.0s | 100% | |
| Z.AI GLM 4.5 | 100% | $0.0001 | 2.4s | 100% | |
| Gemini 3.5 Flash Lite (Reasoning) | 100% | $0.0004 | 780ms | 100% | |
| Claude Haiku 5.5 (Adaptive) | 100% | $0.0002 | 2.6s | 100% | |
| Gemini 3.5 Flash Lite (Reasoning, Minimal) | 100% | $0.0005 | 887ms | 100% | |
| GPT-6 Sol | 100% | $0.0004 | 1.7s | 100% | |
| Claude Haiku 5.5 (Reasoning, Low) | 100% | $0.0002 | 3.9s | 100% | |
| Claude Haiku 5.5 (Reasoning, Medium) | 100% | $0.0002 | 4.3s | 100% | |
| Mistral Large 4.0 | 100% | $0.0004 | 2.6s | 100% | |
| Laguna S 2.1 | 100% | $0.0001 | 4.9s | 100% | |
| GPT-5.6 Terra | 100% | $0.0007 | 1.1s | 100% | |
| Mistral Medium 3.5 | 100% | $0.0008 | 890ms | 100% | |
| Mistral Medium 3.5 (Reasoning) | 100% | $0.0008 | 991ms | 100% | |
| GPT-6.1 Terra (Reasoning, Medium) | 100% | $0.0005 | 3.0s | 100% | |
| Median | Evaluator | Top 3 | Flop 3 |
|---|---|---|---|
| 100.0% | Matches Regex |