Write N of X
Write exactly N words/sentences/paragraphs...
Performance Score Distribution (Top 20)
Click a model name to view its detail page.
Price-Performance Score Distribution (Top 20)
Click a model name to view its detail page.
| Score | Cost | Time | ||
|---|---|---|---|---|
| Stealth: Aurora Alpha | 99% | — | 3.7s | |
| Inception Mercury | 99% | $0.0003 | 1.8s | |
| Ministral 3 3B | 72% | $0.0002 | 1.2s | |
| Gemini 2.5 Flash Lite | 77% | $0.0003 | 1.3s | |
| Inception Mercury 2 | 99% | $0.0008 | 1.2s | |
| Llama 3.1 8B | 74% | $0.0004 | 1.2s | |
| Gemini 3.1 Flash Lite (Preview) | 96% | $0.0007 | 1.6s | |
| GPT-5.4 Nano | 86% | $0.0006 | 2.3s | |
| GPT-5.4 Nano (Reasoning) | 98% | $0.0009 | 3.7s | |
| GPT-5.4 Nano (Reasoning, Low) | 92% | $0.0007 | 2.6s | |
| GPT-4.1 Nano | 82% | $0.0002 | 4.4s | |
| Mistral Small Creative | 75% | $0.0003 | 1.9s | |
| Ministral 3 14B | 83% | $0.0004 | 2.7s | |
| Mistral Small 3.2 24B | 81% | $0.0002 | 5.2s | |
| GPT-4.1 Mini | 84% | $0.0006 | 3.8s | |
| Grok 4 Fast | 88% | $0.0005 | 3.9s | |
| GPT-5.4 Mini | 91% | $0.0015 | 1.6s | |
| Stealth: Healer Alpha | 87% | $0.0000 | 10.8s | |
| GPT-5.4 Mini (Reasoning, Low) | 97% | $0.0019 | 2.2s | |
| Gemini 3 Flash (Preview) | 97% | $0.0015 | 2.6s | |
Cost vs Performance
Compares total cost for this test against the test score. Quadrant lines are drawn at the median values. Only models with available cost data are shown.
4 low-scoring outliers hidden: Ministral 8B (38.1%), Ministral 3B (37.0%), Mistral NeMO (36.0%), Rocinante 12B (31.0%).
Most Stable Models (Top 20)
Ranked by stability (median × consistency). Click a model name to view its detail page.
| Score | Consistency | Stability | ||
|---|---|---|---|---|
| Gemini 3.1 Pro (Preview) | 100% | 100% | 100% | |
| Qwen 3.5 397B A17B | 100% | 100% | 100% | |
| Z.AI GLM 5 | 100% | 100% | 100% | |
| Qwen 3.5 35B | 100% | 100% | 100% | |
| Qwen 3.5 Flash | 100% | 100% | 100% | |
| Gemini 3 Flash (Preview, Reasoning) | 100% | 100% | 100% | |
| Z.AI GLM 4.7 | 100% | 100% | 100% | |
| Claude Opus 4.6 (Reasoning) | 100% | 100% | 100% | |
| Gemini 3 Pro (Preview) | 100% | 100% | 100% | |
| Z.AI GLM 5 Turbo | 100% | 100% | 100% | |
| Claude Sonnet 4.6 (Reasoning) | 100% | 100% | 100% | |
| GPT-5.4 Mini (Reasoning) | 100% | 100% | 100% | |
| MoonshotAI: Kimi K2.5 | 100% | 99% | 99% | |
| GPT-5.4 (Reasoning) | 100% | 99% | 99% | |
| GPT-5.1 | 100% | 98% | 98% | |
| GPT-5.2 | 100% | 98% | 98% | |
| o4 Mini High | 100% | 96% | 96% | |
| GPT-5 Mini | 100% | 96% | 96% | |
| ByteDance Seed 1.6 | 100% | 96% | 96% | |
| GPT-5 | 99% | 94% | 94% | |
Top Overall Models (Top 20)
Ranked by composite score (performance, cost, speed & stability). Click a model name to view its detail page.
| Score | Cost | Speed | Stability | ||
|---|---|---|---|---|---|
| GPT-5.4 Mini (Reasoning) | 100% | $0.0028 | 3.9s | 100% | |
| Inception Mercury 2 | 99% | $0.0008 | 1.2s | 88% | |
| GPT-5 Mini | 100% | $0.0022 | 10.4s | 96% | |
| Stealth: Aurora Alpha | 99% | — | 3.7s | 89% | |
| Inception Mercury | 99% | $0.0003 | 1.8s | 83% | |
| GPT-5.2 | 100% | $0.0076 | 8.5s | 98% | |
| GPT-5.1 | 100% | $0.0075 | 10.8s | 98% | |
| Nemotron 3 Super | 99% | $0.0000 | 12.8s | 83% | |
| Z.AI GLM 5 Turbo | 100% | $0.0071 | 17.7s | 100% | |
| GPT-5.4 Nano (Reasoning) | 98% | $0.0009 | 3.7s | 78% | |
| GPT-5.4 (Reasoning) | 100% | $0.010 | 10.5s | 99% | |
| Qwen 3.5 Flash | 100% | $0.0025 | 39.9s | 100% | |
| Gemini 3 Flash (Preview) | 97% | $0.0015 | 2.6s | 73% | |
| o4 Mini | 99% | $0.0058 | 13.2s | 87% | |
| GPT-5 Nano | 99% | $0.0008 | 21.9s | 83% | |
| Gemini 3 Flash (Preview, Reasoning) | 100% | $0.011 | 18.1s | 100% | |
| o4 Mini High | 100% | $0.0083 | 23.8s | 96% | |
| GPT-5 | 99% | $0.010 | 16.5s | 94% | |
| GPT-5.4 Mini (Reasoning, Low) | 97% | $0.0019 | 2.2s | 69% | |
| Gemini 3.1 Flash Lite (Preview) | 96% | $0.0007 | 1.6s | 66% | |
| words | sentences | paragraphs | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Model | Total â–¼ | 10 word summary | 20 word summary | 50 word summary | 100 word summary | 200 word summary | 1 sentence summary | 3 sentence summary | 10 sentence summary | 20 sentence summary | 50 sentence summary | 1 paragraph summary | 3 paragraph summary | 5 paragraph summary |
| Gemini 3.1 Pro (Preview) | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% |
| Qwen 3.5 397B A17B | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% |
| Z.AI GLM 5 | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% |
| Qwen 3.5 35B | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% |
| Qwen 3.5 Flash | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% |
| Gemini 3 Flash (Preview, Reasoning) | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% |
| Z.AI GLM 4.7 | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% |
| Claude Opus 4.6 (Reasoning) | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% |
| Gemini 3 Pro (Preview) | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% |
| Z.AI GLM 5 Turbo | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% |
| Claude Sonnet 4.6 (Reasoning) | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% |
| GPT-5.4 Mini (Reasoning) | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% |
| MoonshotAI: Kimi K2.5 | 100% | 100% | 100% | 100% | 100% | 99% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% |
| GPT-5.4 (Reasoning) | 100% | 100% | 100% | 100% | 100% | 99% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% |
| GPT-5.1 | 100% | 100% | 100% | 100% | 100% | 99% | 100% | 100% | 100% | 99% | 100% | 100% | 100% | 100% |
paragraphs
1 paragraph summary
Performance Score Distribution (Top 20)
Click a model name to view its detail page.
Price-Performance Score Distribution (Top 20)
Click a model name to view its detail page.
| Score | Cost | Time | ||
|---|---|---|---|---|
| Stealth: Aurora Alpha | 100% | — | 3.9s | |
| Arcee AI: Trinity Mini | 100% | $0.0001 | 880ms | |
| Ministral 3B | 100% | $0.0001 | 2.1s | |
| Inception Mercury | 100% | $0.0003 | 845ms | |
| Gemini 2.5 Flash Lite | 100% | $0.0002 | 688ms | |
| Nemotron 3 Super | 100% | $0.0000 | 3.6s | |
| Ministral 8B | 100% | $0.0002 | 988ms | |
| Ministral 3 3B | 100% | $0.0002 | 1.0s | |
| Gemma 3 4B | 100% | $0.0001 | 2.2s | |
| Arcee AI: Trinity Large (Preview) | 100% | $0.0000 | 5.5s | |
| GPT-4.1 Nano | 100% | $0.0001 | 2.3s | |
| LFM2 24B | 100% | $0.0001 | 2.7s | |
| Inception Mercury 2 | 100% | $0.0004 | 820ms | |
| Mistral Small Creative | 100% | $0.0002 | 1.4s | |
| Ministral 3 8B | 100% | $0.0003 | 1.3s | |
| Llama 3.1 8B | 100% | $0.0003 | 709ms | |
| Stealth: Healer Alpha | 100% | $0.0000 | 3.9s | |
| Mistral NeMO | 100% | $0.0003 | 1.8s | |
| Mistral Small 3.2 24B | 100% | $0.0002 | 2.5s | |
| Gemma 3 12B | 100% | $0.0001 | 3.8s | |
Most Stable Models (Top 20)
Ranked by stability (median × consistency). Click a model name to view its detail page.
| Score | Consistency | Stability | ||
|---|---|---|---|---|
| Claude Opus 4.6 (Reasoning) | 100% | 100% | 100% | |
| Gemini 3.1 Pro (Preview) | 100% | 100% | 100% | |
| Z.AI GLM 5 Turbo | 100% | 100% | 100% | |
| Claude Sonnet 4.6 (Reasoning) | 100% | 100% | 100% | |
| GPT-5.4 (Reasoning) | 100% | 100% | 100% | |
| GPT-5 Mini | 100% | 100% | 100% | |
| GPT-5.1 | 100% | 100% | 100% | |
| Claude Opus 4.6 | 100% | 100% | 100% | |
| GPT-5 | 100% | 100% | 100% | |
| Qwen 3.5 397B A17B | 100% | 100% | 100% | |
| Qwen 3.5 122B | 100% | 100% | 100% | |
| Grok 4.20 (Beta, Reasoning) | 100% | 100% | 100% | |
| GPT-5.4 (Reasoning, Low) | 100% | 100% | 100% | |
| Z.AI GLM 5 | 100% | 100% | 100% | |
| Claude Sonnet 4.6 | 100% | 100% | 100% | |
| MoonshotAI: Kimi K2.5 | 100% | 100% | 100% | |
| Qwen 3.5 27B | 100% | 100% | 100% | |
| ByteDance Seed 1.6 | 100% | 100% | 100% | |
| GPT-5.4 Mini (Reasoning) | 100% | 100% | 100% | |
| Gemini 3 Flash (Preview, Reasoning) | 100% | 100% | 100% | |
Top Overall Models (Top 20)
Ranked by composite score (performance, cost, speed & stability). Click a model name to view its detail page.
| Score | Cost | Speed | Stability | ||
|---|---|---|---|---|---|
| Arcee AI: Trinity Mini | 100% | $0.0001 | 880ms | 100% | |
| Gemini 2.5 Flash Lite | 100% | $0.0002 | 688ms | 100% | |
| Ministral 8B | 100% | $0.0002 | 988ms | 100% | |
| Inception Mercury | 100% | $0.0003 | 845ms | 100% | |
| Llama 3.1 8B | 100% | $0.0003 | 709ms | 100% | |
| Ministral 3 3B | 100% | $0.0002 | 1.0s | 100% | |
| Inception Mercury 2 | 100% | $0.0004 | 820ms | 100% | |
| Ministral 3 8B | 100% | $0.0003 | 1.3s | 100% | |
| Mistral Small Creative | 100% | $0.0002 | 1.4s | 100% | |
| Ministral 3B | 100% | $0.0001 | 2.1s | 100% | |
| Mistral NeMO | 100% | $0.0003 | 1.8s | 100% | |
| Gemma 3 4B | 100% | $0.0001 | 2.2s | 100% | |
| Gemini 2.5 Flash | 100% | $0.0006 | 1.3s | 100% | |
| GPT-5.4 Nano | 100% | $0.0005 | 1.5s | 100% | |
| GPT-4.1 Nano | 100% | $0.0001 | 2.3s | 100% | |
| GPT-5.4 Nano (Reasoning) | 100% | $0.0005 | 1.5s | 100% | |
| GPT-5.4 Nano (Reasoning, Low) | 100% | $0.0005 | 1.6s | 100% | |
| Mistral Small 4 | 100% | $0.0003 | 2.0s | 100% | |
| Gemini 3.1 Flash Lite (Preview) | 100% | $0.0006 | 1.4s | 100% | |
| Ministral 3 14B | 100% | $0.0004 | 1.9s | 100% | |
| Median | Evaluator | Top 3 | Flop 3 |
|---|---|---|---|
| 100.0% | Matches paragraph count |
3 paragraph summary
Performance Score Distribution (Top 20)
Click a model name to view its detail page.
Price-Performance Score Distribution (Top 20)
Click a model name to view its detail page.
| Score | Cost | Time | ||
|---|---|---|---|---|
| Stealth: Aurora Alpha | 100% | — | 1.4s | |
| Ministral 3 3B | 100% | $0.0002 | 1.3s | |
| Gemini 2.5 Flash Lite | 100% | $0.0003 | 1.4s | |
| Arcee AI: Trinity Mini | 100% | $0.0001 | 2.8s | |
| Llama 3.1 8B | 90% | $0.0004 | 1.4s | |
| Mistral Small Creative | 100% | $0.0003 | 2.3s | |
| Inception Mercury | 100% | $0.0004 | 1.9s | |
| Ministral 3 8B | 100% | $0.0003 | 2.7s | |
| Gemma 3 4B | 60% | $0.0001 | 3.7s | |
| Mistral Small 3.2 24B | 100% | $0.0002 | 4.4s | |
| Stealth: Healer Alpha | 100% | $0.0000 | 13.5s | |
| Arcee AI: Trinity Large (Preview) | 100% | $0.0000 | 6.9s | |
| Ministral 3 14B | 100% | $0.0004 | 4.1s | |
| Nemotron 3 Super | 100% | $0.0000 | 8.4s | |
| Inception Mercury 2 | 100% | $0.0007 | 1.1s | |
| Mistral Small 4 | 100% | $0.0004 | 3.4s | |
| GPT-5.4 Nano (Reasoning) | 100% | $0.0006 | 2.1s | |
| GPT-5.4 Nano (Reasoning, Low) | 100% | $0.0007 | 2.0s | |
| GPT-4.1 Nano | 100% | $0.0002 | 4.8s | |
| GPT-5.4 Nano | 100% | $0.0007 | 1.9s | |
Most Stable Models (Top 20)
Ranked by stability (median × consistency). Click a model name to view its detail page.
| Score | Consistency | Stability | ||
|---|---|---|---|---|
| Claude Opus 4.6 (Reasoning) | 100% | 100% | 100% | |
| Gemini 3.1 Pro (Preview) | 100% | 100% | 100% | |
| Z.AI GLM 5 Turbo | 100% | 100% | 100% | |
| Claude Sonnet 4.6 (Reasoning) | 100% | 100% | 100% | |
| GPT-5.4 (Reasoning) | 100% | 100% | 100% | |
| GPT-5 Mini | 100% | 100% | 100% | |
| GPT-5.1 | 100% | 100% | 100% | |
| Claude Opus 4.6 | 100% | 100% | 100% | |
| GPT-5 | 100% | 100% | 100% | |
| Qwen 3.5 397B A17B | 100% | 100% | 100% | |
| Qwen 3.5 122B | 100% | 100% | 100% | |
| Grok 4.20 (Beta, Reasoning) | 100% | 100% | 100% | |
| GPT-5.4 (Reasoning, Low) | 100% | 100% | 100% | |
| Z.AI GLM 5 | 100% | 100% | 100% | |
| Claude Sonnet 4.6 | 100% | 100% | 100% | |
| MoonshotAI: Kimi K2.5 | 100% | 100% | 100% | |
| Qwen 3.5 27B | 100% | 100% | 100% | |
| ByteDance Seed 1.6 | 100% | 100% | 100% | |
| GPT-5.4 Mini (Reasoning) | 100% | 100% | 100% | |
| Gemini 3 Flash (Preview, Reasoning) | 100% | 100% | 100% | |
Top Overall Models (Top 20)
Ranked by composite score (performance, cost, speed & stability). Click a model name to view its detail page.
| Score | Cost | Speed | Stability | ||
|---|---|---|---|---|---|
| Stealth: Aurora Alpha | 100% | — | 1.4s | 100% | |
| Ministral 3 3B | 100% | $0.0002 | 1.3s | 100% | |
| Gemini 2.5 Flash Lite | 100% | $0.0003 | 1.4s | 100% | |
| Inception Mercury 2 | 100% | $0.0007 | 1.1s | 100% | |
| Inception Mercury | 100% | $0.0004 | 1.9s | 100% | |
| Mistral Small Creative | 100% | $0.0003 | 2.3s | 100% | |
| GPT-5.4 Nano | 100% | $0.0007 | 1.9s | 100% | |
| Arcee AI: Trinity Mini | 100% | $0.0001 | 2.8s | 100% | |
| GPT-5.4 Nano (Reasoning, Low) | 100% | $0.0007 | 2.0s | 100% | |
| GPT-5.4 Nano (Reasoning) | 100% | $0.0006 | 2.1s | 100% | |
| Gemini 3.1 Flash Lite (Preview) | 100% | $0.0008 | 1.8s | 100% | |
| Ministral 3 8B | 100% | $0.0003 | 2.7s | 100% | |
| Gemini 2.5 Flash | 100% | $0.0010 | 2.0s | 100% | |
| GPT-5.4 Mini | 100% | $0.0014 | 1.8s | 100% | |
| Mistral Small 4 | 100% | $0.0004 | 3.4s | 100% | |
| GPT-4.1 Mini | 100% | $0.0007 | 3.4s | 100% | |
| GPT-5.4 Mini (Reasoning, Low) | 100% | $0.0018 | 1.7s | 100% | |
| Ministral 3 14B | 100% | $0.0004 | 4.1s | 100% | |
| Mistral Small 3.2 24B | 100% | $0.0002 | 4.4s | 100% | |
| Grok 4.20 (Beta) | 100% | $0.0021 | 1.7s | 100% | |
| Median | Evaluator | Top 3 | Flop 3 |
|---|---|---|---|
| 100.0% | Matches paragraph count |