Text Replacement
Tests deterministic text transformations: renaming characters/locations, expanding contractions, tense rewriting, POV shifts, gender swaps, combined transformations, and word avoidance. Scored by checking each expected change independently.
Passive voice → active voice
Text EditingHallucination
Performance Score Distribution (Top 20)
Click a model name to view its detail page.
Price-Performance Score Distribution (Top 20)
Click a model name to view its detail page.
| Score | Cost | Time | ||
|---|---|---|---|---|
| Gemini 3 Flash (Preview) | 99% | $0.0027 | 4.4s | |
| Grok 4 Fast | 98% | $0.0015 | 12.2s | |
| Gemini 2.5 Flash | 97% | $0.0021 | 3.1s | |
| Qwen 3.5 Plus (2026-02-15) | 97% | $0.0022 | 9.5s | |
| Grok 4.1 Fast | 98% | $0.0020 | 28.2s | |
| Mistral Large 3 | 96% | $0.0016 | 10.4s | |
| Claude Haiku 4.5 | 96% | $0.0052 | 6.2s | |
| Gemini 2.5 Flash Lite (Reasoning) | 95% | $0.0031 | 25.5s | |
| Claude Sonnet 4.5 | 99% | $0.016 | 7.0s | |
| DeepSeek V3.2 | 99% | $0.0006 | 54.4s | |
| Gemini 2.5 Flash Lite | 94% | $0.0004 | 2.4s | |
| Gemma 3 12B | 94% | $0.0001 | 12.1s | |
| DeepSeek V3 (2024-12-26) | 95% | $0.0012 | 22.5s | |
| Mistral Medium 3.1 | 94% | $0.0019 | 6.3s | |
| Hermes 3 405B | 94% | $0.0018 | 27.1s | |
| DeepSeek V3.1 | 90% | $0.0009 | 33.9s | |
| Claude Sonnet 4.6 | 98% | $0.016 | 7.4s | |
| Mistral Large 2 | 96% | $0.0064 | 10.4s | |
| Mistral Large | 95% | $0.0064 | 10.4s | |
| Writer: Palmyra X5 | 95% | $0.0052 | 9.7s | |
Most Stable Models (Top 20)
Ranked by stability (median × consistency). Click a model name to view its detail page.
| Score | Consistency | Stability | ||
|---|---|---|---|---|
| Gemini 3.1 Pro (Preview) | 99% | 100% | 99% | |
| Claude Opus 4.6 | 98% | 100% | 98% | |
| Grok 4 | 99% | 99% | 98% | |
| Claude Sonnet 4.6 | 98% | 99% | 98% | |
| Gemini 2.5 Pro | 99% | 98% | 97% | |
| Claude Sonnet 4.5 | 99% | 98% | 97% | |
| DeepSeek V3.2 | 99% | 98% | 97% | |
| Gemini 3 Flash (Preview) | 99% | 99% | 97% | |
| Claude Opus 4.6 (Reasoning) | 99% | 98% | 97% | |
| Claude Sonnet 4.6 (Reasoning) | 99% | 98% | 97% | |
| Z.AI GLM 5 | 98% | 98% | 97% | |
| ByteDance Seed 1.6 | 97% | 100% | 97% | |
| GPT-5 | 98% | 97% | 97% | |
| Grok 4 Fast | 98% | 98% | 97% | |
| Grok 4.1 Fast | 98% | 98% | 97% | |
| o4 Mini | 98% | 98% | 96% | |
| GPT-5.1 | 98% | 98% | 96% | |
| Claude Opus 4.5 | 97% | 99% | 96% | |
| Claude Sonnet 4 | 98% | 98% | 96% | |
| Gemini 3 Flash (Preview, Reasoning) | 97% | 99% | 95% | |
Top Overall Models (Top 20)
Ranked by composite score (performance, cost, speed & stability). Click a model name to view its detail page.
| Score | Cost | Speed | Stability | ||
|---|---|---|---|---|---|
| Gemini 3 Flash (Preview) | 99% | $0.0027 | 4.4s | 97% | |
| Grok 4 Fast | 98% | $0.0015 | 12.2s | 97% | |
| Gemini 2.5 Flash | 97% | $0.0021 | 3.1s | 95% | |
| Qwen 3.5 Plus (2026-02-15) | 97% | $0.0022 | 9.5s | 95% | |
| Grok 4.1 Fast | 98% | $0.0020 | 28.2s | 97% | |
| Claude Sonnet 4.5 | 99% | $0.016 | 7.0s | 97% | |
| Mistral Large 3 | 96% | $0.0016 | 10.4s | 95% | |
| Claude Sonnet 4.6 | 98% | $0.016 | 7.4s | 98% | |
| DeepSeek V3.2 | 99% | $0.0006 | 54.4s | 97% | |
| Mistral Large 2 | 96% | $0.0064 | 10.4s | 95% | |
| Claude Sonnet 4 | 98% | $0.016 | 9.2s | 96% | |
| Mistral Large | 95% | $0.0064 | 10.4s | 94% | |
| Claude Haiku 4.5 | 96% | $0.0052 | 6.2s | 92% | |
| Gemini 2.5 Flash Lite | 94% | $0.0004 | 2.4s | 92% | |
| Mistral Medium 3.1 | 94% | $0.0019 | 6.3s | 93% | |
| Claude Opus 4.6 | 98% | $0.026 | 8.7s | 98% | |
| DeepSeek V3 (2024-12-26) | 95% | $0.0012 | 22.5s | 92% | |
| Gemma 3 12B | 94% | $0.0001 | 12.1s | 92% | |
| Writer: Palmyra X5 | 95% | $0.0052 | 9.7s | 93% | |
| Claude Opus 4.5 | 97% | $0.026 | 8.0s | 96% | |
| Median | Evaluator | Top 3 | Flop 3 |
|---|---|---|---|
| 95.7% | Dialogue content preserved unchanged | ||
| 100.0% | No hallucinated or fabricated content | ||
| 94.6% | Non-passive narration preserved | ||
| 86.5% | Passive → active voice transformations | ||
| 100.0% | Structural similarity to original |