Creative Writing
18 scenarios across 6 subcategories. 104 models scored.
Subcategories
| Subcategory | Avg Score | Best Model | Best Score |
|---|---|---|---|
| AI-isms | 80.00% | ByteDance Seed 2.0 Lite | 93.39% |
| Prose Variety | 67.05% | Writer: Palmyra X5 | 83.01% |
| Dialogue | 74.96% | Claude Sonnet 4.6 | 95.20% |
| Purple Prose | 87.26% | Grok 4.1 Fast | 97.96% |
| Mechanical Style | 85.17% | GPT-5.4 (Reasoning) | 97.97% |
| Clichés | 77.22% | o4 Mini High | 90.38% |
Model Leaderboard
All models ranked by their Creative Writing category score.
| # | Model | Creative Writing | AI-isms | Prose Variety | Dialogue | Purple Prose | Mechanical Style | Clichés | Overall |
|---|---|---|---|---|---|---|---|---|---|
| 1 | GPT-5.4 (Reasoning) | 91.17% | 91.56% | 79.74% | 93.69% | 97.55% | 97.97% | 86.52% | 93.24% |
| 2 | GPT-5.4 | 90.94% | 91.06% | 81.26% | 94.79% | 96.74% | 97.49% | 84.30% | 84.32% |
| 3 | GPT-5.4 (Reasoning, Low) | 90.51% | 91.02% | 80.88% | 92.18% | 96.68% | 97.75% | 84.51% | 91.41% |
| 4 | GPT-5.1 | 87.20% | 88.21% | 73.76% | 87.44% | 93.57% | 93.87% | 86.39% | 92.54% |
| 5 | Qwen 3.5 397B A17B | 86.93% | 84.94% | 68.63% | 92.54% | 94.84% | 97.50% | 83.12% | 91.73% |
| 6 | GPT-5 | 86.87% | 92.05% | 62.58% | 91.30% | 92.06% | 93.65% | 89.59% | 91.93% |
| 7 | Gemini 3.1 Pro (Preview) | 85.44% | 80.73% | 63.42% | 87.20% | 95.06% | 97.27% | 88.95% | 94.37% |
| 8 | Claude Opus 4.6 (Reasoning) | 84.55% | 88.14% | 75.04% | 93.56% | 91.88% | 82.92% | 75.75% | 95.02% |
| 9 | Qwen 3.5 9B | 84.36% | 87.56% | 54.03% | 91.86% | 96.88% | 96.13% | 79.70% | 86.05% |
| 10 | Claude Sonnet 4.5 | 84.19% | 84.67% | 78.05% | 89.63% | 89.39% | 86.97% | 76.41% | 88.03% |
| 11 | Writer: Palmyra X5 | 83.95% | 82.97% | 83.01% | 84.42% | 94.98% | 79.92% | 78.38% | 79.57% |
| 12 | Qwen 3.5 Flash | 83.81% | 84.96% | 58.83% | 87.13% | 94.71% | 95.18% | 82.05% | 86.38% |
| 13 | Claude Opus 4 | 83.79% | 82.47% | 77.58% | 89.08% | 90.42% | 84.86% | 78.30% | 87.69% |
| 14 | Z.AI GLM 5 | 83.63% | 84.90% | 77.33% | 88.46% | 88.49% | 83.75% | 78.86% | 91.23% |
| 15 | Claude Opus 4.6 | 83.59% | 88.68% | 74.14% | 92.37% | 91.07% | 82.67% | 72.59% | 92.35% |
| 16 | Qwen 3.5 35B | 83.51% | 85.05% | 58.12% | 89.61% | 93.58% | 93.58% | 81.11% | 88.00% |
| 17 | Claude Sonnet 4.6 | 83.31% | 87.17% | 72.52% | 95.20% | 90.14% | 78.39% | 76.43% | 91.15% |
| 18 | Claude Sonnet 4.6 (Reasoning) | 83.09% | 88.70% | 71.90% | 94.92% | 89.19% | 78.68% | 75.13% | 93.66% |
| 19 | Qwen 3.5 122B | 83.02% | 84.79% | 56.46% | 86.76% | 94.27% | 95.52% | 80.31% | 91.53% |
| 20 | o4 Mini High | 82.72% | 77.81% | 63.78% | 78.26% | 97.56% | 88.52% | 90.38% | 90.29% |
| 21 | Qwen 3.5 27B | 82.54% | 84.16% | 54.98% | 88.67% | 94.46% | 94.50% | 78.44% | 90.85% |
| 22 | ByteDance Seed 2.0 Lite | 82.35% | 93.39% | 58.28% | 85.96% | 90.78% | 89.48% | 76.22% | 84.80% |
| 23 | DeepSeek V3 (2025-03-24) | 82.34% | 81.15% | 73.86% | 83.31% | 95.33% | 79.89% | 80.49% | 81.99% |
| 24 | Grok 4.1 Fast | 82.14% | 78.06% | 71.82% | 78.96% | 97.96% | 84.23% | 81.78% | 89.55% |
| 25 | o4 Mini | 82.04% | 78.02% | 63.95% | 78.87% | 97.30% | 87.50% | 86.60% | 88.35% |
| 26 | Mistral Large | 82.02% | 81.60% | 73.53% | 81.53% | 94.33% | 81.07% | 80.04% | 80.15% |
| 27 | Rocinante 12B | 81.94% | 81.99% | 79.52% | 72.56% | 92.33% | 82.57% | 82.68% | 54.55% |
| 28 | Mistral Large 2 | 81.86% | 81.31% | 72.75% | 83.10% | 91.94% | 80.68% | 81.36% | 82.41% |
| 29 | Claude Opus 4.5 | 81.71% | 84.65% | 76.11% | 88.91% | 83.27% | 83.45% | 73.89% | 89.69% |
| 30 | Mistral Medium 3.1 | 81.70% | 82.67% | 74.30% | 81.51% | 94.59% | 77.16% | 79.96% | 77.83% |
| 31 | ByteDance Seed 1.6 Flash | 81.51% | 90.73% | 70.46% | 79.96% | 95.11% | 77.28% | 75.52% | 73.27% |
| 32 | MoonshotAI: Kimi K2.5 | 81.35% | 84.62% | 70.84% | 86.21% | 93.06% | 86.00% | 67.36% | 91.04% |
| 33 | GPT-4.1 | 81.24% | 82.39% | 69.77% | 76.96% | 93.57% | 80.93% | 83.80% | 88.68% |
| 34 | Minimax M2.5 | 81.21% | 86.13% | 73.63% | 88.93% | 84.71% | 78.48% | 75.41% | 88.71% |
| 35 | Mistral Large 3 | 81.21% | 81.25% | 72.38% | 80.22% | 92.61% | 80.06% | 80.74% | 85.43% |
| 36 | Gemini 2.5 Pro | 81.03% | 78.06% | 62.91% | 77.40% | 90.00% | 90.61% | 87.21% | 88.53% |
| 37 | Hermes 3 405B | 80.92% | 78.30% | 69.94% | 68.75% | 93.61% | 92.33% | 82.60% | 82.86% |
| 38 | GPT-5 Mini | 80.48% | 89.87% | 60.91% | 85.94% | 83.16% | 84.52% | 78.48% | 92.62% |
| 39 | GPT-5.2 | 80.36% | 88.60% | 67.99% | 80.71% | 87.55% | 90.94% | 66.36% | 90.26% |
| 40 | Mistral Small Creative | 80.29% | 80.94% | 75.44% | 78.30% | 94.23% | 76.63% | 76.20% | 73.27% |
| 41 | Aion 2.0 | 80.24% | 81.95% | 64.90% | 76.51% | 89.80% | 86.75% | 81.53% | 89.21% |
| 42 | ByteDance Seed 2.0 Mini | 80.11% | 90.38% | 59.35% | 81.36% | 87.57% | 80.08% | 81.90% | 86.91% |
| 43 | DeepSeek V3.2 | 79.95% | 80.86% | 66.11% | 73.33% | 90.65% | 87.42% | 81.32% | 82.25% |
| 44 | Claude Sonnet 4 | 79.21% | 79.20% | 76.88% | 82.84% | 78.57% | 84.00% | 73.80% | 88.72% |
| 45 | Stealth: Hunter Alpha | 79.18% | 81.32% | 68.88% | 76.41% | 91.65% | 81.86% | 74.96% | 87.33% |
| 46 | Ministral 3 14B | 79.11% | 80.51% | 74.94% | 74.59% | 92.74% | 73.18% | 78.70% | 72.54% |
| 47 | WizardLM 2 8x22b | 79.06% | 80.21% | 65.28% | 77.45% | 85.19% | 86.84% | 79.40% | 71.07% |
| 48 | Claude Haiku 4.5 | 78.96% | 84.13% | 75.25% | 82.25% | 81.79% | 78.41% | 71.93% | 85.14% |
| 49 | Z.AI GLM 4.7 | 78.89% | 83.61% | 61.49% | 71.01% | 91.38% | 84.23% | 81.62% | 88.69% |
| 50 | Z.AI GLM 4.6 | 78.86% | 79.06% | 63.85% | 74.32% | 84.37% | 87.76% | 83.84% | 89.11% |
| 51 | Gemma 3 27B | 78.79% | 75.45% | 71.72% | 64.44% | 88.37% | 88.98% | 83.82% | 77.85% |
| 52 | Claude 3.5 Sonnet | 78.69% | 78.78% | 68.25% | 80.13% | 82.20% | 85.61% | 77.15% | 84.24% |
| 53 | ByteDance Seed 1.6 | 78.43% | 87.67% | 57.70% | 85.62% | 87.01% | 74.93% | 77.64% | 90.70% |
| 54 | Stealth: Healer Alpha | 78.28% | 81.02% | 66.33% | 77.16% | 88.08% | 82.39% | 74.72% | 85.92% |
| 55 | LFM2 24B | 78.10% | 76.37% | 69.90% | 72.22% | 91.50% | 83.73% | 74.86% | 58.77% |
| 56 | DeepSeek V3 (2024-12-26) | 77.88% | 76.53% | 66.31% | 69.79% | 91.42% | 83.43% | 79.81% | 83.68% |
| 57 | Gemini 3 Pro (Preview) | 77.77% | 83.34% | 63.57% | 67.00% | 91.81% | 80.39% | 80.50% | 88.79% |
| 58 | Cohere Command R+ (Aug. 2024) | 77.70% | 76.55% | 71.05% | 64.24% | 87.40% | 89.16% | 77.80% | 69.03% |
| 59 | Gemini 2.5 Flash | 77.57% | 73.23% | 65.37% | 70.64% | 83.37% | 94.77% | 78.05% | 80.60% |
| 60 | DeepSeek V3.1 | 77.45% | 78.57% | 62.92% | 68.61% | 86.19% | 84.49% | 83.91% | 82.39% |
| 61 | Hermes 3 70B | 77.41% | 77.97% | 73.70% | 59.25% | 87.04% | 88.06% | 78.42% | 72.57% |
| 62 | Z.AI GLM 4.7 Flash | 77.36% | 83.78% | 61.69% | 69.49% | 89.60% | 78.53% | 81.09% | 84.82% |
| 63 | Grok 4 | 77.34% | 78.04% | 67.50% | 68.65% | 91.44% | 80.92% | 77.48% | 88.12% |
| 64 | Ministral 3 8B | 77.26% | 78.74% | 70.61% | 72.81% | 90.74% | 74.38% | 76.24% | 71.76% |
| 65 | DeepSeek-V2 Chat | 77.20% | 75.84% | 66.87% | 66.95% | 91.52% | 82.94% | 79.10% | 84.83% |
| 66 | Qwen 3.5 Plus (2026-02-15) | 77.07% | 81.88% | 67.63% | 61.06% | 87.42% | 92.52% | 71.92% | 85.96% |
| 67 | Grok 4 Fast | 77.03% | 76.89% | 68.43% | 69.13% | 92.79% | 80.12% | 74.82% | 86.15% |
| 68 | Ministral 8B | 76.87% | 78.83% | 69.62% | 76.29% | 89.29% | 73.33% | 73.81% | 64.87% |
| 69 | Mistral NeMO | 76.72% | 73.01% | 59.98% | 67.00% | 89.84% | 94.70% | 75.80% | 65.04% |
| 70 | Z.AI GLM 4.5 | 76.56% | 80.07% | 68.98% | 73.22% | 81.73% | 83.00% | 72.34% | 86.27% |
| 71 | Llama 3.1 8B | 76.54% | 78.41% | 77.72% | 73.18% | 69.60% | 81.03% | 79.32% | 63.37% |
| 72 | Claude 3.7 Sonnet | 76.31% | 80.64% | 70.66% | 75.00% | 81.90% | 80.55% | 69.12% | 83.39% |
| 73 | Gemini 2.5 Flash (Reasoning) | 76.30% | 71.84% | 66.66% | 65.33% | 81.71% | 94.83% | 77.43% | 86.51% |
| 74 | GPT-4o, May 13th (temp=1) | 75.88% | 72.12% | 69.83% | 58.51% | 87.39% | 86.96% | 80.44% | 83.80% |
| 75 | Gemini 3 Flash (Preview, Reasoning) | 75.87% | 82.18% | 61.94% | 69.48% | 78.95% | 81.52% | 81.18% | 90.50% |
| 76 | Gemini 3.1 Flash Lite (Preview) | 75.78% | 78.70% | 59.92% | 75.91% | 82.09% | 78.41% | 79.66% | 85.87% |
| 77 | GPT-4o, Aug. 6th (temp=1) | 75.50% | 71.49% | 73.05% | 59.42% | 87.96% | 80.80% | 80.25% | 82.62% |
| 78 | Ministral 3B | 75.49% | 76.30% | 67.17% | 75.29% | 90.17% | 73.22% | 70.80% | 61.29% |
| 79 | Ministral 3 3B | 75.45% | 75.23% | 65.17% | 74.49% | 89.60% | 77.57% | 70.63% | 67.22% |
| 80 | Gemma 3 12B | 75.38% | 72.08% | 71.52% | 54.87% | 86.76% | 84.22% | 82.85% | 78.41% |
| 81 | Claude 3.5 Haiku | 75.28% | 71.39% | 72.74% | 77.75% | 77.31% | 77.74% | 74.78% | 83.73% |
| 82 | Arcee AI: Trinity Large (Preview) | 75.26% | 78.62% | 68.56% | 65.33% | 81.59% | 83.61% | 73.85% | 73.33% |
| 83 | Qwen 2.5 72B | 75.16% | 73.92% | 60.17% | 64.34% | 84.37% | 95.34% | 72.84% | 75.46% |
| 84 | Gemini 2.5 Flash Lite | 75.05% | 71.91% | 66.56% | 62.67% | 79.16% | 93.78% | 76.25% | 81.08% |
| 85 | Gemini 3 Flash (Preview) | 75.04% | 83.34% | 61.35% | 64.78% | 84.15% | 76.32% | 80.32% | 85.35% |
| 86 | GPT-4o, May 13th (temp=0) | 74.89% | 72.87% | 60.13% | 64.81% | 86.01% | 95.74% | 69.79% | 85.36% |
| 87 | Claude 3 Haiku | 74.53% | 70.91% | 69.39% | 60.58% | 88.64% | 88.96% | 68.71% | 71.19% |
| 88 | GPT-4.1 Mini | 74.52% | 72.34% | 68.20% | 57.72% | 87.91% | 80.59% | 80.38% | 83.20% |
| 89 | GPT-4o Mini (temp=1) | 74.37% | 70.73% | 71.50% | 53.50% | 91.21% | 81.11% | 78.20% | 79.08% |
| 90 | Arcee AI: Trinity Mini | 74.01% | 75.18% | 56.69% | 63.42% | 85.69% | 83.32% | 79.76% | 70.90% |
| 91 | GPT-4o, Aug. 6th (temp=0) | 73.65% | 72.11% | 58.95% | 63.20% | 84.90% | 93.39% | 69.33% | 82.45% |
| 92 | GPT-4o Mini (temp=0) | 73.10% | 70.53% | 59.43% | 56.91% | 88.83% | 92.33% | 70.56% | 78.29% |
| 93 | Llama 3.1 70B | 72.78% | 74.82% | 65.53% | 70.76% | 71.74% | 82.99% | 70.83% | 78.40% |
| 94 | Gemma 3 4B | 72.10% | 69.45% | 68.92% | 52.95% | 83.05% | 78.08% | 80.17% | 68.57% |
| 95 | Mistral Small 3.2 24B | 71.87% | 72.69% | 47.89% | 68.93% | 84.70% | 88.45% | 68.55% | 78.60% |
| 96 | GPT-4.1 Nano | 71.81% | 68.54% | 67.03% | 55.61% | 82.65% | 76.30% | 80.71% | 71.94% |
| 97 | Llama 3.1 Nemotron 70B | 71.71% | 71.82% | 70.84% | 62.12% | 69.97% | 83.82% | 71.70% | 74.70% |
| 98 | Gemini 2.5 Flash Lite (Reasoning) | 71.64% | 71.77% | 65.69% | 65.73% | 72.59% | 87.33% | 66.75% | 85.75% |
| 99 | Inception Mercury | 69.99% | 75.55% | 40.36% | 73.29% | 72.27% | 89.59% | 68.89% | 79.50% |
| 100 | Nemotron 3 Super | 69.75% | 76.58% | 57.81% | 67.38% | 70.69% | 81.62% | 64.41% | 84.56% |
| 101 | Inception Mercury 2 | 68.31% | 74.37% | 50.37% | 59.94% | 67.97% | 89.69% | 67.53% | 83.85% |
| 102 | Stealth: Aurora Alpha | 67.54% | 74.28% | 49.43% | 59.16% | 65.58% | 88.68% | 68.10% | 83.79% |
| 103 | GPT-5 Nano | 67.04% | 84.30% | 60.85% | 62.32% | 66.77% | 77.89% | 50.07% | 82.60% |
| 104 | Nemotron 3 Nano | 65.87% | 74.00% | 52.17% | 60.70% | 59.84% | 84.19% | 64.30% | 77.78% |