Tool usage within Novelcrafter
Output messages that are related to tool usage within Novelcrafter
Performance Score Distribution (Top 20)
Click a model name to view its detail page.
Price-Performance Score Distribution (Top 20)
Click a model name to view its detail page.
| Score | Cost | Time | ||
|---|---|---|---|---|
| Ministral 3B | 80% | $0.0000 | 2.1s | |
| Gemini 2.5 Flash Lite | 100% | $0.0002 | 1.5s | |
| Inception Mercury 2 | 97% | $0.0004 | 1.1s | |
| Mistral NeMO | 97% | $0.0001 | 3.2s | |
| Ministral 8B | 80% | $0.0001 | 6.9s | |
| Ministral 3 3B | 90% | $0.0001 | 3.6s | |
| Mistral Small 3.2 24B | 100% | $0.0001 | 4.9s | |
| GPT-4.1 Nano | 90% | $0.0001 | 4.0s | |
| Gemini 3.1 Flash Lite (Preview) | 100% | $0.0008 | 2.6s | |
| Gemini 3.1 Flash Lite (Reasoning) | 100% | $0.0007 | 5.1s | |
| Gemini 3.1 Flash Lite | 100% | $0.0007 | 5.6s | |
| Laguna S 2.1 | 100% | $0.0001 | 7.3s | |
| Gemini 2.5 Flash | 100% | $0.0010 | 2.4s | |
| GPT-4.1 Mini | 97% | $0.0006 | 4.3s | |
| GPT-4o Mini (temp=0) | 100% | $0.0003 | 5.5s | |
| Arcee AI: Trinity Mini | 97% | $0.0002 | 6.4s | |
| Gemini 3.5 Flash Lite (Reasoning) | 100% | $0.0012 | 2.3s | |
| GPT-4o Mini (temp=1) | 100% | $0.0003 | 8.0s | |
| Gemini 3.5 Flash Lite (Reasoning, Minimal) | 100% | $0.0012 | 2.3s | |
| Ministral 3 8B | 100% | $0.0002 | 6.6s | |
Cost vs Performance
Compares total cost for this test against the test score. Quadrant lines are drawn at the median values. Only models with available cost data are shown.
47 low-scoring outliers hidden: Z.AI GLM 5.2 (Reasoning, High) (96.7%), Muse Spark 1.1 (Reasoning, Minimal) (96.7%), GPT-5.1 (96.7%), ByteDance Seed 1.6 (96.7%), Qwen 3.6 27B (96.7%), MiniMax M2.5 (96.7%), Gemini 3 Flash (Preview) (96.7%), GPT-5.4 (96.7%), Qwen 3.5 9B (96.7%), Inception Mercury 2 (96.7%), GPT-4.1 Mini (96.7%), Qwen 3 32B (96.7%), Mistral Medium 3.1 (96.7%), WizardLM 2 8x22b (96.7%), Arcee AI: Trinity Mini (96.7%), Mistral NeMO (96.7%), Qwen 3.5 Plus (2026-04-20) (93.3%), Gemma 4 26B (93.3%), DeepSeek V4 Flash (93.3%), Mistral Small 4 (93.3%), DeepSeek V4 Flash (Reasoning) (93.3%), Z.AI GLM 5 Turbo (90.0%), Qwen 3.8 27B (Reasoning, XHigh) (90.0%), Muse Glimmer 30B (Reasoning, Medium) (90.0%), Qwen 3.5 35B (90.0%), Z.AI GLM 4.7 Flash (90.0%), Nemotron 3 Super (90.0%), Grok 4.20 (90.0%), DeepSeek V3 (2025-03-24) (90.0%), Grok 4.3 (90.0%), Ministral 3 14B (90.0%), GPT-4.1 Nano (90.0%), Cohere Command R+ (Aug. 2024) (90.0%), Ministral 3 3B (90.0%), Llama 3.1 70B (86.7%), Cydonia 24B V4.1 (86.7%), Aion 3.0 Mini (83.3%), Laguna XS 2.1 (83.3%), Qwen 3.8 Flash (Reasoning) (80.0%), Qwen 3.7 Flash (Reasoning) (80.0%), Qwen 3.5 Flash (80.0%), Ministral 8B (80.0%), Ministral 3B (80.0%), Nemotron 3 Nano (73.3%), Qwen 3.6 35B (66.7%), Thinking Machines Inkling (16.7%), ByteDance Seed 1.6 Flash (0.0%).
Most Stable Models (Top 20)
Ranked by stability (median × consistency). Click a model name to view its detail page.
| Score | Consistency | Stability | ||
|---|---|---|---|---|
| Claude Opus 5.5 (Reasoning) | 100% | 100% | 100% | |
| Qwen 3.8 Max (Reasoning, XHigh) | 100% | 100% | 100% | |
| Gemini 3.8 Flash (Reasoning, Medium) | 100% | 100% | 100% | |
| Z.AI GLM 5.3 (Reasoning, Max) | 100% | 100% | 100% | |
| GPT-5.6 Sol (Reasoning, Medium) | 100% | 100% | 100% | |
| Claude Opus 4.6 (Reasoning) | 100% | 100% | 100% | |
| Gemini 3.6 Flash (Reasoning) | 100% | 100% | 100% | |
| Gemini 3.7 Flash (Reasoning, Medium) | 100% | 100% | 100% | |
| Hy4 Preview (Reasoning, High) | 100% | 100% | 100% | |
| Muse Spark 1.2 (Reasoning, Medium) | 100% | 100% | 100% | |
| Qwen 3.7 Max | 100% | 100% | 100% | |
| DeepSeek V4.1 Flash (Reasoning, High) | 100% | 100% | 100% | |
| Z.AI GLM 5.3 Flash (Reasoning, Max) | 100% | 100% | 100% | |
| Grok 4.5 (Reasoning, High) | 100% | 100% | 100% | |
| Gemini 3.1 Pro (Preview) | 100% | 100% | 100% | |
| Muse Spark 1.3 (Reasoning, Medium) | 100% | 100% | 100% | |
| GPT-6 Luna (Reasoning, High) | 100% | 100% | 100% | |
| GPT-5.4 (Reasoning) | 100% | 100% | 100% | |
| Muse Spark 1.1 (Reasoning, Medium) | 100% | 100% | 100% | |
| Z.AI GLM 5.1 | 100% | 100% | 100% | |
Top Overall Models (Top 20)
Ranked by composite score (performance, cost, speed & stability). Click a model name to view its detail page.
| Score | Cost | Speed | Stability | ||
|---|---|---|---|---|---|
| Gemini 2.5 Flash Lite | 100% | $0.0002 | 1.5s | 100% | |
| Gemini 3.1 Flash Lite (Preview) | 100% | $0.0008 | 2.6s | 100% | |
| Gemini 2.5 Flash | 100% | $0.0010 | 2.4s | 100% | |
| Gemini 3.5 Flash Lite (Reasoning) | 100% | $0.0012 | 2.3s | 100% | |
| Gemini 3.5 Flash Lite (Reasoning, Minimal) | 100% | $0.0012 | 2.3s | 100% | |
| Mistral Small 3.2 24B | 100% | $0.0001 | 4.9s | 100% | |
| GPT-4o Mini (temp=0) | 100% | $0.0003 | 5.5s | 100% | |
| Gemini 3.1 Flash Lite (Reasoning) | 100% | $0.0007 | 5.1s | 100% | |
| Ministral 3 8B | 100% | $0.0002 | 6.6s | 100% | |
| Gemini 3.1 Flash Lite | 100% | $0.0007 | 5.6s | 100% | |
| Gemini 2.5 Flash (Reasoning) | 100% | $0.0017 | 3.7s | 100% | |
| GPT-6 Luna | 100% | $0.0003 | 6.7s | 100% | |
| DeepSeek V4.1 Flash (Reasoning, High) | 100% | $0.0005 | 6.2s | 100% | |
| Gemini 2.5 Flash Lite (Reasoning) | 100% | $0.0007 | 6.0s | 100% | |
| Laguna S 2.1 | 100% | $0.0001 | 7.3s | 100% | |
| GPT-6 Luna (Reasoning, High) | 100% | $0.0003 | 6.9s | 100% | |
| GPT-5.4 Nano | 100% | $0.0014 | 5.1s | 100% | |
| GPT-5.4 Mini | 100% | $0.0024 | 3.2s | 100% | |
| GPT-6 Luna (Reasoning, Medium) | 100% | $0.0003 | 7.4s | 100% | |
| GPT-5.4 Nano (Reasoning) | 100% | $0.0013 | 5.5s | 100% | |
| Model | Total â–¼ | Create alternate prose sections |
|---|---|---|
| Claude Opus 5.5 (Reasoning) | 100% | 100% |
| Qwen 3.8 Max (Reasoning, XHigh) | 100% | 100% |
| Gemini 3.8 Flash (Reasoning, Medium) | 100% | 100% |
| Z.AI GLM 5.3 (Reasoning, Max) | 100% | 100% |
| GPT-5.6 Sol (Reasoning, Medium) | 100% | 100% |
| Claude Opus 4.6 (Reasoning) | 100% | 100% |
| Gemini 3.6 Flash (Reasoning) | 100% | 100% |
| Gemini 3.7 Flash (Reasoning, Medium) | 100% | 100% |
| Hy4 Preview (Reasoning, High) | 100% | 100% |
| Muse Spark 1.2 (Reasoning, Medium) | 100% | 100% |
| Qwen 3.7 Max | 100% | 100% |
| DeepSeek V4.1 Flash (Reasoning, High) | 100% | 100% |
| Z.AI GLM 5.3 Flash (Reasoning, Max) | 100% | 100% |
| Grok 4.5 (Reasoning, High) | 100% | 100% |
| Gemini 3.1 Pro (Preview) | 100% | 100% |
Create alternate prose sections
Performance Score Distribution (Top 20)
Click a model name to view its detail page.
Price-Performance Score Distribution (Top 20)
Click a model name to view its detail page.
| Score | Cost | Time | ||
|---|---|---|---|---|
| Ministral 3B | 80% | $0.0000 | 2.1s | |
| Gemini 2.5 Flash Lite | 100% | $0.0002 | 1.5s | |
| Inception Mercury 2 | 97% | $0.0004 | 1.1s | |
| Mistral NeMO | 97% | $0.0001 | 3.2s | |
| Ministral 8B | 80% | $0.0001 | 6.9s | |
| Ministral 3 3B | 90% | $0.0001 | 3.6s | |
| Mistral Small 3.2 24B | 100% | $0.0001 | 4.9s | |
| GPT-4.1 Nano | 90% | $0.0001 | 4.0s | |
| Gemini 3.1 Flash Lite (Preview) | 100% | $0.0008 | 2.6s | |
| Gemini 3.1 Flash Lite (Reasoning) | 100% | $0.0007 | 5.1s | |
| Gemini 3.1 Flash Lite | 100% | $0.0007 | 5.6s | |
| Laguna S 2.1 | 100% | $0.0001 | 7.3s | |
| Gemini 2.5 Flash | 100% | $0.0010 | 2.4s | |
| GPT-4.1 Mini | 97% | $0.0006 | 4.3s | |
| GPT-4o Mini (temp=0) | 100% | $0.0003 | 5.5s | |
| Arcee AI: Trinity Mini | 97% | $0.0002 | 6.4s | |
| Gemini 3.5 Flash Lite (Reasoning) | 100% | $0.0012 | 2.3s | |
| GPT-4o Mini (temp=1) | 100% | $0.0003 | 8.0s | |
| Gemini 3.5 Flash Lite (Reasoning, Minimal) | 100% | $0.0012 | 2.3s | |
| Ministral 3 8B | 100% | $0.0002 | 6.6s | |
Most Stable Models (Top 20)
Ranked by stability (median × consistency). Click a model name to view its detail page.
| Score | Consistency | Stability | ||
|---|---|---|---|---|
| Claude Opus 5.5 (Reasoning) | 100% | 100% | 100% | |
| Qwen 3.8 Max (Reasoning, XHigh) | 100% | 100% | 100% | |
| Gemini 3.8 Flash (Reasoning, Medium) | 100% | 100% | 100% | |
| Z.AI GLM 5.3 (Reasoning, Max) | 100% | 100% | 100% | |
| GPT-5.6 Sol (Reasoning, Medium) | 100% | 100% | 100% | |
| Claude Opus 4.6 (Reasoning) | 100% | 100% | 100% | |
| Gemini 3.6 Flash (Reasoning) | 100% | 100% | 100% | |
| Gemini 3.7 Flash (Reasoning, Medium) | 100% | 100% | 100% | |
| Hy4 Preview (Reasoning, High) | 100% | 100% | 100% | |
| Muse Spark 1.2 (Reasoning, Medium) | 100% | 100% | 100% | |
| Qwen 3.7 Max | 100% | 100% | 100% | |
| DeepSeek V4.1 Flash (Reasoning, High) | 100% | 100% | 100% | |
| Z.AI GLM 5.3 Flash (Reasoning, Max) | 100% | 100% | 100% | |
| Grok 4.5 (Reasoning, High) | 100% | 100% | 100% | |
| Gemini 3.1 Pro (Preview) | 100% | 100% | 100% | |
| Muse Spark 1.3 (Reasoning, Medium) | 100% | 100% | 100% | |
| GPT-6 Luna (Reasoning, High) | 100% | 100% | 100% | |
| GPT-5.4 (Reasoning) | 100% | 100% | 100% | |
| Muse Spark 1.1 (Reasoning, Medium) | 100% | 100% | 100% | |
| Z.AI GLM 5.1 | 100% | 100% | 100% | |
Top Overall Models (Top 20)
Ranked by composite score (performance, cost, speed & stability). Click a model name to view its detail page.
| Score | Cost | Speed | Stability | ||
|---|---|---|---|---|---|
| Gemini 2.5 Flash Lite | 100% | $0.0002 | 1.5s | 100% | |
| Gemini 3.1 Flash Lite (Preview) | 100% | $0.0008 | 2.6s | 100% | |
| Gemini 2.5 Flash | 100% | $0.0010 | 2.4s | 100% | |
| Gemini 3.5 Flash Lite (Reasoning) | 100% | $0.0012 | 2.3s | 100% | |
| Gemini 3.5 Flash Lite (Reasoning, Minimal) | 100% | $0.0012 | 2.3s | 100% | |
| Mistral Small 3.2 24B | 100% | $0.0001 | 4.9s | 100% | |
| GPT-4o Mini (temp=0) | 100% | $0.0003 | 5.5s | 100% | |
| Gemini 3.1 Flash Lite (Reasoning) | 100% | $0.0007 | 5.1s | 100% | |
| Ministral 3 8B | 100% | $0.0002 | 6.6s | 100% | |
| Gemini 3.1 Flash Lite | 100% | $0.0007 | 5.6s | 100% | |
| Gemini 2.5 Flash (Reasoning) | 100% | $0.0017 | 3.7s | 100% | |
| GPT-6 Luna | 100% | $0.0003 | 6.7s | 100% | |
| DeepSeek V4.1 Flash (Reasoning, High) | 100% | $0.0005 | 6.2s | 100% | |
| Gemini 2.5 Flash Lite (Reasoning) | 100% | $0.0007 | 6.0s | 100% | |
| Laguna S 2.1 | 100% | $0.0001 | 7.3s | 100% | |
| GPT-6 Luna (Reasoning, High) | 100% | $0.0003 | 6.9s | 100% | |
| GPT-5.4 Nano | 100% | $0.0014 | 5.1s | 100% | |
| GPT-5.4 Mini | 100% | $0.0024 | 3.2s | 100% | |
| GPT-6 Luna (Reasoning, Medium) | 100% | $0.0003 | 7.4s | 100% | |
| GPT-5.4 Nano (Reasoning) | 100% | $0.0013 | 5.5s | 100% | |
| Median | Evaluator | Top 3 | Flop 3 |
|---|---|---|---|
| 100.0% | Match blue prose section | ||
| 100.0% | Match green prose section | ||
| 100.0% | Match red prose section |