x-ai/grok-4.1-fast
Grok 4.1 FastRelease Date
Nov 19th, 2025Context Size
2mBenchmark Cost
$0.58Speed
116.2 tok/sCreative writing
72.22%Rule following
80.37%Utility
87.75%Mathematics
100.00%Tooling
91.54%Language
90.35%Logic
90.50%Bad Writing Habits
Detects common prose quality anti-patterns in AI-generated creative writing, including passive voice, past progressive overuse, weak dialogue tags, filter words, purple prose, cliches, AI-ism words/adverbs/names, and more.
| Scenario | #1 | #2 | #3 | #4 | #5 | Total |
|---|---|---|---|---|---|---|
| Detailed Writing Rules | ||||||
| 79 | 78 | 78 | 78 | 75 | 78% | |
| 89 | 83 | 83 | 79 | 78 | 82% | |
| 88 | 85 | 85 | 85 | 82 | 85% | |
| 89 | 88 | 87 | 84 | 83 | 86% | |
| 92 | 88 | 86 | 85 | 81 | 86% | |
| 87 | 85 | 83 | 82 | 78 | 83% | |
| Detailed Writing Rules | 83.50% | |||||
| genre | ||||||
| 76 | 76 | 76 | 74 | 72 | 75% | |
| 85 | 80 | 80 | 78 | 78 | 80% | |
| 83 | 82 | 81 | 81 | 80 | 82% | |
| 84 | 83 | 80 | 79 | 75 | 81% | |
| 82 | 80 | 80 | 77 | 76 | 79% | |
| 83 | 82 | 80 | 76 | 73 | 79% | |
| genre | 79.08% | |||||
| Novelcrafter Default Prompt | ||||||
| 82 | 81 | 78 | 77 | 74 | 78% | |
| 86 | 83 | 82 | 82 | 73 | 81% | |
| 89 | 85 | 85 | 82 | 82 | 85% | |
| 84 | 83 | 80 | 79 | 78 | 81% | |
| 83 | 81 | 80 | 80 | 79 | 81% | |
| 85 | 85 | 85 | 85 | 84 | 85% | |
| Novelcrafter Default Prompt | 81.74% | |||||
| 81.44% | ||||||
Codex Violation Detection
Detects factual inconsistencies between a story bible and prose passages. The model must output structured XML identifying each violation with paragraph number and substring.
| Scenario | #1 | #2 | #3 | #4 | #5 | #6 | #7 | #8 | #9 | #10 | Total |
|---|---|---|---|---|---|---|---|---|---|---|---|
| matrix | |||||||||||
| 100 | 99 | 98 | 97 | 97 | 95 | 95 | 94 | 90 | 90 | 95% | |
| 98 | 98 | 98 | 96 | 96 | 96 | 96 | 95 | 94 | 93 | 96% | |
| 100 | 100 | 97 | 95 | 95 | 92 | 92 | 88 | 87 | 79 | 93% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 97 | 97 | 99% | |
| matrix | 95.84% | ||||||||||
| tiers | |||||||||||
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% | |
| 97 | 97 | 97 | 97 | 97 | 94 | 94 | 92 | 91 | 91 | 95% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% | |
| tiers | 98.67% | ||||||||||
| 97.25% | |||||||||||
Data extraction
Extract key details from a given block of text.
| Scenario | #1 | #2 | #3 | #4 | #5 | #6 | #7 | #8 | #9 | #10 | Total |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% | |
| 100 | 100 | 100 | 50 | 50 | 50 | 50 | 50 | 50 | 50 | 65% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 50 | 50 | 50 | 50 | 80% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 50 | 50 | 50 | 50 | 80% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 50 | 50 | 90% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% | |
| 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% | |
| 84.58% | |||||||||||
Dialogue tags
Various tasks related to dialogue tags in text.
| Scenario | #1 | #2 | #3 | #4 | #5 | #6 | #7 | #8 | #9 | #10 | Total |
|---|---|---|---|---|---|---|---|---|---|---|---|
| dialogue-200 | |||||||||||
| 99 | 50 | 50 | 50 | 50 | 49 | 47 | 45 | 45 | 43 | 53% | |
| 99 | 93 | 81 | 69 | 68 | 60 | 53 | 50 | 49 | 7 | 63% | |
| 100 | 94 | 89 | 86 | 77 | 70 | 64 | 63 | 57 | 32 | 73% | |
| dialogue-200 | 62.91% | ||||||||||
| dialogue-500 | |||||||||||
| 50 | 43 | 34 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 13% | |
| 50 | 3 | 1 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 5% | |
| 93 | 48 | 41 | 38 | 31 | 27 | 25 | 15 | 7 | 3 | 33% | |
| dialogue-500 | 16.97% | ||||||||||
| Ungrouped | |||||||||||
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% | |
| 48.52% | |||||||||||
Language Comprehension
Does the model understand more than just English?
| Scenario | #1 | #2 | #3 | #4 | #5 | Total |
|---|---|---|---|---|---|---|
| 100 | 100 | 100 | 100 | 100 | 100% | |
| 100 | 100 | 100 | 0 | 0 | 60% | |
| 100 | 100 | 100 | 100 | 100 | 100% | |
| 100 | 100 | 100 | 100 | 100 | 100% | |
| 90.00% | ||||||
Language Writing
Can the model generate text in different languages?
| Scenario | #1 | #2 | #3 | #4 | #5 | Total |
|---|---|---|---|---|---|---|
| 100 | 100 | 100 | 100 | 100 | 100% | |
| 100 | 100 | 100 | 100 | 100 | 100% | |
| 56 | 56 | 55 | 50 | 50 | 53% | |
| 100 | 100 | 100 | 100 | 100 | 100% | |
| 100 | 100 | 100 | 100 | 100 | 100% | |
| 90.63% | ||||||
N-Length Sentences
Write sentences with exactly N words
| Scenario | #1 | #2 | #3 | #4 | #5 | #6 | #7 | #8 | #9 | #10 | Total |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 100 | 99 | 91 | 80 | 78 | 78 | 78 | 78 | 78 | 78 | 84% | |
| 100 | 100 | 97 | 95 | 94 | 91 | 90 | 85 | 84 | 84 | 92% | |
| 100 | 90 | 85 | 22 | 19 | 15 | 3 | 1 | 0 | 0 | 33% | |
| 69.73% | |||||||||||
Novel outline
Handle questions about the outline of a novel in various formats
| Scenario | #1 | #2 | #3 | #4 | #5 | #6 | #7 | #8 | #9 | #10 | Total |
|---|---|---|---|---|---|---|---|---|---|---|---|
| outline-count | |||||||||||
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% | |
| outline-count | 100.00% | ||||||||||
| pov-count | |||||||||||
| 50 | 50 | 50 | 50 | 50 | 50 | 50 | 0 | 0 | 0 | 35% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 0 | 0 | 80% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 0 | 0 | 80% | |
| pov-count | 65.00% | ||||||||||
| 82.50% | |||||||||||
Tool usage within Novelcrafter
Output messages that are related to tool usage within Novelcrafter
| Scenario | #1 | #2 | #3 | #4 | #5 | #6 | #7 | #8 | #9 | #10 | Total |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% | |
| 100.00% | |||||||||||
Voice/dialogue sheets
Extract dialogue from given text as voice sheets.
| Scenario | #1 | #2 | #3 | #4 | #5 | #6 | #7 | #8 | #9 | #10 | Total |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 100 | 100 | 100 | 100 | 100 | 100 | 0 | 0 | 0 | 0 | 60% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 0 | 0 | 80% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 0 | 0 | 80% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% | |
| 84.00% | |||||||||||
Write N of X
Write exactly N words/sentences/paragraphs...
| Scenario | #1 | #2 | #3 | #4 | #5 | #6 | #7 | #8 | #9 | #10 | Total |
|---|---|---|---|---|---|---|---|---|---|---|---|
| paragraphs | |||||||||||
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% | |
| paragraphs | 100.00% | ||||||||||
| sentences | |||||||||||
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 54 | 27 | 88% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 0 | 90% | |
| sentences | 95.61% | ||||||||||
| words | |||||||||||
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 98 | 98 | 98 | 100% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 98 | 98 | 92 | 27 | 92% | |
| 98 | 92 | 92 | 77 | 77 | 9 | 9 | 9 | 0 | 0 | 47% | |
| 98 | 98 | 92 | 9 | 0 | 0 | 0 | 0 | 0 | 0 | 30% | |
| words | 73.49% | ||||||||||
| 88.11% | |||||||||||