x-ai/grok-4-fast

Grok 4 Fast

Release Date

Sep 19th, 2025

Context Size

2m

Benchmark Cost

$0.49

Speed

151.9 tok/s

Creative writing

67.49%

Rule following

76.56%

Utility

81.64%

Mathematics

100.00%

Tooling

72.83%

Language

87.52%

Logic

91.72%

Bad Writing Habits

Detects common prose quality anti-patterns in AI-generated creative writing, including passive voice, past progressive overuse, weak dialogue tags, filter words, purple prose, cliches, AI-ism words/adverbs/names, and more.

Scenario #1 #2 #3 #4 #5 Total
Detailed Writing Rules
0-shot Creative writingRule following
797675747275%
0-shot Creative writingRule following
797775757376%
0-shot Creative writingRule following
838180777379%
0-shot Creative writingRule following
757572696872%
0-shot Creative writingRule following
818078787679%
0-shot Creative writingRule following
807978787778%
Detailed Writing Rules76.44%
genre
0-shot Creative writingRule following
737372716871%
0-shot Creative writingRule following
818078726876%
0-shot Creative writingRule following
807979787678%
0-shot Creative writingRule following
828275746976%
0-shot Creative writingRule following
828079797479%
0-shot Creative writingRule following
858375746777%
genre76.27%
Novelcrafter Default Prompt
0-shot Creative writingRule following
777773727074%
0-shot Creative writingRule following
808078737177%
0-shot Creative writingRule following
858382828082%
0-shot Creative writingRule following
818075737276%
0-shot Creative writingRule following
828079787779%
0-shot Creative writingRule following
848178757178%
Novelcrafter Default Prompt77.59%
76.77%

Codex Violation Detection

Detects factual inconsistencies between a story bible and prose passages. The model must output structured XML identifying each violation with paragraph number and substring.

Scenario #1 #2 #3 #4 #5 #6 #7 #8 #9 #10 Total
matrix
0-shot ToolingUtilityLogicRule following
100100999796959492919096%
0-shot ToolingUtilityLogicRule following
9898989696969696969397%
0-shot ToolingUtilityLogicRule following
100100959593929292878393%
0-shot ToolingUtilityLogicRule following
100100100100100100100100979799%
matrix96.13%
tiers
0-shot ToolingUtilityLogicRule following
1001001001001001001001001009199%
0-shot ToolingUtilityLogicRule following
1001001001001001001001001006997%
0-shot ToolingUtilityLogicRule following
1009797979796949494387%
0-shot ToolingUtilityLogicRule following
100100100100100100100100100100100%
tiers95.73%
95.93%

Dialogue tags

Various tasks related to dialogue tags in text.

Scenario #1 #2 #3 #4 #5 #6 #7 #8 #9 #10 Total
dialogue-200
0-shot Creative writingRule following
5049494747414138221840%
0-shot Creative writingRule following
4848464030211487527%
0-shot Creative writingRule following
8156504331181482230%
dialogue-20032.37%
dialogue-500
0-shot Creative writingRule following
504948262210000021%
0-shot Creative writingRule following
515050505010921027%
0-shot Creative writingRule following
9792897467504743371161%
dialogue-50036.15%
Ungrouped
0-shot Creative writingRule following
100100100100100100100100100100100%
43.65%

Language Comprehension

Does the model understand more than just English?

Scenario #1 #2 #3 #4 #5 Total
0-shot Language
100100100100100100%
0-shot Language
10010000040%
0-shot Language
100100100100100100%
0-shot Language
100100100100100100%
85.00%

Language Writing

Can the model generate text in different languages?

Scenario #1 #2 #3 #4 #5 Total
0-shot Language
100100100100100100%
0-shot Language
1001001001008697%
0-shot Language
575650454451%
0-shot Language
100100100100100100%
0-shot Language
100100100100100100%
89.53%

N-Length Sentences

Write sentences with exactly N words

Scenario #1 #2 #3 #4 #5 #6 #7 #8 #9 #10 Total
0-shot Rule following
8978787878787070675374%
0-shot Rule following
9392909090907268483577%
0-shot Rule following
36231688100009%
53.24%

Novel outline

Handle questions about the outline of a novel in various formats

Scenario #1 #2 #3 #4 #5 #6 #7 #8 #9 #10 Total
outline-count
0-shot ToolingUtility
1001001001001001001001000080%
0-shot ToolingUtility
10010010010000000040%
0-shot ToolingUtility
10010010010010010010000070%
outline-count63.33%
pov-count
0-shot ToolingUtility
10050505000000025%
0-shot ToolingUtility
00000000000%
0-shot ToolingUtility
10000000000010%
pov-count11.67%
37.50%

Tool usage within Novelcrafter

Output messages that are related to tool usage within Novelcrafter

Scenario #1 #2 #3 #4 #5 #6 #7 #8 #9 #10 Total
0-shot ToolingUtility
100100100100100100100100100100100%
100.00%

Voice/dialogue sheets

Extract dialogue from given text as voice sheets.

Scenario #1 #2 #3 #4 #5 #6 #7 #8 #9 #10 Total
0-shot Utility
100100100100100100000060%
0-shot Utility
1001001001001001001001000080%
1-shot Utility
100100100100100100100100100090%
Few-shot Utility
100100100100100100100100100090%
0-shot Utility
100100100100100100100100100100100%
84.00%

Write N of X

Write exactly N words/sentences/paragraphs...

Scenario #1 #2 #3 #4 #5 #6 #7 #8 #9 #10 Total
paragraphs
0-shot Rule following
100100100100100100100100100100100%
0-shot Rule following
100100100100100100100100100100100%
0-shot Rule following
100100100100100100100100100100100%
paragraphs100.00%
sentences
0-shot Rule following
100100100100100100100100100100100%
0-shot Rule following
100100100100100100100100100100100%
0-shot Rule following
100100100100100100100100100100100%
0-shot Rule following
1001001001001001001001009898100%
0-shot Rule following
1001001001001000000050%
sentences89.92%
words
0-shot Rule following
100100100100100100100100100100100%
0-shot Rule following
1001001001001001001001001009299%
0-shot Rule following
1001001009898929292929296%
0-shot Rule following
10010010010098989877775490%
0-shot Rule following
99200000002%
words77.44%
87.45%