mistralai/ministral-3b-2512
Ministral 3 3BRelease Date
Dec 2nd, 2025Context Size
131kBenchmark Cost
$0.13Speed
227.0 tok/sCreative writing
59.51%Rule following
62.07%Utility
57.88%Mathematics
90.00%Tooling
60.81%Language
87.03%Logic
64.51%Bad Writing Habits
Detects common prose quality anti-patterns in AI-generated creative writing, including passive voice, past progressive overuse, weak dialogue tags, filter words, purple prose, cliches, AI-ism words/adverbs/names, and more.
| Scenario | #1 | #2 | #3 | #4 | #5 | Total |
|---|---|---|---|---|---|---|
| Detailed Writing Rules | ||||||
| 69 | 68 | 67 | 62 | 59 | 65% | |
| 83 | 83 | 81 | 80 | 79 | 81% | |
| 84 | 79 | 76 | 75 | 71 | 77% | |
| 80 | 77 | 74 | 72 | 72 | 75% | |
| 81 | 79 | 78 | 76 | 70 | 77% | |
| 79 | 78 | 76 | 75 | 67 | 75% | |
| Detailed Writing Rules | 75.04% | |||||
| genre | ||||||
| 73 | 69 | 68 | 65 | 65 | 68% | |
| 81 | 81 | 80 | 77 | 69 | 78% | |
| 80 | 78 | 75 | 72 | 72 | 76% | |
| 80 | 78 | 75 | 73 | 71 | 75% | |
| 82 | 80 | 79 | 79 | 75 | 79% | |
| 84 | 76 | 74 | 73 | 70 | 75% | |
| genre | 75.18% | |||||
| Novelcrafter Default Prompt | ||||||
| 77 | 76 | 70 | 67 | 67 | 71% | |
| 77 | 77 | 73 | 68 | 65 | 72% | |
| 82 | 82 | 82 | 78 | 68 | 78% | |
| 77 | 75 | 74 | 73 | 70 | 74% | |
| 81 | 78 | 76 | 76 | 74 | 77% | |
| 82 | 79 | 78 | 77 | 74 | 78% | |
| Novelcrafter Default Prompt | 75.14% | |||||
| 75.12% | ||||||
Codex Violation Detection
Detects factual inconsistencies between a story bible and prose passages. The model must output structured XML identifying each violation with paragraph number and substring.
| Scenario | #1 | #2 | #3 | #4 | #5 | #6 | #7 | #8 | #9 | #10 | Total |
|---|---|---|---|---|---|---|---|---|---|---|---|
| matrix | |||||||||||
| 47 | 46 | 44 | 42 | 41 | 41 | 41 | 40 | 38 | 38 | 42% | |
| 80 | 77 | 76 | 76 | 72 | 67 | 57 | 54 | 48 | 35 | 64% | |
| 75 | 71 | 71 | 67 | 67 | 67 | 66 | 62 | 62 | 61 | 67% | |
| 84 | 84 | 84 | 84 | 80 | 80 | 79 | 76 | 70 | 62 | 78% | |
| matrix | 62.77% | ||||||||||
| tiers | |||||||||||
| 83 | 83 | 76 | 69 | 67 | 67 | 63 | 60 | 44 | 42 | 65% | |
| 86 | 56 | 53 | 52 | 52 | 49 | 41 | 41 | 39 | 37 | 51% | |
| 62 | 60 | 59 | 59 | 56 | 55 | 47 | 43 | 42 | 41 | 52% | |
| 83 | 83 | 83 | 80 | 75 | 72 | 71 | 67 | 60 | 53 | 73% | |
| tiers | 60.26% | ||||||||||
| 61.52% | |||||||||||
Data extraction
Extract key details from a given block of text.
| Scenario | #1 | #2 | #3 | #4 | #5 | #6 | #7 | #8 | #9 | #10 | Total |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% | |
| 50 | 50 | 50 | 50 | 50 | 50 | 50 | 50 | 50 | 50 | 50% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 50 | 50 | 90% | |
| 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% | |
| 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% | |
| 78.33% | |||||||||||
Dialogue tags
Various tasks related to dialogue tags in text.
| Scenario | #1 | #2 | #3 | #4 | #5 | #6 | #7 | #8 | #9 | #10 | Total |
|---|---|---|---|---|---|---|---|---|---|---|---|
| dialogue-200 | |||||||||||
| 98 | 98 | 92 | 70 | 50 | 34 | 9 | 5 | 5 | 0 | 46% | |
| 50 | 34 | 10 | 7 | 7 | 5 | 1 | 0 | 0 | 0 | 11% | |
| 68 | 48 | 25 | 18 | 1 | 0 | 0 | 0 | 0 | 0 | 16% | |
| dialogue-200 | 24.49% | ||||||||||
| dialogue-500 | |||||||||||
| 52 | 46 | 13 | 3 | 2 | 0 | 0 | 0 | 0 | 0 | 12% | |
| 50 | 48 | 44 | 25 | 22 | 3 | 0 | 0 | 0 | 0 | 19% | |
| 14 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1% | |
| dialogue-500 | 10.75% | ||||||||||
| Ungrouped | |||||||||||
| 61 | 61 | 61 | 61 | 14 | 14 | 14 | 14 | 1 | 0 | 30% | |
| 19.36% | |||||||||||
Language Comprehension
Does the model understand more than just English?
| Scenario | #1 | #2 | #3 | #4 | #5 | Total |
|---|---|---|---|---|---|---|
| 100 | 100 | 100 | 100 | 100 | 100% | |
| 100 | 100 | 100 | 100 | 100 | 100% | |
| 100 | 100 | 100 | 100 | 100 | 100% | |
| 100 | 100 | 100 | 100 | 100 | 100% | |
| 100.00% | ||||||
Language Writing
Can the model generate text in different languages?
| Scenario | #1 | #2 | #3 | #4 | #5 | Total |
|---|---|---|---|---|---|---|
| 100 | 100 | 100 | 100 | 0 | 80% | |
| 100 | 100 | 90 | 0 | 0 | 58% | |
| 100 | 100 | 67 | 67 | 0 | 67% | |
| 100 | 100 | 100 | 93 | 0 | 79% | |
| 100 | 100 | 100 | 100 | 100 | 100% | |
| 76.65% | ||||||
N-Length Sentences
Write sentences with exactly N words
| Scenario | #1 | #2 | #3 | #4 | #5 | #6 | #7 | #8 | #9 | #10 | Total |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 93 | 84 | 74 | 74 | 64 | 63 | 56 | 56 | 52 | 50 | 66% | |
| 82 | 78 | 65 | 64 | 58 | 56 | 54 | 53 | 15 | 7 | 53% | |
| 23 | 19 | 10 | 4 | 2 | 2 | 0 | 0 | 0 | 0 | 6% | |
| 41.79% | |||||||||||
Novel outline
Handle questions about the outline of a novel in various formats
| Scenario | #1 | #2 | #3 | #4 | #5 | #6 | #7 | #8 | #9 | #10 | Total |
|---|---|---|---|---|---|---|---|---|---|---|---|
| outline-count | |||||||||||
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% | |
| 100 | 100 | 100 | 100 | 100 | 0 | 0 | 0 | 0 | 0 | 50% | |
| outline-count | 83.33% | ||||||||||
| pov-count | |||||||||||
| 100 | 50 | 50 | 50 | 50 | 50 | 50 | 0 | 0 | 0 | 40% | |
| 100 | 100 | 100 | 100 | 0 | 0 | 0 | 0 | 0 | 0 | 40% | |
| 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0% | |
| pov-count | 26.67% | ||||||||||
| 55.00% | |||||||||||
Tool usage within Novelcrafter
Output messages that are related to tool usage within Novelcrafter
| Scenario | #1 | #2 | #3 | #4 | #5 | #6 | #7 | #8 | #9 | #10 | Total |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 0 | 90% | |
| 90.00% | |||||||||||
Voice/dialogue sheets
Extract dialogue from given text as voice sheets.
| Scenario | #1 | #2 | #3 | #4 | #5 | #6 | #7 | #8 | #9 | #10 | Total |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0% | |
| 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0% | |
| 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0% | |
| 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0% | |
| 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0% | |
| 0.00% | |||||||||||
Write N of X
Write exactly N words/sentences/paragraphs...
| Scenario | #1 | #2 | #3 | #4 | #5 | #6 | #7 | #8 | #9 | #10 | Total |
|---|---|---|---|---|---|---|---|---|---|---|---|
| paragraphs | |||||||||||
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% | |
| paragraphs | 100.00% | ||||||||||
| sentences | |||||||||||
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 98 | 100% | |
| 100 | 100 | 100 | 100 | 100 | 92 | 54 | 2 | 2 | 0 | 65% | |
| 92 | 2 | 2 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 10% | |
| sentences | 74.85% | ||||||||||
| words | |||||||||||
| 100 | 100 | 100 | 100 | 98 | 98 | 98 | 98 | 98 | 77 | 97% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 98 | 100% | |
| 92 | 77 | 27 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 20% | |
| 98 | 92 | 92 | 54 | 27 | 0 | 0 | 0 | 0 | 0 | 36% | |
| 92 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 9% | |
| words | 52.40% | ||||||||||
| 72.02% | |||||||||||