aion-labs/aion-3.5-mini
Aion 3.5 Mini (Reasoning, High)Release Date
Sep 23rd, 2026Context Size
262kReasoning
YesBenchmark Cost
$5.39Speed
46.0 tok/sCategories
Subcategories
Bad Writing Habits
Detects common prose quality anti-patterns in AI-generated creative writing, including passive voice, past progressive overuse, weak dialogue tags, filter words, purple prose, cliches, AI-ism words/adverbs/names, and more.
| Scenario | #1 | #2 | #3 | #4 | #5 | Total |
|---|---|---|---|---|---|---|
| Detailed Writing Rules | ||||||
| 96 | 94 | 93 | 90 | 89 | 92% | |
| 96 | 96 | 93 | 93 | 90 | 94% | |
| 99 | 93 | 89 | 85 | 83 | 90% | |
| 95 | 94 | 92 | 90 | 89 | 92% | |
| 91 | 90 | 88 | 85 | 82 | 87% | |
| 98 | 94 | 92 | 91 | 85 | 92% | |
| Detailed Writing Rules | 91.19% | |||||
| genre | ||||||
| 87 | 85 | 84 | 82 | 82 | 84% | |
| 90 | 82 | 80 | 80 | 78 | 82% | |
| 88 | 85 | 82 | 80 | 78 | 83% | |
| 90 | 88 | 87 | 86 | 83 | 87% | |
| 86 | 85 | 83 | 75 | 75 | 81% | |
| 89 | 88 | 86 | 79 | 74 | 83% | |
| genre | 83.25% | |||||
| Novelcrafter Default Prompt | ||||||
| 91 | 87 | 85 | 84 | 71 | 84% | |
| 91 | 89 | 89 | 88 | 86 | 88% | |
| 89 | 89 | 87 | 87 | 86 | 88% | |
| 90 | 89 | 88 | 88 | 87 | 88% | |
| 86 | 85 | 81 | 80 | 79 | 82% | |
| 95 | 94 | 84 | 82 | 79 | 87% | |
| Novelcrafter Default Prompt | 86.16% | |||||
| 86.87% | ||||||
Codex Extraction
Evaluates a model's ability to extract structured codex entries (characters, locations, objects, lore) from prose passages and return them as well-formed XML.
| Scenario | #1 | #2 | #3 | #4 | #5 | Total |
|---|---|---|---|---|---|---|
| 98 | 97 | 97 | 97 | 97 | 97% | |
| 98 | 98 | 97 | 97 | 96 | 97% | |
| 99 | 98 | 98 | 98 | 97 | 98% | |
| 99 | 99 | 99 | 99 | 95 | 98% | |
| 97.65% | ||||||
Codex Red Herring (False Positive Detection)
Tests whether models correctly report "no violations" when a codex is fully consistent with the prose passage. Models that hallucinate false violations (false positives) fail. Uses a 2×2 matrix of text length × codex size, with bare and detailed-entry variants.
| Scenario | #1 | #2 | #3 | #4 | #5 | #6 | #7 | #8 | #9 | #10 | Total |
|---|---|---|---|---|---|---|---|---|---|---|---|
| basic entries | |||||||||||
| 100 | 100 | 100 | 17 | 17 | 17 | 17 | 17 | 17 | – | 44% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% | |
| basic entries | 86.11% | ||||||||||
| detailed entries | |||||||||||
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 25 | 93% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 25 | 25 | 85% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 25 | 25 | 25 | 25 | 70% | |
| detailed entries | 86.87% | ||||||||||
| 86.49% | |||||||||||
Codex Violation Detection
Detects factual inconsistencies between a story bible and prose passages. The model must output structured XML identifying each violation with paragraph number and substring.
| Scenario | #1 | #2 | #3 | #4 | #5 | #6 | #7 | #8 | #9 | #10 | Total |
|---|---|---|---|---|---|---|---|---|---|---|---|
| matrix | |||||||||||
| 100 | 100 | 100 | 100 | 99 | 99 | 99 | 99 | 97 | 94 | 99% | |
| 100 | 98 | 97 | 97 | 97 | 96 | 96 | 93 | 93 | 93 | 96% | |
| 100 | 100 | 100 | 100 | 97 | 95 | 95 | 95 | 95 | 87 | 97% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 95 | 100% | |
| matrix | 97.72% | ||||||||||
| tiers | |||||||||||
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 91 | 99% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 0 | 90% | |
| 100 | 100 | 100 | 100 | 97 | 96 | 92 | 92 | 88 | 88 | 95% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% | |
| tiers | 96.12% | ||||||||||
| 96.92% | |||||||||||
Data extraction
Extract key details from a given block of text.
| Scenario | #1 | #2 | #3 | #4 | #5 | #6 | #7 | #8 | #9 | #10 | Total |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 50 | 95% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 50 | 50 | 90% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 50 | 50 | 90% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 50 | 50 | 90% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 50 | 0 | 85% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 50 | 95% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% | |
| 95.00% | |||||||||||
Dialogue tags
Various tasks related to dialogue tags in text.
| Scenario | #1 | #2 | #3 | #4 | #5 | #6 | #7 | #8 | #9 | #10 | Total |
|---|---|---|---|---|---|---|---|---|---|---|---|
| dialogue-200 | |||||||||||
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 97 | 18 | 92% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 99 | 71 | 0 | 87% | |
| 100 | 100 | 100 | 100 | 99 | 97 | 91 | 90 | 82 | 80 | 94% | |
| dialogue-200 | 90.80% | ||||||||||
| dialogue-500 | |||||||||||
| 98 | 93 | 90 | 86 | 79 | 50 | 48 | 48 | 32 | 26 | 65% | |
| 90 | 89 | 83 | 50 | 50 | 47 | 22 | 3 | 2 | 0 | 44% | |
| 51 | 50 | 50 | 46 | 19 | 5 | 4 | 0 | 0 | 0 | 23% | |
| dialogue-500 | 43.71% | ||||||||||
| Ungrouped | |||||||||||
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 0 | 90% | |
| 70.50% | |||||||||||
Language Comprehension
Does the model understand more than just English?
| Scenario | #1 | #2 | #3 | #4 | #5 | Total |
|---|---|---|---|---|---|---|
| 100 | 100 | 100 | 100 | 100 | 100% | |
| 100 | 100 | 100 | 100 | 100 | 100% | |
| 100 | 100 | 100 | 100 | 100 | 100% | |
| 100 | 100 | 100 | 100 | 100 | 100% | |
| 100.00% | ||||||
Language Writing
Can the model generate text in different languages?
| Scenario | #1 | #2 | #3 | #4 | #5 | Total |
|---|---|---|---|---|---|---|
| 100 | 100 | 100 | 100 | 100 | 100% | |
| 100 | 100 | 100 | 100 | 96 | 99% | |
| 100 | 100 | 100 | 100 | 47 | 89% | |
| 100 | 100 | 100 | 100 | 100 | 100% | |
| 100 | 100 | 100 | 100 | 100 | 100% | |
| 97.69% | ||||||
N-Length Sentences
Write sentences with exactly N words
| Scenario | #1 | #2 | #3 | #4 | #5 | #6 | #7 | #8 | #9 | #10 | Total |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 95 | 91 | 67 | 95% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% | |
| 98.42% | |||||||||||
Novel outline
Handle questions about the outline of a novel in various formats
| Scenario | #1 | #2 | #3 | #4 | #5 | #6 | #7 | #8 | #9 | #10 | Total |
|---|---|---|---|---|---|---|---|---|---|---|---|
| outline-count | |||||||||||
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 0 | 90% | |
| outline-count | 96.67% | ||||||||||
| pov-count | |||||||||||
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 50 | 95% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% | |
| pov-count | 98.33% | ||||||||||
| 97.50% | |||||||||||
Relationship tree
Extracts a deterministic XML family and relationship tree from cumulative literary prose.
| Scenario | #1 | #2 | #3 | #4 | #5 | Total |
|---|---|---|---|---|---|---|
| 98 | 98 | 97 | 86 | 85 | 93% | |
| 84 | 82 | 82 | 82 | 46 | 75% | |
| 84.17% | ||||||
Text Replacement
Tests deterministic text transformations: renaming characters/locations, expanding contractions, tense rewriting, POV shifts, gender swaps, combined transformations, and word avoidance. Scored by checking each expected change independently.
| Scenario | #1 | #2 | #3 | #4 | #5 | #6 | #7 | Total |
|---|---|---|---|---|---|---|---|---|
| Generic Prompt | ||||||||
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% | |
| 99 | 99 | 99 | 99 | 99 | 99 | 98 | 99% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 99 | 100% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 33 | 90% | |
| 100 | 100 | 99 | 99 | 99 | 99 | 99 | 100% | |
| 97 | 97 | 96 | 96 | 96 | 95 | 95 | 96% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 99 | 100% | |
| 100 | 100 | 100 | 100 | 100 | 99 | 99 | 100% | |
| Generic Prompt | 98.26% | |||||||
| Specific Prompt | ||||||||
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% | |
| 100 | 99 | 99 | 99 | 99 | 99 | 99 | 99% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 99 | 100% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 33 | 90% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% | |
| 99 | 99 | 98 | 98 | 98 | 98 | 96 | 98% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 33 | 90% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% | |
| Specific Prompt | 97.62% | |||||||
| 97.94% | ||||||||
Tool usage within Novelcrafter
Output messages that are related to tool usage within Novelcrafter
| Scenario | #1 | #2 | #3 | #4 | #5 | #6 | #7 | #8 | #9 | #10 | Total |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% | |
| 100.00% | |||||||||||
Voice/dialogue sheets
Extract dialogue from given text as voice sheets.
| Scenario | #1 | #2 | #3 | #4 | #5 | #6 | #7 | #8 | #9 | #10 | Total |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 0 | 0 | 0 | 70% | |
| 100 | 100 | 100 | 100 | 100 | 0 | 0 | 0 | 0 | 0 | 50% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 0 | 90% | |
| 82.00% | |||||||||||
Write N of X
Write exactly N words/sentences/paragraphs...
| Scenario | #1 | #2 | #3 | #4 | #5 | #6 | #7 | #8 | #9 | #10 | Total |
|---|---|---|---|---|---|---|---|---|---|---|---|
| paragraphs | |||||||||||
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% | |
| paragraphs | 100.00% | ||||||||||
| sentences | |||||||||||
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 92 | 0 | 89% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 98 | 77 | 0 | 88% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 27 | 0 | 83% | |
| sentences | 91.90% | ||||||||||
| words | |||||||||||
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 77 | 0 | 0 | 0 | 68% | |
| 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 98 | 0 | 90% | |
| words | 91.51% | ||||||||||
| 93.62% | |||||||||||