aion-labs/aion-3.5

Aion 3.5 (Reasoning, High)

Release Date

Sep 23rd, 2026

Context Size

262k

Reasoning

Yes

Benchmark Cost

$11.61

Speed

43.1 tok/s

Categories

20%40%60%80%100%Creative Writing86.2%Tooling97.4%Language99.9%Utility95.8%Reasoning85.0%Text Editing98.5%Rule Following76.2%Hallucination96.1%

Subcategories

20%40%60%80%100%AI-ismsProse VarietyDialoguePurple ProseMechanical StyleClichésXMLComprehensionGenerationWord CountingSentence CountingParagraph CountingStructural CountingData ExtractionDeductionAttentionTransformationPreservationStructural IntegrityConstraint AdherenceFalse PositivesContent InventionOutput Corruption

Bad Writing Habits

Detects common prose quality anti-patterns in AI-generated creative writing, including passive voice, past progressive overuse, weak dialogue tags, filter words, purple prose, cliches, AI-ism words/adverbs/names, and more.

Scenario #1 #2 #3 #4 #5 Total
Detailed Writing Rules
898887848386%
929189868388%
928988868488%
939392929092%
939189898890%
919190898890%
Detailed Writing Rules88.88%
genre
878583828083%
848276767579%
888582807682%
898181807982%
868281817882%
848079767478%
genre81.02%
Novelcrafter Default Prompt
898885838185%
878684847984%
878585828184%
918886858387%
868483827882%
878686838285%
Novelcrafter Default Prompt84.57%
84.82%

Codex Extraction

Evaluates a model's ability to extract structured codex entries (characters, locations, objects, lore) from prose passages and return them as well-formed XML.

Scenario #1 #2 #3 #4 #5 Total
1009998989698%
989898979697%
10010099999899%
100100100999999%
98.48%

Relationship tree

Extracts a deterministic XML family and relationship tree from cumulative literary prose.

Scenario #1 #2 #3 #4 #5 Total
989887867389%
858382794675%
82.01%

Text Replacement

Tests deterministic text transformations: renaming characters/locations, expanding contractions, tense rewriting, POV shifts, gender swaps, combined transformations, and word avoidance. Scored by checking each expected change independently.

Scenario #1 #2 #3 #4 #5 #6 #7 Total
Generic Prompt
1001001001001001005894%
100100100100100100100100%
9999989898989898%
100100100100100100100100%
100100100100100100100100%
100100100100100100100100%
9998989898979798%
1001001001001009999100%
100100999999999799%
Generic Prompt98.75%
Specific Prompt
100100100100100100100100%
100100100100100959599%
10010010010010010099100%
100100100100100100100100%
100100100100100100100100%
100100100100100100100100%
9999999898989899%
100100100100100100100100%
10010010010010010099100%
Specific Prompt99.67%
99.21%

Tool usage within Novelcrafter

Output messages that are related to tool usage within Novelcrafter

Scenario #1 #2 #3 #4 #5 #6 #7 #8 #9 #10 Total
100100100100100100100100100100100%
100.00%