NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-07-07-01KWZ5XM8MZSNAYH0K66SAXH9S
Run Details
Model:
Aion 3.0 Mini
Test:
Codex Extraction
Scenario:
Medium: The Hollow (Inferred)
Duration:
56.7s
Cost:
$0.004979
Provider:
AionLabs
Evaluation summary
Score
Evaluator
Details Link
0.00%
Accuracy
(details)
0.00%
Precision
(details)
0.00%
Recall
(details)
0.00%
Structural validity
(details)
0.0000%
Overall
Model input
System
You are a meticulous story bible editor for a fiction project. Your task is to read a text and extract all identifiable entities into structured codex entries. Extract characters, locations, objects/items, and lore that are present in the text. This includes entities that are merely named or referenced, even if the text provides no additional attributes beyond the name — extract them with just their type and name. Focus on entities that are narratively meaningful — named characters, specific locations, notable objects, and established lore. Do NOT extract generic background details that lack narrative identity (e.g. "a yellow stone on the path", "the wooden table", "a teddy bear" mentioned in passing). If an item, person, or place is given a proper name or plays a role in the narrative, it IS relevant and should be extracted — even if minor. Rules: 1. Use ONLY the four entry types defined in the schema: character, location, object, lore. 2. Use ONLY the fields defined for each entry type. Do not invent new fields. 3. For dropdown fields, use ONLY the listed values. If no listed value fits, omit the field. 4. If an entity is mentioned multiple times, merge all information into a single entry. 5. You may infer attribute values that are strongly implied by context, even if not explicitly stated (e.g. inferring a time period from surrounding dialogue). 6. Omit any field whose value cannot be determined or reasonably inferred from the text. 7. Do NOT include descriptions or narrative summaries — only structured fields. 8. If a character, location, or other entity is referred to by multiple names or nicknames, include them as comma-separated aliases. 9. Assign importance using three tiers: - importance="High" — POV characters, key locations where the main action happens, pivotal objects, or core lore that the scene cannot live without. - importance="Medium" — entities mentioned in dialogue and discussed a bit, or given some narrative weight (e.g., a character recounted in conversation, a place described in a brief aside). They matter to the story but are not central to the scene. - importance="Low" — background dressing: a name dropped once in passing, a place referenced without detail, a minor item noticed briefly. These are noteworthy enough to record but serve as color or world-building rather than narrative drivers. 10. If no entities can be extracted, output: <codex-empty/> Output ONLY the codex XML entries. Do not include any other text, preamble, or explanation outside the XML. { "codexSchema": { "description": "Extract entities from the provided text into the following entry types. Output as XML.", "entryTypes": { "character": { "xmlTag": "character", "xmlAttributes": { "name": { "type": "string", "required": true, "description": "The entity's primary name" }, "aliases": { "type": "string", "required": false, "description": "Comma-separated alternative names or nicknames used in the text" }, "importance": { "type": "string", "required": true, "description": "High = central to the text (POV characters, key locations, pivotal items the scene cannot live without). Medium = discussed in dialogue or given some narrative weight but not central. Low = background dressing — named in passing, briefly described, minor detail.", "enum": [ "High", "Medium", "Low" ] } }, "fields": { "species": { "type": "string", "enum": [ "Human", "Elf", "Dwarf", "Orc", "Halfling", "Gnome", "Dragon", "Demon", "Angel", "Undead", "Vampire", "Werewolf", "Fae", "Half-Elf", "Goblin", "Troll", "Giant", "Merfolk", "Centaur", "Tiefling" ] }, "gender": { "type": "string", "enum": [ "Male", "Female", "Non-binary" ] }, "age": { "type": "string" }, "eyeColor": { "type": "string", "enum": [ "Blue", "Green", "Brown", "Hazel", "Gray", "Amber", "Black", "Violet", "Red", "Golden", "Silver" ] }, "hairColor": { "type": "string", "enum": [ "Black", "Brown", "Blonde", "Red", "Auburn", "Gray", "White", "Silver", "Blue", "Green" ] } } }, "location": { "xmlTag": "location", "xmlAttributes": { "name": { "type": "string", "required": true, "description": "The entity's primary name" }, "aliases": { "type": "string", "required": false, "description": "Comma-separated alternative names or nicknames used in the text" }, "importance": { "type": "string", "required": true, "description": "High = central to the text (POV characters, key locations, pivotal items the scene cannot live without). Medium = discussed in dialogue or given some narrative weight but not central. Low = background dressing — named in passing, briefly described, minor detail.", "enum": [ "High", "Medium", "Low" ] } }, "fields": { "country": { "type": "string" }, "climate": { "type": "string", "enum": [ "Tropical", "Arid", "Temperate", "Continental", "Polar", "Humid", "Mediterranean", "Desert", "Oceanic", "Subarctic" ] }, "terrain": { "type": "string", "enum": [ "Forest", "Mountain", "Desert", "Plains", "Swamp", "Coastal", "Volcanic", "Tundra", "Underground", "Urban", "Island", "Jungle" ] } } }, "object": { "xmlTag": "object", "xmlAttributes": { "name": { "type": "string", "required": true, "description": "The entity's primary name" }, "aliases": { "type": "string", "required": false, "description": "Comma-separated alternative names or nicknames used in the text" }, "importance": { "type": "string", "required": true, "description": "High = central to the text (POV characters, key locations, pivotal items the scene cannot live without). Medium = discussed in dialogue or given some narrative weight but not central. Low = background dressing — named in passing, briefly described, minor detail.", "enum": [ "High", "Medium", "Low" ] } }, "fields": { "material": { "type": "string" }, "objectType": { "type": "string", "enum": [ "Weapon", "Armor", "Artifact", "Tool", "Jewelry", "Potion", "Book", "Key", "Instrument", "Clothing" ] }, "power": { "type": "string", "enum": [ "Fire", "Water", "Earth", "Air", "Lightning", "Ice", "Dark", "Light", "Arcane", "Nature", "Void", "Poison", "Healing", "Time", "Psychic" ] } } }, "lore": { "xmlTag": "lore", "xmlAttributes": { "name": { "type": "string", "required": true, "description": "The entity's primary name" }, "aliases": { "type": "string", "required": false, "description": "Comma-separated alternative names or nicknames used in the text" }, "importance": { "type": "string", "required": true, "description": "High = central to the text (POV characters, key locations, pivotal items the scene cannot live without). Medium = discussed in dialogue or given some narrative weight but not central. Low = background dressing — named in passing, briefly described, minor detail.", "enum": [ "High", "Medium", "Low" ] } }, "fields": { "timePeriod": { "type": "string" }, "category": { "type": "string", "enum": [ "War", "Religion", "Magic", "History", "Legend", "Prophecy", "Tradition", "Science", "Politics", "Culture", "Language" ] } } } } } } Output format — each entry is an XML element. name, aliases, and importance are XML attributes. All fields are child elements. Omit fields that cannot be determined from the text. Example: <character name="Adris" aliases="The Wanderer" importance="High"> <species>Half-Elf</species> <eyeColor>Green</eyeColor> </character> <location name="Thornwood" importance="Medium"> <terrain>Forest</terrain> </location> <lore name="The Grey Tide" importance="Low"> <category>History</category> </lore>
User/Human
<text> The Fathom Stair began where the ridgeline split open, high above the world, and wound down into the earth — steps hewn from the living rock, spiraling into silence. The stone was slick in places, worn smooth by feet that had passed this way long before any of them were born. Torben descended first, one hand on the cold wall for balance, fingers tracing grooves that might have been carved or might have been natural — it was impossible to tell in the low light. His breath came out in thin clouds that hung in the still air before dissolving. The temperature dropped with each turn of the stair, a steady bleed of warmth that left his joints stiff and his knuckles aching against the rock. Behind him the others followed single file, their footsteps swallowed by the stone, the sound of their breathing the only proof they were still there. At the bottom the corridor opened into a wide chamber with no sky above it, only rough-cut ceilings lost in shadow. Frost glittered on the walls in pale, branching patterns, like veins beneath skin. The air tasted of mineral and age. This was The Hollow — ancient, and utterly still. She was waiting for them at the far end of the chamber. Iselda Moth stood beside a collapsed pillar, violet eyes watching the party approach with an expression that was more curiosity than caution. White hair hung to her waist, so pale it seemed to glow in the dim light. At her back, folded close to her body, were gossamer wings — translucent as moth-glass, veined with faint iridescence that shifted when she moved. She tilted her head as Torben reached her. "You found it, then," she said. Her voice carried strangely in the stone space, as if the walls were listening. "I haven't seen Moth Hall since before the last Ashfall. This place is older." The third member of the welcoming party stood further back, half-hidden in an alcove. A human of the old order. Brother Hemmen had weathered hands — the knuckles swollen, the skin mapped with veins — and eyes the color of cold ash that saw more than they should have. His white hair was thin, combed back from a face that had been strong once and was now simply patient. On his wrist he wore the Verity Beads: beads of yellowed bone, worn smooth by decades of prayer, strung on a cord that was nearly as old as he was. "The Order of the Closed Eye," he said, when Torben looked at the beads. "We sealed our sight to see the truth beneath. That was the promise we made." Torben regarded him for a moment. "They call you the Eyeless," he said. Hemmen smiled. "They do." Hemmen led them deeper into The Hollow, through corridors where the frost grew thicker and the silence pressed in like weight. They passed doorways that opened onto rooms full of dust and broken furniture, the remains of a life that had ended centuries ago. In one of these rooms Hemmen stopped and turned to face them. "In the First Age," he said, "they bound the creature known as Reshkai — a thing of ember and hunger, something that had crawled up from the deep places of the world. They sealed it with word and sigil, here, in this very structure. The Binding of Reshkai. That is what these walls were built to hold." He gestured at the stone around them. "The wards have thinned. You can feel it in the cold." He was right. The chill here was different from the surface cold — it had a pull to it, a quality of drawing something out of the body rather than simply pressing against the skin. The walls were marked with faint sigils, barely visible beneath the frost, their edges softened by centuries of ice forming and retreating. Whatever power had been laid into them was fading, slowly, like a held breath finally giving out. On a shelf behind him, half-buried under dust, lay a hymnal — the Unfinished Hymnal, its vellum pages brittle with age, the ink faded to brown. Hemmen lifted it carefully, the spine cracking as he opened it. Someone had stopped writing mid-sentence. The last legible line was a prayer for containment. The pages before it were filled with dense, careful script — liturgical notation, instructions for renewal of the seals. Whoever had been writing them had known the work was urgent. They had not finished. Torben moved further into the chamber, studying the murals that covered the far wall. Faded figures in procession, their features worn smooth by time — robed shapes carrying objects he couldn't identify, arranged around a central form that radiated lines of red and black pigment. The colors had bled into the stone over the centuries, but the composition was clear enough: a sealing, a gathering of wills against something that burned at the center of the image. He leaned close and Iselda saw what she had already suspected — his ears, pointed but less pronounced than an elf's, the shape of someone caught between two bloodlines. He didn't seem to notice her looking. On the floor beneath the mural, half-covered by rubble and a fine layer of frost, lay the Pale Compass — a brass device no larger than his palm, its needle spinning without settling, clicking faintly against the glass. The casing was tarnished but intact, and the mechanisms inside still moved with a precision that had no business surviving this long beneath the stone. Torben picked it up carefully. "There's still energy in it," he said, turning it in the light. "Residual, but real." Iselda came to stand beside him. She watched the needle turn — restless, searching, never finding north. "Then we're not alone down here," she said. Torben closed his hand around the compass and looked at Hemmen. The old man stood in the corridor behind them, the Verity Beads turning between his fingers, his pale eyes fixed on some middle distance. He said nothing for a long moment. "The wards were meant to last," he said finally. "They were not meant to last forever." The three of them stood in the cold and the quiet, the weight of the stone above them pressing down, and listened to the dark. </text> Extract all codex entries from the text above.
Model response
Messages
Meta
AI
Got it. Let me work through the extraction systematically. **1. Analyze entities in the text:** Looking across the whole text, I need to identify named characters, locations, objects, and lore with narrative significance. **Characters:** - *Torben*: POV character, descends Fathom Stair, interacts with others, picks up Pale Compass. Pointed ears "caught between two bloodlines." Male. Importance: HIGH. - *Iselda Moth*: Described in detail — violet eyes, white hair, gossamer wings, waiting in The Hollow. Speaks to Torben. Female. Importance: HIGH. - *Brother Hemmen*: "Human of the old order," weathered hands, cold ash eyes, wears Verity Beads, leads them deeper, explains the binding. Male. Importance: HIGH (guides the scene and delivers key lore). **Locations:** - *The Fathom Stair*: Named. Steps from ridgeline into earth, hewn from rock. Importance: MEDIUM (transitional but named). - *The Hollow*: Named. Central chamber, ancient, still, no sky, frost on walls. Importance: HIGH (central setting). - *Moth Hall*: Referenced in dialogue by Iselda ("I haven't seen Moth Hall since before the last Ashfall"). Not described in detail, just namedropped. Importance: LOW. **Objects:** - *Verity Beads*: Worn by Hemmen. Yellowed bone beads, worn smooth by prayer. Importance: MEDIUM (significant character detail, not central to action). - *Pale Compass*: Brass device, tarnished but intact, needle spinning without settling, residual energy. Picked up by Torben. Importance: MEDIUM (key item in the scene, used to sense residual magic). - *Unfinished Hymnal*: Vellum pages, brittle, last line is a prayer for containment. Found on shelf. Importance: MEDIUM (provides lore context — unfinished ritual). **Lore:** - *Reshkai*: Creature of ember and hunger, bound in the First Age, sealed with word and sigil. Named. Importance: HIGH (central threat underlying the scene). - *The Binding of Reshkai*: The event/ritual of sealing. Importance: HIGH (pivotal historical event). - *Order of the Closed Eye*: Hemmen's order, sealed their sight to see truth. Named. Importance: MEDIUM (gives context to Hemmen). - *The First Age*: Time period mentioned. Importance: LOW (background). - *Ashfall*: Event referenced in passing by Iselda. Importance: LOW. **2. Verify against required fields and schema:** - Use only the four entry types: character, location, object, lore. - Use only the defined fields for each. - For dropdown fields, use only the listed values. - Merge information for same entity. - Assign importance tiers correctly. I see the species options don't include "Fae" directly? Wait, looking at the enum: "Human", "Elf", "Dwarf", "Orc", "Halfling", "Gnome", "Dragon", "Demon", "Angel", "Undead", "Vampire", "Werewolf", "Fae", "Half-Elf", "Goblin", "Troll", "Giant", "Merfolk", "Centaur", "Tiefling". Good, "Fae" is there. For Iselda's species, the text describes gossamer wings and moth-like qualities — Fae seems fitting. For Torben, "ears pointed but less pronounced than an elf's... caught between two bloodlines" clearly suggests Half-Elf. Hemmen is described as "human of the old order" — fits Human. **3. Construct the XML elements:** I'll output each entry as XML with attributes (name, aliases if any, importance) and child elements for fields where values can be determined. Let me check if any of these have aliases: none directly mentioned beyond their primary names. I see in the text "Brother Hemmen" — is that an alias or title? It seems like a title/brotherhood name. I'll use "Brother Hemmen" as the name since that's how he's primarily referred to, with "Hemmen" as a potential alias if needed? Actually, the text uses "Brother Hemmen" as his full name essentially. I'll use "Brother Hemmen" as name and add no alias unless there's another name. The text says "They call you the Eyeless" — that could be an alias for Hemmen. "The Eyeless." Yes, that's mentioned in dialogue. I'll add that as an alias. I also see "Iselda Moth" — her full name. No aliases mentioned. Now let me write the XML carefully. I realize I should double-check: the "Order of the Closed Eye" — is this a location, lore, or organization? It's a religious/monastic order, which fits lore. The category could be "Religion" or "History". It's described as an order that made a promise. I'll go with category "Religion" for it. The "Binding of Reshkai" — could be lore with category "Legend" or "History". The text presents it as historical event. I'll use "History". **4. Final check before output:** - Torben: character, importance High, species Half-Elf, gender Male. - Iselda Moth: character, importance High, species Fae, gender Female, eyeColor Violet, hairColor White. - Brother Hemmen: character, importance High, aliases The Eyeless, species Human, gender Male, eyeColor Gray, hairColor White, age old/elderly (can infer "Elderly" but schema has age as string, can put "Elderly" or omit). - The Fathom Stair: location, importance Medium, terrain? "hewn from the living rock, spiraling into silence" — underground stair. Schema terrain enum doesn't have "Stair" or "Underground". Actually it has "Underground" — yes! Terrain: Underground. - The Hollow: location, importance High, terrain Underground. - Moth Hall: location, importance Low. No additional fields determined. - Verity Beads: object, importance Medium, material Bone, objectType Jewelry? It's beads worn on wrist — jewelry seems fitting. - Pale Compass: object, importance Medium, material Brass, objectType Tool (compass is a tool). - Unfinished Hymnal: object, importance Medium, objectType Book. - Reshkai: lore, importance High, timePeriod First Age, category History? Or Legend? The text says "In the First Age" — so History. - The Binding of Reshkai: lore, importance High, timePeriod First Age, category History. - Order of the Closed Eye: lore, importance Medium, category Religion. - The First Age: lore, importance Low, category History. - Ashfall: lore, importance Low, category History? Or could be "Event" but schema doesn't have Event — I'll use History. I need to be careful: lore entries should be distinct. I could merge "Reshkai" and "The Binding of Reshkai" into one, but the schema says "If an entity is mentioned multiple times, merge all information into a single entry." But these are separate concepts — the creature vs the event/ritual of binding. I'll keep them separate. Hmm, "Ashfall" — is this a named event? "the last Ashfall" — yes, seems like a named disaster/event. I'll extract it as lore. Let me now write the XML output.
created_at
"2026-07-07T20:57:09.174Z"
7/7/2026, 8:57:09 PM
model
"aion-labs/aion-3.0-mini-20260707"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
587
moderation_latency
(null)
generation_time
56593
tokens_prompt
4451
tokens_completion
2854
native_tokens_prompt
3566
native_tokens_completion
2765
native_tokens_completion_images
(null)
native_tokens_reasoning
1140
native_tokens_cached
2669
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.00497932
router
(null)
provider_responses
0
endpoint_id
"0ad7ab68-a351-4a96-b2ef-fa8fe13adae3"
id
"0d84e83bf5f74f9f8c7a5a7f704717c5"
is_byok
false
latency
586
model_permaslug
"aion-labs/aion-3.0-mini-20260707"
provider_name
"AionLabs"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.18.0; linux; x64))"
http_referer
(null)
request_id
"req-1783457829-jKDHnLYbT0qzwrVNmoZu"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1783457829-HzB7hGZg0DJF7k8vzyoe"
upstream_id
"0d84e83bf5f74f9f8c7a5a7f704717c5"
total_cost
0.00497932
cache_discount
0.00138788
upstream_inference_cost
0
provider_name
"AionLabs"
response_cache_source_id
(null)
data_region
"global"
Evaluation details
Result
Evaluator
Details
Meta Data
0.00%
Accuracy
Eligible: 0, Weighted avg: 0.00
eligibleCount
0
matchedCount
0
weightedAvg
0
entryScores
(empty)
explicitAccuracy
(null)
inferredAccuracy
(null)
0.00%
Precision
True positives: 0/0
totalReported
0
duplicateCount
0
duplicates
(empty)
truePositives
0
reportedDetails
(empty)
0.00%
Recall
Matched: 0/14, FP: 0
parsedCount
0
totalExpected
14
duplicates
(empty)
matched
0
falsePositives
0
weightedRecall
0
fpPenalty
0
expectedDetails
0
expected
name
"Torben Reikhart"
types
0
"character"
importance
"high"
status
"missed"
1
expected
name
"Iselda Moth"
types
0
"character"
importance
"high"
status
"missed"
2
expected
name
"Brother Hemmen"
types
0
"character"
importance
"high"
status
"missed"
3
expected
name
"Reshkai"
types
0
"character"
1
"lore"
importance
(null)
status
"missed"
4
expected
name
"The Hollow"
types
0
"location"
importance
"high"
status
"missed"
5
expected
name
"The Fathom Stair"
types
0
"location"
importance
"medium"
status
"missed"
6
expected
name
"Moth Hall"
types
0
"location"
importance
"low"
status
"missed"
7
expected
name
"The Pale Compass"
types
0
"object"
importance
"medium"
status
"missed"
8
expected
name
"The Verity Beads"
types
0
"object"
importance
"medium"
status
"missed"
9
expected
name
"The Unfinished Hymnal"
types
0
"object"
importance
"medium"
status
"missed"
10
expected
name
"The Binding of Reshkai"
types
0
"lore"
importance
"high"
status
"missed"
11
expected
name
"The Order of the Closed Eye"
types
0
"lore"
importance
"medium"
status
"missed"
12
expected
name
"The Ashfall"
types
0
"lore"
importance
"low"
status
"missed"
13
expected
name
"The First Age"
types
0
"lore"
importance
"low"
status
"missed"
falsePositiveDetails
(empty)
0.00%
Structural validity
Parsed: 0, Avg score: 0.00
parsedCount
0
hasAttempt
false
avgScore
0
entryDetails
(empty)
0.0000%