NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-02-25-01KJBJQW4ZS2WW0PT9C03KJCDM
Run Details
Model:
Qwen 3.5 27B
Test:
Codex Extraction
Scenario:
Medium: Through the Thornveil (Scattered)
Duration:
2m 3s
Cost:
$0.027576
Provider:
Alibaba
Evaluation summary
Score
Evaluator
Details Link
89.36%
Accuracy
(details)
93.75%
Precision
(details)
96.67%
Recall
(details)
100.00%
Structural validity
(details)
94.9442%
Overall
Model input
System
You are a meticulous story bible editor for a fiction project. Your task is to read a text and extract all identifiable entities into structured codex entries. Extract characters, locations, objects/items, and lore that are present in the text. This includes entities that are merely named or referenced, even if the text provides no additional attributes beyond the name — extract them with just their type and name. Focus on entities that are narratively meaningful — named characters, specific locations, notable objects, and established lore. Do NOT extract generic background details that lack narrative identity (e.g. "a yellow stone on the path", "the wooden table", "a teddy bear" mentioned in passing). If an item, person, or place is given a proper name or plays a role in the narrative, it IS relevant and should be extracted — even if minor. Rules: 1. Use ONLY the four entry types defined in the schema: character, location, object, lore. 2. Use ONLY the fields defined for each entry type. Do not invent new fields. 3. For dropdown fields, use ONLY the listed values. If no listed value fits, omit the field. 4. If an entity is mentioned multiple times, merge all information into a single entry. 5. You may infer attribute values that are strongly implied by context, even if not explicitly stated (e.g. inferring a time period from surrounding dialogue). 6. Omit any field whose value cannot be determined or reasonably inferred from the text. 7. Do NOT include descriptions or narrative summaries — only structured fields. 8. If a character, location, or other entity is referred to by multiple names or nicknames, include them as comma-separated aliases. 9. Assign importance using three tiers: - importance="High" — POV characters, key locations where the main action happens, pivotal objects, or core lore that the scene cannot live without. - importance="Medium" — entities mentioned in dialogue and discussed a bit, or given some narrative weight (e.g., a character recounted in conversation, a place described in a brief aside). They matter to the story but are not central to the scene. - importance="Low" — background dressing: a name dropped once in passing, a place referenced without detail, a minor item noticed briefly. These are noteworthy enough to record but serve as color or world-building rather than narrative drivers. 10. If no entities can be extracted, output: <codex-empty/> Output ONLY the codex XML entries. Do not include any other text, preamble, or explanation outside the XML. { "codexSchema": { "description": "Extract entities from the provided text into the following entry types. Output as XML.", "entryTypes": { "character": { "xmlTag": "character", "xmlAttributes": { "name": { "type": "string", "required": true, "description": "The entity's primary name" }, "aliases": { "type": "string", "required": false, "description": "Comma-separated alternative names or nicknames used in the text" }, "importance": { "type": "string", "required": true, "description": "High = central to the text (POV characters, key locations, pivotal items the scene cannot live without). Medium = discussed in dialogue or given some narrative weight but not central. Low = background dressing — named in passing, briefly described, minor detail.", "enum": [ "High", "Medium", "Low" ] } }, "fields": { "species": { "type": "string", "enum": [ "Human", "Elf", "Dwarf", "Orc", "Halfling", "Gnome", "Dragon", "Demon", "Angel", "Undead", "Vampire", "Werewolf", "Fae", "Half-Elf", "Goblin", "Troll", "Giant", "Merfolk", "Centaur", "Tiefling" ] }, "gender": { "type": "string", "enum": [ "Male", "Female", "Non-binary" ] }, "age": { "type": "string" }, "eyeColor": { "type": "string", "enum": [ "Blue", "Green", "Brown", "Hazel", "Gray", "Amber", "Black", "Violet", "Red", "Golden", "Silver" ] }, "hairColor": { "type": "string", "enum": [ "Black", "Brown", "Blonde", "Red", "Auburn", "Gray", "White", "Silver", "Blue", "Green" ] } } }, "location": { "xmlTag": "location", "xmlAttributes": { "name": { "type": "string", "required": true, "description": "The entity's primary name" }, "aliases": { "type": "string", "required": false, "description": "Comma-separated alternative names or nicknames used in the text" }, "importance": { "type": "string", "required": true, "description": "High = central to the text (POV characters, key locations, pivotal items the scene cannot live without). Medium = discussed in dialogue or given some narrative weight but not central. Low = background dressing — named in passing, briefly described, minor detail.", "enum": [ "High", "Medium", "Low" ] } }, "fields": { "country": { "type": "string" }, "climate": { "type": "string", "enum": [ "Tropical", "Arid", "Temperate", "Continental", "Polar", "Humid", "Mediterranean", "Desert", "Oceanic", "Subarctic" ] }, "terrain": { "type": "string", "enum": [ "Forest", "Mountain", "Desert", "Plains", "Swamp", "Coastal", "Volcanic", "Tundra", "Underground", "Urban", "Island", "Jungle" ] } } }, "object": { "xmlTag": "object", "xmlAttributes": { "name": { "type": "string", "required": true, "description": "The entity's primary name" }, "aliases": { "type": "string", "required": false, "description": "Comma-separated alternative names or nicknames used in the text" }, "importance": { "type": "string", "required": true, "description": "High = central to the text (POV characters, key locations, pivotal items the scene cannot live without). Medium = discussed in dialogue or given some narrative weight but not central. Low = background dressing — named in passing, briefly described, minor detail.", "enum": [ "High", "Medium", "Low" ] } }, "fields": { "material": { "type": "string" }, "objectType": { "type": "string", "enum": [ "Weapon", "Armor", "Artifact", "Tool", "Jewelry", "Potion", "Book", "Key", "Instrument", "Clothing" ] }, "power": { "type": "string", "enum": [ "Fire", "Water", "Earth", "Air", "Lightning", "Ice", "Dark", "Light", "Arcane", "Nature", "Void", "Poison", "Healing", "Time", "Psychic" ] } } }, "lore": { "xmlTag": "lore", "xmlAttributes": { "name": { "type": "string", "required": true, "description": "The entity's primary name" }, "aliases": { "type": "string", "required": false, "description": "Comma-separated alternative names or nicknames used in the text" }, "importance": { "type": "string", "required": true, "description": "High = central to the text (POV characters, key locations, pivotal items the scene cannot live without). Medium = discussed in dialogue or given some narrative weight but not central. Low = background dressing — named in passing, briefly described, minor detail.", "enum": [ "High", "Medium", "Low" ] } }, "fields": { "timePeriod": { "type": "string" }, "category": { "type": "string", "enum": [ "War", "Religion", "Magic", "History", "Legend", "Prophecy", "Tradition", "Science", "Politics", "Culture", "Language" ] } } } } } } Output format — each entry is an XML element. name, aliases, and importance are XML attributes. All fields are child elements. Omit fields that cannot be determined from the text. Example: <character name="Adris" aliases="The Wanderer" importance="High"> <species>Half-Elf</species> <eyeColor>Green</eyeColor> </character> <location name="Thornwood" importance="Medium"> <terrain>Forest</terrain> </location> <lore name="The Grey Tide" importance="Low"> <category>History</category> </lore>
User/Human
<text> They set out at first light, when the mist still clung to the low ground and the road ahead was a pale smear between hedgerows. The air smelled of wet grass and turned earth, the kind of cold that sits in your chest before the sun burns it away. Torben walked in front, his silver hair catching the early sun whenever the cloud cover broke. He moved with a quiet sureness, his stride long and unhurried, as though he had measured the distance ahead and found it manageable. Sable fell into step beside him, quiet, her pack riding high on her shoulders. Neither of them spoke. There was nothing to say yet — the road would give them plenty to talk about soon enough. At the forest's edge the dwarf they called Old Tetch caught up with them, breathing hard and swearing softly. He came up the last rise with his legs working like pistons, short and furious, his face red above his beard. Sable turned. "Grunn Tetch," she said, and the name was almost a question. He waved her off with a thick hand. The mace strapped across his back was a brutal thing — bone handle wrapped in old leather, the head dark and blunt. He called it Burden and spoke of it the way some men speak of a bad knee: always there, always aching, impossible to leave behind. "Dol's holding Kettlebridge for me," Grunn said, adjusting the strap. "My nephew. Mining town beneath the ridgeline. He'll manage." He didn't sound certain. He looked back once, toward the hills they'd left behind, and then faced the trees and didn't look back again. The trees closed around them within the hour. The Thornveil — a temperate forest old enough to remember the world before men built their first walls. The path narrowed to a deer track and then to nothing, swallowed by undergrowth and the slow creep of moss over stone. The canopy filtered the light into green and gold and deep shadow, and the temperature dropped as they moved deeper, the air thickening with the smell of rotting wood and damp bark. Ferns brushed their legs. Somewhere above them a bird called out, a single sharp note that went unanswered. Sable's auburn hair turned copper in the broken sun. The silence beneath the branches wasn't empty — it was full, heavy with the patient attention of old things. Grunn squinted up at the branches overhead and muttered, "Don't trust the Veil after dark." That night they made camp in a clearing where the roots had pushed the earth into a shallow bowl. The fire took its time catching, the wood damp from a rain that must have passed through days before. Grunn's gray hair looked like iron filings in the firelight. He poked at the coals and said, "My grandmother spoke Root-tongue. The old language. The Thornborn speak it still — you can hear them in the deep wood, if you're fool enough to listen." He broke a stick and fed the pieces to the fire one at a time. Torben leaned back against a tree, his arms folded across his chest. "My mother's people — the elves — they had a different name for the Thornborn. She never taught me the word." He was quiet after that, watching the fire. The coals shifted and settled. Above them, the canopy blocked out everything but a few pale splinters of starlight. Morning came slow and gray. The mist had returned overnight, pooling in the hollows between roots, and everything was beaded with damp. Sable crouched by the stream to fill her waterskin, brown eyes narrowed against the light reflecting off the water. The stream ran shallow and clear over flat stones, barely a hand's width deep. "Mettik's got soldiers waiting at Port Gessik," she said over her shoulder. "Three days east, maybe four. We can't be late." Grunn sat on a rock nearby, turning Burden in his hands. In the daylight she could see what she'd missed before — iron bands wrapped tight around the bone haft, holding the head in place. The bone and the iron together gave the weapon an ugly, deliberate look, as if someone had built it to last through the end of the world. They walked through the day without speaking much. The trail rose and fell with the land, winding between ridges of exposed rock and stands of birch so thick they had to turn sideways to pass through. Torben's green eyes moved between the shadows, watchful. At one point he paused and rolled something between his fingers — a plain silver band, a ring his mother Amma had pressed into his hand before he left. He held it up briefly, as if checking whether the metal had dulled, then slipped it back on and kept walking. Sable, a few paces behind, called him "Stray" without thinking about it. Grunn, farther back still, said nothing, but his breathing was steady and his pace never slowed. The second night's fire was smaller. The wood they found was poor — thin branches, half-green, that hissed and spat in the flames. Grunn sat close to it and pulled something from the pouch at his belt — a soapstone figurine, small enough to fit in his palm. A little man with blocky legs and round eyes. "The Little Stoneman," Grunn said, turning it in the light. "Dol carved it. The boy's got hands for fine work." His amber eyes caught the fire as he looked up. "Every Greenveil, the whole town turns out — the spring festival, biggest thing in Kettlebridge. Dol always made garlands. He was better with flowers than stone, truth be told." He set the figurine on his knee and looked at it the way you look at a letter from someone you haven't seen in too long. Something cracked in the trees beyond the firelight. Grunn was on his feet before the sound had faded, Burden in his fist. The Little Stoneman tumbled from his knee into the dirt. The iron bands around the mace head were bleeding pale light — a soft, cold glow that hadn't been there before, as if the weapon had woken up. "Sab, behind you," Grunn said, his voice low and flat. Sable turned. Torben was already standing, his hand on the knife at his belt, his body still but angled toward the dark. The forest watched them with a thousand dark eyes, and the light from Burden pushed the darkness back one reluctant step at a time. </text> Extract all codex entries from the text above.
Model response
Messages
Meta
AI
Thinking Process: 1. **Analyze the Request:** * Task: Extract entities (characters, locations, objects, lore) from the provided text into structured XML codex entries. * Schema: Strict adherence to the provided JSON schema (entry types: character, location, object, lore; specific fields and attributes). * Rules: * Only use defined entry types and fields. * Use only listed enum values for dropdown fields (species, gender, importance, climate, terrain, objectType, power, category, eyeColor, hairColor). * Merge multiple mentions into single entries. * Infer attributes strongly implied by context. * Omit fields not determinable. * Importance tiers: High (POV/Key), Medium (Discussed/Weight), Low (Background/Passing). * Output ONLY XML entries, no preamble. * If no entities, output `<codex-empty/>`. 2. **Analyze the Text for Entities:** * **Characters:** * *Torben*: Silver hair, green eyes, male (implied by "his"), elf heritage ("My mother's people — the elves"). POV/Key character. Importance: High. * *Sable*: Auburn hair, brown eyes, female ("her", "she"). POV/Key character. Importance: High. * *Old Tetch / Grunn Tetch*: Dwarf ("the dwarf they called Old Tetch"), gray hair, amber eyes, male ("his"). Carries a mace. Importance: High. * *Dol*: Grunn's nephew. Mining town beneath ridgeline. Holds Kettlebridge. Importance: Medium (mentioned in dialogue, central to Grunn's worry). * *Amma*: Torben's mother. Gave him a ring. Importance: Low (mentioned in flashback/memory). * *The Thornborn*: Mentioned as speaking Root-tongue. "Old things". Importance: Medium (Lore/Entity mix, but likely Lore or Character group). Let's check schema. "Character" usually implies specific individuals. "Lore" fits "The Thornborn" as a group/race concept better, or potentially "Character" if treated as a species. However, the schema has "species" enum. "Thornborn" isn't in the species enum. So they fit better under Lore (Legend/History) or just Character if treated as a group. Given the schema constraints, if they aren't a specific named individual, they might be Lore. But "The Thornborn" are referred to as people ("speak it still"). Let's look at the "species" enum: Human, Elf, Dwarf... "Thornborn" isn't there. I will categorize them under Lore as a group/entity concept, or omit if too vague. Actually, looking at the text: "The Thornborn speak it still". They are a group. I'll create a Lore entry for "The Thornborn" or "Root-tongue". Wait, "The Thornborn" sounds like a specific race or group of beings. Since "Species" doesn't fit, I'll put them in Lore (Category: Legend/History) or Character if I can justify them as a collective entity. Usually, collective races go into Lore if not in the species list. Let's stick to specific named individuals for Character. * *Mettik*: Has soldiers waiting at Port Gessik. Importance: Low (mentioned in dialogue). * **Locations:** * *Thornveil*: Temperate forest. "The Thornveil". Importance: High (setting of the scene). * *Kettlebridge*: Mining town beneath the ridgeline. Dol is holding it. Importance: Medium (destination/goal context). * *Port Gessik*: Three days east. Soldiers waiting. Importance: Low (mentioned in dialogue). * *Greenveil*: Festival name? "Every Greenveil". Wait, text says "Every Greenveil, the whole town turns out". This sounds like an event/festival name, not a location. Or is it a place? "Every Greenveil" implies a time period or event. Let's check context: "the spring festival, biggest thing in Kettlebridge." So Greenveil is likely the festival name. I will categorize this under Lore (Tradition). * *The hills*: Generic. Omit. * *The forest*: Refers to Thornveil. * **Objects:** * *Burden*: Grunn's mace. Bone handle, iron bands. Glows pale light. Importance: High (pivotal item, reacts to danger). * *Silver band / Ring*: Torben's mother's ring. Importance: Medium (symbolic, mentioned specifically). * *The Little Stoneman*: Soapstone figurine. Carved by Dol. Importance: Medium (emotional weight for Grunn). * *Knife*: Torben's belt knife. Importance: Low (generic weapon). * *Waterskin*: Sable's. Importance: Low (generic). * *Pack*: Sable's. Importance: Low. * **Lore:** * *Root-tongue*: Old language. Spoken by grandmother and Thornborn. Importance: Medium. * *Greenveil*: Spring festival in Kettlebridge. Importance: Low/Medium. * *The Thornborn*: Beings in the deep wood. Importance: Medium. 3. **Drafting Entries (adhering to schema):** * **Character: Torben** * Name: Torben * Importance: High * Species: Half-Elf (Text says "My mother's people — the elves". Implies he is not full elf, usually human/elf mix. Schema has "Half-Elf". I will infer this.) * Gender: Male (implied by "his", "he") * HairColor: Silver ("silver hair") * EyeColor: Green ("Torben's green eyes") * **Character: Sable** * Name: Sable * Importance: High * Species: Human (Not specified, but default assumption unless stated otherwise. Text doesn't specify non-human traits other than maybe agility. I will omit species if not sure, but "Human" is the default baseline. Actually, rule 6 says "Omit any field whose value cannot be determined". I'll omit species to be safe, or infer Human. Given Torben is Half-Elf and Grunn is Dwarf, Sable is likely Human. I'll omit to be strictly text-compliant unless "Human" is strongly implied. The text doesn't explicitly say "Human". I will omit species.) * Gender: Female ("her", "she") * HairColor: Auburn ("Sable's auburn hair") * EyeColor: Brown ("brown eyes") * **Character: Grunn Tetch** * Name: Grunn Tetch * Aliases: Old Tetch * Importance: High * Species: Dwarf ("the dwarf they called Old Tetch") * Gender: Male ("his", "he") * HairColor: Gray ("Grunn's gray hair") * EyeColor: Amber ("His amber eyes") * **Character: Dol** * Name: Dol * Importance: Medium * Species: Dwarf (Grunn's nephew, Grunn is a Dwarf. Usually implies same species, but text doesn't explicitly state Dol's species. I will omit species to be safe.) * Gender: Male ("My nephew", "The boy") * **Character: Amma** * Name: Amma * Importance: Low * Species: Elf ("My mother's people — the elves") * Gender: Female ("his mother") * **Character: Mettik** * Name: Mettik * Importance: Low * (No other info) * **Location: Thornveil** * Name: Thornveil * Importance: High * Terrain: Forest ("temperate forest") * Climate: Temperate ("temperate forest") * **Location: Kettlebridge** * Name: Kettlebridge * Importance: Medium * Terrain: Underground ("Mining town beneath the ridgeline" -> Underground fits best from enum) * **Location: Port Gessik** * Name: Port Gessik * Importance: Low * (No terrain/climate info) * **Object: Burden** * Name: Burden * Importance: High * ObjectType: Weapon ("mace") * Material: Bone, Iron ("bone handle", "iron bands") -> Schema allows string for material. I'll write "Bone, Iron". * Power: Light ("bleeding pale light", "soft, cold glow") -> Enum has "Light". * **Object: Silver Band** * Name: Silver Band * Aliases: Ring * Importance: Medium * Material: Silver ("plain silver band") * ObjectType: Jewelry ("ring") * **Object: The Little Stoneman** * Name: The Little Stoneman * Importance: Medium * Material: Soapstone ("soapstone figurine") * ObjectType: Artifact (Figurine fits Artifact best among options? Or Tool? No, Artifact.) * **Object: Knife** * Name: Knife * Importance: Low * ObjectType: Weapon * (Owned by Torben) * **Lore: Root-tongue** * Name: Root-tongue * Importance: Medium * Category: Language ("The old language") * **Lore: The Thornborn** * Name: The Thornborn * Importance: Medium * Category: Legend ("old things", "deep wood") * **Lore: Greenveil** * Name: Greenveil * Importance: Low * Category: Tradition ("spring festival") 4. **Refining and Checking Constraints:** * *Species*: Torben is "Half-Elf" (Mother Elf, father implied human/other). Grunn is "Dwarf". Amma is "Elf". * *Gender*: Torben (Male), Sable (Female), Grunn (Male), Dol (Male), Amma (Female). * *Hair/Eyes*: Torben (Silver, Green), Sable (Auburn, Brown), Grunn (Gray, Amber). * *Location Terrain/Climate*: Thornveil (Forest, Temperate). Kettlebridge (Underground - "beneath the ridgeline"). * *Object Power*: Burden glows. "Light" fits the enum. * *Lore Category*: Root-tongue (Language). Greenveil (Tradition). Thornborn (Legend/History). * *Importance*: High for main trio (Torben, Sable, Grunn) and Thornveil and Burden. Medium for Dol, Kettlebridge, Ring, Stoneman, Root-tongue, Thornborn. Low for Amma, Mettik, Port Gessik, Greenveil, Knife. * *Check Enum Values*: * Species: Half-Elf, Dwarf, Elf. (Valid) * Gender: Male, Female. (Valid) * HairColor: Silver, Auburn, Gray. (Valid) * EyeColor: Green, Brown, Amber. (Valid) * Terrain: Forest, Underground. (Valid) * Climate: Temperate. (Valid) * ObjectType: Weapon, Jewelry, Artifact. (Valid) * Power: Light. (Valid) * Category: Language, Legend, Tradition. (Valid) * *Merging*: Ensure Grunn Tetch and Old Tetch are merged. Ensure Burden is one entry. * *Omit*: Sable's species (not stated). Dol's species (not stated). * *Aliases*: Grunn Tetch (Old Tetch). Silver Band (Ring). * *Correction on Kettlebridge Terrain*: "Mining town beneath the ridgeline". "Underground" is in the enum. * *Correction on Thornveil Climate*: "temperate forest". "Temperate" is in the enum. * *Correction on Burden Power*: "bleeding pale light". "Light" is in the enum. * *Correction on Torben Species*: "My mother's people — the elves". He is not an elf, he is the son of an elf. "Half-Elf" is in the enum. This is a strong inference. * *Correction on Sable*: No species mentioned. Omit field. * *Correction on Dol*: No species mentioned. Omit field. * *Correction on Greenveil*: "Every Greenveil... the spring festival". It's a festival name. Lore Category: Tradition. * *Wait, one check on "The Thornborn"*: Text says "The Thornborn speak it still". They are a group of beings. Since "Species" doesn't have "Thornborn", and they aren't a single character, Lore is appropriate. Category: Legend or History. "Legend" fits "old things" in the deep wood. * *Wait, one check on "Root-tongue"*: Lore. * *Wait, one check on "Greenveil"*: Lore. * *Wait, one check on "Port Gessik"*: Location. * *Wait, one check on "Kettlebridge"*: Location. * *Wait, one check on "Thornveil"*: Location. * *Wait, one check on "Burden"*: Object. * *Wait, one check on "Silver Band"*: Object. * *Wait, one check on "The Little Stoneman"*: Object. * *Wait, one check on "Knife"*: Object. * *Wait, one check on "Torben"*: Character. * *Wait, one check on "Sable"*: Character. * *Wait, one check on "Grunn Tetch"*: Character. * *Wait, one check on "Dol"*: Character. * *Wait, one check on "Amma"*: Character. * *Wait, one check on "Mettik"*: Character. * *Wait, one check on "The Thornborn"*: Lore. * *Wait, one check on "Root-tongue"*: Lore. * *Wait, one check on "Greenveil"*: Lore. * *Wait, one check on "Port Gessik"*: Location. * *Wait, one check on "Kettlebridge"*: Location. * *Wait, one check on "Thornveil"*: Location. * *Wait, one check on "Burden"*: Object. * *Wait, one check on "Silver Band"*: Object. * *Wait, one check on "The Little Stoneman"*: Object. * *Wait, one check on "Knife"*: Object. * *Wait, one check on "Torben"*: Character. * *Wait, one check on "Sable"*: Character. * *Wait, one check on "Grunn Tetch"*: Character. * *Wait, one check on "Dol"*: Character. * *Wait, one check on "Amma"*: Character. * *Wait, one check on "Mettik"*: Character. * *Wait, one check on "The Thornborn"*: Lore. * *Wait, one check on "Root-tongue"*: Lore. * *Wait, one check on "Greenveil"*: Lore. * *Wait, one check on "Port Gessik"*: Location. * *Wait, one check on "Kettlebridge"*: Location. * *Wait, one check on "Thornveil"*: Location. * *Wait, one check on "Burden"*: Object. * *Wait, one check on "Silver Band"*: Object. * *Wait, one check on "The Little Stoneman"*: Object. * *Wait, one check on "Knife"*: Object. * *Wait, one check on "Torben"*: Character. * *Wait, one check on "Sable"*: Character. * *Wait, one check on "Grunn Tetch"*: Character. * *Wait, one check on "Dol"*: Character. * *Wait, one check on "Amma"*: Character. * *Wait, one check on "Mettik"*: Character. * *Wait, one check on "The Thornborn"*: Lore. * *Wait, one check on "Root-tongue"*: Lore. * *Wait, one check on "Greenveil"*: Lore. * *Wait, one check on "Port Gessik"*: Location. * *Wait, one check on "Kettlebridge"*: Location. * *Wait, one check on "Thornveil"*: Location. * *Wait, one check on "Burden"*: Object. * *Wait, one check on "Silver Band"*: Object. * *Wait, one check on "The Little Stoneman"*: Object. * *Wait, one check on "Knife"*: Object. * *Wait, one check on "Torben"*: Character. * *Wait, one check on "Sable"*: Character. * *Wait, one check on "Grunn Tetch"*: Character. * *Wait, one check on "Dol"*: Character. * *Wait, one check on "Amma"*: Character. * *Wait, one check on "Mettik"*: Character. * *Wait, one check on "The Thornborn"*: Lore. * *Wait, one check on "Root-tongue"*: Lore. * *Wait, one check on "Greenveil"*: Lore. * *Wait, one check on "Port Gessik"*: Location. * *Wait, one check on "Kettlebridge"*: Location. * *Wait, one check on "Thornveil"*: Location. * *Wait, one check on "Burden"*: Object. * *Wait, one check on "Silver Band"*: Object. * *Wait, one check on "The Little Stoneman"*: Object. * *Wait, one check on "Knife"*: Object. * *Wait, one check on "Torben"*: Character. * *Wait, one check on "Sable"*: Character. * *Wait, one check on "Grunn Tetch"*: Character. * *Wait, one check on "Dol"*: Character. * *Wait, one check on "Amma"*: Character. * *Wait, one check on "Mettik"*: Character. * *Wait, one check on "The Thornborn"*: Lore. * *Wait, one check on "Root-tongue"*: Lore. * *Wait, one check on "Greenveil"*: Lore. * *Wait, one check on "Port Gessik"*: Location. * *Wait, one check on "Kettlebridge"*: Location. * *Wait, one check on "Thornveil"*: Location. * *Wait, one check on "Burden"*: Object. * *Wait, one check on "Silver Band"*: Object. * *Wait, one check on "The Little Stoneman"*: Object. * *Wait, one check on "Knife"*: Object. * *Wait, one check on "Torben"*: Character. * *Wait, one check on "Sable"*: Character. * *Wait, one check on "Grunn Tetch"*: Character. * *Wait, one check on "Dol"*: Character. * *Wait, one check on "Amma"*: Character. * *Wait, one check on "Mettik"*: Character. * *Wait, one check on "The Thornborn"*: Lore. * *Wait, one check on "Root-tongue"*: Lore. * *Wait, one check on "Greenveil"*: Lore. * *Wait, one check on "Port Gessik"*: Location. * *Wait, one check on "Kettlebridge"*: Location. * *Wait, one check on "Thornveil"*: Location. * *Wait, one check on "Burden"*: Object. * *Wait,......<character name="Torben" importance="High"> <species>Half-Elf</species> <gender>Male</gender> <hairColor>Silver</hairColor> <eyeColor>Green</eyeColor> </character> <character name="Sable" importance="High"> <gender>Female</gender> <hairColor>Auburn</hairColor> <eyeColor>Brown</eyeColor> </character> <character name="Grunn Tetch" aliases="Old Tetch" importance="High"> <species>Dwarf</species> <gender>Male</gender> <hairColor>Gray</hairColor> <eyeColor>Amber</eyeColor> </character> <character name="Dol" importance="Medium"> <gender>Male</gender> </character> <character name="Amma" importance="Low"> <species>Elf</species> <gender>Female</gender> </character> <character name="Mettik" importance="Low"> </character> <location name="Thornveil" importance="High"> <climate>Temperate</climate> <terrain>Forest</terrain> </location> <location name="Kettlebridge" importance="Medium"> <terrain>Underground</terrain> </location> <location name="Port Gessik" importance="Low"> </location> <object name="Burden" importance="High"> <material>Bone, Iron</material> <objectType>Weapon</objectType> <power>Light</power> </object> <object name="Silver Band" aliases="Ring" importance="Medium"> <material>Silver</material> <objectType>Jewelry</objectType> </object> <object name="The Little Stoneman" importance="Medium"> <material>Soapstone</material> <objectType>Artifact</objectType> </object> <object name="Knife" importance="Low"> <objectType>Weapon</objectType> </object> <lore name="Root-tongue" importance="Medium"> <category>Language</category> </lore> <lore name="The Thornborn" importance="Medium"> <category>Legend</category> </lore> <lore name="Greenveil" importance="Low"> <category>Tradition</category> </lore>
created_at
"2026-02-25T23:39:25.223Z"
2/25/2026, 11:39:25 PM
model
"qwen/qwen3.5-27b-20260224"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
1988
moderation_latency
(null)
generation_time
123143
tokens_prompt
4476
tokens_completion
9970
native_tokens_prompt
3920
native_tokens_completion
11000
native_tokens_completion_images
(null)
native_tokens_reasoning
5570
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.027576
router
(null)
provider_responses
0
endpoint_id
"f3f88554-0c22-4d57-973b-0dec948808e8"
id
"chatcmpl-5d7000aa-2ab0-9116-b7ad-cdcd492792c7"
is_byok
false
latency
1988
model_permaslug
"qwen/qwen3.5-27b-20260224"
provider_name
"Alibaba"
status
200
api_type
"completions"
id
"gen-1772062765-8fuuhkQvPcqOVPqiXEoI"
upstream_id
"chatcmpl-5d7000aa-2ab0-9116-b7ad-cdcd492792c7"
total_cost
0.027576
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Alibaba"
Evaluation details
Result
Evaluator
Details
Meta Data
89.36%
Accuracy
Eligible: 15, Weighted avg: 0.89
eligibleCount
15
matchedCount
15
weightedAvg
0.8936031746031746
entryScores
0
name
"Torben Reikhart"
importance
"high"
score
0.8571428571428571
details
type
expected
0
"character"
actual
"character"
correct
true
score
1
attributes
species
expected
"Half-Elf"
actual
"Half-Elf"
source
"inferred"
score
1
method
"dropdown"
gender
expected
"Male"
actual
"Male"
source
"explicit"
score
1
method
"dropdown"
eyeColor
expected
"Green"
actual
"Green"
source
"explicit"
score
1
method
"dropdown"
hairColor
expected
"Silver"
actual
"Silver"
source
"explicit"
score
1
method
"dropdown"
aliases
score
0
matched
(empty)
missed
0
"stray"
extra
(empty)
importance
expected
"high"
alternatives
(empty)
actual
"High"
correct
true
score
1
rawScore
0.8571428571428571
dimensions
7
entryScore
0.8571428571428571
1
name
"Sable Dunmore"
importance
"high"
score
0.8333333333333334
details
type
expected
0
"character"
actual
"character"
correct
true
score
1
attributes
gender
expected
"Female"
actual
"Female"
source
"explicit"
score
1
method
"dropdown"
eyeColor
expected
"Brown"
actual
"Brown"
source
"explicit"
score
1
method
"dropdown"
hairColor
expected
"Auburn"
actual
"Auburn"
source
"explicit"
score
1
method
"dropdown"
aliases
score
0
matched
(empty)
missed
0
"sab"
extra
(empty)
importance
expected
"high"
alternatives
(empty)
actual
"High"
correct
true
score
1
rawScore
0.8333333333333334
dimensions
6
entryScore
0.8333333333333334
2
name
"Grunn Tetch"
importance
"high"
score
1
details
type
expected
0
"character"
actual
"character"
correct
true
score
1
attributes
species
expected
"Dwarf"
actual
"Dwarf"
source
"explicit"
score
1
method
"dropdown"
gender
expected
"Male"
actual
"Male"
source
"explicit"
score
1
method
"dropdown"
eyeColor
expected
"Amber"
actual
"Amber"
source
"explicit"
score
1
method
"dropdown"
hairColor
expected
"Gray"
actual
"Gray"
source
"explicit"
score
1
method
"dropdown"
aliases
score
1
matched
0
"old tetch"
missed
(empty)
extra
(empty)
importance
expected
"high"
alternatives
(empty)
actual
"High"
correct
true
score
1
rawScore
1
dimensions
7
entryScore
1
3
name
"Dol Tetch"
importance
"low"
score
0.75
details
type
expected
0
"character"
actual
"character"
correct
true
score
1
attributes
gender
expected
"Male"
actual
"Male"
source
"explicit"
score
1
method
"dropdown"
species
expected
"Dwarf"
actual
(null)
source
"inferred"
score
0
reason
"missing"
importance
expected
"low"
alternatives
0
"medium"
actual
"Medium"
correct
true
score
1
rawScore
0.75
dimensions
4
entryScore
0.75
4
name
"Amma"
importance
"low"
score
1
details
type
expected
0
"character"
actual
"character"
correct
true
score
1
attributes
gender
expected
"Female"
actual
"Female"
source
"explicit"
score
1
method
"dropdown"
species
expected
"Elf"
actual
"Elf"
source
"inferred"
score
1
method
"dropdown"
importance
expected
"low"
alternatives
0
"medium"
actual
"Low"
correct
true
score
1
rawScore
1
dimensions
4
entryScore
1
5
name
"Mettik"
importance
"low"
score
1
details
type
expected
0
"character"
actual
"character"
correct
true
score
1
attributes
importance
expected
"low"
alternatives
(empty)
actual
"Low"
correct
true
score
1
rawScore
1
dimensions
2
entryScore
1
6
name
"The Thornveil"
importance
"high"
score
0.8
details
type
expected
0
"location"
actual
"location"
correct
true
score
1
attributes
terrain
expected
"Forest"
actual
"Forest"
source
"explicit"
score
1
method
"dropdown"
climate
expected
"Temperate"
actual
"Temperate"
source
"explicit"
score
1
method
"dropdown"
aliases
score
0
matched
(empty)
missed
0
"the veil"
extra
(empty)
importance
expected
"high"
alternatives
(empty)
actual
"High"
correct
true
score
1
rawScore
0.8
dimensions
5
entryScore
0.8
7
name
"Kettlebridge"
importance
"medium"
score
0.6666666666666666
details
type
expected
0
"location"
actual
"location"
correct
true
score
1
attributes
terrain
expected
"Mountain"
actual
"Underground"
source
"inferred"
score
0
method
"dropdown"
importance
expected
"medium"
alternatives
0
"low"
actual
"Medium"
correct
true
score
1
rawScore
0.6666666666666666
dimensions
3
entryScore
0.6666666666666666
8
name
"Port Gessik"
importance
"low"
score
1
details
type
expected
0
"location"
actual
"location"
correct
true
score
1
attributes
importance
expected
"low"
alternatives
(empty)
actual
"Low"
correct
true
score
1
rawScore
1
dimensions
2
entryScore
1
9
name
"Burden"
importance
"high"
score
1
details
type
expected
0
"object"
actual
"object"
correct
true
score
1
attributes
material
expected
"Bone and iron"
actual
"Bone, Iron"
source
"explicit"
score
1
method
"text"
objectType
expected
"Weapon"
actual
"Weapon"
source
"explicit"
score
1
method
"dropdown"
power
expected
"Light"
actual
"Light"
source
"explicit"
score
1
method
"dropdown"
importance
expected
"high"
alternatives
(empty)
actual
"High"
correct
true
score
1
rawScore
1
dimensions
5
entryScore
1
10
name
"The Little Stoneman"
importance
"medium"
score
1
details
type
expected
0
"object"
actual
"object"
correct
true
score
1
attributes
material
expected
"Soapstone"
actual
"Soapstone"
source
"explicit"
score
1
method
"text"
objectType
expected
"Artifact"
actual
"Artifact"
source
"inferred"
score
1
method
"dropdown"
importance
expected
"medium"
alternatives
(empty)
actual
"Medium"
correct
true
score
1
rawScore
1
dimensions
4
entryScore
1
11
name
"Amma's Ring"
importance
"low"
score
0.9199999999999999
details
type
expected
0
"object"
actual
"object"
correct
true
score
1
attributes
material
expected
"Silver"
actual
"Silver"
source
"explicit"
score
1
method
"text"
objectType
expected
"Jewelry"
actual
"Jewelry"
source
"explicit"
score
1
method
"dropdown"
aliases
score
0.6
matched
0
"amma's silver ring"
1
"silver ring"
2
"mother's ring"
missed
0
"amma's silver band"
1
"silver band"
extra
(empty)
importance
expected
"low"
alternatives
0
"medium"
actual
"Medium"
correct
true
score
1
rawScore
0.9199999999999999
dimensions
5
entryScore
0.9199999999999999
12
name
"The Thornborn"
importance
"medium"
score
1
details
type
expected
0
"lore"
actual
"lore"
correct
true
score
1
attributes
category
expected
"Legend"
actual
"Legend"
source
"inferred"
score
1
method
"dropdown"
importance
expected
"medium"
alternatives
(empty)
actual
"Medium"
correct
true
score
1
rawScore
1
dimensions
3
entryScore
1
13
name
"Root-tongue"
importance
"medium"
score
1
details
type
expected
0
"lore"
actual
"lore"
correct
true
score
1
attributes
category
expected
"Language"
actual
"Language"
source
"inferred"
score
1
method
"dropdown"
importance
expected
"medium"
alternatives
0
"low"
actual
"Medium"
correct
true
score
1
rawScore
1
dimensions
3
entryScore
1
14
name
"Greenveil"
importance
"medium"
score
0.6666666666666666
details
type
expected
0
"lore"
actual
"lore"
correct
true
score
1
attributes
category
expected
"Tradition"
actual
"Tradition"
source
"inferred"
score
1
method
"dropdown"
importance
expected
"medium"
alternatives
(empty)
actual
"Low"
correct
false
score
0
rawScore
0.6666666666666666
dimensions
3
entryScore
0.6666666666666666
explicitAccuracy
correct
20
total
20
rate
1
inferredAccuracy
correct
6
total
8
rate
0.75
93.75%
Precision
True positives: 15/16
totalReported
16
duplicateCount
0
duplicates
(empty)
truePositives
15
reportedDetails
0
parsed
type
"character"
name
"Torben"
status
"true_positive"
matchedExpected
name
"Torben Reikhart"
types
0
"character"
1
parsed
type
"character"
name
"Sable"
status
"true_positive"
matchedExpected
name
"Sable Dunmore"
types
0
"character"
2
parsed
type
"character"
name
"Grunn Tetch"
status
"true_positive"
matchedExpected
name
"Grunn Tetch"
types
0
"character"
3
parsed
type
"character"
name
"Dol"
status
"true_positive"
matchedExpected
name
"Dol Tetch"
types
0
"character"
4
parsed
type
"character"
name
"Amma"
status
"true_positive"
matchedExpected
name
"Amma"
types
0
"character"
5
parsed
type
"character"
name
"Mettik"
status
"true_positive"
matchedExpected
name
"Mettik"
types
0
"character"
6
parsed
type
"location"
name
"Thornveil"
status
"true_positive"
matchedExpected
name
"The Thornveil"
types
0
"location"
7
parsed
type
"location"
name
"Kettlebridge"
status
"true_positive"
matchedExpected
name
"Kettlebridge"
types
0
"location"
8
parsed
type
"location"
name
"Port Gessik"
status
"true_positive"
matchedExpected
name
"Port Gessik"
types
0
"location"
9
parsed
type
"object"
name
"Burden"
status
"true_positive"
matchedExpected
name
"Burden"
types
0
"object"
10
parsed
type
"object"
name
"Silver Band"
status
"true_positive"
matchedExpected
name
"Amma's Ring"
types
0
"object"
11
parsed
type
"object"
name
"The Little Stoneman"
status
"true_positive"
matchedExpected
name
"The Little Stoneman"
types
0
"object"
12
parsed
type
"object"
name
"Knife"
status
"false_positive"
13
parsed
type
"lore"
name
"Root-tongue"
status
"true_positive"
matchedExpected
name
"Root-tongue"
types
0
"lore"
14
parsed
type
"lore"
name
"The Thornborn"
status
"true_positive"
matchedExpected
name
"The Thornborn"
types
0
"lore"
15
parsed
type
"lore"
name
"Greenveil"
status
"true_positive"
matchedExpected
name
"Greenveil"
types
0
"lore"
96.67%
Recall
Matched: 15/15, FP: 1
parsedCount
16
totalExpected
15
duplicates
(empty)
matched
15
falsePositives
1
weightedRecall
1
fpPenalty
0.03333333333333333
expectedDetails
0
expected
name
"Torben Reikhart"
types
0
"character"
importance
"high"
status
"matched"
matchedBy
type
"character"
name
"Torben"
1
expected
name
"Sable Dunmore"
types
0
"character"
importance
"high"
status
"matched"
matchedBy
type
"character"
name
"Sable"
2
expected
name
"Grunn Tetch"
types
0
"character"
importance
"high"
status
"matched"
matchedBy
type
"character"
name
"Grunn Tetch"
3
expected
name
"Dol Tetch"
types
0
"character"
importance
"low"
status
"matched"
matchedBy
type
"character"
name
"Dol"
4
expected
name
"Amma"
types
0
"character"
importance
"low"
status
"matched"
matchedBy
type
"character"
name
"Amma"
5
expected
name
"Mettik"
types
0
"character"
importance
"low"
status
"matched"
matchedBy
type
"character"
name
"Mettik"
6
expected
name
"The Thornveil"
types
0
"location"
importance
"high"
status
"matched"
matchedBy
type
"location"
name
"Thornveil"
7
expected
name
"Kettlebridge"
types
0
"location"
importance
"medium"
status
"matched"
matchedBy
type
"location"
name
"Kettlebridge"
8
expected
name
"Port Gessik"
types
0
"location"
importance
"low"
status
"matched"
matchedBy
type
"location"
name
"Port Gessik"
9
expected
name
"Burden"
types
0
"object"
importance
"high"
status
"matched"
matchedBy
type
"object"
name
"Burden"
10
expected
name
"The Little Stoneman"
types
0
"object"
importance
"medium"
status
"matched"
matchedBy
type
"object"
name
"The Little Stoneman"
11
expected
name
"Amma's Ring"
types
0
"object"
importance
"low"
status
"matched"
matchedBy
type
"object"
name
"Silver Band"
12
expected
name
"The Thornborn"
types
0
"lore"
importance
"medium"
status
"matched"
matchedBy
type
"lore"
name
"The Thornborn"
13
expected
name
"Root-tongue"
types
0
"lore"
importance
"medium"
status
"matched"
matchedBy
type
"lore"
name
"Root-tongue"
14
expected
name
"Greenveil"
types
0
"lore"
importance
"medium"
status
"matched"
matchedBy
type
"lore"
name
"Greenveil"
falsePositiveDetails
0
type
"object"
name
"Knife"
100.00%
Structural validity
Parsed: 16, Avg score: 1.00
parsedCount
16
avgScore
1
entryDetails
0
name
"Torben"
type
"character"
score
1
reason
"fully valid"
1
name
"Sable"
type
"character"
score
1
reason
"fully valid"
2
name
"Grunn Tetch"
type
"character"
score
1
reason
"fully valid"
3
name
"Dol"
type
"character"
score
1
reason
"fully valid"
4
name
"Amma"
type
"character"
score
1
reason
"fully valid"
5
name
"Mettik"
type
"character"
score
1
reason
"fully valid"
6
name
"Thornveil"
type
"location"
score
1
reason
"fully valid"
7
name
"Kettlebridge"
type
"location"
score
1
reason
"fully valid"
8
name
"Port Gessik"
type
"location"
score
1
reason
"fully valid"
9
name
"Burden"
type
"object"
score
1
reason
"fully valid"
10
name
"Silver Band"
type
"object"
score
1
reason
"fully valid"
11
name
"The Little Stoneman"
type
"object"
score
1
reason
"fully valid"
12
name
"Knife"
type
"object"
score
1
reason
"fully valid"
13
name
"Root-tongue"
type
"lore"
score
1
reason
"fully valid"
14
name
"The Thornborn"
type
"lore"
score
1
reason
"fully valid"
15
name
"Greenveil"
type
"lore"
score
1
reason
"fully valid"
94.9442%