Run: 2026-07-07-01KWZ5CC7AJ1BYX7SWSQ5S9HRG

Run Details

Model:
Aion 3.0
Duration:
1m 37s
Cost:
$0.034855
Provider:
AionLabs

Evaluation summary

Score Evaluator
Details Link
93.44% Accuracy (details)
88.24% Precision (details)
96.67% Recall (details)
100.00% Structural validity (details)
94.5866% Overall

Model input

System
You are a meticulous story bible editor for a fiction project. Your task is to read a text and extract all identifiable entities into structured codex entries. Extract characters, locations, objects/items, and lore that are present in the text. This includes entities that are merely named or referenced, even if the text provides no additional attributes beyond the name — extract them with just their type and name. Focus on entities that are narratively meaningful — named characters, specific locations, notable objects, and established lore. Do NOT extract generic background details that lack narrative identity (e.g. "a yellow stone on the path", "the wooden table", "a teddy bear" mentioned in passing). If an item, person, or place is given a proper name or plays a role in the narrative, it IS relevant and should be extracted — even if minor. Rules: 1. Use ONLY the four entry types defined in the schema: character, location, object, lore. 2. Use ONLY the fields defined for each entry type. Do not invent new fields. 3. For dropdown fields, use ONLY the listed values. If no listed value fits, omit the field. 4. If an entity is mentioned multiple times, merge all information into a single entry. 5. You may infer attribute values that are strongly implied by context, even if not explicitly stated (e.g. inferring a time period from surrounding dialogue). 6. Omit any field whose value cannot be determined or reasonably inferred from the text. 7. Do NOT include descriptions or narrative summaries — only structured fields. 8. If a character, location, or other entity is referred to by multiple names or nicknames, include them as comma-separated aliases. 9. Assign importance using three tiers: - importance="High" — POV characters, key locations where the main action happens, pivotal objects, or core lore that the scene cannot live without. - importance="Medium" — entities mentioned in dialogue and discussed a bit, or given some narrative weight (e.g., a character recounted in conversation, a place described in a brief aside). They matter to the story but are not central to the scene. - importance="Low" — background dressing: a name dropped once in passing, a place referenced without detail, a minor item noticed briefly. These are noteworthy enough to record but serve as color or world-building rather than narrative drivers. 10. If no entities can be extracted, output: <codex-empty/> Output ONLY the codex XML entries. Do not include any other text, preamble, or explanation outside the XML. { "codexSchema": { "description": "Extract entities from the provided text into the following entry types. Output as XML.", "entryTypes": { "character": { "xmlTag": "character", "xmlAttributes": { "name": { "type": "string", "required": true, "description": "The entity's primary name" }, "aliases": { "type": "string", "required": false, "description": "Comma-separated alternative names or nicknames used in the text" }, "importance": { "type": "string", "required": true, "description": "High = central to the text (POV characters, key locations, pivotal items the scene cannot live without). Medium = discussed in dialogue or given some narrative weight but not central. Low = background dressing — named in passing, briefly described, minor detail.", "enum": [ "High", "Medium", "Low" ] } }, "fields": { "species": { "type": "string", "enum": [ "Human", "Elf", "Dwarf", "Orc", "Halfling", "Gnome", "Dragon", "Demon", "Angel", "Undead", "Vampire", "Werewolf", "Fae", "Half-Elf", "Goblin", "Troll", "Giant", "Merfolk", "Centaur", "Tiefling" ] }, "gender": { "type": "string", "enum": [ "Male", "Female", "Non-binary" ] }, "age": { "type": "string" }, "eyeColor": { "type": "string", "enum": [ "Blue", "Green", "Brown", "Hazel", "Gray", "Amber", "Black", "Violet", "Red", "Golden", "Silver" ] }, "hairColor": { "type": "string", "enum": [ "Black", "Brown", "Blonde", "Red", "Auburn", "Gray", "White", "Silver", "Blue", "Green" ] } } }, "location": { "xmlTag": "location", "xmlAttributes": { "name": { "type": "string", "required": true, "description": "The entity's primary name" }, "aliases": { "type": "string", "required": false, "description": "Comma-separated alternative names or nicknames used in the text" }, "importance": { "type": "string", "required": true, "description": "High = central to the text (POV characters, key locations, pivotal items the scene cannot live without). Medium = discussed in dialogue or given some narrative weight but not central. Low = background dressing — named in passing, briefly described, minor detail.", "enum": [ "High", "Medium", "Low" ] } }, "fields": { "country": { "type": "string" }, "climate": { "type": "string", "enum": [ "Tropical", "Arid", "Temperate", "Continental", "Polar", "Humid", "Mediterranean", "Desert", "Oceanic", "Subarctic" ] }, "terrain": { "type": "string", "enum": [ "Forest", "Mountain", "Desert", "Plains", "Swamp", "Coastal", "Volcanic", "Tundra", "Underground", "Urban", "Island", "Jungle" ] } } }, "object": { "xmlTag": "object", "xmlAttributes": { "name": { "type": "string", "required": true, "description": "The entity's primary name" }, "aliases": { "type": "string", "required": false, "description": "Comma-separated alternative names or nicknames used in the text" }, "importance": { "type": "string", "required": true, "description": "High = central to the text (POV characters, key locations, pivotal items the scene cannot live without). Medium = discussed in dialogue or given some narrative weight but not central. Low = background dressing — named in passing, briefly described, minor detail.", "enum": [ "High", "Medium", "Low" ] } }, "fields": { "material": { "type": "string" }, "objectType": { "type": "string", "enum": [ "Weapon", "Armor", "Artifact", "Tool", "Jewelry", "Potion", "Book", "Key", "Instrument", "Clothing" ] }, "power": { "type": "string", "enum": [ "Fire", "Water", "Earth", "Air", "Lightning", "Ice", "Dark", "Light", "Arcane", "Nature", "Void", "Poison", "Healing", "Time", "Psychic" ] } } }, "lore": { "xmlTag": "lore", "xmlAttributes": { "name": { "type": "string", "required": true, "description": "The entity's primary name" }, "aliases": { "type": "string", "required": false, "description": "Comma-separated alternative names or nicknames used in the text" }, "importance": { "type": "string", "required": true, "description": "High = central to the text (POV characters, key locations, pivotal items the scene cannot live without). Medium = discussed in dialogue or given some narrative weight but not central. Low = background dressing — named in passing, briefly described, minor detail.", "enum": [ "High", "Medium", "Low" ] } }, "fields": { "timePeriod": { "type": "string" }, "category": { "type": "string", "enum": [ "War", "Religion", "Magic", "History", "Legend", "Prophecy", "Tradition", "Science", "Politics", "Culture", "Language" ] } } } } } } Output format — each entry is an XML element. name, aliases, and importance are XML attributes. All fields are child elements. Omit fields that cannot be determined from the text. Example: <character name="Adris" aliases="The Wanderer" importance="High"> <species>Half-Elf</species> <eyeColor>Green</eyeColor> </character> <location name="Thornwood" importance="Medium"> <terrain>Forest</terrain> </location> <lore name="The Grey Tide" importance="Low"> <category>History</category> </lore>
User/Human
<text> They set out at first light, when the mist still clung to the low ground and the road ahead was a pale smear between hedgerows. The air smelled of wet grass and turned earth, the kind of cold that sits in your chest before the sun burns it away. Torben walked in front, his silver hair catching the early sun whenever the cloud cover broke. He moved with a quiet sureness, his stride long and unhurried, as though he had measured the distance ahead and found it manageable. Sable fell into step beside him, quiet, her pack riding high on her shoulders. Neither of them spoke. There was nothing to say yet — the road would give them plenty to talk about soon enough. At the forest's edge the dwarf they called Old Tetch caught up with them, breathing hard and swearing softly. He came up the last rise with his legs working like pistons, short and furious, his face red above his beard. Sable turned. "Grunn Tetch," she said, and the name was almost a question. He waved her off with a thick hand. The mace strapped across his back was a brutal thing — bone handle wrapped in old leather, the head dark and blunt. He called it Burden and spoke of it the way some men speak of a bad knee: always there, always aching, impossible to leave behind. "Dol's holding Kettlebridge for me," Grunn said, adjusting the strap. "My nephew. Mining town beneath the ridgeline. He'll manage." He didn't sound certain. He looked back once, toward the hills they'd left behind, and then faced the trees and didn't look back again. The trees closed around them within the hour. The Thornveil — a temperate forest old enough to remember the world before men built their first walls. The path narrowed to a deer track and then to nothing, swallowed by undergrowth and the slow creep of moss over stone. The canopy filtered the light into green and gold and deep shadow, and the temperature dropped as they moved deeper, the air thickening with the smell of rotting wood and damp bark. Ferns brushed their legs. Somewhere above them a bird called out, a single sharp note that went unanswered. Sable's auburn hair turned copper in the broken sun. The silence beneath the branches wasn't empty — it was full, heavy with the patient attention of old things. Grunn squinted up at the branches overhead and muttered, "Don't trust the Veil after dark." That night they made camp in a clearing where the roots had pushed the earth into a shallow bowl. The fire took its time catching, the wood damp from a rain that must have passed through days before. Grunn's gray hair looked like iron filings in the firelight. He poked at the coals and said, "My grandmother spoke Root-tongue. The old language. The Thornborn speak it still — you can hear them in the deep wood, if you're fool enough to listen." He broke a stick and fed the pieces to the fire one at a time. Torben leaned back against a tree, his arms folded across his chest. "My mother's people — the elves — they had a different name for the Thornborn. She never taught me the word." He was quiet after that, watching the fire. The coals shifted and settled. Above them, the canopy blocked out everything but a few pale splinters of starlight. Morning came slow and gray. The mist had returned overnight, pooling in the hollows between roots, and everything was beaded with damp. Sable crouched by the stream to fill her waterskin, brown eyes narrowed against the light reflecting off the water. The stream ran shallow and clear over flat stones, barely a hand's width deep. "Mettik's got soldiers waiting at Port Gessik," she said over her shoulder. "Three days east, maybe four. We can't be late." Grunn sat on a rock nearby, turning Burden in his hands. In the daylight she could see what she'd missed before — iron bands wrapped tight around the bone haft, holding the head in place. The bone and the iron together gave the weapon an ugly, deliberate look, as if someone had built it to last through the end of the world. They walked through the day without speaking much. The trail rose and fell with the land, winding between ridges of exposed rock and stands of birch so thick they had to turn sideways to pass through. Torben's green eyes moved between the shadows, watchful. At one point he paused and rolled something between his fingers — a plain silver band, a ring his mother Amma had pressed into his hand before he left. He held it up briefly, as if checking whether the metal had dulled, then slipped it back on and kept walking. Sable, a few paces behind, called him "Stray" without thinking about it. Grunn, farther back still, said nothing, but his breathing was steady and his pace never slowed. The second night's fire was smaller. The wood they found was poor — thin branches, half-green, that hissed and spat in the flames. Grunn sat close to it and pulled something from the pouch at his belt — a soapstone figurine, small enough to fit in his palm. A little man with blocky legs and round eyes. "The Little Stoneman," Grunn said, turning it in the light. "Dol carved it. The boy's got hands for fine work." His amber eyes caught the fire as he looked up. "Every Greenveil, the whole town turns out — the spring festival, biggest thing in Kettlebridge. Dol always made garlands. He was better with flowers than stone, truth be told." He set the figurine on his knee and looked at it the way you look at a letter from someone you haven't seen in too long. Something cracked in the trees beyond the firelight. Grunn was on his feet before the sound had faded, Burden in his fist. The Little Stoneman tumbled from his knee into the dirt. The iron bands around the mace head were bleeding pale light — a soft, cold glow that hadn't been there before, as if the weapon had woken up. "Sab, behind you," Grunn said, his voice low and flat. Sable turned. Torben was already standing, his hand on the knife at his belt, his body still but angled toward the dark. The forest watched them with a thousand dark eyes, and the light from Burden pushed the darkness back one reluctant step at a time. </text> Extract all codex entries from the text above.

Model response

AI
<character name="Torben" aliases="Stray" importance="High"> <species>Half-Elf</species> <gender>Male</gender> <eyeColor>Green</eyeColor> <hairColor>Silver</hairColor> </character> <character name="Sable" aliases="Sab" importance="High"> <gender>Female</gender> <eyeColor>Brown</eyeColor> <hairColor>Auburn</hairColor> </character> <character name="Grunn Tetch" aliases="Old Tetch, Grunn" importance="High"> <species>Dwarf</species> <gender>Male</gender> <eyeColor>Amber</eyeColor> <hairColor>Gray</hairColor> </character> <character name="Dol" importance="Medium"> <species>Dwarf</species> <gender>Male</gender> </character> <character name="Mettik" importance="Low" /> <character name="Amma" importance="Medium"> <species>Elf</species> <gender>Female</gender> </character> <location name="The Thornveil" aliases="the Veil" importance="High"> <climate>Temperate</climate> <terrain>Forest</terrain> </location> <location name="Kettlebridge" importance="Medium"> <terrain>Mountain</terrain> </location> <location name="Port Gessik" importance="Medium"> <terrain>Coastal</terrain> </location> <object name="Burden" importance="High"> <material>bone, leather, iron</material> <objectType>Weapon</objectType> </object> <object name="The Little Stoneman" importance="Medium"> <material>soapstone</material> <objectType>Artifact</objectType> </object> <object name="Amma's ring" importance="Medium"> <material>silver</material> <objectType>Jewelry</objectType> </object> <lore name="Root-tongue" importance="Medium"> <category>Language</category> </lore> <lore name="The Thornborn" importance="Medium"> <category>Legend</category> </lore> <lore name="Greenveil" importance="Low"> <category>Tradition</category> </lore> Wait, I need to double check: is "Burden" a weapon that has a power? It glows with pale light. But that's more of a magical reaction to danger rather than an inherent power type. The light could be "Light" power. Let me think... The iron bands "bled pale light — a soft, cold glow that hadn't been there before, as if the weapon had woken up." This suggests a magical quality, but I'm not sure it maps to a specific power type from the enum. "Light" is in the enum and the glow is described as pale light. I could include it, but it might be too speculative. The glow seems to be a reaction rather than a defined power. I'll leave power out since we don't have enough information. Let me also verify: the Little Stoneman - it falls into the dirt when danger approaches. Is this coincidence or does it have significance? It's more of a narrative detail than a magical property. I'll leave it without a power attribute. Actually, let me also reconsider whether "the Veil" is an alias for "The Thornveil" or if it could be a separate concept. Looking at the text: "Don't trust the Veil after dark." - Grunn is referring to the forest they're in, which is called the Thornveil. So yes, "the Veil" is an alias/abbreviation. One more check - Torben's species. The text says "My mother's people — the elves — they had a different name for the Thornborn." This implies his mother is an elf. It doesn't explicitly say he's a half-elf, but it's strongly implied. He has silver hair and green eyes, which could be elven traits. I'll infer Half-Elf. Actually, I need to be more careful. He says his "mother's people" were elves. This could mean: 1. His mother is an elf (making him potentially half-elven) 2. His mother's people (ancestors) were elves The most natural reading is that his mother is an elf, which would make him a Half-Elf if his father is human. But we don't know about his father. Still, Half-Elf is the most reasonable inference given the context. Let me also verify hair colors against the enum: - Torben: silver hair → Silver (in enum) ✓ - Sable: auburn hair → Auburn (in enum) ✓ - Grunn: gray hair → Gray (in enum) ✓ And eye colors: - Torben: green eyes → Green (in enum) ✓ - Sable: brown eyes → Brown (in enum) ✓ - Grunn: amber eyes → Amber (in enum) ✓ Now let me format all of these as XML entries. Wait, I should also check - is "Stray" an alias for Torben? Yes: "Sable, a few paces behind, called him 'Stray' without thinking about it." This is a nickname used for Torben. And "Sab" is used by Grunn for Sable: "Sab, behind you," Grunn said. Alright, let me also think about whether there's anything I'm missing: - The road/track they're walking on - not named, just "the road" or "the trail" - The stream - not named - The clearing/campsite - not named - Various natural features - not named I think I've captured all the named entities. Let me write the XML. Wait, one more thing: "the hills they'd left behind" - not a specific named location, so I won't extract it. Also: "Port Gessik" - it says "Three days east, maybe four" from their current location. It's where Mettik has soldiers waiting. The word "Port" suggests it's a port town. I'll set the terrain as "Coastal" based on the name implying a port. Let me also consider: should "Port Gessik" importance be Medium or Low? It's mentioned once but with some detail (distance, purpose - soldiers waiting). I think Medium is appropriate since it's discussed in a way that affects their plans. And "Mettik" - he's named only in the context of having soldiers at Port Gessik. He's mentioned once in passing. Low importance. Okay, I think I have everything. Let me write the final XML. Actually, let me reconsider one more time. The text mentions "the world before men built their first walls" - this is a piece of lore about the age of the Thornveil. But it's not really a separate lore entity - it's just describing the forest's age. I won't extract this as a separate lore entry. Also, the text mentions "Root-tongue" as "the old language" - this is the language lore entry I already have. I think I'm ready to write the final output. Let me verify one more thing about Amma's ring: "a plain silver band, a ring his mother Amma had pressed into his hand before he left." So it's a plain silver ring/band given by Amma to Torben. It doesn't have any apparent magical properties mentioned. It's just a sentimental item. And for "The Little Stoneman" - Grunn pulls it from his pouch, says "The Little Stoneman" and it was carved by Dol. It's a soapstone figurine. Okay, let me also think about whether the figurine should have objectType "Artifact" or something else. Looking at the enum: Weapon, Armor, Artifact, Tool, Jewelry, Potion, Book, Key, Instrument, Clothing. None of these perfectly fit a carved figurine, but "Artifact" seems closest since it's a crafted item with personal/cultural significance. I'll use Artifact. One more consideration: "Burden" the mace - should I list it as having a power? The text says the iron bands started glowing with pale light "as if the weapon had woken up." This could suggest some kind of magical property. The glow is described as "pale light — a soft, cold glow." Could this be "Light" power? Or perhaps the weapon reacts to danger in some way. I think I should note this, but I'm not sure which power type fits. The glow is "pale light" which could be "Light" but it's also "cold" which might suggest something else. Actually, it might just be a reaction to the presence of the Thornborn or danger in the forest, not an inherent power of the weapon. I'll leave power out since we don't have enough information. Actually, looking again at the enum options for power: Fire, Water, Earth, Air, Lightning, Ice, Dark, Light, Arcane, Nature, Void, Poison, Healing, Time, Psychic. The glow is "pale light — a soft, cold glow" - this could be "Light" power. But I'm not confident enough to assign this definitively. The glow appears only once and seems to be a reaction to something in the forest rather than an inherent power of the weapon. I'll leave it without a power attribute. Okay, final check - did I miss any characters? Characters mentioned: - Torben ✓ - Sable ✓ - Grunn Tetch / Old Tetch ✓ - Dol ✓ - Mettik ✓ - Amma ✓ - Grunn's grandmother (mentioned as speaking Root-tongue) - Should I include her? She's mentioned in passing as part of Grunn's backstory. She's not given a name. I think she's too minor to include as a separate character entry since we don't even know her name. Actually, looking at the rules: "This includes entities that are merely named or referenced, even if the text provides no additional attributes beyond the name." But she's not named - she's just "my grandmother." So I won't include her. Any other characters? No, I think that's everyone. Locations: - The Thornveil ✓ - Kettlebridge ✓ - Port Gessik ✓ Objects: - Burden ✓ - The Little Stoneman ✓ - Amma's ring ✓ Lore: - Root-tongue ✓ - The Thornborn ✓ - Greenveil ✓ I think I have everything. Let me finalize. Actually, let me also reconsider the "hills they'd left behind" - not named, so not included. And "the ridgeline" mentioned in "Mining town beneath the ridgeline" - this is just describing Kettlebridge's location, not a separate named location. Okay, I'm ready to write the final output. Let me double-check my XML format against the example: <character name="Adris" aliases="The Wanderer" importance="High"> <species>Half-Elf</species> <eyeColor>Green</eyeColor> </character> Yes, this matches the format I should use. Also, for characters with no determinable attributes, I need to decide: do I include an empty element or can I self-close? Looking at the rules: "Omit any field whose value cannot be determined or reasonably inferred from the text." For Mettik, we know nothing except the name. So: <character name="Mettik" importance="Low" /> Or should I have child elements? If I have no child elements, I can self-close. That should be fine. Let me write it all out now.
created_at"2026-07-07T20:47:43.887Z" 7/7/2026, 8:47:43 PM
model"aion-labs/aion-3.0-20260707"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency736
moderation_latency(null)
generation_time96874
tokens_prompt4476
tokens_completion5220
native_tokens_prompt3602
native_tokens_completion5009
native_tokens_completion_images(null)
native_tokens_reasoning2599
native_tokens_cached2669
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
num_fetches(null)
web_search_engine(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
service_tier(null)
usage0.03485475
router(null)
provider_responses
0
endpoint_id"8c8f827d-2bef-468a-8f9e-8e27b470de5e"
id"126d287a8cdd4a3dbb30a146ac2347cd"
is_byokfalse
latency733
model_permaslug"aion-labs/aion-3.0-20260707"
provider_name"AionLabs"
status200
user_agent"langchainjs-openai/1.0.0 ((node/v24.18.0; linux; x64))"
http_referer(null)
request_id"req-1783457263-Msk75RbW1d4chmnvPoEt"
session_id(null)
preset_id(null)
api_type"completions"
id"gen-1783457263-cB2JYd3d96VoOnCjdUoC"
upstream_id"126d287a8cdd4a3dbb30a146ac2347cd"
total_cost0.03485475
cache_discount0.00600525
upstream_inference_cost0
provider_name"AionLabs"
response_cache_source_id(null)
data_region"global"

Evaluation details

Result Evaluator Details Meta Data
93.44% Accuracy
Eligible: 15, Weighted avg: 0.93
eligibleCount15
matchedCount15
weightedAvg0.9344444444444444
entryScores
0
name"Torben Reikhart"
importance"high"
score1
details
type
expected
0"character"
actual"character"
correcttrue
score1
attributes
species
expected"Half-Elf"
actual"Half-Elf"
source"inferred"
score1
method"dropdown"
gender
expected"Male"
actual"Male"
source"explicit"
score1
method"dropdown"
eyeColor
expected"Green"
actual"Green"
source"explicit"
score1
method"dropdown"
hairColor
expected"Silver"
actual"Silver"
source"explicit"
score1
method"dropdown"
aliases
score1
matched
0"stray"
missed(empty)
extra(empty)
importance
expected"high"
alternatives(empty)
actual"High"
correcttrue
score1
rawScore1
dimensions7
entryScore1
1
name"Sable Dunmore"
importance"high"
score1
details
type
expected
0"character"
actual"character"
correcttrue
score1
attributes
gender
expected"Female"
actual"Female"
source"explicit"
score1
method"dropdown"
eyeColor
expected"Brown"
actual"Brown"
source"explicit"
score1
method"dropdown"
hairColor
expected"Auburn"
actual"Auburn"
source"explicit"
score1
method"dropdown"
aliases
score1
matched
0"sab"
missed(empty)
extra(empty)
importance
expected"high"
alternatives(empty)
actual"High"
correcttrue
score1
rawScore1
dimensions6
entryScore1
2
name"Grunn Tetch"
importance"high"
score1
details
type
expected
0"character"
actual"character"
correcttrue
score1
attributes
species
expected"Dwarf"
actual"Dwarf"
source"explicit"
score1
method"dropdown"
gender
expected"Male"
actual"Male"
source"explicit"
score1
method"dropdown"
eyeColor
expected"Amber"
actual"Amber"
source"explicit"
score1
method"dropdown"
hairColor
expected"Gray"
actual"Gray"
source"explicit"
score1
method"dropdown"
aliases
score1
matched
0"old tetch"
missed(empty)
extra
0"grunn"
importance
expected"high"
alternatives(empty)
actual"High"
correcttrue
score1
rawScore1
dimensions7
entryScore1
3
name"Dol Tetch"
importance"low"
score1
details
type
expected
0"character"
actual"character"
correcttrue
score1
attributes
gender
expected"Male"
actual"Male"
source"explicit"
score1
method"dropdown"
species
expected"Dwarf"
actual"Dwarf"
source"inferred"
score1
method"dropdown"
importance
expected"low"
alternatives
0"medium"
actual"Medium"
correcttrue
score1
rawScore1
dimensions4
entryScore1
4
name"Amma"
importance"low"
score1
details
type
expected
0"character"
actual"character"
correcttrue
score1
attributes
gender
expected"Female"
actual"Female"
source"explicit"
score1
method"dropdown"
species
expected"Elf"
actual"Elf"
source"inferred"
score1
method"dropdown"
importance
expected"low"
alternatives
0"medium"
actual"Medium"
correcttrue
score1
rawScore1
dimensions4
entryScore1
5
name"Mettik"
importance"low"
score1
details
type
expected
0"character"
actual"character"
correcttrue
score1
attributes
importance
expected"low"
alternatives(empty)
actual"Low"
correcttrue
score1
rawScore1
dimensions2
entryScore1
6
name"The Thornveil"
importance"high"
score1
details
type
expected
0"location"
actual"location"
correcttrue
score1
attributes
terrain
expected"Forest"
actual"Forest"
source"explicit"
score1
method"dropdown"
climate
expected"Temperate"
actual"Temperate"
source"explicit"
score1
method"dropdown"
aliases
score1
matched
0"the veil"
missed(empty)
extra(empty)
importance
expected"high"
alternatives(empty)
actual"High"
correcttrue
score1
rawScore1
dimensions5
entryScore1
7
name"Kettlebridge"
importance"medium"
score1
details
type
expected
0"location"
actual"location"
correcttrue
score1
attributes
terrain
expected"Mountain"
actual"Mountain"
source"inferred"
score1
method"dropdown"
importance
expected"medium"
alternatives
0"low"
actual"Medium"
correcttrue
score1
rawScore1
dimensions3
entryScore1
8
name"Port Gessik"
importance"low"
score0.5
details
type
expected
0"location"
actual"location"
correcttrue
score1
attributes
importance
expected"low"
alternatives(empty)
actual"Medium"
correctfalse
score0
rawScore0.5
dimensions2
entryScore0.5
9
name"Burden"
importance"high"
score0.8
details
type
expected
0"object"
actual"object"
correcttrue
score1
attributes
material
expected"Bone and iron"
actual"bone, leather, iron"
source"explicit"
score1
method"text"
objectType
expected"Weapon"
actual"Weapon"
source"explicit"
score1
method"dropdown"
power
expected"Light"
actual(null)
source"explicit"
score0
reason"missing"
importance
expected"high"
alternatives(empty)
actual"High"
correcttrue
score1
rawScore0.8
dimensions5
entryScore0.8
10
name"The Little Stoneman"
importance"medium"
score1
details
type
expected
0"object"
actual"object"
correcttrue
score1
attributes
material
expected"Soapstone"
actual"soapstone"
source"explicit"
score1
method"text"
objectType
expected"Artifact"
actual"Artifact"
source"inferred"
score1
method"dropdown"
importance
expected"medium"
alternatives(empty)
actual"Medium"
correcttrue
score1
rawScore1
dimensions4
entryScore1
11
name"Amma's Ring"
importance"low"
score0.8
details
type
expected
0"object"
actual"object"
correcttrue
score1
attributes
material
expected"Silver"
actual"silver"
source"explicit"
score1
method"text"
objectType
expected"Jewelry"
actual"Jewelry"
source"explicit"
score1
method"dropdown"
aliases
score0
matched(empty)
missed
0"amma's silver ring"
1"amma's silver band"
2"silver ring"
3"silver band"
4"mother's ring"
extra(empty)
importance
expected"low"
alternatives
0"medium"
actual"Medium"
correcttrue
score1
rawScore0.8
dimensions5
entryScore0.8
12
name"The Thornborn"
importance"medium"
score1
details
type
expected
0"lore"
actual"lore"
correcttrue
score1
attributes
category
expected"Legend"
actual"Legend"
source"inferred"
score1
method"dropdown"
importance
expected"medium"
alternatives(empty)
actual"Medium"
correcttrue
score1
rawScore1
dimensions3
entryScore1
13
name"Root-tongue"
importance"medium"
score1
details
type
expected
0"lore"
actual"lore"
correcttrue
score1
attributes
category
expected"Language"
actual"Language"
source"inferred"
score1
method"dropdown"
importance
expected"medium"
alternatives
0"low"
actual"Medium"
correcttrue
score1
rawScore1
dimensions3
entryScore1
14
name"Greenveil"
importance"medium"
score0.6666666666666666
details
type
expected
0"lore"
actual"lore"
correcttrue
score1
attributes
category
expected"Tradition"
actual"Tradition"
source"inferred"
score1
method"dropdown"
importance
expected"medium"
alternatives(empty)
actual"Low"
correctfalse
score0
rawScore0.6666666666666666
dimensions3
entryScore0.6666666666666666
explicitAccuracy
correct19
total20
rate0.95
inferredAccuracy
correct8
total8
rate1
88.24% Precision
True positives: 15/17
totalReported17
duplicateCount1
duplicates
0
type"character"
name"Mettik"
truePositives15
reportedDetails
0
parsed
type"character"
name"Torben"
status"true_positive"
matchedExpected
name"Torben Reikhart"
types
0"character"
1
parsed
type"character"
name"Sable"
status"true_positive"
matchedExpected
name"Sable Dunmore"
types
0"character"
2
parsed
type"character"
name"Grunn Tetch"
status"true_positive"
matchedExpected
name"Grunn Tetch"
types
0"character"
3
parsed
type"character"
name"Dol"
status"true_positive"
matchedExpected
name"Dol Tetch"
types
0"character"
4
parsed
type"character"
name"Mettik"
status"true_positive"
matchedExpected
name"Mettik"
types
0"character"
5
parsed
type"character"
name"Amma"
status"true_positive"
matchedExpected
name"Amma"
types
0"character"
6
parsed
type"character"
name"Adris"
status"false_positive"
7
parsed
type"location"
name"The Thornveil"
status"true_positive"
matchedExpected
name"The Thornveil"
types
0"location"
8
parsed
type"location"
name"Kettlebridge"
status"true_positive"
matchedExpected
name"Kettlebridge"
types
0"location"
9
parsed
type"location"
name"Port Gessik"
status"true_positive"
matchedExpected
name"Port Gessik"
types
0"location"
10
parsed
type"object"
name"Burden"
status"true_positive"
matchedExpected
name"Burden"
types
0"object"
11
parsed
type"object"
name"The Little Stoneman"
status"true_positive"
matchedExpected
name"The Little Stoneman"
types
0"object"
12
parsed
type"object"
name"Amma's ring"
status"true_positive"
matchedExpected
name"Amma's Ring"
types
0"object"
13
parsed
type"lore"
name"Root-tongue"
status"true_positive"
matchedExpected
name"Root-tongue"
types
0"lore"
14
parsed
type"lore"
name"The Thornborn"
status"true_positive"
matchedExpected
name"The Thornborn"
types
0"lore"
15
parsed
type"lore"
name"Greenveil"
status"true_positive"
matchedExpected
name"Greenveil"
types
0"lore"
96.67% Recall
Matched: 15/15, FP: 1
parsedCount17
totalExpected15
duplicates
0
type"character"
name"Mettik"
matched15
falsePositives1
weightedRecall1
fpPenalty0.03333333333333333
expectedDetails
0
expected
name"Torben Reikhart"
types
0"character"
importance"high"
status"matched"
matchedBy
type"character"
name"Torben"
1
expected
name"Sable Dunmore"
types
0"character"
importance"high"
status"matched"
matchedBy
type"character"
name"Sable"
2
expected
name"Grunn Tetch"
types
0"character"
importance"high"
status"matched"
matchedBy
type"character"
name"Grunn Tetch"
3
expected
name"Dol Tetch"
types
0"character"
importance"low"
status"matched"
matchedBy
type"character"
name"Dol"
4
expected
name"Amma"
types
0"character"
importance"low"
status"matched"
matchedBy
type"character"
name"Amma"
5
expected
name"Mettik"
types
0"character"
importance"low"
status"matched"
matchedBy
type"character"
name"Mettik"
6
expected
name"The Thornveil"
types
0"location"
importance"high"
status"matched"
matchedBy
type"location"
name"The Thornveil"
7
expected
name"Kettlebridge"
types
0"location"
importance"medium"
status"matched"
matchedBy
type"location"
name"Kettlebridge"
8
expected
name"Port Gessik"
types
0"location"
importance"low"
status"matched"
matchedBy
type"location"
name"Port Gessik"
9
expected
name"Burden"
types
0"object"
importance"high"
status"matched"
matchedBy
type"object"
name"Burden"
10
expected
name"The Little Stoneman"
types
0"object"
importance"medium"
status"matched"
matchedBy
type"object"
name"The Little Stoneman"
11
expected
name"Amma's Ring"
types
0"object"
importance"low"
status"matched"
matchedBy
type"object"
name"Amma's ring"
12
expected
name"The Thornborn"
types
0"lore"
importance"medium"
status"matched"
matchedBy
type"lore"
name"The Thornborn"
13
expected
name"Root-tongue"
types
0"lore"
importance"medium"
status"matched"
matchedBy
type"lore"
name"Root-tongue"
14
expected
name"Greenveil"
types
0"lore"
importance"medium"
status"matched"
matchedBy
type"lore"
name"Greenveil"
falsePositiveDetails
0
type"character"
name"Adris"
100.00% Structural validity
Parsed: 17, Avg score: 1.00
parsedCount17
avgScore1
entryDetails
0
name"Torben"
type"character"
score1
reason"fully valid"
1
name"Sable"
type"character"
score1
reason"fully valid"
2
name"Grunn Tetch"
type"character"
score1
reason"fully valid"
3
name"Dol"
type"character"
score1
reason"fully valid"
4
name"Mettik"
type"character"
score1
reason"fully valid"
5
name"Amma"
type"character"
score1
reason"fully valid"
6
name"Adris"
type"character"
score1
reason"fully valid"
7
name"Mettik"
type"character"
score1
reason"fully valid"
8
name"The Thornveil"
type"location"
score1
reason"fully valid"
9
name"Kettlebridge"
type"location"
score1
reason"fully valid"
10
name"Port Gessik"
type"location"
score1
reason"fully valid"
11
name"Burden"
type"object"
score1
reason"fully valid"
12
name"The Little Stoneman"
type"object"
score1
reason"fully valid"
13
name"Amma's ring"
type"object"
score1
reason"fully valid"
14
name"Root-tongue"
type"lore"
score1
reason"fully valid"
15
name"The Thornborn"
type"lore"
score1
reason"fully valid"
16
name"Greenveil"
type"lore"
score1
reason"fully valid"
94.5866%