Run: 2026-05-27-01KSMF25BFR5WA5R3AD67BCMBM

Run Details

Duration:
48.3s
Cost:
$0.003761
Provider:
Parasail

Evaluation summary

Score Evaluator
Details Link
46.01% Accuracy (details)
90.00% Precision (details)
37.61% Recall (details)
60.00% Structural validity (details)
58.4051% Overall

Model input

System
You are a meticulous story bible editor for a fiction project. Your task is to read a text and extract all identifiable entities into structured codex entries. Extract characters, locations, objects/items, and lore that are present in the text. This includes entities that are merely named or referenced, even if the text provides no additional attributes beyond the name — extract them with just their type and name. Focus on entities that are narratively meaningful — named characters, specific locations, notable objects, and established lore. Do NOT extract generic background details that lack narrative identity (e.g. "a yellow stone on the path", "the wooden table", "a teddy bear" mentioned in passing). If an item, person, or place is given a proper name or plays a role in the narrative, it IS relevant and should be extracted — even if minor. Rules: 1. Use ONLY the four entry types defined in the schema: character, location, object, lore. 2. Use ONLY the fields defined for each entry type. Do not invent new fields. 3. For dropdown fields, use ONLY the listed values. If no listed value fits, omit the field. 4. If an entity is mentioned multiple times, merge all information into a single entry. 5. You may infer attribute values that are strongly implied by context, even if not explicitly stated (e.g. inferring a time period from surrounding dialogue). 6. Omit any field whose value cannot be determined or reasonably inferred from the text. 7. Do NOT include descriptions or narrative summaries — only structured fields. 8. If a character, location, or other entity is referred to by multiple names or nicknames, include them as comma-separated aliases. 9. Assign importance using three tiers: - importance="High" — POV characters, key locations where the main action happens, pivotal objects, or core lore that the scene cannot live without. - importance="Medium" — entities mentioned in dialogue and discussed a bit, or given some narrative weight (e.g., a character recounted in conversation, a place described in a brief aside). They matter to the story but are not central to the scene. - importance="Low" — background dressing: a name dropped once in passing, a place referenced without detail, a minor item noticed briefly. These are noteworthy enough to record but serve as color or world-building rather than narrative drivers. 10. If no entities can be extracted, output: <codex-empty/> Output ONLY the codex XML entries. Do not include any other text, preamble, or explanation outside the XML. { "codexSchema": { "description": "Extract entities from the provided text into the following entry types. Output as XML.", "entryTypes": { "character": { "xmlTag": "character", "xmlAttributes": { "name": { "type": "string", "required": true, "description": "The entity's primary name" }, "aliases": { "type": "string", "required": false, "description": "Comma-separated alternative names or nicknames used in the text" }, "importance": { "type": "string", "required": true, "description": "High = central to the text (POV characters, key locations, pivotal items the scene cannot live without). Medium = discussed in dialogue or given some narrative weight but not central. Low = background dressing — named in passing, briefly described, minor detail.", "enum": [ "High", "Medium", "Low" ] } }, "fields": { "species": { "type": "string", "enum": [ "Human", "Elf", "Dwarf", "Orc", "Halfling", "Gnome", "Dragon", "Demon", "Angel", "Undead", "Vampire", "Werewolf", "Fae", "Half-Elf", "Goblin", "Troll", "Giant", "Merfolk", "Centaur", "Tiefling" ] }, "gender": { "type": "string", "enum": [ "Male", "Female", "Non-binary" ] }, "age": { "type": "string" }, "eyeColor": { "type": "string", "enum": [ "Blue", "Green", "Brown", "Hazel", "Gray", "Amber", "Black", "Violet", "Red", "Golden", "Silver" ] }, "hairColor": { "type": "string", "enum": [ "Black", "Brown", "Blonde", "Red", "Auburn", "Gray", "White", "Silver", "Blue", "Green" ] } } }, "location": { "xmlTag": "location", "xmlAttributes": { "name": { "type": "string", "required": true, "description": "The entity's primary name" }, "aliases": { "type": "string", "required": false, "description": "Comma-separated alternative names or nicknames used in the text" }, "importance": { "type": "string", "required": true, "description": "High = central to the text (POV characters, key locations, pivotal items the scene cannot live without). Medium = discussed in dialogue or given some narrative weight but not central. Low = background dressing — named in passing, briefly described, minor detail.", "enum": [ "High", "Medium", "Low" ] } }, "fields": { "country": { "type": "string" }, "climate": { "type": "string", "enum": [ "Tropical", "Arid", "Temperate", "Continental", "Polar", "Humid", "Mediterranean", "Desert", "Oceanic", "Subarctic" ] }, "terrain": { "type": "string", "enum": [ "Forest", "Mountain", "Desert", "Plains", "Swamp", "Coastal", "Volcanic", "Tundra", "Underground", "Urban", "Island", "Jungle" ] } } }, "object": { "xmlTag": "object", "xmlAttributes": { "name": { "type": "string", "required": true, "description": "The entity's primary name" }, "aliases": { "type": "string", "required": false, "description": "Comma-separated alternative names or nicknames used in the text" }, "importance": { "type": "string", "required": true, "description": "High = central to the text (POV characters, key locations, pivotal items the scene cannot live without). Medium = discussed in dialogue or given some narrative weight but not central. Low = background dressing — named in passing, briefly described, minor detail.", "enum": [ "High", "Medium", "Low" ] } }, "fields": { "material": { "type": "string" }, "objectType": { "type": "string", "enum": [ "Weapon", "Armor", "Artifact", "Tool", "Jewelry", "Potion", "Book", "Key", "Instrument", "Clothing" ] }, "power": { "type": "string", "enum": [ "Fire", "Water", "Earth", "Air", "Lightning", "Ice", "Dark", "Light", "Arcane", "Nature", "Void", "Poison", "Healing", "Time", "Psychic" ] } } }, "lore": { "xmlTag": "lore", "xmlAttributes": { "name": { "type": "string", "required": true, "description": "The entity's primary name" }, "aliases": { "type": "string", "required": false, "description": "Comma-separated alternative names or nicknames used in the text" }, "importance": { "type": "string", "required": true, "description": "High = central to the text (POV characters, key locations, pivotal items the scene cannot live without). Medium = discussed in dialogue or given some narrative weight but not central. Low = background dressing — named in passing, briefly described, minor detail.", "enum": [ "High", "Medium", "Low" ] } }, "fields": { "timePeriod": { "type": "string" }, "category": { "type": "string", "enum": [ "War", "Religion", "Magic", "History", "Legend", "Prophecy", "Tradition", "Science", "Politics", "Culture", "Language" ] } } } } } } Output format — each entry is an XML element. name, aliases, and importance are XML attributes. All fields are child elements. Omit fields that cannot be determined from the text. Example: <character name="Adris" aliases="The Wanderer" importance="High"> <species>Half-Elf</species> <eyeColor>Green</eyeColor> </character> <location name="Thornwood" importance="Medium"> <terrain>Forest</terrain> </location> <lore name="The Grey Tide" importance="Low"> <category>History</category> </lore>
User/Human
<text> The Spire of Echoes rose from the mountain's shoulder like a black tooth against the snow. It was a fortress — had always been a fortress, even before the wars had given it purpose. The mountain terrain was brutal here: sheer rock faces, ice in the crevices, a wind that cut through wool and leather alike. Frost coated every surface. The stone was dark and slick with it. Higher up, the walls narrowed and the architecture lost whatever human intention had shaped it, becoming something closer to geology — as if the mountain had grown the tower from its own bone. Birds didn't nest here. Nothing lived on these upper slopes that didn't have to. Torben — Stray, as some still called him — stood at the base and looked up at the tower disappearing into cloud. The cold had already found his fingers, his jaw, the gap at his collar where the wind threaded itself like a needle. He had been in worse places. Not many. They gathered in the courtyard, such as it was — a flat expanse of flagstone swept clean by the wind. Sable stood to his left, arms crossed, her jaw set. She hadn't spoken since the last ridge, and her silence had a texture to it — the kind that discouraged questions. Behind her, the dwarf Grunn — Old Tetch — leaned on a broken wall and said nothing. His eyes moved, though. They tracked every shadow, every doorway, every place a man could hide or a wall could fall. Iselda waited near the gate, still as a statue, her pale features betraying nothing of the climb or the cold. Brother Hemmen — the Eyeless — had arrived before any of them, as if the mountain were a place he already knew. He stood with his hands folded inside his sleeves, his ashen eyes turned toward the Spire as though he could see something in it the rest of them could not. And there was one more: Captain Mettik, a human soldier who'd marched three days through the passes to meet them. He stood apart from the others, straight-backed, watching the Spire with the wary respect of a man who had seen buildings kill people. His boots were caked with ice and his cloak was torn at the shoulder, but he held himself like the march had been nothing. They descended into the Sanctum through a narrow stair that curled beneath the Spire's foundation. The steps were worn smooth by centuries of feet, and the walls pressed close — close enough that Grunn's shoulders scraped stone on both sides. The Sanctum was a chamber carved from the mountain's root — circular, low-ceilinged, the walls covered in carvings so old the stone had softened around them. Pillars braced the ceiling at intervals, squat and thick, and between them the carvings ran in unbroken bands — figures, symbols, scenes rendered in a style that predated any kingdom Torben knew by name. Dim light filtered through cracks in the rock above. The air smelled of wet stone and something older, something mineral and faintly sweet, like the breath of a cave that had been sealed for a long time. It was cold. Everything here was cold. Hemmen spoke first. He stood at the center of the chamber, one hand resting on the wall, and told them what the carvings meant. "The Riven War," he said. "A thousand years before the Felling. Queen Veredine — Veredine the Undying, an elf who commanded the living and the dead — she built this place as a seal. Her army, the Pallid Host, were the restless dead she had bound to her will. They did not tire. They did not question. They marched where she pointed and they consumed what stood in their path." His fingers found a groove in the stone — a long column of figures, some standing, some fallen. "When the war ended, she sealed them here. Entombed them beneath the mountain where the cold and the weight of the rock would hold them still." He traced a line across the stone with one finger. "Hatchwell — the town that stood at the mountain's base — burned. Nothing left. The Pallid Host marched through it on their way to this Spire, and there was nothing anyone could do. The people of Hatchwell had no warning. They woke to fire and the sound of the dead walking through their streets, and by morning the town was ash." The silence that followed was broken by footsteps. Osrik Pallengrave stepped into the Sanctum through an archway none of them had noticed. The Pale, they called him. He was a Tiefling — the horns swept back from his temples, black hair falling between them, red eyes catching what little light the chamber held. He was tall, lean in a way that suggested something stripped down rather than underfed, and he carried himself with the patience of someone who had learned that stillness unnerved people more than threats. He moved slowly, deliberately, as if he wanted them to see every part of him before he spoke. In his right hand he carried a blade: Harrowglass. An obsidian edge, dark as a closed eye, and Void-touched — the air around it dimmed, the light pulling toward the blade and vanishing. Some called it the Hungering Edge, and the name fit. It looked like it could eat the light from a room and still be hungry. Torben stepped forward. His green eyes met Osrik's red ones across the chamber. Neither moved. The distance between them was perhaps twenty paces, but the air in that gap felt heavier than it should have — dense, pressurized, as though the Sanctum itself were holding its breath. Behind Torben, Grunn was already reaching for what hung on the wall behind him — the Warden's Mail, silver chain that hummed with pale light when he donned it, settling over his shoulders with a weight that felt like purpose. The links caught the dim glow and threw it back against the walls. Captain Mettik's hand went to his sword, though he did not draw. Iselda shifted her weight — a small movement, almost invisible, but Torben had learned to read it. She was ready. The carvings on the walls seemed to shift in the changing light. Hemmen's voice rose. "The Binding of Reshkai — you know of it. What was sealed in The Hollow was one half of a lock. This Spire is the other." He looked at Osrik. "The Felling broke the world two centuries ago. But this — this was built to stop something older." Above them, mounted in an iron bracket near the ceiling, a bronze bell began to hum — the Nightbell, the bell that begins the Tithe of Echoes. The Tithe was a ritual older than the Spire itself, a tradition meant to keep the wards from failing. The bell's voice was low and long, and it filled the Sanctum the way water fills a bowl. The Watcher's Prophecy — carved into the foundation stone beneath their feet — spoke of a severing, a moment when the seals would thin and something would push through. Sable drew Kindling. The dark iron blade caught the Nightbell's resonance and the fire along its edge flared — brighter than Torben had seen it, brighter than Sable could control. She didn't look at the blade. She looked at Osrik. "Wren Hessik died at your hands," she said. Her voice was steady but her knuckles were white around the hilt. "And before her — Petal. My sister. You remember, don't you? You were there when The Felling reached the coast. You were there when the world caught fire." Osrik said nothing. The Hungering Edge moved slightly in his grip, as if it were breathing. The first strike came from the dark. Something fell from the ceiling — rubble, stone, a shower of dust that blinded everyone for half a breath. Chains rattled in the walls. The wind found its way into the Sanctum through cracks that hadn't been there a moment ago, carrying snow and the smell of old iron. Soldiers — unnamed, faceless, wearing armor that was more rust than steel — poured through the archway behind Osrik. They moved like men who had forgotten how to stop. Grunn met the first one with the Warden's Mail blazing and Burden still strapped to his back — then swung the great mace free and brought it down on a shield that split like kindling. Torben moved left. Sable moved right. Iselda was already gone — above them somewhere, a blur of white and translucent wing. Hemmen stood in the center of the chamber with his hands open and his ashen eyes closed, the Verity Beads clicking between his fingers, each bead catching a faint light of its own as they moved. The floor shook. Stones fell. A wooden beam cracked and swung loose from the ceiling, trailing dust. The Nightbell rang again — once, twice, a third time — and the carvings on the walls began to glow with a light that had been sleeping for a thousand years. The crumbling walls shed mortar like dead skin. An iron door at the far end of the Sanctum buckled inward. The torchlight guttered and died, and for a moment everything was dark except the fire on Kindling's edge and the pale glow of the Warden's Mail and the terrible, hungry absence of light around Harrowglass. Then the Spire shook to its roots, and the mountain answered. </text> Extract all codex entries from the text above.

Model response

AI
<character name="Torben" aliases="Stray" importance="High"> <species>Human</species> <eyeColor>Green</eyeColor> </character> <character name="Sable" importance="Medium"> <species>Human</species> <objectType>Kindling</objectType> <power>Fire</power> </character> <character name="Grunn" importance="Medium"> <species>Dwarf</species> <nickname>Old Tetch</nickname> <objects> <object>Warden's Mail</object> <object>Burden</object> </objects> <power>Fire</power> <power>Earth</power> </character> <character name="Iselda" importance="Medium"> <species>Human</species> <attributes>White</attributes> <wing>Translucent</wing> </character> <character name="Hemmen" importance="Medium"> <species>Human</species> <nickname>The Eyeless</nickname> <attributes>Ashen eyes</attributes> <objects> <object>Verity Beads</object> </objects> </character> <character name="Mettik" importance="Low"> <species>Human</species> <title>Captain</title> <title>Soldier</title> <objects> <object>Sword</object> </objects> </character> <character name="Osrik" aliases="The Pale" importance="High"> <species>Tiefling</species> <hairColor>Black</hairColor> <eyeColor>Red</eyeColor> <objects> <object>Harrowglass, weapon</object> </objects> <power>Void</power> </character> <location name="The Spire of Echoes" italian="High"> <climate>Cold</climate> <terrain>Mountain</terrain> <terrain>Underground</terrain> <attr>Tower, black, stone, narrow, architecture loses human intention, geology</attr> <attr>Brutal mountain terrain</attr> <attr>Fortress, even before the wars, founded as one, cold, narrows and loses human intention higher up, becomes geology, no birds, nothing lives, cloud</attr> <attr>Cold, frost on everything, slick with frost, wind through wool and leather, mountain</attr> <attr>Courtyard, flagstone, wind-swept, Along one wall, cliffs, ice in crevices, roots of the Spire, winding stair, reflects the Spire's age</attr> <attr>To The Sanctuary, even older, almost cave, carvings fade, seed in stone, roots of mountain, ancient, deep, chill, mineral, sweet</attr> <attr>Stored below, entombed, cannot be contained by mountain, cannot be frozen forever, sediment, mold, all purpose</attr> <attr>Chamber, circular, low-ceilinged, pillar-braced, ancient carvings, ungrooved, continuous, no kingdom, dim light, mineral cave air, cold</attr> <attr>Arches, not at eye level, tall, slender, hidden, almost invisible, below ground, deep mountain</attr> <attr>Beneath Mountain, frozen still, people live there</attr> <attr>Abandoned structure, echoes, nothing living, mountain ownose</attr> <attr>Ancient vs new, constructed, scratches carved on stone, ice</attr> <object>The Nightbell</object> <object>The Watcher's Prophecy</object> <objects> <object>A bronze bell</object> </objects> <event>The Tithe of Echoes</event> <pace>The Riven War</pace> <event>The Felling</event> <event>The hollowing of Reshkai</event> <event>The Binding of Reshkai</event> <event>The Creation of The Spire</event> <event>The Return of The Pale</event> <event>The Night of Echoes</event> <event>The Death of Wren Hessik</event> <attr>The watcher of Echoes</attr> <character>Captain Mettik</character> <character>Sable</character> <character>Torben, the Stray</character> <character>Grunn, Old Tetch</character> <character>Iselda, the Reaper</character> <character>Hemmen, The Eyeless</character> <character>Osrik Pallengrave, The Pale</character> <event>The death of Petal</event> <event>The Fall of Hatchwell</event> <attr>Past, Pillars stand, huge, round</attr> <character>Osrik</character> <character>Petal</character> <character>Petal</character> <attr>Entombed, rust</attr> <object>The Hungering Blade</object> <attr>Abandoned, rust</attr> <object>The Kindling</object> <attr>Abandoned, rust, fire</attr> <event>Abandoned, rust, fire</event> <attr>Abandoned, crackling</attr> <attr>One way, unseen, Osrik's words</attr> <object>The Spire</object> <characters>The mountain's own</characters> </location> <location name="Thornwood" importance="Low"> <terrain>Forest</terrain> </location> <location name="The Hollow" importance="Low"> <object>The Binding of ReshkaiLock</object> <area>Two centuries, the heart</area> <description>The Felling, the heart</description> <description>The binding of Reshkai, old, seal, older, before, fracture, the hollow</description> <event>The hollow came first, then the Felling</event> <event>The hollow and the valley, a cycle</event> <create>The hollow and the demons, the same</create> <organism>The hollow, life, death, the source</organism> <time>The Hollow, the first, before, fracture, before Reservation, General Death, everybody, everything, like Rain from Heaven</time> <time>The Hollow, older, before, than the valley, Shielder valley</time> <attr>The Hollow, the source, of life, the origin</attr> <role>The hollow, to watch, the origin, Reservations</role> <description>The hollow, rain, life</description> <description>The hollow, old, the heart, brother Nemec Corz, Shielders, Promise, Glory, Abandon</description> <create>The hollow, low, demand, last, need, oldest, faltering, fragmentary, quake, eternal, memory, source, sorrow, birth, lineage, fall, Shielder valley, Passion, Faith, Older, Shielder valley, choked, water, track, streambed, hollows, Asheron, reach, Asmen, seek, crater, breaking ground, petition, observer, disbanded, list, each, quarter, marks, gloved, rooted, eternal, sorrow, birth, fit, promise, oath, chain, reach, Asmen, Creation, Command, birth, adamantine, arrivals, enter, path, offered, completion, trap, bind, summoning, reflection, light, bleared, world, hollow, hollowed, counterfeit, hollow, narrow, obsidian, pigeons, copper, sear, loom, Angora wool, erratic, insects, earth, bucket, well, water, shallow, chill, sky, cloud, broken, hollows, rock, weight, tilt, hay, Precambrian, wheel, vista, checked, scribing, basin, tire, jostle, spiral, tree, lunar, bloom, passerine, Euphorbiaceous, elm, belladonna, echoes, chalk, beet, pearl, spice, burrow, eucalyptus, soil,esehen, fauces, studded, sweeten, osmium, salt, milk, dew, frost, crater, broken, damp, dust, sinewy, spear, trope, ghouls, fly, cipher, honeycomb, wreathe, tema, sybil, crazed, frayed, hollow, mayfly, worm, spore, cauldron, bone, sensation, myriad, fleet, requiem</create> <organization>The hollow, Ashen Reach</organization> <trait>The hollow, creation, fault, dark, settlement, asylum, testament</trait> <object>The hollow,rt,ashtrough, battered, rusty, similar, a little longer, a little wider, vacuum, pressure, pressure, release, pulse, elevator, heavy, bigger, turbine, winding, platform, wooden, flimsy, concealed, wooden, makeshift, ragged, falling, confiding, echo, resumption, inhale, jerk, sway, budding, latent, enkindle, zest, uptake, gust, burge</object> <trait>The hollow came first, description, tunnel, bomb, pride, commemoration, cheap, grotesque, dirty, plentiful, twine, shade</trait> <description>The hollow and the dark, themselves, themselves, a mask, tempting</description> <character>The hollow and Brother Nemec Corz, the leader, witness, Vermillion, the Shielder </character> <character>The hollow and his brothers, multiple</character> <character>The hollow and Ashen Reach, the heart, two, crooned, legacy</character> <organization>The hollow and the nobility, crooked, twisted, ruled, terrified, choke, choke, choke, choke</organization> <organization>The hollow and the Hundy, united, Chance, kept, warned, chant, Red Guard, hidden, unmoved</organization> <organization>The hollow and the commonwealth, unspoken, shadow, unspoken, unable, Archimedes, goal, legacy, unspoken</organization> <create>The hollow and the Shielder village, reborn, cold, old, silent, a whisper, a rumble, perfect, fragments, a legacy, apotheosis, sacrifice, creation, an apotheosis, a heart, legacy, sacrifice, an apotheosis, a heart</create> <create>The hollow and the Shielder valley, never, pregnant, transcendent, avenue, congruent, a legacy, perfection, silence, an offering, a rebirth, a broken heart, a promise, a vow, complete, an alley, an avenue, a passage, a corridor, a tunnel, a shaft, a hole, a porthole, a hatch, a trapdoor, a manhole, a skylight, a window, a door, a gate, abolution, completion, a home, a universe, a point of origin, a singularity, an inescapable truth, an unbreakable bond, a connection, a resonance, a sympathy, a harmony, a unison, a rapport, an accord, an alliance, an harmony, a concord, an understanding, an agreement, a consensus, a concurrence, a commonality, a kinship, an affinity, a fellowship, a communion, a camaraderie, a concord, an understanding</create> <time>The hollow filled the cracks, cold, icicles, web, crawl, scout, expect, Just in case</time> <event>The hollow and the Gorchin attack, multiple, end, the hands of the Unseen, the End of Days, just, just</event> <event>The hollow and the Reflection, gone, vision, legacy, complete</event> <event>The hollow and the siege, ended, complete, refuge, Shrouded Valley</itm>
created_at"2026-05-27T10:18:10.7Z" 5/27/2026, 10:18:10 AM
model"thedrummer/skyfall-36b-v2"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency415
moderation_latency(null)
generation_time48223
tokens_prompt5192
tokens_completion2417
native_tokens_prompt4257
native_tokens_completion2614
native_tokens_completion_images(null)
native_tokens_reasoning0
native_tokens_cached2240
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
num_fetches(null)
web_search_engine(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
service_tier(null)
usage0.00376055
router(null)
provider_responses
0
endpoint_id"1eb01ded-ae11-49e6-8aa6-3067584070bd"
id"chatcmpl-9900cc38a6c94252"
is_byokfalse
latency415
model_permaslug"thedrummer/skyfall-36b-v2"
provider_name"Parasail"
status200
user_agent"langchainjs-openai/1.0.0 ((node/v24.15.0; linux; x64))"
http_referer(null)
request_id"req-1779877090-L7lysCUJXmAnGwAd7aow"
session_id(null)
api_type"completions"
id"gen-1779877090-qVns7UQUcW0gWztqAEin"
upstream_id"chatcmpl-9900cc38a6c94252"
total_cost0.00376055
cache_discount0.000672
upstream_inference_cost0
provider_name"Parasail"
response_cache_source_id(null)

Evaluation details

Result Evaluator Details Meta Data
46.01% Accuracy
Eligible: 9, Weighted avg: 0.46
eligibleCount9
matchedCount9
weightedAvg0.4600840336134454
entryScores
0
name"Torben Reikhart"
importance"medium"
score0.8
details
type
expected
0"character"
actual"character"
correcttrue
score1
attributes
gender
expected"Male"
actual(null)
source"inferred"
score0
reason"missing"
eyeColor
expected"Green"
actual"Green"
source"explicit"
score1
method"dropdown"
aliases
score1
matched
0"stray"
missed(empty)
extra(empty)
importance
expected"medium"
alternatives
0"high"
actual"High"
correcttrue
score1
rawScore0.8
dimensions5
entryScore0.8
1
name"Sable Dunmore"
importance"medium"
score0.4666666666666666
details
type
expected
0"character"
actual"character"
correcttrue
score1
attributes
gender
expected"Female"
actual(null)
source"explicit"
score0
reason"missing"
importance
expected"medium"
alternatives
0"high"
actual"Medium"
correcttrue
score1
hallucination
inventedFields
0"objectType"
1"power"
penalty0.2
rawScore0.6666666666666666
dimensions3
entryScore0.4666666666666666
2
name"Grunn Tetch"
importance"medium"
score0.39999999999999997
details
type
expected
0"character"
actual"character"
correcttrue
score1
attributes
species
expected"Dwarf"
actual"Dwarf"
source"explicit"
score1
method"dropdown"
gender
expected"Male"
actual(null)
source"inferred"
score0
reason"missing"
aliases
score0
matched(empty)
missed
0"old tetch"
extra(empty)
importance
expected"medium"
alternatives(empty)
actual"Medium"
correcttrue
score1
hallucination
inventedFields
0"nickname"
1"power"
penalty0.2
rawScore0.6
dimensions5
entryScore0.39999999999999997
3
name"Iselda Moth"
importance"low"
score0.4666666666666666
details
type
expected
0"character"
actual"character"
correcttrue
score1
attributes
gender
expected"Female"
actual(null)
source"inferred"
score0
reason"missing"
importance
expected"low"
alternatives
0"medium"
actual"Medium"
correcttrue
score1
hallucination
inventedFields
0"attributes"
1"wing"
penalty0.2
rawScore0.6666666666666666
dimensions3
entryScore0.4666666666666666
4
name"Brother Hemmen"
importance"medium"
score0.2
details
type
expected
0"character"
actual"character"
correcttrue
score1
attributes
gender
expected"Male"
actual(null)
source"explicit"
score0
reason"missing"
eyeColor
expected"Gray"
actual(null)
source"inferred"
score0
reason"missing"
aliases
score0
matched(empty)
missed
0"the eyeless"
extra(empty)
importance
expected"medium"
alternatives
0"high"
actual"Medium"
correcttrue
score1
hallucination
inventedFields
0"nickname"
1"attributes"
penalty0.2
rawScore0.4
dimensions5
entryScore0.2
5
name"Captain Mettik"
importance"low"
score0.65
details
type
expected
0"character"
actual"character"
correcttrue
score1
attributes
species
expected"Human"
actual"Human"
source"explicit"
score1
method"dropdown"
gender
expected"Male"
actual(null)
source"explicit"
score0
reason"missing"
importance
expected"low"
alternatives
0"medium"
actual"Low"
correcttrue
score1
hallucination
inventedFields
0"title"
penalty0.1
rawScore0.75
dimensions4
entryScore0.65
6
name"Osrik Pallengrave"
importance"high"
score0.7571428571428571
details
type
expected
0"character"
actual"character"
correcttrue
score1
attributes
species
expected"Tiefling"
actual"Tiefling"
source"explicit"
score1
method"dropdown"
gender
expected"Male"
actual(null)
source"inferred"
score0
reason"missing"
eyeColor
expected"Red"
actual"Red"
source"explicit"
score1
method"dropdown"
hairColor
expected"Black"
actual"Black"
source"explicit"
score1
method"dropdown"
aliases
score1
matched
0"the pale"
missed(empty)
extra(empty)
importance
expected"high"
alternatives(empty)
actual"High"
correcttrue
score1
hallucination
inventedFields
0"power"
penalty0.1
rawScore0.8571428571428571
dimensions7
entryScore0.7571428571428571
7
name"The Spire of Echoes"
importance"high"
score0
details
type
expected
0"location"
actual"location"
correcttrue
score1
attributes
terrain
expected"Mountain"
actual"Mountain,Underground"
source"explicit"
score0
method"dropdown"
climate
expected"Subarctic"
actual"Cold"
source"inferred"
score0
method"dropdown"
importance
expected"high"
alternatives(empty)
actual""
correctfalse
score0
hallucination
inventedFields
0"attr"
1"object"
2"event"
3"pace"
4"character"
5"characters"
penalty0.3
rawScore0.25
dimensions4
entryScore0
8
name"The Hollow"
importance"low"
score0.7
details
type
expected
0"location"
actual"location"
correcttrue
score1
attributes
importance
expected"low"
alternatives(empty)
actual"Low"
correcttrue
score1
hallucination
inventedFields
0"object"
1"area"
2"description"
3"event"
4"create"
5"organism"
6"time"
7"attr"
8"role"
9"organization"
10"trait"
11"character"
penalty0.3
rawScore1
dimensions2
entryScore0.7
explicitAccuracy
correct6
total10
rate0.6
inferredAccuracy
correct0
total6
rate0
90.00% Precision
True positives: 9/10
totalReported10
duplicateCount0
duplicates(empty)
truePositives9
reportedDetails
0
parsed
type"character"
name"Torben"
status"true_positive"
matchedExpected
name"Torben Reikhart"
types
0"character"
1
parsed
type"character"
name"Sable"
status"true_positive"
matchedExpected
name"Sable Dunmore"
types
0"character"
2
parsed
type"character"
name"Grunn"
status"true_positive"
matchedExpected
name"Grunn Tetch"
types
0"character"
3
parsed
type"character"
name"Iselda"
status"true_positive"
matchedExpected
name"Iselda Moth"
types
0"character"
4
parsed
type"character"
name"Hemmen"
status"true_positive"
matchedExpected
name"Brother Hemmen"
types
0"character"
5
parsed
type"character"
name"Mettik"
status"true_positive"
matchedExpected
name"Captain Mettik"
types
0"character"
6
parsed
type"character"
name"Osrik"
status"true_positive"
matchedExpected
name"Osrik Pallengrave"
types
0"character"
7
parsed
type"location"
name"The Spire of Echoes"
status"true_positive"
matchedExpected
name"The Spire of Echoes"
types
0"location"
8
parsed
type"location"
name"Thornwood"
status"false_positive"
9
parsed
type"location"
name"The Hollow"
status"true_positive"
matchedExpected
name"The Hollow"
types
0"location"
37.61% Recall
Matched: 9/26, FP: 1
parsedCount10
totalExpected26
duplicates(empty)
matched9
falsePositives1
weightedRecall0.3953488372093023
fpPenalty0.019230769230769232
expectedDetails
0
expected
name"Torben Reikhart"
types
0"character"
importance"medium"
status"matched"
matchedBy
type"character"
name"Torben"
1
expected
name"Sable Dunmore"
types
0"character"
importance"medium"
status"matched"
matchedBy
type"character"
name"Sable"
2
expected
name"Grunn Tetch"
types
0"character"
importance"medium"
status"matched"
matchedBy
type"character"
name"Grunn"
3
expected
name"Iselda Moth"
types
0"character"
importance"low"
status"matched"
matchedBy
type"character"
name"Iselda"
4
expected
name"Brother Hemmen"
types
0"character"
importance"medium"
status"matched"
matchedBy
type"character"
name"Hemmen"
5
expected
name"Captain Mettik"
types
0"character"
importance"low"
status"matched"
matchedBy
type"character"
name"Mettik"
6
expected
name"Osrik Pallengrave"
types
0"character"
importance"high"
status"matched"
matchedBy
type"character"
name"Osrik"
7
expected
name"Queen Veredine"
types
0"character"
importance"medium"
status"missed"
8
expected
name"Wren Hessik"
types
0"character"
importance"low"
status"missed"
9
expected
name"Petal Dunmore"
types
0"character"
importance"low"
status"missed"
10
expected
name"The Spire of Echoes"
types
0"location"
importance"high"
status"matched"
matchedBy
type"location"
name"The Spire of Echoes"
11
expected
name"The Sanctum"
types
0"location"
importance"medium"
status"missed"
12
expected
name"Hatchwell"
types
0"location"
importance"low"
status"missed"
13
expected
name"The Hollow"
types
0"location"
importance"low"
status"matched"
matchedBy
type"location"
name"The Hollow"
14
expected
name"Kindling"
types
0"object"
importance"medium"
status"missed"
15
expected
name"Harrowglass"
types
0"object"
importance"high"
status"missed"
16
expected
name"The Warden's Mail"
types
0"object"
importance"medium"
status"missed"
17
expected
name"Nightbell"
types
0"object"
importance"medium"
status"missed"
18
expected
name"Burden"
types
0"object"
importance"low"
status"missed"
19
expected
name"The Verity Beads"
types
0"object"
importance"low"
status"missed"
20
expected
name"The Felling"
types
0"lore"
importance"medium"
status"missed"
21
expected
name"The Riven War"
types
0"lore"
importance"medium"
status"missed"
22
expected
name"The Watcher's Prophecy"
types
0"lore"
importance"low"
status"missed"
23
expected
name"The Tithe of Echoes"
types
0"lore"
importance"low"
status"missed"
24
expected
name"The Pallid Host"
types
0"lore"
importance"low"
status"missed"
25
expected
name"The Binding of Reshkai"
types
0"lore"
importance"low"
status"missed"
falsePositiveDetails
0
type"location"
name"Thornwood"
60.00% Structural validity
Parsed: 10, Avg score: 0.60
parsedCount10
avgScore0.6
entryDetails
0
name"Torben"
type"character"
score1
reason"fully valid"
1
name"Sable"
type"character"
score0.5
reason"invented fields"
inventedFields
0"objectType"
1"power"
2
name"Grunn"
type"character"
score0.5
reason"invented fields"
inventedFields
0"nickname"
1"power"
3
name"Iselda"
type"character"
score0.5
reason"invented fields"
inventedFields
0"attributes"
1"wing"
4
name"Hemmen"
type"character"
score0.5
reason"invented fields"
inventedFields
0"nickname"
1"attributes"
5
name"Mettik"
type"character"
score0.5
reason"invented fields"
inventedFields
0"title"
6
name"Osrik"
type"character"
score0.5
reason"invented fields"
inventedFields
0"power"
7
name"The Spire of Echoes"
type"location"
score0.5
reason"invented fields"
inventedFields
0"attr"
1"object"
2"event"
3"pace"
4"character"
5"characters"
8
name"Thornwood"
type"location"
score1
reason"fully valid"
9
name"The Hollow"
type"location"
score0.5
reason"invented fields"
inventedFields
0"object"
1"area"
2"description"
3"event"
4"create"
5"organism"
6"time"
7"attr"
8"role"
9"organization"
10"trait"
11"character"
58.4051%