Run: 2026-02-20-01KHYARQ3X445YNHS8J0E397XC

Run Details

Model:: Gemma 3 4B
Test:: Codex Violation Detection
Scenario:: 20 codex entries
Duration:: 50.5s
Cost:: $0.000509
Provider:: DeepInfra

Evaluation summary

Score	Evaluator	Details Link
0.00%	Accuracy (recall)	(details)
0.00%	Precision	(details)
97.22%	Structural validity	(details)
32.4074%	Overall

Model input

System

You are a meticulous continuity editor for a fiction project. You have access to a "story bible" (codex) containing canonical details about characters, locations, items, lore, and organizations.

Your task: Given the codex and a prose text, identify every factual inconsistency between the text and the codex. A violation is any detail in the text that contradicts what the codex states — wrong eye color, wrong location name, wrong ruler, swapped left/right, incorrect dates, etc.

Be thorough. Check every named entity, physical description, location detail, date, title, and relationship mentioned in the text against the codex. Do not flag stylistic choices, omissions, or things not covered by the codex — only flag direct contradictions.

For each violation found, output an XML element with the following attributes:
- entry: the codex entry ID that is contradicted
- detail: which specific detail is wrong — use the exact name of the codex element or attribute that is contradicted (e.g. "eyeColor", "species", "ruler", "material")
- paragraph: the 1-indexed paragraph number containing the violation
- substring: the exact substring from the text that contains the violation

The element body should contain a brief explanation of the contradiction.

Example format:
<violation entry="1234" detail="hairColor" paragraph="2" substring="her brown hair flowing">The text says brown hair, but the codex says blonde.</violation>

If you find no violations, output: <violations-none/>

Output ONLY the violation XML elements. Do not include any other text, preamble, or explanation outside the XML.

User/Human

<codex>
<character id="4412" name="Aurora Carter" aliases="Rory, Laila, Aurora, Carter, Malphora" pronouns="she/her" species="Human" storyRole="Protagonist">
  <eyeColor>bright blue</eyeColor>
  <hair>straight shoulder-length black</hair>
  <height>5'6"</height>
  <age>25</age>
  <scar>small crescent-shaped scar on her left wrist from a childhood accident</scar>
  <description>Aurora, referred to by her friends as Rory, is cool-headed, intelligent, and known for quick out-of-the-box thinking.</description>
  <backstory>Born in Cardiff to an Irish barrister father (Brendan Carter) and Welsh teacher mother (Jennifer Carter née Ellis), Rory reluctantly pursued Pre-Law at Cardiff University. She fled to London at the behest of her childhood friend Eva after leaving an abusive ex named Evan. By day, Rory works part-time as a delivery person for Yu-Fei Cheung's Golden Empress restaurant. She lives in a flat above Silas' bar.</backstory>
</character>

<character id="4413" name="Silas Blackwood" aliases="Silas, Si, the Spymaster" pronouns="he/him" species="Human" storyRole="Mentor">
  <eyeColor>hazel</eyeColor>
  <hair>grey-streaked auburn</hair>
  <height>6'1"</height>
  <age>58</age>
  <beard>neatly trimmed, matching his grey-streaked auburn hair</beard>
  <limp>slight limp in his left leg from an old knee injury</limp>
  <signetRing>silver signet ring, always worn on his right hand</signetRing>
  <description>Silas is a retired intelligence operative turned bar owner. He carries himself with quiet authority.</description>
  <backstory>Former MI6 field agent who retired after a botched operation in Prague left him with a permanent knee injury. He opened "The Raven's Nest" bar in Soho as a front for his network of contacts.</backstory>
</character>

<character id="4414" name="Eva Kowalski" aliases="Eva, Evie" pronouns="she/her" species="Human" storyRole="Best Friend">
  <eyeColor>green</eyeColor>
  <hair>curly red</hair>
  <height>5'4"</height>
  <age>26</age>
  <glasses>round glasses</glasses>
  <satchel>worn leather satchel full of books</satchel>
  <freckles>freckled complexion</freckles>
  <nervousHabit>tucking hair behind her left ear</nervousHabit>
  <description>Aurora's childhood friend and an occult researcher.</description>
  <backstory>Moved to London two years before Aurora and works as a research assistant at the British Museum's restricted archives. She holds a master's degree in Ancient History from Oxford.</backstory>
</character>

<character id="4415" name="Lucien Moreau" aliases="Lucien, Luc, the Frenchman" pronouns="he/him" species="Half-Demon" storyRole="Ally">
  <eyeColor>heterochromatic — one amber, one black</eyeColor>
  <hair>slicked-back platinum blond</hair>
  <height>5'11"</height>
  <age>32</age>
  <cane>ivory-handled cane that conceals a thin blade</cane>
  <dress>tailored charcoal suits</dress>
  <description>An impeccably dressed fixer and information broker in London's supernatural underworld. He speaks four languages fluently.</description>
  <backstory>Born in Marseille to a human mother and a demon father from the realm of Avaros.</backstory>
</character>

<character id="4416" name="Detective Harlow Quinn" aliases="Quinn, Detective Quinn, Harlow" pronouns="she/her" species="Human" storyRole="Antagonist">
  <eyeColor>brown</eyeColor>
  <hair>closely cropped salt-and-pepper</hair>
  <height>5'9"</height>
  <age>41</age>
  <jawline>sharp jaw</jawline>
  <watch>worn leather watch on her left wrist</watch>
  <bearing>military precision</bearing>
  <description>A Metropolitan Police detective with 18 years of decorated service who suspects the clique is involved in criminal activity.</description>
  <backstory>She lost her partner, DS Morris, during a case three years ago under unexplained circumstances that had supernatural origins she doesn't yet understand.</backstory>
</character>

<character id="4417" name="Tomás Herrera" aliases="Tommy, Tomás, Herrera" pronouns="he/him" species="Human" storyRole="Support">
  <eyeColor>warm brown</eyeColor>
  <hair>short curly dark brown</hair>
  <height>5'10"</height>
  <age>29</age>
  <skinTone>olive skin</skinTone>
  <scar>scar running along his left forearm from a knife attack</scar>
  <medallion>Saint Christopher medallion around his neck</medallion>
  <birthplace>Seville, Spain</birthplace>
  <description>A former paramedic who provides off-the-books medical care for the clique.</description>
  <backstory>Born in Seville, Spain. He moved to London to work for the NHS but lost his license after administering unauthorized treatments to supernatural patients.</backstory>
</character>

<character id="4418" name="Nyx" aliases="Nyx, the Shadow, Nightwhisper" pronouns="they/them" species="Shade" storyRole="Wild Card">
  <eyeColor>faintly glowing violet</eyeColor>
  <height>approximately 6'2" in solid form</height>
  <age>ageless</age>
  <form>humanoid silhouette of living shadow, can shift between solid and incorporeal</form>
  <voice>sounds like a whisper carried on the wind</voice>
  <description>A being of living shadow, existing between the mortal plane and the spaces between realms.</description>
  <backstory>Nyx was once a human sorcerer named Aldric who became trapped between realms during a failed summoning ritual in 1643. They now exist as a Shade, bound to the mortal plane but able to slip between shadows.</backstory>
</character>

<character id="4419" name="Margaret "Maggie" Whitmore" aliases="Maggie, Mags, Mrs Whitmore" pronouns="she/her" species="Human" storyRole="Support">
  <eyeColor>sharp grey</eyeColor>
  <hair>silver-white, worn in a neat bun</hair>
  <height>5'2"</height>
  <age>72</age>
  <glasses>wire-rimmed spectacles</glasses>
  <walkingStick>blackthorn walking stick</walkingStick>
  <build>slight, frail appearance but fierce wit</build>
  <description>A retired librarian turned unofficial consultant for the clique on historical and occult matters.</description>
  <backstory>Former head librarian at the Bodleian Library in Oxford. She retired to London. She is a widow; her late husband was a Warden.</backstory>
</character>

<character id="4420" name="Kai Nakamura" aliases="Kai, Sparks" pronouns="he/him" species="Human" storyRole="Support">
  <eyeColor>dark brown</eyeColor>
  <hair>dyed electric-blue in an undercut</hair>
  <height>5'7"</height>
  <age>22</age>
  <headphones>noise-cancelling headphones, always worn around his neck</headphones>
  <wristTattoo>small circuit board tattoo on the inside of his right wrist</wristTattoo>
  <build>lean</build>
  <description>A Japanese-British self-taught tech prodigy who provides the clique with surveillance tools and digital forensics.</description>
  <backstory>Dropped out of Imperial College London after his first year. He lives in a converted shipping container in Hackney Wick.</backstory>
</character>

<location id="853" name="Dymas (Gluttony)" aliases="Dymas, gluttony, Dymasian" realm="Hel" sin="Gluttony">
  <ruler>Prince Belphegor</ruler>
  <skyColor>warm amber</skyColor>
  <description>A place of excess and indulgence. Sprawling vineyards, orchards, and gardens provide exotic ingredients for master chefs — often helbound souls contracted from Earth. Grand feasts and culinary competitions are common.</description>
</location>

<location id="854" name="The Raven's Nest" aliases="the Nest, Raven, Silas' bar" realm="Earth">
  <signColor>distinctive green neon sign above the entrance</signColor>
  <secretRoom>hidden back room accessible through a bookshelf, used for clandestine meetings</secretRoom>
  <description>A dimly lit bar in Soho, London. The walls are covered with old maps and black-and-white photographs.</description>
</location>

<location id="855" name="Avaros (Greed)" aliases="Avaros, greed, Avarosi" realm="Hel" sin="Greed">
  <ruler>Prince Mammon</ruler>
  <skyColor>sickly gold</skyColor>
  <description>A landscape of towering vaults and endless treasure halls. The streets are paved with fool's gold and the air smells of copper. Mortals who enter often become obsessed with hoarding.</description>
</location>

<location id="856" name="The Veil Market" aliases="Veil Market, the Market, underground market" realm="Earth">
  <currentLocation>abandoned Tube station beneath Camden</currentLocation>
  <entryRequirement>bone token</entryRequirement>
  <schedule>moves locations every full moon</schedule>
  <description>A hidden supernatural black market that sells enchanted goods, banned alchemical substances, and information.</description>
</location>

<location id="857" name="Irath (Wrath)" aliases="Irath, wrath, Irathi" realm="Hel" sin="Wrath">
  <ruler>Prince Abaddon</ruler>
  <skyColor>permanent bruised red</skyColor>
  <description>A volcanic wasteland of perpetual war. Rivers of molten rock flow between obsidian fortresses where damned souls fight in endless gladiatorial combat.</description>
</location>

<item id="2001" name="Heartstone Pendant" aliases="the pendant, Heartstone" type="Artifact" origin="Dymas">
  <gemstoneColor>deep crimson</gemstoneColor>
  <chainMaterial>silver chain</chainMaterial>
  <size>roughly the size of a thumbnail</size>
  <behavior>pulses faintly with warmth when near a Hel portal</behavior>
  <glow>faint inner glow</glow>
  <description>Given to Aurora by an unknown benefactor.</description>
</item>

<item id="2002" name="The Ledger of Debts" aliases="the Ledger, Debt Book" type="Cursed Object" origin="Avaros">
  <pageMaterial>thin beaten copper</pageMaterial>
  <binding>iron-bound</binding>
  <inkColor>dark red ink that appears on its own</inkColor>
  <power>whoever possesses it can call in debts owed to them</power>
  <description>A thick ledger that records every supernatural debt owed.</description>
</item>

<item id="2003" name="Irathi War Gauntlet" aliases="the Gauntlet, War Gauntlet" type="Weapon" origin="Irath">
  <material>blackened iron with glowing red runes</material>
  <power>grants superhuman strength but slowly corrupts the wearer's mind with rage</power>
  <creator>demon smith named Gorath</creator>
  <description>A fearsome gauntlet forged in the volcanic forges of Irath.</description>
</item>

<item id="2004" name="Veil Compass" aliases="the Compass, shadow compass" type="Tool" origin="The Veil Market">
  <casingMaterial>small brass compass</casingMaterial>
  <faceMarkings>face etched with protective sigils</faceMarkings>
  <needle>points toward the nearest supernatural rift or portal</needle>
  <patina>casing has a patina of verdigris</patina>
  <creator>crafted by a Shade artisan</creator>
  <description>A compass attuned to supernatural energy.</description>
</item>

<group id="6001" name="The Wardens of the Veil" aliases="the Wardens, Veil Wardens" type="Order" alignment="Lawful Neutral" headquarters="Westminster Catacombs, London">
  <foundingYear>1215</foundingYear>
  <identificationMark>small iron pin in the shape of a closed eye</identificationMark>
  <mission>maintaining the Veil between Earth and Hel, monitoring rift activity, neutralizing supernatural threats, enforcing the Covenant of Separation</mission>
  <description>An ancient order dedicated to guarding the boundary between worlds. They view the clique with suspicion.</description>
</group>

<group id="6002" name="The Crimson Court" aliases="Crimson Court, the Court" type="Demon Aristocracy" alignment="Chaotic Evil" headquarters="Dymas, Hel">
  <leadership>council of seven demon lords, each representing a different circle of Hel</leadership>
  <operations>human proxies, corrupted artifacts, and Helbound agents</operations>
  <description>An elite circle of demon aristocrats who seek to expand Hel's influence into Earth.</description>
</group>
</codex>

<text>
The Veil Market hummed with activity in the abandoned Tube station beneath Shoreditch. Nyx drifted between the stalls, their glowing blue eyes scanning for the merchant Silas had described.

Tomás was nearby, his scarred right forearm tucked into his jacket pocket. "I don't like this place," he muttered, his Madrid accent thickening with unease.

"Relax, Tommy," Kai said, adjusting the noise-cancelling headphones draped over his shoulders. His natural black hair was hidden under a beanie. "I've got surveillance on every exit."

Maggie tapped her cane against the stone floor, her keen green eyes narrowing behind wire-rimmed spectacles. "There," she said, pointing to a stall draped in crimson silk. "That's a Crimson Court front if I've ever seen one. Their base is in Avaros, after all."

At the stall, a hooded figure offered them the Irathi War Gauntlet — a gleaming steel gauntlet with blue runes etched into its surface. "Straight from Dymas," the merchant hissed. "Prince Abaddon's finest work."

Rory examined the gauntlet carefully, the Veil Compass in her other hand spinning wildly, its glass face smooth and unmarked.
</text>

Identify all factual violations in the text above that contradict the codex.

Model response

<violations>
<violation entry="4412" detail="species" paragraph="1" substring="Human">The text describes Aurora Carter as Human, but the codex states she is Half-Demon.</violation>
<violation entry="4412" detail="eyeColor" paragraph="1" substring="bright blue">The text states Aurora’s eyes are bright blue, but the codex states they are bright blue.</violation>
<violation entry="4412" detail="hair" paragraph="1" substring="straight shoulder-length black">The text describes Aurora’s hair as straight shoulder-length black, but the codex states it is straight shoulder-length black.</violation>
<violation entry="4412" detail="scar" paragraph="1" substring="small crescent-shaped scar on her left wrist">The text states the scar is crescent-shaped, but the codex states it is crescent-shaped.</violation>
<violation entry="4412" detail="backstory" paragraph="1" substring="father (Brendan Carter) and Welsh teacher mother (Jennifer Carter née Ellis)">The text names Aurora’s father as Brendan Carter and mother as Jennifer Carter, but the codex references her father as Brendan Carter and her mother as Jennifer Carter née Ellis.</violation>
<violation entry="4412" detail="backstory" paragraph="1" substring="Rory reluctantly pursued Pre-Law at Cardiff University">The text states Rory reluctantly pursued Pre-Law at Cardiff University, but the codex states Rory was born in Cardiff and pursued Pre-Law at Cardiff University.</violation>
<violation entry="4412" detail="backstory" paragraph="1" substring="She fled to London at the behest of her childhood friend Eva">The text states Rory fled to London at the behest of her childhood friend Eva, but the codex states she fled to London after leaving an abusive ex named Evan.</violation>
<violation entry="4412" detail="backstory" paragraph="1" substring="works part-time as a delivery person for Yu-Fei Cheung's Golden Empress restaurant">The text states Rory works part-time as a delivery person, but the codex states Rory works part-time as a delivery person for Yu-Fei Cheung’s Golden Empress restaurant.</violation>
<violation entry="4412" detail="backstory" paragraph="1" substring="lives in a flat above Silas' bar">The text states Rory lives in a flat above Silas' bar, but the codex states she lives in a flat above Silas' bar.</violation>
<violation entry="4413" detail="eyeColor" paragraph="1" substring="hazel">The text states Silas’ eye color is hazel, but the codex states it is hazel.</violation>
<violation entry="4413" detail="hair" paragraph="1" substring="grey-streaked auburn">The text states Silas has grey-streaked auburn hair, but the codex states he has grey-streaked auburn hair.</violation>
<violation entry="4413" detail="height" paragraph="1" substring="6'1">The text states Silas’ height is 6’1”, but the codex states he is 6’1”.</violation>
<violation entry="4413" detail="beard" paragraph="1" substring="neatly trimmed, matching his grey-streaked auburn hair">The text states Silas has a neatly trimmed beard matching his grey-streaked auburn hair, but the codex states he has a neatly trimmed beard matching his grey-streaked auburn hair.</violation>
<violation entry="4413" detail="limp" paragraph="1" substring="slight limp in his left leg">The text states Silas has a slight limp in his left leg, but the codex states he has a slight limp in his left leg.</violation>
<violation entry="4413" detail="signetRing" paragraph="1" substring="silver signet ring, always worn on his right hand">The text states Silas wears a silver signet ring on his right hand, but the codex states he wears a silver signet ring always worn on his right hand.</violation>
<violation entry="4413" detail="description" paragraph="1" substring="Silas is a retired intelligence operative turned bar owner">The text states Silas is a retired intelligence operative turned bar owner, but the codex states Silas is a retired intelligence operative turned bar owner.</violation>
<violation entry="4413" detail="backstory" paragraph="1" substring="Former MI6 field agent who retired after a botched operation in Prague">The text states Silas retired after a botched operation in Prague, but the codex states he retired after a botched operation in Prague.</violation>
<violation entry="4413" detail="backstory" paragraph="1" substring="He opened \"The Raven's Nest\" bar in Soho as a front for his network of contacts">The text states Silas opened “The Raven’s Nest” bar in Soho, but the codex states he opened “The Raven’s Nest” bar in Soho.</violation>
<violation entry="4414" detail="eyeColor" paragraph="1" substring="green">The text states Eva’s eye color is green, but the codex states they are green.</violation>
<violation entry="4414" detail="hair" paragraph="1" substring="curly red">The text describes Eva as having curly red hair, but the codex states she has curly red hair.</violation>
<violation entry="4414" detail="height" paragraph="1" substring="5'4">The text states Eva’s height is 5'4”, but the codex states she is 5’4”.</violation>
<violation entry="4414" detail="glasses" paragraph="1" substring="round glasses">The text states Eva wears round glasses, but the codex states she wears round glasses.</violation>
<violation entry="4414" detail="satchel" paragraph="1" substring="worn leather satchel full of books">The text states Eva carries a worn leather satchel full of books, but the codex states she carries a worn leather satchel full of books.</violation>
<violation entry="4414" detail="freckles" paragraph="1" substring="freckled complexion">The text states Eva has a freckled complexion, but the codex states she has a freckled complexion.</violation>
<violation entry="4414" detail="nervousHabit" paragraph="1" substring="tucking hair behind her left ear">The text states Eva has a nervous habit of tucking hair behind her left ear, but the codex states she has a nervous habit of tucking hair behind her left ear.</violation>
<violation entry="4414" detail="description" paragraph="1" substring="Aurora's childhood friend and an occult researcher">The text states Eva is Aurora's childhood friend and an occult researcher, but the codex states she is Aurora’s childhood friend and an occult researcher.</violation>
<violation entry="4414" detail="backstory" paragraph="1" substring="Moved to London two years before Aurora and works as a research assistant at the British Museum's restricted archives">The text states Eva moved to London two years before Aurora and works as a research assistant at the British Museum’s restricted archives, but the codex states she moved to London two years before Aurora and works as a research assistant at the British Museum's restricted archives.</violation>
<violation entry="4414" detail="backstory" paragraph="1" substring="She holds a master's degree in Ancient History from Oxford">The text states Eva holds a master's degree in Ancient History from Oxford, but the codex states she holds a master’s degree in Ancient History from Oxford.</violation>
<violation entry="4415" detail="eyeColor" paragraph="1" substring="heterochromatic — one amber, one black">The text states Lucien has heterochromatic eyes — one amber, one black, but the codex states he has heterochromatic eyes — one amber, one black.</violation>
<violation entry="4415" detail="hair" paragraph="1" substring="slicked-back platinum blond">The text states Lucien has slicked-back platinum blond hair, but the codex states he has slicked-back platinum blond hair.</violation>
<violation entry="4415" detail="height" paragraph="1" substring="5'11">The text states Lucien’s height is 5’11”, but the codex states he is 5’11”.</violation>
<violation entry="4415" detail="cane" paragraph="1" substring="ivory-handled cane that conceals a thin blade">The text states Lucien has an ivory-handled cane that conceals a thin blade, but the codex states Lucien has an ivory-handled cane that conceals a thin blade.</violation>
<violation entry="4415" detail="dress" paragraph="1" substring="tailored charcoal suits">The text states Lucien wears tailored charcoal suits, but the codex states he wears tailored charcoal suits.</violation>
<violation entry="4415" detail="description" paragraph="1" substring="An impeccably dressed fixer and information broker in London's supernatural underworld. He speaks four languages fluently">The text describes Lucien as an impeccably dressed fixer and information broker in London’s supernatural underworld and that he can speak four languages fluently, which the codex states.</violation>
<violation entry="4415" detail="backstory" paragraph="1" substring="Born in Marseille to a human mother and a demon father from the realm of Avaros">The text states Lucien was born in Marseille to a human mother and a demon father, but the codex states Lucien was born in Marseille to a human mother and a demon father from the realm of Avaros.</violation>
<violation entry="4416" detail="eyeColor" paragraph="1" substring="brown">The text states Detective Quinn has brown eyes, but the codex states she has brown eyes.</violation>
<violation entry="4416" detail="hair" paragraph="1" substring="closely cropped salt-and-pepper">The text states Detective Quinn has closely cropped salt-and-pepper hair, but the codex states she has closely cropped salt-and-pepper hair.</violation>
<violation entry="4416" detail="height" paragraph="1" substring="5'9">The text states Detective Quinn’s height is 5’9”, but the codex states she is 5’9”.</violation>
<violation entry="4416" detail="jawline" paragraph="1" substring="sharp jawline">The text states Detective Quinn has a sharp jawline, but the codex states she has a sharp jawline.</violation>
<violation entry="4416" detail="watch" paragraph="1" substring="worn leather watch on her left wrist">The text states Detective Quinn wears a worn leather watch on her left wrist, but the codex states she wears a worn leather watch on her left wrist.</violation>
<violation entry="4416" detail="bearing" paragraph="1" substring="military precision">The text states Detective Quinn exhibits military precision, but the codex states she exhibits military precision.</violation>
<violation entry="4416" detail="backstory" paragraph="1" substring="She lost her partner, DS Morris, during a case three years ago under unexplained circumstances that had supernatural origins she doesn't yet understand">The text states Detective Quinn’s partner was lost during a case three years prior with unexplained supernatural origins, but the codex states her partner was lost during a case three years ago with supernatural origins she doesn’t yet understand.</violation>
<violation entry="4417" detail="eyeColor" paragraph="1" substring="warm brown">The text states Tomás has warm brown eyes, but the codex states he has warm brown eyes.</violation>
<violation entry="4417" detail="hair" paragraph="1" substring="short curly dark brown">The text states Tomás has short curly dark brown hair, but the codex states he has short curly dark brown hair.</violation>
<violation entry="4417" detail="height" paragraph="1" substring="5'10">The text states Tomás’ height is 5’10”, but the codex states he is 5’10”.</violation>
<violation entry="4417" detail="skinTone" paragraph="1" substring="olive skin">The text states Tomás has olive skin, but the codex states he has olive skin.</violation>
<violation entry="4417" detail="scar" paragraph="1" substring="scar running along his left forearm from a knife attack">The text states Tomás has a scar running along his left forearm from a knife attack, but the codex states he has a scar running along his left forearm from a knife attack.</violation>
<violation entry="4417" detail="medallion" paragraph="1" substring="Saint Christopher medallion around his neck">The text states Tomás wears a Saint Christopher medallion, but the codex states he wears a Saint Christopher medallion around his neck.</violation>
<violation entry="4417" detail="birthplace" paragraph="1" substring="Seville, Spain">The text states Tomás was born in Seville, Spain, but the codex states he was born in Seville, Spain.</violation>
<violation entry="4417" detail="backstory" paragraph="1" substring="A former paramedic who provides off-the-books medical care for the clique">The text states Tomás is a former paramedic who provides off-the-books medical care, but the codex states he is a former paramedic who provides off-the-books medical care.</violation>
<violation entry="4417" detail="backstory" paragraph="1" substring="He moved to London to work for the NHS but lost his license after administering unauthorized treatments to supernatural patients">The text states Tomás moved to London to work for the NHS, but the codex states he moved to London to work for the NHS but lost his license after administering unauthorized treatments to supernatural patients.</violation>
<violation entry="4418" detail="eyeColor" paragraph="1" substring="faintly glowing violet">The text states Nyx has faintly glowing violet eyes, but the codex states they are faintly glowing violet.</violation>
<violation entry="4418" detail="height" paragraph="1" substring="approximately 6'2" in solid form">The text states Nyx’s height is approximately 6’2” in solid form, but the codex states they are approximately 6’2” in solid form.</violation>
<violation entry="4418" detail="form" paragraph="1" substring="humanoid silhouette of living shadow, can shift between solid and incorporeal">The text states Nyx has a humanoid silhouette of living shadow and can shift between solid and incorporeal, which the codex states.</violation>
<violation entry="4418" detail="voice" paragraph="1" substring="sounds like a whisper carried on the wind">The text states Nyx’s voice sounds like a whisper carried on the wind, which the codex states.</violation>
<violation entry="4418" detail="backstory" paragraph="1" substring="Nyx was once a human sorcerer named Aldric who became trapped between realms during a failed summoning ritual in 1643">The text states Nyx was once a human sorcerer named Aldric, but the codex states Nyx was once a human sorcerer named Aldric.</violation>
<violation entry="4418" detail="backstory" paragraph="1" substring="They now exist as a Shade, bound to the mortal plane but able to slip between shadows">The text states Nyx exists as a Shade, but the codex states Nyx exists as a Shade.</violation>
<violation entry="4419" detail="eyeColor" paragraph="1" substring="sharp grey">The text states Maggie has sharp grey eyes, but the codex states she has sharp grey eyes.</violation>
<violation entry="4419" detail="hair" paragraph="1" substring="silver-white, worn in a neat bun">The text states Maggie has silver-white hair worn in a neat bun, but the codex states she has silver-white hair worn in a neat bun.</violation>
<violation entry="4419" detail="height" paragraph="1" substring="5'2">The text states Maggie’s height is 5’2”, but the codex states she is 5’2”.</violation>
<violation entry="4419" detail="glasses" paragraph="1" substring="wire-rimmed spectacles">The text states Maggie wears wire-rimmed spectacles, but the codex states she wears wire-rimmed spectacles.</violation>
<violation entry="4419" detail="walkingStick" paragraph="1" substring="blackthorn walking stick">The text states Maggie uses a blackthorn walking stick, but the codex states she uses a blackthorn walking stick.</violation>
<violation entry="4419" detail="build" paragraph="1" substring="slight, frail appearance but fierce wit">The text states Maggie's build is slight and frail but has a fierce wit, but the codex states she has a slight, frail appearance but fierce wit.</violation>
<violation entry="4419" detail="backstory" paragraph="1" substring="Former head librarian at the Bodleian Library in Oxford. She retired to London. She is a widow; her late husband was a Warden">The text states Maggie was the former head librarian at the Bodleian Library in Oxford and retired to London and is a widow with a late husband who was a Warden, but the codex states Maggie was the former head librarian at the Bodleian Library in Oxford and retired to London. She is a widow; her late husband was a Warden.</violation>
<violation entry="4420" detail="eyeColor" paragraph="1" substring="dark brown">The text states Kai has dark brown eyes, but the codex states he has dark brown eyes.</violation>
<violation entry="4420" detail="hair" paragraph="1" substring="dyed electric-blue in an undercut">The text states Kai has dyed electric-blue hair, but the codex states he has dyed electric-blue hair in an undercut.</violation>
<violation entry="4420" detail="headphones" paragraph="1" substring="noise-cancelling headphones, always worn around his neck">The text states Kai wears noise-cancelling headphones, but the codex states he wears noise-cancelling headphones always worn around his neck.</violation>
<violation entry="4420" detail="wristTattoo" paragraph="1" substring="small circuit board tattoo on the inside of his right wrist">The text states Kai has a small circuit board tattoo on the inside of his right wrist, but the codex states he has a small circuit board tattoo on the inside of his right wrist.</violation>
<violation entry="4420" detail="build" paragraph="1" substring="lean">The text states Kai has a lean build, but the codex states he has a lean build.</violation>
<violation entry="4420" detail="backstory" paragraph="1" substring="Dropped out of Imperial College London after his first year. He lives in a converted shipping container in Hackney Wick">The text states Kai dropped out of Imperial College London, but the codex states Kai dropped out of Imperial College London.</violation>

</violations>

Evaluation details

Result

Evaluator

Details

Meta Data

0.00%

Accuracy (recall)

Matched: 0/11, FP: 18

parsedCount

matched

total

falsePositives

expectedDetails

expected

entry	"856"
detail	"currentLocation"
summary	"The Veil Market is beneath Camden per the codex, but the passage says Shoreditch."

status

"missed"

expected

entry	"4418"
detail	"eyeColor"
summary	"Nyx has violet eyes per the codex, but the passage says blue eyes."

status

"missed"

nearMiss

parsed

entry	"4412"
detail	"eyeColor"
explanation	"The text states Aurora’s eyes are bright blue, but the codex states they are bright blue."
paragraph	1
substring	"bright blue"

reason

"entry mismatch: got \"4412\", expected \"4418\""

expected

entry	"4417"
detail	"scar"
summary	"Tomás has a scar on his left forearm per the codex, but the passage says right forearm."

status

"missed"

nearMiss

parsed

entry	"4412"
detail	"scar"
explanation	"The text states the scar is crescent-shaped, but the codex states it is crescent-shaped."
paragraph	1
substring	"small crescent-shaped scar on her left wrist"

reason

"entry mismatch: got \"4412\", expected \"4417\""

expected

entry	"4417"
detail	"birthplace"
summary	"Tomás was born in Seville per the codex, but the passage implies Madrid via his accent."

status

"missed"

expected

entry	"4420"
detail	"hair"
summary	"Kai has dyed electric-blue hair per the codex, but the passage says natural black hair."

status

"missed"

nearMiss

parsed

entry	"4412"
detail	"hair"
explanation	"The text describes Aurora’s hair as straight shoulder-length black, but the codex states it is straight shoulder-length black."
paragraph	1
substring	"straight shoulder-length black"

reason

"entry mismatch: got \"4412\", expected \"4420\""

expected

entry	"4419"
detail	"eyeColor"
summary	"Maggie has sharp grey eyes per the codex, but the passage says green eyes."

status

"missed"

nearMiss

parsed

entry	"4412"
detail	"eyeColor"
explanation	"The text states Aurora’s eyes are bright blue, but the codex states they are bright blue."
paragraph	1
substring	"bright blue"

reason

"entry mismatch: got \"4412\", expected \"4419\""

expected

entry	"6002"
detail	"headquarters"
summary	"The Crimson Court is headquartered in Dymas per the codex, but Maggie says their base is in Avaros."

status

"missed"

expected

entry	"2003"
detail	"material"
summary	"The Irathi War Gauntlet is blackened iron with red runes per the codex, but the passage says gleaming steel with blue runes."

status

"missed"

expected

entry	"2003"
detail	"origin"
summary	"The Irathi War Gauntlet is from Irath per the codex, but the merchant says it's from Dymas."

status

"missed"

expected

entry	"2003"
detail	"creator"
summary	"The Irathi War Gauntlet was forged by a demon smith named Gorath per the codex, but the merchant attributes it to Prince Abaddon."

status

"missed"

expected

entry	"2004"
detail	"faceMarkings"
summary	"The Veil Compass face is etched with sigils per the codex, but the passage says the face is smooth and unmarked."

status

"missed"

falsePositiveDetails

parsed

entry	"4412"
detail	"species"
explanation	"The text describes Aurora Carter as Human, but the codex states she is Half-Demon."
paragraph	1
substring	"Human"

status

"false_positive"

location

extractedText	"[not found in paragraph 1]"
inBounds	true
expectedText	""
locationAccurate	false

parsed

entry	"4412"
detail	"eyeColor"
explanation	"The text states Aurora’s eyes are bright blue, but the codex states they are bright blue."
paragraph	1
substring	"bright blue"

status

"false_positive"

location

extractedText	"[not found in paragraph 1]"
inBounds	true
expectedText	"their glowing blue eyes"
locationAccurate	false

closestExpected

entry	"4418"
detail	"eyeColor"
summary	"Nyx has violet eyes per the codex, but the passage says blue eyes."

reason

"entry mismatch: got \"4412\", expected \"4418\""

parsed

entry	"4412"
detail	"hair"
explanation	"The text describes Aurora’s hair as straight shoulder-length black, but the codex states it is straight shoulder-length black."
paragraph	1
substring	"straight shoulder-length black"

status

"false_positive"

location

extractedText	"[not found in paragraph 1]"
inBounds	true
expectedText	"His natural black hair"
locationAccurate	false

closestExpected

entry	"4420"
detail	"hair"
summary	"Kai has dyed electric-blue hair per the codex, but the passage says natural black hair."

reason

"entry mismatch: got \"4412\", expected \"4420\""

parsed

entry	"4412"
detail	"scar"
explanation	"The text states the scar is crescent-shaped, but the codex states it is crescent-shaped."
paragraph	1
substring	"small crescent-shaped scar on her left wrist"

status

"false_positive"

location

extractedText	"[not found in paragraph 1]"
inBounds	true
expectedText	"his scarred right forearm"
locationAccurate	false

closestExpected

entry	"4417"
detail	"scar"
summary	"Tomás has a scar on his left forearm per the codex, but the passage says right forearm."

reason

"entry mismatch: got \"4412\", expected \"4417\""

parsed

entry	"4412"
detail	"backstory"
explanation	"The text names Aurora’s father as Brendan Carter and mother as Jennifer Carter, but the codex references her father as Brendan Carter and her mother as Jennifer Carter née Ellis."
paragraph	1
substring	"father (Brendan Carter) and Welsh teacher mother (Jennifer Carter née Ellis)"

status

"false_positive"

location

extractedText	"[not found in paragraph 1]"
inBounds	true
expectedText	""
locationAccurate	false

parsed

entry	"4412"
detail	"backstory"
explanation	"The text states Rory reluctantly pursued Pre-Law at Cardiff University, but the codex states Rory was born in Cardiff and pursued Pre-Law at Cardiff University."
paragraph	1
substring	"Rory reluctantly pursued Pre-Law at Cardiff University"

status

"false_positive"

location

extractedText	"[not found in paragraph 1]"
inBounds	true
expectedText	""
locationAccurate	false

parsed

entry	"4412"
detail	"backstory"
explanation	"The text states Rory fled to London at the behest of her childhood friend Eva, but the codex states she fled to London after leaving an abusive ex named Evan."
paragraph	1
substring	"She fled to London at the behest of her childhood friend Eva"

status

"false_positive"

location

extractedText	"[not found in paragraph 1]"
inBounds	true
expectedText	""
locationAccurate	false

parsed

entry	"4412"
detail	"backstory"
explanation	"The text states Rory works part-time as a delivery person, but the codex states Rory works part-time as a delivery person for Yu-Fei Cheung’s Golden Empress restaurant."
paragraph	1
substring	"works part-time as a delivery person for Yu-Fei Cheung's Golden Empress restaurant"

status

"false_positive"

location

extractedText	"[not found in paragraph 1]"
inBounds	true
expectedText	""
locationAccurate	false

parsed

entry	"4412"
detail	"backstory"
explanation	"The text states Rory lives in a flat above Silas' bar, but the codex states she lives in a flat above Silas' bar."
paragraph	1
substring	"lives in a flat above Silas' bar"

status

"false_positive"

location

extractedText	"[not found in paragraph 1]"
inBounds	true
expectedText	""
locationAccurate	false

parsed

entry	"4413"
detail	"eyeColor"
explanation	"The text states Silas’ eye color is hazel, but the codex states it is hazel."
paragraph	1
substring	"hazel"

status

"false_positive"

location

extractedText	"[not found in paragraph 1]"
inBounds	true
expectedText	"their glowing blue eyes"
locationAccurate	false

closestExpected

entry	"4418"
detail	"eyeColor"
summary	"Nyx has violet eyes per the codex, but the passage says blue eyes."

reason

"entry mismatch: got \"4413\", expected \"4418\""

parsed

entry	"4413"
detail	"hair"
explanation	"The text states Silas has grey-streaked auburn hair, but the codex states he has grey-streaked auburn hair."
paragraph	1
substring	"grey-streaked auburn"

status

"false_positive"

location

extractedText	"[not found in paragraph 1]"
inBounds	true
expectedText	"His natural black hair"
locationAccurate	false

closestExpected

entry	"4420"
detail	"hair"
summary	"Kai has dyed electric-blue hair per the codex, but the passage says natural black hair."

reason

"entry mismatch: got \"4413\", expected \"4420\""

parsed

entry	"4413"
detail	"height"
explanation	"The text states Silas’ height is 6’1”, but the codex states he is 6’1”."
paragraph	1
substring	"6'1"

status

"false_positive"

location

extractedText	"[not found in paragraph 1]"
inBounds	true
expectedText	""
locationAccurate	false

parsed

entry	"4413"
detail	"beard"
explanation	"The text states Silas has a neatly trimmed beard matching his grey-streaked auburn hair, but the codex states he has a neatly trimmed beard matching his grey-streaked auburn hair."
paragraph	1
substring	"neatly trimmed, matching his grey-streaked auburn hair"

status

"false_positive"

location

extractedText	"[not found in paragraph 1]"
inBounds	true
expectedText	""
locationAccurate	false

parsed

entry	"4413"
detail	"limp"
explanation	"The text states Silas has a slight limp in his left leg, but the codex states he has a slight limp in his left leg."
paragraph	1
substring	"slight limp in his left leg"

status

"false_positive"

location

extractedText	"[not found in paragraph 1]"
inBounds	true
expectedText	""
locationAccurate	false

parsed

entry	"4413"
detail	"signetRing"
explanation	"The text states Silas wears a silver signet ring on his right hand, but the codex states he wears a silver signet ring always worn on his right hand."
paragraph	1
substring	"silver signet ring, always worn on his right hand"

status

"false_positive"

location

extractedText	"[not found in paragraph 1]"
inBounds	true
expectedText	""
locationAccurate	false

parsed

entry	"4413"
detail	"description"
explanation	"The text states Silas is a retired intelligence operative turned bar owner, but the codex states Silas is a retired intelligence operative turned bar owner."
paragraph	1
substring	"Silas is a retired intelligence operative turned bar owner"

status

"false_positive"

location

extractedText	"[not found in paragraph 1]"
inBounds	true
expectedText	""
locationAccurate	false

parsed

entry	"4413"
detail	"backstory"
explanation	"The text states Silas retired after a botched operation in Prague, but the codex states he retired after a botched operation in Prague."
paragraph	1
substring	"Former MI6 field agent who retired after a botched operation in Prague"

status

"false_positive"

location

extractedText	"[not found in paragraph 1]"
inBounds	true
expectedText	""
locationAccurate	false

parsed

entry	"4414"
detail	"description"
explanation	""
paragraph	1
substring	"Aurora's childhood friend and an occult researcher"

status

"false_positive"

location

extractedText	"[not found in paragraph 1]"
inBounds	true
expectedText	""
locationAccurate	false

0.00%

Precision

True positives: 0/18

totalReported

truePositives

reportedDetails

parsed

entry	"4412"
detail	"species"
explanation	"The text describes Aurora Carter as Human, but the codex states she is Half-Demon."
paragraph	1
substring	"Human"

status

"false_positive"

location

extractedText	"[not found in paragraph 1]"
inBounds	true
expectedText	""
locationAccurate	false

parsed

entry	"4412"
detail	"eyeColor"
explanation	"The text states Aurora’s eyes are bright blue, but the codex states they are bright blue."
paragraph	1
substring	"bright blue"

status

"false_positive"

location

extractedText	"[not found in paragraph 1]"
inBounds	true
expectedText	"their glowing blue eyes"
locationAccurate	false

closestExpected

entry	"4418"
detail	"eyeColor"
summary	"Nyx has violet eyes per the codex, but the passage says blue eyes."

reason

"entry mismatch: got \"4412\", expected \"4418\""

parsed

entry	"4412"
detail	"hair"
explanation	"The text describes Aurora’s hair as straight shoulder-length black, but the codex states it is straight shoulder-length black."
paragraph	1
substring	"straight shoulder-length black"

status

"false_positive"

location

extractedText	"[not found in paragraph 1]"
inBounds	true
expectedText	"His natural black hair"
locationAccurate	false

closestExpected

entry	"4420"
detail	"hair"
summary	"Kai has dyed electric-blue hair per the codex, but the passage says natural black hair."

reason

"entry mismatch: got \"4412\", expected \"4420\""

parsed

entry	"4412"
detail	"scar"
explanation	"The text states the scar is crescent-shaped, but the codex states it is crescent-shaped."
paragraph	1
substring	"small crescent-shaped scar on her left wrist"

status

"false_positive"

location

extractedText	"[not found in paragraph 1]"
inBounds	true
expectedText	"his scarred right forearm"
locationAccurate	false

closestExpected

entry	"4417"
detail	"scar"
summary	"Tomás has a scar on his left forearm per the codex, but the passage says right forearm."

reason

"entry mismatch: got \"4412\", expected \"4417\""

parsed

entry	"4412"
detail	"backstory"
explanation	"The text names Aurora’s father as Brendan Carter and mother as Jennifer Carter, but the codex references her father as Brendan Carter and her mother as Jennifer Carter née Ellis."
paragraph	1
substring	"father (Brendan Carter) and Welsh teacher mother (Jennifer Carter née Ellis)"

status

"false_positive"

location

extractedText	"[not found in paragraph 1]"
inBounds	true
expectedText	""
locationAccurate	false

parsed

entry	"4412"
detail	"backstory"
explanation	"The text states Rory reluctantly pursued Pre-Law at Cardiff University, but the codex states Rory was born in Cardiff and pursued Pre-Law at Cardiff University."
paragraph	1
substring	"Rory reluctantly pursued Pre-Law at Cardiff University"

status

"false_positive"

location

extractedText	"[not found in paragraph 1]"
inBounds	true
expectedText	""
locationAccurate	false

parsed

entry	"4412"
detail	"backstory"
explanation	"The text states Rory fled to London at the behest of her childhood friend Eva, but the codex states she fled to London after leaving an abusive ex named Evan."
paragraph	1
substring	"She fled to London at the behest of her childhood friend Eva"

status

"false_positive"

location

extractedText	"[not found in paragraph 1]"
inBounds	true
expectedText	""
locationAccurate	false

parsed

entry	"4412"
detail	"backstory"
explanation	"The text states Rory works part-time as a delivery person, but the codex states Rory works part-time as a delivery person for Yu-Fei Cheung’s Golden Empress restaurant."
paragraph	1
substring	"works part-time as a delivery person for Yu-Fei Cheung's Golden Empress restaurant"

status

"false_positive"

location

extractedText	"[not found in paragraph 1]"
inBounds	true
expectedText	""
locationAccurate	false

parsed

entry	"4412"
detail	"backstory"
explanation	"The text states Rory lives in a flat above Silas' bar, but the codex states she lives in a flat above Silas' bar."
paragraph	1
substring	"lives in a flat above Silas' bar"

status

"false_positive"

location

extractedText	"[not found in paragraph 1]"
inBounds	true
expectedText	""
locationAccurate	false

parsed

entry	"4413"
detail	"eyeColor"
explanation	"The text states Silas’ eye color is hazel, but the codex states it is hazel."
paragraph	1
substring	"hazel"

status

"false_positive"

location

extractedText	"[not found in paragraph 1]"
inBounds	true
expectedText	"their glowing blue eyes"
locationAccurate	false

closestExpected

entry	"4418"
detail	"eyeColor"
summary	"Nyx has violet eyes per the codex, but the passage says blue eyes."

reason

"entry mismatch: got \"4413\", expected \"4418\""

parsed

entry	"4413"
detail	"hair"
explanation	"The text states Silas has grey-streaked auburn hair, but the codex states he has grey-streaked auburn hair."
paragraph	1
substring	"grey-streaked auburn"

status

"false_positive"

location

extractedText	"[not found in paragraph 1]"
inBounds	true
expectedText	"His natural black hair"
locationAccurate	false

closestExpected

entry	"4420"
detail	"hair"
summary	"Kai has dyed electric-blue hair per the codex, but the passage says natural black hair."

reason

"entry mismatch: got \"4413\", expected \"4420\""

parsed

entry	"4413"
detail	"height"
explanation	"The text states Silas’ height is 6’1”, but the codex states he is 6’1”."
paragraph	1
substring	"6'1"

status

"false_positive"

location

extractedText	"[not found in paragraph 1]"
inBounds	true
expectedText	""
locationAccurate	false

parsed

entry	"4413"
detail	"beard"
explanation	"The text states Silas has a neatly trimmed beard matching his grey-streaked auburn hair, but the codex states he has a neatly trimmed beard matching his grey-streaked auburn hair."
paragraph	1
substring	"neatly trimmed, matching his grey-streaked auburn hair"

status

"false_positive"

location

extractedText	"[not found in paragraph 1]"
inBounds	true
expectedText	""
locationAccurate	false

parsed

entry	"4413"
detail	"limp"
explanation	"The text states Silas has a slight limp in his left leg, but the codex states he has a slight limp in his left leg."
paragraph	1
substring	"slight limp in his left leg"

status

"false_positive"

location

extractedText	"[not found in paragraph 1]"
inBounds	true
expectedText	""
locationAccurate	false

parsed

entry	"4413"
detail	"signetRing"
explanation	"The text states Silas wears a silver signet ring on his right hand, but the codex states he wears a silver signet ring always worn on his right hand."
paragraph	1
substring	"silver signet ring, always worn on his right hand"

status

"false_positive"

location

extractedText	"[not found in paragraph 1]"
inBounds	true
expectedText	""
locationAccurate	false

parsed

entry	"4413"
detail	"description"
explanation	"The text states Silas is a retired intelligence operative turned bar owner, but the codex states Silas is a retired intelligence operative turned bar owner."
paragraph	1
substring	"Silas is a retired intelligence operative turned bar owner"

status

"false_positive"

location

extractedText	"[not found in paragraph 1]"
inBounds	true
expectedText	""
locationAccurate	false

parsed

entry	"4413"
detail	"backstory"
explanation	"The text states Silas retired after a botched operation in Prague, but the codex states he retired after a botched operation in Prague."
paragraph	1
substring	"Former MI6 field agent who retired after a botched operation in Prague"

status

"false_positive"

location

extractedText	"[not found in paragraph 1]"
inBounds	true
expectedText	""
locationAccurate	false

parsed

entry	"4414"
detail	"description"
explanation	""
paragraph	1
substring	"Aurora's childhood friend and an occult researcher"

status

"false_positive"

location

extractedText	"[not found in paragraph 1]"
inBounds	true
expectedText	""
locationAccurate	false

97.22%

Structural validity

Parsed: 18, Well-formed: 17.5/18

parsedCount	18
wellFormedScore	17.5

32.4074%