| 20.0000% | Accuracy (recall) | Matched: 3/5, FP: 4 | | parsedCount | 7 | | matched | 3 | | total | 5 | | falsePositives | 4 | | expectedDetails | | 0 | | expected | | entry | "4412" | | detail | "eyeColor" | | summary | "Aurora has bright blue eyes per her codex entry, but the passage says she has green eyes." |
| | status | "matched" | | matchedBy | | entry | "4412" | | detail | "eyeColor" | | explanation | "Aurora's eye color in the codex is \"bright blue,\" but the text states \"green.\"" | | paragraph | 1 | | substring | "her green eyes scanning" |
| | location | | extractedText | "her green eyes scanning" | | inBounds | true | | expectedText | "her green eyes scanning the room" | | locationAccurate | true |
|
| | 1 | | expected | | entry | "4412" | | detail | "species" | | summary | "Aurora is Human per her codex entry, but the passage refers to her as Half-Fae." |
| | status | "missed" | | nearMiss | | parsed | | entry | "4412" | | detail | "hairColor" | | explanation | "Aurora's hair in the codex is \"straight shoulder-length black,\" but the text refers to Silas having a \"dark brown beard\" (not Aurora's hair)." | | paragraph | 2 | | substring | "dark brown beard" |
| | reason | "detail mismatch: got \"hairColor\", expected \"species\"" |
|
| | 2 | | expected | | entry | "2001" | | detail | "chainMaterial" | | summary | "The Heartstone Pendant has a silver chain per its codex entry, but the passage says golden chain." |
| | status | "matched" | | matchedBy | | entry | "2001" | | detail | "chainMaterial" | | explanation | "The Heartstone Pendant's chain material in the codex is **silver**, but the text describes it as \"golden,\" which contradicts the codex." | | paragraph | 3 | | substring | "golden chain" |
| | location | | extractedText | "golden chain" | | inBounds | true | | expectedText | "the golden chain catching the low light" | | locationAccurate | true |
|
| | 3 | | expected | | entry | "4413" | | detail | "beard" | | summary | "Silas's beard matches his grey-streaked auburn hair per codex, but the passage says dark brown beard." |
| | status | "missed" | | nearMiss | | parsed | | entry | "4413" | | detail | "eyeColor" | | explanation | "Silas's eye color in the codex is \"hazel,\" but the text does not mention his eye color—only his beard (which is correctly described as \"dark brown\" in Silas' alias context, but this is irrelevant to the violation).\n*Note: The text does not contradict Silas's eye color explicitly, but the phrasing \"dark brown beard\" is ambiguous for Silas’s hair color (codex says \"grey-streaked auburn\"). If Silas’s beard is \"dark brown,\" it contradicts the codex's \"grey-streaked auburn\" hair description." | | paragraph | 2 | | substring | "hazel" |
| | reason | "detail mismatch: got \"eyeColor\", expected \"beard\"" |
|
| | 4 | | expected | | entry | "853" | | detail | "ruler" | | summary | "Dymas is Prince Belphegor's realm per the codex, but the passage says Prince Mammon's realm." |
| | status | "matched" | | matchedBy | | entry | "853" | | detail | "ruler" | | explanation | "Prince Mammon is not listed as the ruler of Dymas (Gluttony); the codex states the ruler is **Prince Belphegor**." | | paragraph | 3 | | substring | "Prince Mammon's realm" |
| | location | | extractedText | "Prince Mammon's realm" | | inBounds | true | | expectedText | "Prince Mammon's realm" | | locationAccurate | true |
|
|
| | falsePositiveDetails | | 0 | | parsed | | entry | "4412" | | detail | "hairColor" | | explanation | "Aurora's hair in the codex is \"straight shoulder-length black,\" but the text refers to Silas having a \"dark brown beard\" (not Aurora's hair)." | | paragraph | 2 | | substring | "dark brown beard" |
| | status | "false_positive" | | location | | extractedText | "dark brown beard" | | inBounds | true | | expectedText | "her green eyes scanning the room" | | locationAccurate | false |
| | closestExpected | | entry | "4412" | | detail | "eyeColor" | | summary | "Aurora has bright blue eyes per her codex entry, but the passage says she has green eyes." |
| | reason | "detail mismatch: got \"hairColor\", expected \"eyeColor\"" |
| | 1 | | parsed | | entry | "4413" | | detail | "eyeColor" | | explanation | "Silas's eye color in the codex is \"hazel,\" but the text does not mention his eye color—only his beard (which is correctly described as \"dark brown\" in Silas' alias context, but this is irrelevant to the violation).\n*Note: The text does not contradict Silas's eye color explicitly, but the phrasing \"dark brown beard\" is ambiguous for Silas’s hair color (codex says \"grey-streaked auburn\"). If Silas’s beard is \"dark brown,\" it contradicts the codex's \"grey-streaked auburn\" hair description." | | paragraph | 2 | | substring | "hazel" |
| | status | "false_positive" | | location | | extractedText | "[not found in paragraph 2]" | | inBounds | true | | expectedText | "his dark brown beard" | | locationAccurate | false |
| | closestExpected | | entry | "4413" | | detail | "beard" | | summary | "Silas's beard matches his grey-streaked auburn hair per codex, but the passage says dark brown beard." |
| | reason | "detail mismatch: got \"eyeColor\", expected \"beard\"" |
| | 2 | | parsed | | entry | "4413" | | detail | "hair" | | explanation | "Silas's hair in the codex is \"grey-streaked auburn,\" but the text describes his beard as \"dark brown,\" implying a mismatch in hair color (assuming beard color refers to hair color)." | | paragraph | 2 | | substring | "dark brown beard" |
| | status | "false_positive" | | location | | extractedText | "dark brown beard" | | inBounds | true | | expectedText | "his dark brown beard" | | locationAccurate | true |
| | closestExpected | | entry | "4413" | | detail | "beard" | | summary | "Silas's beard matches his grey-streaked auburn hair per codex, but the passage says dark brown beard." |
| | reason | "detail mismatch: got \"hair\", expected \"beard\"" |
| | 3 | | parsed | | entry | "2001" | | detail | "gemstoneColor" | | explanation | "The Heartstone Pendant's gemstone color in the codex is \"deep crimson,\" but the text does not mention this explicitly—only that the \"golden chain\" catches light, which is not a contradiction. However, the text does not align with the codex's description of the pendant's glow or origin.\n*Note: The text does not explicitly contradict the gemstone color, but the phrasing \"golden chain\" is ambiguous—codex specifies a **silver chain**. If \"golden\" is a mistake, this would be a violation." | | paragraph | 3 | | substring | "deep crimson" |
| | status | "false_positive" | | location | | extractedText | "[not found in paragraph 3]" | | inBounds | true | | expectedText | "the golden chain catching the low light" | | locationAccurate | false |
| | closestExpected | | entry | "2001" | | detail | "chainMaterial" | | summary | "The Heartstone Pendant has a silver chain per its codex entry, but the passage says golden chain." |
| | reason | "detail mismatch: got \"gemstoneColor\", expected \"chainMaterial\"" |
|
| |
| 42.8571% | Precision | True positives: 3/7 | | totalReported | 7 | | truePositives | 3 | | reportedDetails | | 0 | | parsed | | entry | "4412" | | detail | "eyeColor" | | explanation | "Aurora's eye color in the codex is \"bright blue,\" but the text states \"green.\"" | | paragraph | 1 | | substring | "her green eyes scanning" |
| | status | "true_positive" | | matchedExpected | | entry | "4412" | | detail | "eyeColor" | | summary | "Aurora has bright blue eyes per her codex entry, but the passage says she has green eyes." |
| | location | | extractedText | "her green eyes scanning" | | inBounds | true | | expectedText | "her green eyes scanning the room" | | locationAccurate | true |
|
| | 1 | | parsed | | entry | "4412" | | detail | "hairColor" | | explanation | "Aurora's hair in the codex is \"straight shoulder-length black,\" but the text refers to Silas having a \"dark brown beard\" (not Aurora's hair)." | | paragraph | 2 | | substring | "dark brown beard" |
| | status | "false_positive" | | location | | extractedText | "dark brown beard" | | inBounds | true | | expectedText | "her green eyes scanning the room" | | locationAccurate | false |
| | closestExpected | | entry | "4412" | | detail | "eyeColor" | | summary | "Aurora has bright blue eyes per her codex entry, but the passage says she has green eyes." |
| | reason | "detail mismatch: got \"hairColor\", expected \"eyeColor\"" |
| | 2 | | parsed | | entry | "4413" | | detail | "eyeColor" | | explanation | "Silas's eye color in the codex is \"hazel,\" but the text does not mention his eye color—only his beard (which is correctly described as \"dark brown\" in Silas' alias context, but this is irrelevant to the violation).\n*Note: The text does not contradict Silas's eye color explicitly, but the phrasing \"dark brown beard\" is ambiguous for Silas’s hair color (codex says \"grey-streaked auburn\"). If Silas’s beard is \"dark brown,\" it contradicts the codex's \"grey-streaked auburn\" hair description." | | paragraph | 2 | | substring | "hazel" |
| | status | "false_positive" | | location | | extractedText | "[not found in paragraph 2]" | | inBounds | true | | expectedText | "his dark brown beard" | | locationAccurate | false |
| | closestExpected | | entry | "4413" | | detail | "beard" | | summary | "Silas's beard matches his grey-streaked auburn hair per codex, but the passage says dark brown beard." |
| | reason | "detail mismatch: got \"eyeColor\", expected \"beard\"" |
| | 3 | | parsed | | entry | "4413" | | detail | "hair" | | explanation | "Silas's hair in the codex is \"grey-streaked auburn,\" but the text describes his beard as \"dark brown,\" implying a mismatch in hair color (assuming beard color refers to hair color)." | | paragraph | 2 | | substring | "dark brown beard" |
| | status | "false_positive" | | location | | extractedText | "dark brown beard" | | inBounds | true | | expectedText | "his dark brown beard" | | locationAccurate | true |
| | closestExpected | | entry | "4413" | | detail | "beard" | | summary | "Silas's beard matches his grey-streaked auburn hair per codex, but the passage says dark brown beard." |
| | reason | "detail mismatch: got \"hair\", expected \"beard\"" |
| | 4 | | parsed | | entry | "853" | | detail | "ruler" | | explanation | "Prince Mammon is not listed as the ruler of Dymas (Gluttony); the codex states the ruler is **Prince Belphegor**." | | paragraph | 3 | | substring | "Prince Mammon's realm" |
| | status | "true_positive" | | matchedExpected | | entry | "853" | | detail | "ruler" | | summary | "Dymas is Prince Belphegor's realm per the codex, but the passage says Prince Mammon's realm." |
| | location | | extractedText | "Prince Mammon's realm" | | inBounds | true | | expectedText | "Prince Mammon's realm" | | locationAccurate | true |
|
| | 5 | | parsed | | entry | "2001" | | detail | "gemstoneColor" | | explanation | "The Heartstone Pendant's gemstone color in the codex is \"deep crimson,\" but the text does not mention this explicitly—only that the \"golden chain\" catches light, which is not a contradiction. However, the text does not align with the codex's description of the pendant's glow or origin.\n*Note: The text does not explicitly contradict the gemstone color, but the phrasing \"golden chain\" is ambiguous—codex specifies a **silver chain**. If \"golden\" is a mistake, this would be a violation." | | paragraph | 3 | | substring | "deep crimson" |
| | status | "false_positive" | | location | | extractedText | "[not found in paragraph 3]" | | inBounds | true | | expectedText | "the golden chain catching the low light" | | locationAccurate | false |
| | closestExpected | | entry | "2001" | | detail | "chainMaterial" | | summary | "The Heartstone Pendant has a silver chain per its codex entry, but the passage says golden chain." |
| | reason | "detail mismatch: got \"gemstoneColor\", expected \"chainMaterial\"" |
| | 6 | | parsed | | entry | "2001" | | detail | "chainMaterial" | | explanation | "The Heartstone Pendant's chain material in the codex is **silver**, but the text describes it as \"golden,\" which contradicts the codex." | | paragraph | 3 | | substring | "golden chain" |
| | status | "true_positive" | | matchedExpected | | entry | "2001" | | detail | "chainMaterial" | | summary | "The Heartstone Pendant has a silver chain per its codex entry, but the passage says golden chain." |
| | location | | extractedText | "golden chain" | | inBounds | true | | expectedText | "the golden chain catching the low light" | | locationAccurate | true |
|
|
| |