"2026-02-16T00:36:55.266253+00:00"2/16/2026, 12:36:55 AM
model
"google/gemini-2.5-flash-lite"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
293
moderation_latency
(null)
generation_time
4220
tokens_prompt
7819
tokens_completion
1413
native_tokens_prompt
7747
native_tokens_completion
1456
native_tokens_completion_images
0
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"STOP"
usage
0.0013571
router
(null)
provider_responses
0
status
200
is_byok
false
latency
293
endpoint_id
"ce839073-aa24-4f29-8358-15b319bd05ec"
provider_name
"Google AI Studio"
model_permaslug
"google/gemini-2.5-flash-lite"
api_type
"completions"
id
"gen-1771202210-mjQVm4IULC8nbHjzVx3A"
upstream_id
(null)
total_cost
0.0013571
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Google AI Studio"
Evaluation details
Result
Evaluator
Details
Meta Data
5.0000%
Accuracy (recall)
Matched: 8/30, FP: 13
parsedCount
21
matched
8
total
30
falsePositives
13
expectedDetails
0
expected
entry
"861"
detail
"parkLocation"
summary
"The Fae Grove is in Richmond Park per codex, but the passage says Hyde Park."
status
"missed"
1
expected
entry
"861"
detail
"standingStones"
summary
"The grove has oak standing stones per codex, but the passage says elm."
status
"missed"
2
expected
entry
"4424"
detail
"eyeColor"
summary
"Isolde has pale lavender eyes per codex, but the passage says pale blue eyes."
status
"missed"
3
expected
entry
"4424"
detail
"footprints"
summary
"Isolde leaves no footprints per codex, but the passage says she leaves clear prints."
status
"missed"
4
expected
entry
"2006"
detail
"temperature"
summary
"The Fae-Forged Blade is always cold per codex, but the passage says warm."
status
"missed"
5
expected
entry
"4414"
detail
"glasses"
summary
"Eva wears round glasses per codex, but the passage says square glasses."
status
"matched"
matchedBy
entry
"4414"
detail
"glasses"
explanation
"The text describes Eva Kowalski as wearing square glasses, but the codex states she wears round glasses."
paragraph
3
substring
"Her square glasses"
location
extractedText
"[not found in paragraph 3]"
inBounds
true
expectedText
"Her square glasses kept fogging"
locationAccurate
false
6
expected
entry
"2005"
detail
"containerColor"
summary
"Dream Dust is stored in cobalt-blue vials per codex, but Isolde says red glass vials."
status
"missed"
7
expected
entry
"2005"
detail
"sealMaterial"
summary
"Dream Dust vials are sealed with black wax per codex, but Isolde says white wax."
status
"missed"
8
expected
entry
"6003"
detail
"master"
summary
"The Somnian Cult serves Prince Asmodeus per codex, but Isolde says Prince Lilith."
status
"missed"
9
expected
entry
"4422"
detail
"eyeColor"
summary
"Father Cormac has pale blue eyes per codex, but the passage says dark brown eyes."
status
"missed"
10
expected
entry
"4422"
detail
"rosary"
summary
"Cormac carries a rowan wood rosary per codex, but the passage says cedar."
status
"missed"
11
expected
entry
"7002"
detail
"signedYear"
summary
"The Covenant of Separation was signed in 1215 per codex, but Cormac says 1066."
status
"matched"
matchedBy
entry
"7002"
detail
"signedYear"
explanation
"The text states the Covenant of Separation was signed in 1066, but the codex indicates it was signed in 1215."
paragraph
7
substring
"The Covenant of Separation — the old treaty from 1066"
location
extractedText
"[not found in paragraph 7]"
inBounds
true
expectedText
"the old treaty from 1066"
locationAccurate
false
12
expected
entry
"6004"
detail
"headquarters"
summary
"The Parish Guard HQ is St. Brigid's in Islington per codex, but Cormac says Southwark."
status
"missed"
13
expected
entry
"4415"
detail
"cane"
summary
"Lucien carries an ivory-handled cane per codex, but the passage says mahogany."
status
"missed"
nearMiss
parsed
entry
"4415"
detail
"backstory"
explanation
"The text states Mammon is based in Avaros and that the Crimson Court's base of operations has shifted from Dymas to Irath. The codex lists Mammon as the ruler of Avaros and Prince Abaddon as the ruler of Irath, and the Crimson Court is listed as having its headquarters in Dymas. It also states Lucien's father is from Avaros, not that Mammon is his father."
paragraph
8
substring
"Mammon breaks it daily in Avaros. And my father— he says the Crimson Court's base of operations has shifted from Dymas to Irath."
"Lucien has heterochromatic eyes (one amber, one black), but the passage says both amber."
status
"missed"
nearMiss
parsed
entry
"4415"
detail
"backstory"
explanation
"The text states Mammon is based in Avaros and that the Crimson Court's base of operations has shifted from Dymas to Irath. The codex lists Mammon as the ruler of Avaros and Prince Abaddon as the ruler of Irath, and the Crimson Court is listed as having its headquarters in Dymas. It also states Lucien's father is from Avaros, not that Mammon is his father."
paragraph
8
substring
"Mammon breaks it daily in Avaros. And my father— he says the Crimson Court's base of operations has shifted from Dymas to Irath."
"Yasmin's flame serpent tattoo is on her left arm per codex, but the passage says right arm."
status
"matched"
matchedBy
entry
"4421"
detail
"tattoo"
explanation
"The text states Yasmin Al-Rashid's flame serpent tattoo is on her right arm, but the codex specifies it coils up her left arm."
paragraph
9
substring
"The flame serpent tattoo on her right arm"
location
extractedText
"[not found in paragraph 9]"
inBounds
true
expectedText
"tattoo on her right arm"
locationAccurate
false
16
expected
entry
"4423"
detail
"tattoo"
summary
"Wei-Lin's dragon tattoo covers his back per codex, but the passage says chest."
status
"missed"
nearMiss
parsed
entry
"4423"
detail
"description"
explanation
"The text mentions a dragon tattoo on Wei-Lin's chest. The codex states his dragon tattoo covers his entire back."
paragraph
10
substring
"Wei-Lin, leaning against one of the standing stones with his arms folded, grunted in agreement. The edge of the dragon tattoo on his chest was visible above his collar."
"The Heartstone Pendant was forged in Dymas per codex, but Isolde says it was forged in Avaros."
status
"matched"
matchedBy
entry
"2001"
detail
"origin"
explanation
"The text states the Heartstone Pendant was forged in Avaros. The codex states it originated in Dymas."
paragraph
15
substring
"The Heartstone was forged in Avaros"
location
extractedText
"[not found in paragraph 15]"
inBounds
true
expectedText
"The Heartstone was forged in Avaros"
locationAccurate
false
29
expected
entry
"855"
detail
"ruler"
summary
"Avaros is Prince Mammon's realm per codex, but Tomás says Prince Belphegor's agents operate there."
status
"missed"
nearMiss
parsed
entry
"853"
detail
"ruler"
explanation
"The text mentions Prince Belphegor's agents are kidnapping humans. The codex states Prince Belphegor rules Dymas (Gluttony), not that he is directly involved with agents engaging in such activities."
paragraph
13
substring
"Prince Belphegor's agents"
reason
"entry mismatch: got \"853\", expected \"855\""
falsePositiveDetails
0
parsed
entry
"4415"
detail
"backstory"
explanation
"The text states Mammon is based in Avaros and that the Crimson Court's base of operations has shifted from Dymas to Irath. The codex lists Mammon as the ruler of Avaros and Prince Abaddon as the ruler of Irath, and the Crimson Court is listed as having its headquarters in Dymas. It also states Lucien's father is from Avaros, not that Mammon is his father."
paragraph
8
substring
"Mammon breaks it daily in Avaros. And my father— he says the Crimson Court's base of operations has shifted from Dymas to Irath."
status
"false_positive"
location
extractedText
"[not found in paragraph 8]"
inBounds
true
expectedText
"leaning on his mahogany cane"
locationAccurate
false
closestExpected
entry
"4415"
detail
"cane"
summary
"Lucien carries an ivory-handled cane per codex, but the passage says mahogany."
"The text implies Lucien Moreau's father is Mammon, ruler of Avaros. The codex states his father was a demon from Avaros, but not specifically Mammon."
paragraph
8
substring
"my father"
status
"false_positive"
location
extractedText
"[not found in paragraph 8]"
inBounds
true
expectedText
"leaning on his mahogany cane"
locationAccurate
false
closestExpected
entry
"4415"
detail
"cane"
summary
"Lucien carries an ivory-handled cane per codex, but the passage says mahogany."
"The text mentions a dragon tattoo on Wei-Lin's chest. The codex states his dragon tattoo covers his entire back."
paragraph
10
substring
"Wei-Lin, leaning against one of the standing stones with his arms folded, grunted in agreement. The edge of the dragon tattoo on his chest was visible above his collar."
status
"false_positive"
location
extractedText
"[not found in paragraph 10]"
inBounds
true
expectedText
"the dragon tattoo on his chest"
locationAccurate
false
closestExpected
entry
"4423"
detail
"tattoo"
summary
"Wei-Lin's dragon tattoo covers his back per codex, but the passage says chest."
"The text states Blackthorn Security's logo is a sword inside a circle. The codex states it is a thorned branch inside a shield."
paragraph
11
substring
"Helena Voss. Their logo — the sword inside a circle"
status
"false_positive"
location
extractedText
"[not found in paragraph 11]"
inBounds
true
expectedText
""
locationAccurate
false
4
parsed
entry
"7002"
detail
"signedYear"
explanation
"The text states the Wardens were founded in 1066. The codex indicates they were founded in 1215."
paragraph
12
substring
"The Wardens were founded in 1066"
status
"false_positive"
location
extractedText
"[not found in paragraph 12]"
inBounds
true
expectedText
""
locationAccurate
false
5
parsed
entry
"853"
detail
"ruler"
explanation
"The text mentions Prince Belphegor's agents are kidnapping humans. The codex states Prince Belphegor rules Dymas (Gluttony), not that he is directly involved with agents engaging in such activities."
paragraph
13
substring
"Prince Belphegor's agents"
status
"false_positive"
location
extractedText
"[not found in paragraph 13]"
inBounds
true
expectedText
"Prince Belphegor's agents are kidnapping humans"
locationAccurate
false
closestExpected
entry
"855"
detail
"ruler"
summary
"Avaros is Prince Mammon's realm per codex, but Tomás says Prince Belphegor's agents operate there."
reason
"entry mismatch: got \"853\", expected \"855\""
6
parsed
entry
"4417"
detail
"birthplace"
explanation
"The text states a contract was signed in Avaros. The codex lists Avaros as having Prince Mammon as its ruler, not Prince Belphegor. Prince Belphegor rules Dymas."
paragraph
13
substring
"Avaros"
status
"false_positive"
location
extractedText
"Avaros"
inBounds
true
expectedText
"His scarred right forearm"
locationAccurate
false
closestExpected
entry
"4417"
detail
"scar"
summary
"Tomás has a scar on his left forearm per codex, but the passage says right forearm."
"The text states Prince Belphegor's agents are kidnapping humans and forcing contracts. The codex states Prince Belphegor is the ruler of Dymas (Gluttony), not that he directly commands agents for such actions, and Avaros (Greed) is where the Ledger of Debts originates."
paragraph
13
substring
"Prince Belphegor"
status
"false_positive"
location
extractedText
"[not found in paragraph 13]"
inBounds
true
expectedText
"His scarred right forearm"
locationAccurate
false
closestExpected
entry
"4417"
detail
"scar"
summary
"Tomás has a scar on his left forearm per codex, but the passage says right forearm."
"The text mentions Silas rubbed his left knee. The codex states he has a slight limp in his left leg."
paragraph
17
substring
"He rubbed his left knee"
status
"false_positive"
location
extractedText
"[not found in paragraph 17]"
inBounds
true
expectedText
""
locationAccurate
false
11
parsed
entry
"4413"
detail
"backstory"
explanation
"The text mentions Silas experienced an event in Prague in 1987. The codex states his botched operation in Prague was the cause of his permanent knee injury, but does not specify a date."
paragraph
17
substring
"Prague, 1987"1/1/1987, 12:00:00 AM
status
"false_positive"
location
extractedText
"[not found in paragraph 17]"
inBounds
true
expectedText
""
locationAccurate
false
12
parsed
entry
"4413"
detail
"backstory"
explanation
"The text mentions twelve Wardens were involved in closing a rift in Prague. The codex does not mention the number of Wardens involved in any specific operation."
paragraph
17
substring
"twelve Wardens to close"
status
"false_positive"
location
extractedText
"[not found in paragraph 17]"
inBounds
true
expectedText
""
locationAccurate
false
38.0952%
Precision
True positives: 8/21
totalReported
21
truePositives
8
reportedDetails
0
parsed
entry
"4414"
detail
"glasses"
explanation
"The text describes Eva Kowalski as wearing square glasses, but the codex states she wears round glasses."
paragraph
3
substring
"Her square glasses"
status
"true_positive"
matchedExpected
entry
"4414"
detail
"glasses"
summary
"Eva wears round glasses per codex, but the passage says square glasses."
location
extractedText
"[not found in paragraph 3]"
inBounds
true
expectedText
"Her square glasses kept fogging"
locationAccurate
false
1
parsed
entry
"7002"
detail
"signedYear"
explanation
"The text states the Covenant of Separation was signed in 1066, but the codex indicates it was signed in 1215."
paragraph
7
substring
"The Covenant of Separation — the old treaty from 1066"
status
"true_positive"
matchedExpected
entry
"7002"
detail
"signedYear"
summary
"The Covenant of Separation was signed in 1215 per codex, but Cormac says 1066."
location
extractedText
"[not found in paragraph 7]"
inBounds
true
expectedText
"the old treaty from 1066"
locationAccurate
false
2
parsed
entry
"4415"
detail
"backstory"
explanation
"The text states Mammon is based in Avaros and that the Crimson Court's base of operations has shifted from Dymas to Irath. The codex lists Mammon as the ruler of Avaros and Prince Abaddon as the ruler of Irath, and the Crimson Court is listed as having its headquarters in Dymas. It also states Lucien's father is from Avaros, not that Mammon is his father."
paragraph
8
substring
"Mammon breaks it daily in Avaros. And my father— he says the Crimson Court's base of operations has shifted from Dymas to Irath."
status
"false_positive"
location
extractedText
"[not found in paragraph 8]"
inBounds
true
expectedText
"leaning on his mahogany cane"
locationAccurate
false
closestExpected
entry
"4415"
detail
"cane"
summary
"Lucien carries an ivory-handled cane per codex, but the passage says mahogany."
"The text implies Lucien Moreau's father is Mammon, ruler of Avaros. The codex states his father was a demon from Avaros, but not specifically Mammon."
paragraph
8
substring
"my father"
status
"false_positive"
location
extractedText
"[not found in paragraph 8]"
inBounds
true
expectedText
"leaning on his mahogany cane"
locationAccurate
false
closestExpected
entry
"4415"
detail
"cane"
summary
"Lucien carries an ivory-handled cane per codex, but the passage says mahogany."
"The text states Yasmin Al-Rashid's flame serpent tattoo is on her right arm, but the codex specifies it coils up her left arm."
paragraph
9
substring
"The flame serpent tattoo on her right arm"
status
"true_positive"
matchedExpected
entry
"4421"
detail
"tattoo"
summary
"Yasmin's flame serpent tattoo is on her left arm per codex, but the passage says right arm."
location
extractedText
"[not found in paragraph 9]"
inBounds
true
expectedText
"tattoo on her right arm"
locationAccurate
false
5
parsed
entry
"4423"
detail
"description"
explanation
"The text mentions a dragon tattoo on Wei-Lin's chest. The codex states his dragon tattoo covers his entire back."
paragraph
10
substring
"Wei-Lin, leaning against one of the standing stones with his arms folded, grunted in agreement. The edge of the dragon tattoo on his chest was visible above his collar."
status
"false_positive"
location
extractedText
"[not found in paragraph 10]"
inBounds
true
expectedText
"the dragon tattoo on his chest"
locationAccurate
false
closestExpected
entry
"4423"
detail
"tattoo"
summary
"Wei-Lin's dragon tattoo covers his back per codex, but the passage says chest."
"The text describes Kai Nakamura's hair as natural black. The codex states his hair is dyed electric-blue."
paragraph
11
substring
"his natural black hair falling into his face"
status
"true_positive"
matchedExpected
entry
"4420"
detail
"hair"
summary
"Kai has dyed electric-blue hair per codex, but the passage says natural black hair."
location
extractedText
"[not found in paragraph 11]"
inBounds
true
expectedText
"his natural black hair falling into his face"
locationAccurate
false
7
parsed
entry
"4416"
detail
"description"
explanation
"The text states Blackthorn Security's logo is a sword inside a circle. The codex states it is a thorned branch inside a shield."
paragraph
11
substring
"Helena Voss. Their logo — the sword inside a circle"
status
"false_positive"
location
extractedText
"[not found in paragraph 11]"
inBounds
true
expectedText
""
locationAccurate
false
8
parsed
entry
"4419"
detail
"walkingStick"
explanation
"The text states Maggie Whitmore uses an oak walking stick. The codex specifies it is a blackthorn walking stick."
paragraph
12
substring
"Maggie rapped her oak walking stick"
status
"true_positive"
matchedExpected
entry
"4419"
detail
"walkingStick"
summary
"Maggie carries a blackthorn stick per codex, but the passage says oak."
location
extractedText
"[not found in paragraph 12]"
inBounds
true
expectedText
"her oak walking stick"
locationAccurate
false
9
parsed
entry
"7002"
detail
"signedYear"
explanation
"The text states the Wardens were founded in 1066. The codex indicates they were founded in 1215."
paragraph
12
substring
"The Wardens were founded in 1066"
status
"false_positive"
location
extractedText
"[not found in paragraph 12]"
inBounds
true
expectedText
""
locationAccurate
false
10
parsed
entry
"4417"
detail
"scar"
explanation
"The text states Tomás Herrera's scar is on his right forearm. The codex specifies the scar runs along his left forearm."
paragraph
13
substring
"His scarred right forearm"
status
"true_positive"
matchedExpected
entry
"4417"
detail
"scar"
summary
"Tomás has a scar on his left forearm per codex, but the passage says right forearm."
location
extractedText
"[not found in paragraph 13]"
inBounds
true
expectedText
"His scarred right forearm"
locationAccurate
false
11
parsed
entry
"4417"
detail
"birthplace"
explanation
"The text implies Tomás Herrera is from Madrid. The codex states he was born in Seville, Spain."
paragraph
13
substring
"Madrid accent"
status
"true_positive"
matchedExpected
entry
"4417"
detail
"birthplace"
summary
"Tomás was born in Seville per codex, but the passage implies Madrid accent."
location
extractedText
"[not found in paragraph 13]"
inBounds
true
expectedText
"His Madrid accent"
locationAccurate
false
12
parsed
entry
"853"
detail
"ruler"
explanation
"The text mentions Prince Belphegor's agents are kidnapping humans. The codex states Prince Belphegor rules Dymas (Gluttony), not that he is directly involved with agents engaging in such activities."
paragraph
13
substring
"Prince Belphegor's agents"
status
"false_positive"
location
extractedText
"[not found in paragraph 13]"
inBounds
true
expectedText
"Prince Belphegor's agents are kidnapping humans"
locationAccurate
false
closestExpected
entry
"855"
detail
"ruler"
summary
"Avaros is Prince Mammon's realm per codex, but Tomás says Prince Belphegor's agents operate there."
reason
"entry mismatch: got \"853\", expected \"855\""
13
parsed
entry
"4417"
detail
"birthplace"
explanation
"The text states a contract was signed in Avaros. The codex lists Avaros as having Prince Mammon as its ruler, not Prince Belphegor. Prince Belphegor rules Dymas."
paragraph
13
substring
"Avaros"
status
"false_positive"
location
extractedText
"Avaros"
inBounds
true
expectedText
"His scarred right forearm"
locationAccurate
false
closestExpected
entry
"4417"
detail
"scar"
summary
"Tomás has a scar on his left forearm per codex, but the passage says right forearm."
"The text states Prince Belphegor's agents are kidnapping humans and forcing contracts. The codex states Prince Belphegor is the ruler of Dymas (Gluttony), not that he directly commands agents for such actions, and Avaros (Greed) is where the Ledger of Debts originates."
paragraph
13
substring
"Prince Belphegor"
status
"false_positive"
location
extractedText
"[not found in paragraph 13]"
inBounds
true
expectedText
"His scarred right forearm"
locationAccurate
false
closestExpected
entry
"4417"
detail
"scar"
summary
"Tomás has a scar on his left forearm per codex, but the passage says right forearm."
"The text states the Heartstone Pendant was forged in Avaros. The codex states it originated in Dymas."
paragraph
15
substring
"The Heartstone was forged in Avaros"
status
"true_positive"
matchedExpected
entry
"2001"
detail
"origin"
summary
"The Heartstone Pendant was forged in Dymas per codex, but Isolde says it was forged in Avaros."
location
extractedText
"[not found in paragraph 15]"
inBounds
true
expectedText
"The Heartstone was forged in Avaros"
locationAccurate
false
18
parsed
entry
"4413"
detail
"limp"
explanation
"The text mentions Silas rubbed his left knee. The codex states he has a slight limp in his left leg."
paragraph
17
substring
"He rubbed his left knee"
status
"false_positive"
location
extractedText
"[not found in paragraph 17]"
inBounds
true
expectedText
""
locationAccurate
false
19
parsed
entry
"4413"
detail
"backstory"
explanation
"The text mentions Silas experienced an event in Prague in 1987. The codex states his botched operation in Prague was the cause of his permanent knee injury, but does not specify a date."
paragraph
17
substring
"Prague, 1987"1/1/1987, 12:00:00 AM
status
"false_positive"
location
extractedText
"[not found in paragraph 17]"
inBounds
true
expectedText
""
locationAccurate
false
20
parsed
entry
"4413"
detail
"backstory"
explanation
"The text mentions twelve Wardens were involved in closing a rift in Prague. The codex does not mention the number of Wardens involved in any specific operation."