"2026-02-16T01:01:04.832334+00:00"2/16/2026, 1:01:04 AM
model
"meta-llama/llama-3.1-70b-instruct"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
1788
moderation_latency
(null)
generation_time
106966
tokens_prompt
7863
tokens_completion
1144
native_tokens_prompt
7503
native_tokens_completion
1086
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.0034356
router
(null)
provider_responses
0
id
"cmpl-1592ce1052b6429c9371994b8fbde0b6"
status
200
is_byok
false
latency
102
endpoint_id
"59c87462-40b6-4231-91cf-6d0f8f25e8b9"
provider_name
"DeepInfra"
model_permaslug
"meta-llama/llama-3.1-70b-instruct"
api_type
"completions"
id
"gen-1771203557-j50WqdWqb34FNgcSn4EP"
upstream_id
"cmpl-1592ce1052b6429c9371994b8fbde0b6"
total_cost
0.0034356
cache_discount
(null)
upstream_inference_cost
0
provider_name
"DeepInfra"
Evaluation details
Result
Evaluator
Details
Meta Data
18.3333%
Accuracy (recall)
Matched: 8/30, FP: 5
parsedCount
13
matched
8
total
30
falsePositives
5
expectedDetails
0
expected
entry
"861"
detail
"parkLocation"
summary
"The Fae Grove is in Richmond Park per codex, but the passage says Hyde Park."
status
"matched"
matchedBy
entry
"861"
detail
"parkLocation"
explanation
"The text says the Fae Grove is located in Hyde Park, but the codex states it is located in Richmond Park."
paragraph
1
substring
"The Fae Grove in Hyde Park shimmered in the dying October light."
location
extractedText
"The Fae Grove in Hyde Park shimmered in the dying October light."
inBounds
true
expectedText
"The Fae Grove in Hyde Park"
locationAccurate
true
1
expected
entry
"861"
detail
"standingStones"
summary
"The grove has oak standing stones per codex, but the passage says elm."
status
"missed"
2
expected
entry
"4424"
detail
"eyeColor"
summary
"Isolde has pale lavender eyes per codex, but the passage says pale blue eyes."
status
"matched"
matchedBy
entry
"4424"
detail
"eyeColor"
explanation
"The text says Isolde's eyes are pale blue, but the codex says her eyeColor is pale lavender."
paragraph
10
substring
"Isolde stepped forward, her pale blue eyes widening."
location
extractedText
"[not found in paragraph 10]"
inBounds
true
expectedText
"Her pale blue eyes, unblinking"
locationAccurate
false
3
expected
entry
"4424"
detail
"footprints"
summary
"Isolde leaves no footprints per codex, but the passage says she leaves clear prints."
status
"matched"
matchedBy
entry
"4424"
detail
"footprints"
explanation
"The text says Isolde leaves footprints, but the codex states she leaves no footprints when she walks."
paragraph
1
substring
"The ancient elm standing stones hummed with a resonance that Isolde felt in her bones — or whatever passed for bones in her three-hundred-year-old Half-Fae body. She stood at the center of the circle, her waist-length silver hair stirring in a breeze that didn't exist outside the boundary."
location
extractedText
"The ancient elm standing stones hummed with a resonance that Isolde felt in her bones — or whatever passed for bones in her three-hundred-year-old Half-Fae body. She stood at the center of the circle, her waist-length silver hair stirring in a breeze that didn't exist outside the boundary."
inBounds
true
expectedText
"her bare feet leaving clear prints in the soft earth"
locationAccurate
false
4
expected
entry
"2006"
detail
"temperature"
summary
"The Fae-Forged Blade is always cold per codex, but the passage says warm."
status
"missed"
5
expected
entry
"4414"
detail
"glasses"
summary
"Eva wears round glasses per codex, but the passage says square glasses."
status
"missed"
nearMiss
parsed
entry
"4414"
detail
"hair"
explanation
"The text says Eva's hair is curly red, but the codex says her hair is curly red (correct), however, it also states her height as 5'4\", but her hair is not mentioned as escaping from under a wool hat in the codex, only that she tucks her hair behind her left ear as a nervous habit."
paragraph
5
substring
"Eva was beside her, clutching her leather satchel with both hands, her curly red hair escaping from under a wool hat."
"Dream Dust is stored in cobalt-blue vials per codex, but Isolde says red glass vials."
status
"missed"
7
expected
entry
"2005"
detail
"sealMaterial"
summary
"Dream Dust vials are sealed with black wax per codex, but Isolde says white wax."
status
"missed"
8
expected
entry
"6003"
detail
"master"
summary
"The Somnian Cult serves Prince Asmodeus per codex, but Isolde says Prince Lilith."
status
"missed"
9
expected
entry
"4422"
detail
"eyeColor"
summary
"Father Cormac has pale blue eyes per codex, but the passage says dark brown eyes."
status
"matched"
matchedBy
entry
"4422"
detail
"eyeColor"
explanation
"The text says Father Cormac's eyes are dark brown, but the codex says his eyeColor is pale blue."
paragraph
8
substring
"Father Cormac crossed himself, his dark brown eyes troubled beneath his thinning ginger hair."
location
extractedText
"[not found in paragraph 8]"
inBounds
true
expectedText
"his dark brown eyes troubled"
locationAccurate
false
10
expected
entry
"4422"
detail
"rosary"
summary
"Cormac carries a rowan wood rosary per codex, but the passage says cedar."
status
"matched"
matchedBy
entry
"4422"
detail
"rosary"
explanation
"The text says Father Cormac's rosary is made of cedar, but the codex states it is made of rowan wood."
paragraph
8
substring
"Father Cormac crossed himself, his dark brown eyes troubled beneath his thinning ginger hair. He gripped his cedar rosary beads tightly."
location
extractedText
"[not found in paragraph 8]"
inBounds
true
expectedText
"his cedar rosary beads"
locationAccurate
false
11
expected
entry
"7002"
detail
"signedYear"
summary
"The Covenant of Separation was signed in 1215 per codex, but Cormac says 1066."
status
"matched"
matchedBy
entry
"7002"
detail
"signedYear"
explanation
"The text says the Covenant of Separation was signed in 1066, but the codex states it was signed in 1215."
paragraph
8
substring
"The Covenant of Separation — the old treaty from 1066 — forbids this kind of direct interference."
location
extractedText
"[not found in paragraph 8]"
inBounds
true
expectedText
"the old treaty from 1066"
locationAccurate
false
12
expected
entry
"6004"
detail
"headquarters"
summary
"The Parish Guard HQ is St. Brigid's in Islington per codex, but Cormac says Southwark."
status
"missed"
13
expected
entry
"4415"
detail
"cane"
summary
"Lucien carries an ivory-handled cane per codex, but the passage says mahogany."
status
"missed"
14
expected
entry
"4415"
detail
"eyeColor"
summary
"Lucien has heterochromatic eyes (one amber, one black), but the passage says both amber."
status
"missed"
15
expected
entry
"4421"
detail
"tattoo"
summary
"Yasmin's flame serpent tattoo is on her left arm per codex, but the passage says right arm."
status
"matched"
matchedBy
entry
"4421"
detail
"tattoo"
explanation
"The text says Yasmin's tattoo is on her right arm, but the codex states it is on her left arm."
paragraph
9
substring
"Yasmin uncorked a small vial and sniffed its contents, her amber eyes narrowing. The flame serpent tattoo on her right arm seemed to writhe in the fae-light."
location
extractedText
"[not found in paragraph 9]"
inBounds
true
expectedText
"tattoo on her right arm"
locationAccurate
false
16
expected
entry
"4423"
detail
"tattoo"
summary
"Wei-Lin's dragon tattoo covers his back per codex, but the passage says chest."
status
"missed"
nearMiss
parsed
entry
"4423"
detail
"missingFinger"
explanation
"The text does not mention Wei-Lin's missing finger, but it should be noted that the codex states he is missing the tip of his left little finger, but the text does not contradict this directly."
paragraph
12
substring
"Wei-Lin, leaning against one of the standing stones with his arms folded, grunted in agreement."
"Fae-Forged Blades are moonsilver per codex, but Wei-Lin says bronze."
status
"missed"
18
expected
entry
"856"
detail
"currentLocation"
summary
"The Veil Market is under Camden per codex, but Wei-Lin says Shoreditch."
status
"missed"
19
expected
entry
"4420"
detail
"hair"
summary
"Kai has dyed electric-blue hair per codex, but the passage says natural black hair."
status
"matched"
matchedBy
entry
"4420"
detail
"hair"
explanation
"The text does not mention Kai's hair, but it should be noted that the codex states his hair is dyed electric-blue in an undercut, but the text does not contradict this directly."
paragraph
13
substring
"Kai, who had been quietly checking medical supplies in his bag, looked up. His scarred right forearm brushed the zipper as he closed it."
location
extractedText
"[not found in paragraph 13]"
inBounds
true
expectedText
"his natural black hair falling into his face"
locationAccurate
false
20
expected
entry
"6006"
detail
"logo"
summary
"Blackthorn Security's logo is a thorned branch inside a shield per codex, but Kai says a sword inside a circle."
status
"missed"
21
expected
entry
"4419"
detail
"walkingStick"
summary
"Maggie carries a blackthorn stick per codex, but the passage says oak."
status
"missed"
22
expected
entry
"4419"
detail
"eyeColor"
summary
"Maggie has grey eyes per codex, but the passage says green."
status
"missed"
23
expected
entry
"6001"
detail
"foundingYear"
summary
"The Wardens were founded in 1215 per codex, but Maggie says 1066."
status
"missed"
24
expected
entry
"4417"
detail
"scar"
summary
"Tomás has a scar on his left forearm per codex, but the passage says right forearm."
status
"missed"
25
expected
entry
"4417"
detail
"birthplace"
summary
"Tomás was born in Seville per codex, but the passage implies Madrid accent."
status
"missed"
26
expected
entry
"4418"
detail
"eyeColor"
summary
"Nyx has violet eyes per codex, but the passage says blue."
status
"missed"
27
expected
entry
"2001"
detail
"chainMaterial"
summary
"The Heartstone Pendant has a silver chain per codex, but the passage says golden chain."
status
"missed"
28
expected
entry
"2001"
detail
"origin"
summary
"The Heartstone Pendant was forged in Dymas per codex, but Isolde says it was forged in Avaros."
status
"missed"
29
expected
entry
"855"
detail
"ruler"
summary
"Avaros is Prince Mammon's realm per codex, but Tomás says Prince Belphegor's agents operate there."
status
"missed"
falsePositiveDetails
0
parsed
entry
"4414"
detail
"hair"
explanation
"The text says Eva's hair is curly red, but the codex says her hair is curly red (correct), however, it also states her height as 5'4\", but her hair is not mentioned as escaping from under a wool hat in the codex, only that she tucks her hair behind her left ear as a nervous habit."
paragraph
5
substring
"Eva was beside her, clutching her leather satchel with both hands, her curly red hair escaping from under a wool hat."
status
"false_positive"
location
extractedText
"[not found in paragraph 5]"
inBounds
true
expectedText
"Her square glasses kept fogging"
locationAccurate
false
closestExpected
entry
"4414"
detail
"glasses"
summary
"Eva wears round glasses per codex, but the passage says square glasses."
"The text does not mention Isolde's hair, but it should be noted that the codex states her hair is silver, reaching her waist, but the text does not contradict this directly."
paragraph
10
substring
"Isolde stepped forward, her pale blue eyes widening."
status
"false_positive"
location
extractedText
"[not found in paragraph 10]"
inBounds
true
expectedText
"Her pale blue eyes, unblinking"
locationAccurate
false
closestExpected
entry
"4424"
detail
"eyeColor"
summary
"Isolde has pale lavender eyes per codex, but the passage says pale blue eyes."
"The text does not mention Wei-Lin's missing finger, but it should be noted that the codex states he is missing the tip of his left little finger, but the text does not contradict this directly."
paragraph
12
substring
"Wei-Lin, leaning against one of the standing stones with his arms folded, grunted in agreement."
status
"false_positive"
location
extractedText
"[not found in paragraph 12]"
inBounds
true
expectedText
"the dragon tattoo on his chest"
locationAccurate
false
closestExpected
entry
"4423"
detail
"tattoo"
summary
"Wei-Lin's dragon tattoo covers his back per codex, but the passage says chest."
"The text does not mention Father Cormac's identification, but it should be noted that the codex states the Parish Guard's identification is a rowan-wood rosary, but the text does not contradict this directly."
paragraph
8
substring
"Father Cormac crossed himself, his dark brown eyes troubled beneath his thinning ginger hair."
status
"false_positive"
location
extractedText
"[not found in paragraph 8]"
inBounds
true
expectedText
"his dark brown eyes troubled"
locationAccurate
false
closestExpected
entry
"4422"
detail
"eyeColor"
summary
"Father Cormac has pale blue eyes per codex, but the passage says dark brown eyes."
"The text says Isolde is three-hundred years old, but the codex states she is 300 years old, which is the same, however, the text could be clearer."
paragraph
1
substring
"The ancient elm standing stones hummed with a resonance that Isolde felt in her bones — or whatever passed for bones in her three-hundred-year-old Half-Fae body."
status
"false_positive"
location
extractedText
"The ancient elm standing stones hummed with a resonance that Isolde felt in her bones — or whatever passed for bones in her three-hundred-year-old Half-Fae body."
inBounds
true
expectedText
"Her pale blue eyes, unblinking"
locationAccurate
false
closestExpected
entry
"4424"
detail
"eyeColor"
summary
"Isolde has pale lavender eyes per codex, but the passage says pale blue eyes."
"The text says Eva's hair is curly red, but the codex says her hair is curly red (correct), however, it also states her height as 5'4\", but her hair is not mentioned as escaping from under a wool hat in the codex, only that she tucks her hair behind her left ear as a nervous habit."
paragraph
5
substring
"Eva was beside her, clutching her leather satchel with both hands, her curly red hair escaping from under a wool hat."
status
"false_positive"
location
extractedText
"[not found in paragraph 5]"
inBounds
true
expectedText
"Her square glasses kept fogging"
locationAccurate
false
closestExpected
entry
"4414"
detail
"glasses"
summary
"Eva wears round glasses per codex, but the passage says square glasses."
"The text says Isolde's eyes are pale blue, but the codex says her eyeColor is pale lavender."
paragraph
10
substring
"Isolde stepped forward, her pale blue eyes widening."
status
"true_positive"
matchedExpected
entry
"4424"
detail
"eyeColor"
summary
"Isolde has pale lavender eyes per codex, but the passage says pale blue eyes."
location
extractedText
"[not found in paragraph 10]"
inBounds
true
expectedText
"Her pale blue eyes, unblinking"
locationAccurate
false
2
parsed
entry
"4424"
detail
"hair"
explanation
"The text does not mention Isolde's hair, but it should be noted that the codex states her hair is silver, reaching her waist, but the text does not contradict this directly."
paragraph
10
substring
"Isolde stepped forward, her pale blue eyes widening."
status
"false_positive"
location
extractedText
"[not found in paragraph 10]"
inBounds
true
expectedText
"Her pale blue eyes, unblinking"
locationAccurate
false
closestExpected
entry
"4424"
detail
"eyeColor"
summary
"Isolde has pale lavender eyes per codex, but the passage says pale blue eyes."
"The text says Isolde leaves footprints, but the codex states she leaves no footprints when she walks."
paragraph
1
substring
"The ancient elm standing stones hummed with a resonance that Isolde felt in her bones — or whatever passed for bones in her three-hundred-year-old Half-Fae body. She stood at the center of the circle, her waist-length silver hair stirring in a breeze that didn't exist outside the boundary."
status
"true_positive"
matchedExpected
entry
"4424"
detail
"footprints"
summary
"Isolde leaves no footprints per codex, but the passage says she leaves clear prints."
location
extractedText
"The ancient elm standing stones hummed with a resonance that Isolde felt in her bones — or whatever passed for bones in her three-hundred-year-old Half-Fae body. She stood at the center of the circle, her waist-length silver hair stirring in a breeze that didn't exist outside the boundary."
inBounds
true
expectedText
"her bare feet leaving clear prints in the soft earth"
locationAccurate
false
4
parsed
entry
"861"
detail
"parkLocation"
explanation
"The text says the Fae Grove is located in Hyde Park, but the codex states it is located in Richmond Park."
paragraph
1
substring
"The Fae Grove in Hyde Park shimmered in the dying October light."
status
"true_positive"
matchedExpected
entry
"861"
detail
"parkLocation"
summary
"The Fae Grove is in Richmond Park per codex, but the passage says Hyde Park."
location
extractedText
"The Fae Grove in Hyde Park shimmered in the dying October light."
inBounds
true
expectedText
"The Fae Grove in Hyde Park"
locationAccurate
true
5
parsed
entry
"4422"
detail
"eyeColor"
explanation
"The text says Father Cormac's eyes are dark brown, but the codex says his eyeColor is pale blue."
paragraph
8
substring
"Father Cormac crossed himself, his dark brown eyes troubled beneath his thinning ginger hair."
status
"true_positive"
matchedExpected
entry
"4422"
detail
"eyeColor"
summary
"Father Cormac has pale blue eyes per codex, but the passage says dark brown eyes."
location
extractedText
"[not found in paragraph 8]"
inBounds
true
expectedText
"his dark brown eyes troubled"
locationAccurate
false
6
parsed
entry
"4423"
detail
"missingFinger"
explanation
"The text does not mention Wei-Lin's missing finger, but it should be noted that the codex states he is missing the tip of his left little finger, but the text does not contradict this directly."
paragraph
12
substring
"Wei-Lin, leaning against one of the standing stones with his arms folded, grunted in agreement."
status
"false_positive"
location
extractedText
"[not found in paragraph 12]"
inBounds
true
expectedText
"the dragon tattoo on his chest"
locationAccurate
false
closestExpected
entry
"4423"
detail
"tattoo"
summary
"Wei-Lin's dragon tattoo covers his back per codex, but the passage says chest."
"The text says Father Cormac's rosary is made of cedar, but the codex states it is made of rowan wood."
paragraph
8
substring
"Father Cormac crossed himself, his dark brown eyes troubled beneath his thinning ginger hair. He gripped his cedar rosary beads tightly."
status
"true_positive"
matchedExpected
entry
"4422"
detail
"rosary"
summary
"Cormac carries a rowan wood rosary per codex, but the passage says cedar."
location
extractedText
"[not found in paragraph 8]"
inBounds
true
expectedText
"his cedar rosary beads"
locationAccurate
false
8
parsed
entry
"4422"
detail
"identification"
explanation
"The text does not mention Father Cormac's identification, but it should be noted that the codex states the Parish Guard's identification is a rowan-wood rosary, but the text does not contradict this directly."
paragraph
8
substring
"Father Cormac crossed himself, his dark brown eyes troubled beneath his thinning ginger hair."
status
"false_positive"
location
extractedText
"[not found in paragraph 8]"
inBounds
true
expectedText
"his dark brown eyes troubled"
locationAccurate
false
closestExpected
entry
"4422"
detail
"eyeColor"
summary
"Father Cormac has pale blue eyes per codex, but the passage says dark brown eyes."
"The text says Yasmin's tattoo is on her right arm, but the codex states it is on her left arm."
paragraph
9
substring
"Yasmin uncorked a small vial and sniffed its contents, her amber eyes narrowing. The flame serpent tattoo on her right arm seemed to writhe in the fae-light."
status
"true_positive"
matchedExpected
entry
"4421"
detail
"tattoo"
summary
"Yasmin's flame serpent tattoo is on her left arm per codex, but the passage says right arm."
location
extractedText
"[not found in paragraph 9]"
inBounds
true
expectedText
"tattoo on her right arm"
locationAccurate
false
10
parsed
entry
"4424"
detail
"age"
explanation
"The text says Isolde is three-hundred years old, but the codex states she is 300 years old, which is the same, however, the text could be clearer."
paragraph
1
substring
"The ancient elm standing stones hummed with a resonance that Isolde felt in her bones — or whatever passed for bones in her three-hundred-year-old Half-Fae body."
status
"false_positive"
location
extractedText
"The ancient elm standing stones hummed with a resonance that Isolde felt in her bones — or whatever passed for bones in her three-hundred-year-old Half-Fae body."
inBounds
true
expectedText
"Her pale blue eyes, unblinking"
locationAccurate
false
closestExpected
entry
"4424"
detail
"eyeColor"
summary
"Isolde has pale lavender eyes per codex, but the passage says pale blue eyes."
"The text does not mention Kai's hair, but it should be noted that the codex states his hair is dyed electric-blue in an undercut, but the text does not contradict this directly."
paragraph
13
substring
"Kai, who had been quietly checking medical supplies in his bag, looked up. His scarred right forearm brushed the zipper as he closed it."
status
"true_positive"
matchedExpected
entry
"4420"
detail
"hair"
summary
"Kai has dyed electric-blue hair per codex, but the passage says natural black hair."
location
extractedText
"[not found in paragraph 13]"
inBounds
true
expectedText
"his natural black hair falling into his face"
locationAccurate
false
12
parsed
entry
"7002"
detail
"signedYear"
explanation
"The text says the Covenant of Separation was signed in 1066, but the codex states it was signed in 1215."
paragraph
8
substring
"The Covenant of Separation — the old treaty from 1066 — forbids this kind of direct interference."
status
"true_positive"
matchedExpected
entry
"7002"
detail
"signedYear"
summary
"The Covenant of Separation was signed in 1215 per codex, but Cormac says 1066."