"2026-02-16T00:18:46.068763+00:00"2/16/2026, 12:18:46 AM
model
"meta-llama/llama-3.1-70b-instruct"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
1180
moderation_latency
(null)
generation_time
33518
tokens_prompt
6618
tokens_completion
614
native_tokens_prompt
6419
native_tokens_completion
591
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.002804
router
(null)
provider_responses
0
id
"cmpl-f196679cdf9d4e6aa35741f6806a27b9"
status
200
is_byok
false
latency
112
endpoint_id
"59c87462-40b6-4231-91cf-6d0f8f25e8b9"
provider_name
"DeepInfra"
model_permaslug
"meta-llama/llama-3.1-70b-instruct"
api_type
"completions"
id
"gen-1771201092-yMDQ505n1cDcFtQ7eMzq"
upstream_id
"cmpl-f196679cdf9d4e6aa35741f6806a27b9"
total_cost
0.002804
cache_discount
(null)
upstream_inference_cost
0
provider_name
"DeepInfra"
Evaluation details
Result
Evaluator
Details
Meta Data
15.0000%
Accuracy (recall)
Matched: 4/10, FP: 5
parsedCount
9
matched
4
total
10
falsePositives
5
expectedDetails
0
expected
entry
"861"
detail
"parkLocation"
summary
"The Fae Grove is in Richmond Park per the codex, but the passage places it in Hyde Park."
status
"missed"
nearMiss
parsed
entry
"4420"
detail
"location"
explanation
"The text implies that Wei-Lin is physically present in the Fae Grove, but the codex does not provide information about him visiting the Fae Grove. Also, the text says Wei-Lin is leaning against one of the standing stones in the Fae Grove in Hyde Park, however, the codex states the Fae Grove is located in Richmond Park."
paragraph
5
substring
"I've heard whispers in Chinatown."
reason
"entry mismatch: got \"4420\", expected \"861\""
1
expected
entry
"4424"
detail
"eyeColor"
summary
"Isolde has pale lavender eyes per the codex, but the passage says pale blue eyes."
status
"matched"
matchedBy
entry
"4424"
detail
"eyeColor"
explanation
"The text says Isolde's eyes are pale blue, but the codex says pale lavender."
paragraph
1
substring
"her pale blue eyes"
location
extractedText
"her pale blue eyes"
inBounds
true
expectedText
"Her pale blue eyes settled on Aurora"
locationAccurate
true
2
expected
entry
"2005"
detail
"containerColor"
summary
"Dream Dust is stored in cobalt-blue glass vials per the codex, but Isolde says red glass vials."
status
"missed"
3
expected
entry
"6003"
detail
"master"
summary
"The Somnian Cult serves Prince Asmodeus per the codex, but Isolde says their master is Prince Lilith."
status
"missed"
4
expected
entry
"4422"
detail
"eyeColor"
summary
"Father Cormac has pale blue eyes per the codex, but the passage says dark brown eyes."
status
"matched"
matchedBy
entry
"4422"
detail
"eyeColor"
explanation
"The text says Father Cormac's eyes are dark brown, but the codex says pale blue."
paragraph
2
substring
"his dark brown eyes"
location
extractedText
"[not found in paragraph 2]"
inBounds
true
expectedText
"his dark brown eyes troubled"
locationAccurate
false
5
expected
entry
"6004"
detail
"headquarters"
summary
"The Parish Guard is headquartered at St. Brigid's Church, Islington per the codex, but Cormac says their cathedral in Southwark."
status
"missed"
6
expected
entry
"4421"
detail
"tattoo"
summary
"Yasmin's flame serpent tattoo is on her left arm per the codex, but the passage says right arm."
status
"matched"
matchedBy
entry
"4421"
detail
"tattoo"
explanation
"The text says the flame serpent tattoo is on Yasmin's right arm, but the codex says it coils up her left arm."
paragraph
3
substring
"the flame serpent tattoo on her right arm"
location
extractedText
"[not found in paragraph 3]"
inBounds
true
expectedText
"tattoo on her right arm"
locationAccurate
false
7
expected
entry
"4423"
detail
"tattoo"
summary
"Wei-Lin's dragon tattoo covers his entire back per the codex, but the passage places it on his chest."
status
"matched"
matchedBy
entry
"4423"
detail
"tattoo"
explanation
"The text says Wei-Lin has a dragon tattoo on his chest, but the codex says he has a dragon tattoo covering his entire back."
paragraph
4
substring
"the dragon on his chest was partially visible beneath his open collar"
location
extractedText
"[not found in paragraph 4]"
inBounds
true
expectedText
"The dragon on his chest"
locationAccurate
false
8
expected
entry
"2006"
detail
"material"
summary
"The Fae-Forged Blade is made of moonsilver per the codex, but Wei-Lin says bronze daggers."
status
"missed"
9
expected
entry
"2006"
detail
"temperature"
summary
"The Fae-Forged Blade is always cold to the touch per the codex, but Aurora feels it warm."
status
"missed"
falsePositiveDetails
0
parsed
entry
"4424"
detail
"hair"
explanation
"The text says Isolde's hair is waist-length, but the codex says it reaches her waist, which might be longer than waist-length, and also her hair is not described as waist-length in the codex, only its length is described as reaching her waist."
paragraph
1
substring
"her waist-length silver hair"
status
"false_positive"
location
extractedText
"her waist-length silver hair"
inBounds
true
expectedText
"Her pale blue eyes settled on Aurora"
locationAccurate
false
closestExpected
entry
"4424"
detail
"eyeColor"
summary
"Isolde has pale lavender eyes per the codex, but the passage says pale blue eyes."
"The text does not contradict the codex, however, it does not specify the hair color which is ginger in the codex. Not a direct contradiction, however the text could be interpreted as incomplete information."
paragraph
2
substring
"his thinning ginger hair"
status
"false_positive"
location
extractedText
"[not found in paragraph 2]"
inBounds
true
expectedText
"his dark brown eyes troubled"
locationAccurate
false
closestExpected
entry
"4422"
detail
"eyeColor"
summary
"Father Cormac has pale blue eyes per the codex, but the passage says dark brown eyes."
"The text implies that Wei-Lin is physically present in the Fae Grove, but the codex does not provide information about him visiting the Fae Grove. Also, the text says Wei-Lin is leaning against one of the standing stones in the Fae Grove in Hyde Park, however, the codex states the Fae Grove is located in Richmond Park."
paragraph
5
substring
"I've heard whispers in Chinatown."
status
"false_positive"
location
extractedText
"I've heard whispers in Chinatown."
inBounds
true
expectedText
"The Fae Grove in Hyde Park"
locationAccurate
false
closestExpected
entry
"861"
detail
"parkLocation"
summary
"The Fae Grove is in Richmond Park per the codex, but the passage places it in Hyde Park."
reason
"entry mismatch: got \"4420\", expected \"861\""
4
parsed
entry
"4420"
detail
"item"
explanation
"The text says the Fae-Forged Blades are bronze daggers, but the codex says the Fae-Forged Blade is a slender, leaf-shaped dagger made of moonsilver."
paragraph
5
substring
"Fae-Forged Blades — bronze daggers that can cut through wards."
status
"false_positive"
location
extractedText
"Fae-Forged Blades — bronze daggers that can cut through wards."
inBounds
true
expectedText
""
locationAccurate
true
44.4444%
Precision
True positives: 4/9
totalReported
9
truePositives
4
reportedDetails
0
parsed
entry
"4424"
detail
"eyeColor"
explanation
"The text says Isolde's eyes are pale blue, but the codex says pale lavender."
paragraph
1
substring
"her pale blue eyes"
status
"true_positive"
matchedExpected
entry
"4424"
detail
"eyeColor"
summary
"Isolde has pale lavender eyes per the codex, but the passage says pale blue eyes."
location
extractedText
"her pale blue eyes"
inBounds
true
expectedText
"Her pale blue eyes settled on Aurora"
locationAccurate
true
1
parsed
entry
"4424"
detail
"hair"
explanation
"The text says Isolde's hair is waist-length, but the codex says it reaches her waist, which might be longer than waist-length, and also her hair is not described as waist-length in the codex, only its length is described as reaching her waist."
paragraph
1
substring
"her waist-length silver hair"
status
"false_positive"
location
extractedText
"her waist-length silver hair"
inBounds
true
expectedText
"Her pale blue eyes settled on Aurora"
locationAccurate
false
closestExpected
entry
"4424"
detail
"eyeColor"
summary
"Isolde has pale lavender eyes per the codex, but the passage says pale blue eyes."
"The text says Father Cormac's eyes are dark brown, but the codex says pale blue."
paragraph
2
substring
"his dark brown eyes"
status
"true_positive"
matchedExpected
entry
"4422"
detail
"eyeColor"
summary
"Father Cormac has pale blue eyes per the codex, but the passage says dark brown eyes."
location
extractedText
"[not found in paragraph 2]"
inBounds
true
expectedText
"his dark brown eyes troubled"
locationAccurate
false
3
parsed
entry
"4422"
detail
"hair"
explanation
"The text does not contradict the codex, however, it does not specify the hair color which is ginger in the codex. Not a direct contradiction, however the text could be interpreted as incomplete information."
paragraph
2
substring
"his thinning ginger hair"
status
"false_positive"
location
extractedText
"[not found in paragraph 2]"
inBounds
true
expectedText
"his dark brown eyes troubled"
locationAccurate
false
closestExpected
entry
"4422"
detail
"eyeColor"
summary
"Father Cormac has pale blue eyes per the codex, but the passage says dark brown eyes."
"The text says the flame serpent tattoo is on Yasmin's right arm, but the codex says it coils up her left arm."
paragraph
3
substring
"the flame serpent tattoo on her right arm"
status
"true_positive"
matchedExpected
entry
"4421"
detail
"tattoo"
summary
"Yasmin's flame serpent tattoo is on her left arm per the codex, but the passage says right arm."
location
extractedText
"[not found in paragraph 3]"
inBounds
true
expectedText
"tattoo on her right arm"
locationAccurate
false
6
parsed
entry
"4423"
detail
"tattoo"
explanation
"The text says Wei-Lin has a dragon tattoo on his chest, but the codex says he has a dragon tattoo covering his entire back."
paragraph
4
substring
"the dragon on his chest was partially visible beneath his open collar"
status
"true_positive"
matchedExpected
entry
"4423"
detail
"tattoo"
summary
"Wei-Lin's dragon tattoo covers his entire back per the codex, but the passage places it on his chest."
location
extractedText
"[not found in paragraph 4]"
inBounds
true
expectedText
"The dragon on his chest"
locationAccurate
false
7
parsed
entry
"4420"
detail
"location"
explanation
"The text implies that Wei-Lin is physically present in the Fae Grove, but the codex does not provide information about him visiting the Fae Grove. Also, the text says Wei-Lin is leaning against one of the standing stones in the Fae Grove in Hyde Park, however, the codex states the Fae Grove is located in Richmond Park."
paragraph
5
substring
"I've heard whispers in Chinatown."
status
"false_positive"
location
extractedText
"I've heard whispers in Chinatown."
inBounds
true
expectedText
"The Fae Grove in Hyde Park"
locationAccurate
false
closestExpected
entry
"861"
detail
"parkLocation"
summary
"The Fae Grove is in Richmond Park per the codex, but the passage places it in Hyde Park."
reason
"entry mismatch: got \"4420\", expected \"861\""
8
parsed
entry
"4420"
detail
"item"
explanation
"The text says the Fae-Forged Blades are bronze daggers, but the codex says the Fae-Forged Blade is a slender, leaf-shaped dagger made of moonsilver."
paragraph
5
substring
"Fae-Forged Blades — bronze daggers that can cut through wards."
status
"false_positive"
location
extractedText
"Fae-Forged Blades — bronze daggers that can cut through wards."