"2026-02-16T00:55:43.51406+00:00"2/16/2026, 12:55:43 AM
model
"nvidia/llama-3.1-nemotron-70b-instruct"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
268
moderation_latency
(null)
generation_time
16958
tokens_prompt
6618
tokens_completion
582
native_tokens_prompt
6419
native_tokens_completion
580
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.0083988
router
(null)
provider_responses
0
id
"cmpl-5ccd043246d549d298e3c84c24adf929"
status
200
is_byok
false
latency
120
endpoint_id
"d2a33d30-5d41-47d3-a816-1cc067b5a7dd"
provider_name
"DeepInfra"
model_permaslug
"nvidia/llama-3.1-nemotron-70b-instruct"
api_type
"completions"
id
"gen-1771203326-xC25nwLpqIoPOIFkyCjn"
upstream_id
"cmpl-5ccd043246d549d298e3c84c24adf929"
total_cost
0.0083988
cache_discount
(null)
upstream_inference_cost
0
provider_name
"DeepInfra"
Evaluation details
Result
Evaluator
Details
Meta Data
65.0000%
Accuracy (recall)
Matched: 7/10, FP: 1
parsedCount
8
matched
7
total
10
falsePositives
1
expectedDetails
0
expected
entry
"861"
detail
"parkLocation"
summary
"The Fae Grove is in Richmond Park per the codex, but the passage places it in Hyde Park."
status
"matched"
matchedBy
entry
"861"
detail
"parkLocation"
explanation
"According to the codex (entry 861), The Fae Grove is located in Richmond Park, not Hyde Park."
paragraph
1
substring
"The Fae Grove in Hyde Park"
location
extractedText
"The Fae Grove in Hyde Park"
inBounds
true
expectedText
"The Fae Grove in Hyde Park"
locationAccurate
true
1
expected
entry
"4424"
detail
"eyeColor"
summary
"Isolde has pale lavender eyes per the codex, but the passage says pale blue eyes."
status
"matched"
matchedBy
entry
"4424"
detail
"eyeColor"
explanation
"The text describes Isolde's eye color as pale blue, but the codex (entry 4424) states her eye color is pale lavender."
paragraph
1
substring
"her pale blue eyes settled on Aurora"
location
extractedText
"her pale blue eyes settled on Aurora"
inBounds
true
expectedText
"Her pale blue eyes settled on Aurora"
locationAccurate
true
2
expected
entry
"2005"
detail
"containerColor"
summary
"Dream Dust is stored in cobalt-blue glass vials per the codex, but Isolde says red glass vials."
status
"matched"
matchedBy
entry
"2005"
detail
"containerColor"
explanation
"According to the codex (entry 2005), Somnian Dream Dust is stored in small cobalt-blue glass vials, not little red glass vials."
paragraph
3
substring
"stored in little red glass vials"
location
extractedText
"[not found in paragraph 3]"
inBounds
true
expectedText
"little red glass vials"
locationAccurate
false
3
expected
entry
"6003"
detail
"master"
summary
"The Somnian Cult serves Prince Asmodeus per the codex, but Isolde says their master is Prince Lilith."
status
"missed"
4
expected
entry
"4422"
detail
"eyeColor"
summary
"Father Cormac has pale blue eyes per the codex, but the passage says dark brown eyes."
status
"matched"
matchedBy
entry
"4422"
detail
"eyeColor"
explanation
"The text describes Father Cormac's eye color as dark brown, but the codex (entry 4422) states his eye color is pale blue."
paragraph
2
substring
"dark brown eyes troubled beneath thinning ginger hair"
location
extractedText
"[not found in paragraph 2]"
inBounds
true
expectedText
"his dark brown eyes troubled"
locationAccurate
false
5
expected
entry
"6004"
detail
"headquarters"
summary
"The Parish Guard is headquartered at St. Brigid's Church, Islington per the codex, but Cormac says their cathedral in Southwark."
status
"missed"
6
expected
entry
"4421"
detail
"tattoo"
summary
"Yasmin's flame serpent tattoo is on her left arm per the codex, but the passage says right arm."
status
"matched"
matchedBy
entry
"4421"
detail
"tattoo"
explanation
"The codex (entry 4421) indicates Yasmin's flame serpent tattoo coiling up her left arm, not her right arm."
paragraph
3
substring
"The flame serpent tattoo on her right arm seemed to writhe"
location
extractedText
"[not found in paragraph 3]"
inBounds
true
expectedText
"tattoo on her right arm"
locationAccurate
false
7
expected
entry
"4423"
detail
"tattoo"
summary
"Wei-Lin's dragon tattoo covers his entire back per the codex, but the passage places it on his chest."
status
"matched"
matchedBy
entry
"4423"
detail
"tattoo visibility"
explanation
"The codex (entry 4423) states Zhou Wei-Lin has a dragon tattoo covering his entire back, which wouldn't be partially visible on his chest."
paragraph
4
substring
"The dragon on his chest was partially visible beneath his open collar"
location
extractedText
"[not found in paragraph 4]"
inBounds
true
expectedText
"The dragon on his chest"
locationAccurate
false
8
expected
entry
"2006"
detail
"material"
summary
"The Fae-Forged Blade is made of moonsilver per the codex, but Wei-Lin says bronze daggers."
status
"matched"
matchedBy
entry
"2006"
detail
"material"
explanation
"The text mentions Fae-Forged Blades as bronze daggers, but the codex (entry 2006) specifies the material of the Fae-Forged Blade as moonsilver, not bronze."
paragraph
5
substring
"Wei-Lin... buying up Fae-Forged Blades — bronze daggers"
location
extractedText
"[not found in paragraph 5]"
inBounds
true
expectedText
"bronze daggers that can cut through wards"
locationAccurate
false
9
expected
entry
"2006"
detail
"temperature"
summary
"The Fae-Forged Blade is always cold to the touch per the codex, but Aurora feels it warm."
status
"missed"
falsePositiveDetails
0
parsed
entry
"862"
detail
"ruler"
explanation
"The codex (entry 862) states Prince Lilith is the ruler of Luxuria (Lust), whereas the text incorrectly associates Prince Lilith with Somnia (Sloth), which is actually ruled by Prince Asmodeus (entry 859)."
paragraph
2
substring
"Their master, Prince Lilith, demands more dreamers"
status
"false_positive"
location
extractedText
"Their master, Prince Lilith, demands more dreamers"
inBounds
true
expectedText
""
locationAccurate
true
87.5000%
Precision
True positives: 7/8
totalReported
8
truePositives
7
reportedDetails
0
parsed
entry
"4424"
detail
"eyeColor"
explanation
"The text describes Isolde's eye color as pale blue, but the codex (entry 4424) states her eye color is pale lavender."
paragraph
1
substring
"her pale blue eyes settled on Aurora"
status
"true_positive"
matchedExpected
entry
"4424"
detail
"eyeColor"
summary
"Isolde has pale lavender eyes per the codex, but the passage says pale blue eyes."
location
extractedText
"her pale blue eyes settled on Aurora"
inBounds
true
expectedText
"Her pale blue eyes settled on Aurora"
locationAccurate
true
1
parsed
entry
"4422"
detail
"eyeColor"
explanation
"The text describes Father Cormac's eye color as dark brown, but the codex (entry 4422) states his eye color is pale blue."
paragraph
2
substring
"dark brown eyes troubled beneath thinning ginger hair"
status
"true_positive"
matchedExpected
entry
"4422"
detail
"eyeColor"
summary
"Father Cormac has pale blue eyes per the codex, but the passage says dark brown eyes."
location
extractedText
"[not found in paragraph 2]"
inBounds
true
expectedText
"his dark brown eyes troubled"
locationAccurate
false
2
parsed
entry
"861"
detail
"parkLocation"
explanation
"According to the codex (entry 861), The Fae Grove is located in Richmond Park, not Hyde Park."
paragraph
1
substring
"The Fae Grove in Hyde Park"
status
"true_positive"
matchedExpected
entry
"861"
detail
"parkLocation"
summary
"The Fae Grove is in Richmond Park per the codex, but the passage places it in Hyde Park."
location
extractedText
"The Fae Grove in Hyde Park"
inBounds
true
expectedText
"The Fae Grove in Hyde Park"
locationAccurate
true
3
parsed
entry
"4421"
detail
"tattoo"
explanation
"The codex (entry 4421) indicates Yasmin's flame serpent tattoo coiling up her left arm, not her right arm."
paragraph
3
substring
"The flame serpent tattoo on her right arm seemed to writhe"
status
"true_positive"
matchedExpected
entry
"4421"
detail
"tattoo"
summary
"Yasmin's flame serpent tattoo is on her left arm per the codex, but the passage says right arm."
location
extractedText
"[not found in paragraph 3]"
inBounds
true
expectedText
"tattoo on her right arm"
locationAccurate
false
4
parsed
entry
"4423"
detail
"tattoo visibility"
explanation
"The codex (entry 4423) states Zhou Wei-Lin has a dragon tattoo covering his entire back, which wouldn't be partially visible on his chest."
paragraph
4
substring
"The dragon on his chest was partially visible beneath his open collar"
status
"true_positive"
matchedExpected
entry
"4423"
detail
"tattoo"
summary
"Wei-Lin's dragon tattoo covers his entire back per the codex, but the passage places it on his chest."
location
extractedText
"[not found in paragraph 4]"
inBounds
true
expectedText
"The dragon on his chest"
locationAccurate
false
5
parsed
entry
"2006"
detail
"material"
explanation
"The text mentions Fae-Forged Blades as bronze daggers, but the codex (entry 2006) specifies the material of the Fae-Forged Blade as moonsilver, not bronze."
paragraph
5
substring
"Wei-Lin... buying up Fae-Forged Blades — bronze daggers"
status
"true_positive"
matchedExpected
entry
"2006"
detail
"material"
summary
"The Fae-Forged Blade is made of moonsilver per the codex, but Wei-Lin says bronze daggers."
location
extractedText
"[not found in paragraph 5]"
inBounds
true
expectedText
"bronze daggers that can cut through wards"
locationAccurate
false
6
parsed
entry
"2005"
detail
"containerColor"
explanation
"According to the codex (entry 2005), Somnian Dream Dust is stored in small cobalt-blue glass vials, not little red glass vials."
paragraph
3
substring
"stored in little red glass vials"
status
"true_positive"
matchedExpected
entry
"2005"
detail
"containerColor"
summary
"Dream Dust is stored in cobalt-blue glass vials per the codex, but Isolde says red glass vials."
location
extractedText
"[not found in paragraph 3]"
inBounds
true
expectedText
"little red glass vials"
locationAccurate
false
7
parsed
entry
"862"
detail
"ruler"
explanation
"The codex (entry 862) states Prince Lilith is the ruler of Luxuria (Lust), whereas the text incorrectly associates Prince Lilith with Somnia (Sloth), which is actually ruled by Prince Asmodeus (entry 859)."
paragraph
2
substring
"Their master, Prince Lilith, demands more dreamers"
status
"false_positive"
location
extractedText
"Their master, Prince Lilith, demands more dreamers"