"2026-02-16T00:56:49.224202+00:00"2/16/2026, 12:56:49 AM
model
"meta-llama/llama-3.1-8b-instruct"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
437
moderation_latency
(null)
generation_time
10657
tokens_prompt
7863
tokens_completion
660
native_tokens_prompt
7503
native_tokens_completion
673
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.00018371
router
(null)
provider_responses
0
id
"cmpl-59ca1130dce54bf7b4629eb4b8dd898a"
status
200
is_byok
false
latency
117
endpoint_id
"858e9b98-fa86-433e-8299-17c3c4d6c24f"
provider_name
"DeepInfra"
model_permaslug
"meta-llama/llama-3.1-8b-instruct"
api_type
"completions"
id
"gen-1771203398-Q2e9cFdn6n9jOevWzI1E"
upstream_id
"cmpl-59ca1130dce54bf7b4629eb4b8dd898a"
total_cost
0.00018371
cache_discount
(null)
upstream_inference_cost
0
provider_name
"DeepInfra"
Evaluation details
Result
Evaluator
Details
Meta Data
0.0000%
Accuracy (recall)
Matched: 1/30, FP: 11
parsedCount
12
matched
1
total
30
falsePositives
11
expectedDetails
0
expected
entry
"861"
detail
"parkLocation"
summary
"The Fae Grove is in Richmond Park per codex, but the passage says Hyde Park."
status
"missed"
1
expected
entry
"861"
detail
"standingStones"
summary
"The grove has oak standing stones per codex, but the passage says elm."
status
"missed"
2
expected
entry
"4424"
detail
"eyeColor"
summary
"Isolde has pale lavender eyes per codex, but the passage says pale blue eyes."
status
"missed"
3
expected
entry
"4424"
detail
"footprints"
summary
"Isolde leaves no footprints per codex, but the passage says she leaves clear prints."
status
"missed"
4
expected
entry
"2006"
detail
"temperature"
summary
"The Fae-Forged Blade is always cold per codex, but the passage says warm."
status
"missed"
nearMiss
parsed
entry
"2006"
detail
"origin"
explanation
"The text says the Fae-Forged Blade was made by the Fae Courts, but the codex says it was given to Aurora by Isolde as a gift, with no origin specified."
"Fae-Forged Blades are moonsilver per codex, but Wei-Lin says bronze."
status
"missed"
nearMiss
parsed
entry
"2006"
detail
"origin"
explanation
"The text says the Fae-Forged Blade was made by the Fae Courts, but the codex says it was given to Aurora by Isolde as a gift, with no origin specified."
"The Heartstone Pendant has a silver chain per codex, but the passage says golden chain."
status
"missed"
28
expected
entry
"2001"
detail
"origin"
summary
"The Heartstone Pendant was forged in Dymas per codex, but Isolde says it was forged in Avaros."
status
"missed"
nearMiss
parsed
entry
"2006"
detail
"origin"
explanation
"The text says the Fae-Forged Blade was made by the Fae Courts, but the codex says it was given to Aurora by Isolde as a gift, with no origin specified."
paragraph
23
substring
"The Fae Courts"
reason
"entry mismatch: got \"2006\", expected \"2001\""
29
expected
entry
"855"
detail
"ruler"
summary
"Avaros is Prince Mammon's realm per codex, but Tomás says Prince Belphegor's agents operate there."
status
"missed"
falsePositiveDetails
0
parsed
entry
"6002"
detail
"foundingYear"
explanation
"The text says the Crimson Court was founded in 1066, but the codex says they were founded in 1215."
paragraph
11
substring
"in 1066"
status
"false_positive"
location
extractedText
"[not found in paragraph 11]"
inBounds
true
expectedText
"The Wardens were founded in 1066"
locationAccurate
false
closestExpected
entry
"6001"
detail
"foundingYear"
summary
"The Wardens were founded in 1215 per codex, but Maggie says 1066."
reason
"entry mismatch: got \"6002\", expected \"6001\""
1
parsed
entry
"6004"
detail
"leader"
explanation
"The text says Father Cormac is the leader of the Parish Guard, but the codex says he is only the leader of their network."
paragraph
16
substring
"Father Cormac"
status
"false_positive"
location
extractedText
"Father Cormac"
inBounds
true
expectedText
"our cathedral in Southwark"
locationAccurate
false
closestExpected
entry
"6004"
detail
"headquarters"
summary
"The Parish Guard HQ is St. Brigid's in Islington per codex, but Cormac says Southwark."
"The text says the Fae-Forged Blade was made by the Fae Courts, but the codex says it was given to Aurora by Isolde as a gift, with no origin specified."
paragraph
23
substring
"The Fae Courts"
status
"false_positive"
location
extractedText
(null)
inBounds
false
expectedText
"the Fae-Forged Blade warm at her hip"
locationAccurate
(null)
closestExpected
entry
"2006"
detail
"temperature"
summary
"The Fae-Forged Blade is always cold per codex, but the passage says warm."
"The text implies an organization called \"the clique\", but the codex does not mention this group."
paragraph
(null)
substring
"Clique is listed as an organization"
status
"false_positive"
location
extractedText
(null)
inBounds
false
expectedText
""
locationAccurate
(null)
10
parsed
entry
"6005"
detail
"owner"
explanation
"The text implies an organization called \"Golden Empress Restaurant\" is owned by Yu-Fei, but the codex lists Yu-Fei as an employee and the owner of the Golden Empress."
paragraph
(null)
substring
"Yu-Fei's place is listed as a organization"
status
"false_positive"
location
extractedText
(null)
inBounds
false
expectedText
""
locationAccurate
(null)
8.3333%
Precision
True positives: 1/12
totalReported
12
truePositives
1
reportedDetails
0
parsed
entry
"6002"
detail
"foundingYear"
explanation
"The text says the Crimson Court was founded in 1066, but the codex says they were founded in 1215."
paragraph
11
substring
"in 1066"
status
"false_positive"
location
extractedText
"[not found in paragraph 11]"
inBounds
true
expectedText
"The Wardens were founded in 1066"
locationAccurate
false
closestExpected
entry
"6001"
detail
"foundingYear"
summary
"The Wardens were founded in 1215 per codex, but Maggie says 1066."
reason
"entry mismatch: got \"6002\", expected \"6001\""
1
parsed
entry
"7002"
detail
"signedYear"
explanation
"The text says the Covenant of Separation was signed in 1066, but the codex says it was signed in 1215."
paragraph
11
substring
"in 1066"
status
"true_positive"
matchedExpected
entry
"7002"
detail
"signedYear"
summary
"The Covenant of Separation was signed in 1215 per codex, but Cormac says 1066."
location
extractedText
"[not found in paragraph 11]"
inBounds
true
expectedText
"the old treaty from 1066"
locationAccurate
false
2
parsed
entry
"6004"
detail
"leader"
explanation
"The text says Father Cormac is the leader of the Parish Guard, but the codex says he is only the leader of their network."
paragraph
16
substring
"Father Cormac"
status
"false_positive"
location
extractedText
"Father Cormac"
inBounds
true
expectedText
"our cathedral in Southwark"
locationAccurate
false
closestExpected
entry
"6004"
detail
"headquarters"
summary
"The Parish Guard HQ is St. Brigid's in Islington per codex, but Cormac says Southwark."
"The text says the Fae-Forged Blade was made by the Fae Courts, but the codex says it was given to Aurora by Isolde as a gift, with no origin specified."
paragraph
23
substring
"The Fae Courts"
status
"false_positive"
location
extractedText
(null)
inBounds
false
expectedText
"the Fae-Forged Blade warm at her hip"
locationAccurate
(null)
closestExpected
entry
"2006"
detail
"temperature"
summary
"The Fae-Forged Blade is always cold per codex, but the passage says warm."
"The text implies an organization called \"the clique\", but the codex does not mention this group."
paragraph
(null)
substring
"Clique is listed as an organization"
status
"false_positive"
location
extractedText
(null)
inBounds
false
expectedText
""
locationAccurate
(null)
11
parsed
entry
"6005"
detail
"owner"
explanation
"The text implies an organization called \"Golden Empress Restaurant\" is owned by Yu-Fei, but the codex lists Yu-Fei as an employee and the owner of the Golden Empress."