"2026-02-16T01:24:05.933316+00:00"2/16/2026, 1:24:05 AM
model
"meta-llama/llama-3.1-8b-instruct"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
275
moderation_latency
(null)
generation_time
20039
tokens_prompt
2721
tokens_completion
680
native_tokens_prompt
2447
native_tokens_completion
608
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.00008542
router
(null)
provider_responses
0
id
"cmpl-6a49bf16d7f544498dc1c54a1ec2d01a"
status
200
is_byok
false
latency
266
endpoint_id
"474a9b4c-3ad1-403a-b84a-763335ae8f61"
provider_name
"Nebius"
model_permaslug
"meta-llama/llama-3.1-8b-instruct"
api_type
"completions"
id
"gen-1771205025-2Sq4dMiH2H3PEYU3Jzy3"
upstream_id
"cmpl-6a49bf16d7f544498dc1c54a1ec2d01a"
total_cost
0.00008542
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Nebius"
Evaluation details
Result
Evaluator
Details
Meta Data
0.0000%
Accuracy (recall)
Matched: 0/9, FP: 1
parsedCount
1
matched
0
total
9
falsePositives
1
expectedDetails
0
expected
entry
"854"
detail
"signColor"
summary
"The Raven's Nest has a green neon sign per codex, but the passage says red."
status
"missed"
1
expected
entry
"4413"
detail
"beard"
summary
"Silas's beard matches his grey-streaked auburn hair per codex, but the passage says dark brown beard."
status
"missed"
2
expected
entry
"4413"
detail
"signetRing"
summary
"Silas wears his signet ring on his right hand per codex, but the passage says left hand."
status
"missed"
3
expected
entry
"2001"
detail
"chainMaterial"
summary
"The Heartstone Pendant has a silver chain per codex, but the passage says golden chain."
status
"missed"
4
expected
entry
"853"
detail
"ruler"
summary
"Dymas is Prince Belphegor's realm per codex, but Rory refers to it as Prince Mammon's territory."
status
"missed"
5
expected
entry
"6001"
detail
"foundingYear"
summary
"The Wardens were founded in 1215 per codex, but Rory thinks 1066."
status
"missed"
6
expected
entry
"4413"
detail
"limp"
summary
"Silas limps on his left leg per codex, but the passage says right leg."
status
"missed"
7
expected
entry
"7001"
detail
"solsticeEffect"
summary
"The Veil weakens during the winter solstice per codex, but the passage says summer solstice."
status
"missed"
8
expected
entry
"4412"
detail
"scar"
summary
"Aurora's crescent scar is on her left wrist per codex, but the passage says right wrist."
status
"missed"
nearMiss
parsed
entry
"4412"
detail
"hair"
explanation
"The text says black hair, but the codex says black, but also \"straight shoulder-length but the primary codex detail mentions black hair, yet also \"her straight shoulder-length black hair is incorrect since the primary codex detail specifies the hair is directly black instead of being described as shoulder-length. Since the primary detail for hair in the text says black no contradiction is stated here, however the presence of \"straight shoulder-length details violates because the primary codex detail of \"black\" includes in hair properties both length and color."
"The text says black hair, but the codex says black, but also \"straight shoulder-length but the primary codex detail mentions black hair, yet also \"her straight shoulder-length black hair is incorrect since the primary codex detail specifies the hair is directly black instead of being described as shoulder-length. Since the primary detail for hair in the text says black no contradiction is stated here, however the presence of \"straight shoulder-length details violates because the primary codex detail of \"black\" includes in hair properties both length and color."
paragraph
2
substring
"her straight shoulder-length black"
status
"false_positive"
location
extractedText
"[not found in paragraph 2]"
inBounds
true
expectedText
"the crescent-shaped scar on her right wrist"
locationAccurate
false
closestExpected
entry
"4412"
detail
"scar"
summary
"Aurora's crescent scar is on her left wrist per codex, but the passage says right wrist."
"The text says black hair, but the codex says black, but also \"straight shoulder-length but the primary codex detail mentions black hair, yet also \"her straight shoulder-length black hair is incorrect since the primary codex detail specifies the hair is directly black instead of being described as shoulder-length. Since the primary detail for hair in the text says black no contradiction is stated here, however the presence of \"straight shoulder-length details violates because the primary codex detail of \"black\" includes in hair properties both length and color."
paragraph
2
substring
"her straight shoulder-length black"
status
"false_positive"
location
extractedText
"[not found in paragraph 2]"
inBounds
true
expectedText
"the crescent-shaped scar on her right wrist"
locationAccurate
false
closestExpected
entry
"4412"
detail
"scar"
summary
"Aurora's crescent scar is on her left wrist per codex, but the passage says right wrist."