"2026-02-16T00:16:31.427187+00:00"2/16/2026, 12:16:31 AM
model
"meta-llama/llama-3.1-8b-instruct"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
1177
moderation_latency
(null)
generation_time
6214
tokens_prompt
2319
tokens_completion
310
native_tokens_prompt
2198
native_tokens_completion
320
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.00006316
router
(null)
provider_responses
0
id
"cmpl-5b21aa55a503492d80da8439a7f0d716"
status
200
is_byok
false
latency
1166
endpoint_id
"474a9b4c-3ad1-403a-b84a-763335ae8f61"
provider_name
"Nebius"
model_permaslug
"meta-llama/llama-3.1-8b-instruct"
api_type
"completions"
id
"gen-1771200984-ZMYAiSvF3PAk7aYmN3FB"
upstream_id
"cmpl-5b21aa55a503492d80da8439a7f0d716"
total_cost
0.00006316
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Nebius"
Evaluation details
Result
Evaluator
Details
Meta Data
0.0000%
Accuracy (recall)
Matched: 2/6, FP: 4
parsedCount
6
matched
2
total
6
falsePositives
4
expectedDetails
0
expected
entry
"855"
detail
"ruler"
summary
"Avaros is Prince Mammon's realm per the codex, but Eva says it is Prince Belphegor's domain."
status
"missed"
1
expected
entry
"4415"
detail
"eyeColor"
summary
"Lucien has one amber eye and one black eye (heterochromia), but the passage says both his amber eyes."
status
"missed"
nearMiss
parsed
entry
"4412"
detail
"eyeColor"
explanation
"The text says Detective Quinn has blue eyes, but the codex says brown."
paragraph
5
substring
"The text says blue eyes, but the codex says bright blue, implying a shade or particular tone of blue that is not specified -- however Pr. (= 6 t '\\'ONE ' colour."
reason
"entry mismatch: got \"4412\", expected \"4415\""
2
expected
entry
"2002"
detail
"origin"
summary
"The Ledger of Debts originates from Avaros per its codex entry, but Eva says it came from Dymas."
status
"matched"
matchedBy
entry
"2002"
detail
"origin"
explanation
"The text says The Ledger of Debts comes from Dymas, but the codex says it originates from Avaros."
paragraph
3
substring
"Dymas"
location
extractedText
"[not found in paragraph 3]"
inBounds
true
expectedText
"it originally came from Dymas, not Avaros"
locationAccurate
false
3
expected
entry
"4416"
detail
"eyeColor"
summary
"Detective Quinn has brown eyes per her codex entry, but the passage says blue eyes."
status
"missed"
nearMiss
parsed
entry
"4412"
detail
"eyeColor"
explanation
"The text says Detective Quinn has blue eyes, but the codex says brown."
paragraph
5
substring
"The text says blue eyes, but the codex says bright blue, implying a shade or particular tone of blue that is not specified -- however Pr. (= 6 t '\\'ONE ' colour."
reason
"entry mismatch: got \"4412\", expected \"4416\""
4
expected
entry
"4416"
detail
"hair"
summary
"Detective Quinn has salt-and-pepper hair per her codex entry, but the passage says blonde hair."
status
"missed"
nearMiss
parsed
entry
"4414"
detail
"hair"
explanation
"The text says curly red hair, but the codex says curly red."
paragraph
1
substring
"curly red hair"
reason
"entry mismatch: got \"4414\", expected \"4416\""
5
expected
entry
"4414"
detail
"glasses"
summary
"Eva wears round glasses per her codex entry, but the passage says square glasses."
status
"matched"
matchedBy
entry
"4414"
detail
"glasses"
explanation
"The text says Eva wears square glasses, but the codex says round glasses."
paragraph
1
substring
"square glasses"
location
extractedText
"square glasses"
inBounds
true
expectedText
"her square glasses"
locationAccurate
true
falsePositiveDetails
0
parsed
entry
"4414"
detail
"hair"
explanation
"The text says curly red hair, but the codex says curly red."
paragraph
1
substring
"curly red hair"
status
"false_positive"
location
extractedText
"curly red hair"
inBounds
true
expectedText
"her square glasses"
locationAccurate
false
closestExpected
entry
"4414"
detail
"glasses"
summary
"Eva wears round glasses per her codex entry, but the passage says square glasses."
"The text says Detective Quinn has blue eyes, but the codex says brown."
paragraph
5
substring
"The text says blue eyes, but the codex says bright blue, implying a shade or particular tone of blue that is not specified -- however Pr. (= 6 t '\\'ONE ' colour."
status
"false_positive"
location
extractedText
"[not found in paragraph 5]"
inBounds
true
expectedText
"both his amber eyes narrowed"
locationAccurate
false
closestExpected
entry
"4415"
detail
"eyeColor"
summary
"Lucien has one amber eye and one black eye (heterochromia), but the passage says both his amber eyes."
reason
"entry mismatch: got \"4412\", expected \"4415\""
3
parsed
entry
"2001"
detail
"origin"
explanation
"The text says the Heartstone Pendant comes from Avaros, but the codex says it originates from Dymas."
paragraph
3
substring
"Avaros"
status
"false_positive"
location
extractedText
"[not found in paragraph 3]"
inBounds
true
expectedText
"it originally came from Dymas, not Avaros"
locationAccurate
false
closestExpected
entry
"2002"
detail
"origin"
summary
"The Ledger of Debts originates from Avaros per its codex entry, but Eva says it came from Dymas."
reason
"entry mismatch: got \"2001\", expected \"2002\""
33.3333%
Precision
True positives: 2/6
totalReported
6
truePositives
2
reportedDetails
0
parsed
entry
"4414"
detail
"hair"
explanation
"The text says curly red hair, but the codex says curly red."
paragraph
1
substring
"curly red hair"
status
"false_positive"
location
extractedText
"curly red hair"
inBounds
true
expectedText
"her square glasses"
locationAccurate
false
closestExpected
entry
"4414"
detail
"glasses"
summary
"Eva wears round glasses per her codex entry, but the passage says square glasses."
"The text says Detective Quinn has blue eyes, but the codex says brown."
paragraph
5
substring
"The text says blue eyes, but the codex says bright blue, implying a shade or particular tone of blue that is not specified -- however Pr. (= 6 t '\\'ONE ' colour."
status
"false_positive"
location
extractedText
"[not found in paragraph 5]"
inBounds
true
expectedText
"both his amber eyes narrowed"
locationAccurate
false
closestExpected
entry
"4415"
detail
"eyeColor"
summary
"Lucien has one amber eye and one black eye (heterochromia), but the passage says both his amber eyes."
reason
"entry mismatch: got \"4412\", expected \"4415\""
4
parsed
entry
"2001"
detail
"origin"
explanation
"The text says the Heartstone Pendant comes from Avaros, but the codex says it originates from Dymas."
paragraph
3
substring
"Avaros"
status
"false_positive"
location
extractedText
"[not found in paragraph 3]"
inBounds
true
expectedText
"it originally came from Dymas, not Avaros"
locationAccurate
false
closestExpected
entry
"2002"
detail
"origin"
summary
"The Ledger of Debts originates from Avaros per its codex entry, but Eva says it came from Dymas."
reason
"entry mismatch: got \"2001\", expected \"2002\""
5
parsed
entry
"2002"
detail
"origin"
explanation
"The text says The Ledger of Debts comes from Dymas, but the codex says it originates from Avaros."
paragraph
3
substring
"Dymas"
status
"true_positive"
matchedExpected
entry
"2002"
detail
"origin"
summary
"The Ledger of Debts originates from Avaros per its codex entry, but Eva says it came from Dymas."