"2026-02-16T01:15:58.563586+00:00"2/16/2026, 1:15:58 AM
model
"meta-llama/llama-3.1-8b-instruct"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
347
moderation_latency
(null)
generation_time
3241
tokens_prompt
3857
tokens_completion
638
native_tokens_prompt
3683
native_tokens_completion
567
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.00016152
router
(null)
provider_responses
0
id
"cmpl-da69817b09734f5dafb41fbfc4c1308c"
status
200
is_byok
false
latency
245
endpoint_id
"0a08dbd2-0f96-40dd-baa6-46f324f33a5e"
provider_name
"Nebius"
model_permaslug
"meta-llama/llama-3.1-8b-instruct"
api_type
"completions"
id
"gen-1771204554-95xt20R8j8bgMdUR5zTD"
upstream_id
"cmpl-da69817b09734f5dafb41fbfc4c1308c"
total_cost
0.00016152
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Nebius"
Evaluation details
Result
Evaluator
Details
Meta Data
0.0000%
Accuracy (recall)
Matched: 2/11, FP: 5
parsedCount
7
matched
2
total
11
falsePositives
5
expectedDetails
0
expected
entry
"856"
detail
"currentLocation"
summary
"The Veil Market is beneath Camden per the codex, but the passage says Shoreditch."
status
"missed"
1
expected
entry
"4418"
detail
"eyeColor"
summary
"Nyx has violet eyes per the codex, but the passage says blue eyes."
status
"missed"
2
expected
entry
"4417"
detail
"scar"
summary
"Tomás has a scar on his left forearm per the codex, but the passage says right forearm."
status
"matched"
matchedBy
entry
"4417"
detail
"scarred arm"
explanation
"The text says Tomás' scarred arm is in his left pocket, where his left forearm should be, which doesn't correspond with the codex that mentions it is on his left."
paragraph
2
substring
"Tomás was nearby, his scarred right forearm tucked into his jacket pocket"
location
extractedText
"Tomás was nearby, his scarred right forearm tucked into his jacket pocket"
inBounds
true
expectedText
"his scarred right forearm"
locationAccurate
true
3
expected
entry
"4417"
detail
"birthplace"
summary
"Tomás was born in Seville per the codex, but the passage implies Madrid via his accent."
status
"missed"
4
expected
entry
"4420"
detail
"hair"
summary
"Kai has dyed electric-blue hair per the codex, but the passage says natural black hair."
status
"missed"
5
expected
entry
"4419"
detail
"eyeColor"
summary
"Maggie has sharp grey eyes per the codex, but the passage says green eyes."
status
"missed"
6
expected
entry
"6002"
detail
"headquarters"
summary
"The Crimson Court is headquartered in Dymas per the codex, but Maggie says their base is in Avaros."
status
"matched"
matchedBy
entry
"6002"
detail
"headquarters"
explanation
"The text says The Crimson Court has a headquarters in Dymas, but the codex says it is in Dymas (Gluttony), which is a location in Hel, which is correct but the text includes what the codex describes as the collective name for the location."
paragraph
1
substring
"Dymas, Hel"
location
extractedText
"[not found in paragraph 1]"
inBounds
true
expectedText
"Their base is in Avaros"
locationAccurate
false
7
expected
entry
"2003"
detail
"material"
summary
"The Irathi War Gauntlet is blackened iron with red runes per the codex, but the passage says gleaming steel with blue runes."
status
"missed"
nearMiss
parsed
entry
"2003"
detail
"contrast"
explanation
"The text does not immediately contradict this entry, but when one considers generally when discussing physics or assumption in this regime we equate strength and corruption so this seems like a rather minor point, however the Irathi war gauntlet entry says that sporadic intrusion of this elements isn't that slow and its affects shouldn't be dull — that one things happens scary sooner rather than later."
paragraph
6
substring
"grants superhuman strength but slowly corrupts the wearer's mind with rage"
"The Irathi War Gauntlet is from Irath per the codex, but the merchant says it's from Dymas."
status
"missed"
nearMiss
parsed
entry
"2003"
detail
"contrast"
explanation
"The text does not immediately contradict this entry, but when one considers generally when discussing physics or assumption in this regime we equate strength and corruption so this seems like a rather minor point, however the Irathi war gauntlet entry says that sporadic intrusion of this elements isn't that slow and its affects shouldn't be dull — that one things happens scary sooner rather than later."
paragraph
6
substring
"grants superhuman strength but slowly corrupts the wearer's mind with rage"
"The Irathi War Gauntlet was forged by a demon smith named Gorath per the codex, but the merchant attributes it to Prince Abaddon."
status
"missed"
nearMiss
parsed
entry
"2003"
detail
"contrast"
explanation
"The text does not immediately contradict this entry, but when one considers generally when discussing physics or assumption in this regime we equate strength and corruption so this seems like a rather minor point, however the Irathi war gauntlet entry says that sporadic intrusion of this elements isn't that slow and its affects shouldn't be dull — that one things happens scary sooner rather than later."
paragraph
6
substring
"grants superhuman strength but slowly corrupts the wearer's mind with rage"
"The Veil Compass face is etched with sigils per the codex, but the passage says the face is smooth and unmarked."
status
"missed"
falsePositiveDetails
0
parsed
entry
"853"
detail
"realm"
explanation
"The text says the Veil Market is in Shoreditch, but the codex says its current location is an abandoned Tube station beneath Camden."
paragraph
1
substring
"the abandoned Tube station beneath Shoreditch"
status
"false_positive"
location
extractedText
"the abandoned Tube station beneath Shoreditch"
inBounds
true
expectedText
""
locationAccurate
true
1
parsed
entry
"4413"
detail
"bar name"
explanation
"The text doesn't contain what we might look for, however — the text actually refers to Silas, so this actually isn't applicable."
paragraph
1
substring
"the merchant Silas had described"
status
"false_positive"
location
extractedText
"the merchant Silas had described"
inBounds
true
expectedText
""
locationAccurate
true
2
parsed
entry
"4415"
detail
"supernatural sight"
explanation
"The text says that Nyx's glowing blue eyes are scanning for Silas' merchant, however since we knew they had heterochromatic eyes ones were Amber and one was black, so Nyx's eyes in the text should be heterochromatic with one of each color."
paragraph
2
substring
"glowing blue eyes scanning for"
status
"false_positive"
location
extractedText
"[not found in paragraph 2]"
inBounds
true
expectedText
""
locationAccurate
false
3
parsed
entry
"2003"
detail
"contrast"
explanation
"The text does not immediately contradict this entry, but when one considers generally when discussing physics or assumption in this regime we equate strength and corruption so this seems like a rather minor point, however the Irathi war gauntlet entry says that sporadic intrusion of this elements isn't that slow and its affects shouldn't be dull — that one things happens scary sooner rather than later."
paragraph
6
substring
"grants superhuman strength but slowly corrupts the wearer's mind with rage"
status
"false_positive"
location
extractedText
"[not found in paragraph 6]"
inBounds
true
expectedText
"a gleaming steel gauntlet with blue runes"
locationAccurate
false
closestExpected
entry
"2003"
detail
"material"
summary
"The Irathi War Gauntlet is blackened iron with red runes per the codex, but the passage says gleaming steel with blue runes."
"The text does not immediately contradict this entry, but if stressing the above points about the details of items especially these materials the artwork Codex, so not scenario"
paragraph
7
substring
"Rory examined the gauntlet carefully, the Veil Compass in her other hand spinning wildly, its glass face smooth and unmarked"
status
"false_positive"
location
extractedText
(null)
inBounds
false
expectedText
""
locationAccurate
(null)
28.5714%
Precision
True positives: 2/7
totalReported
7
truePositives
2
reportedDetails
0
parsed
entry
"853"
detail
"realm"
explanation
"The text says the Veil Market is in Shoreditch, but the codex says its current location is an abandoned Tube station beneath Camden."
paragraph
1
substring
"the abandoned Tube station beneath Shoreditch"
status
"false_positive"
location
extractedText
"the abandoned Tube station beneath Shoreditch"
inBounds
true
expectedText
""
locationAccurate
true
1
parsed
entry
"6002"
detail
"headquarters"
explanation
"The text says The Crimson Court has a headquarters in Dymas, but the codex says it is in Dymas (Gluttony), which is a location in Hel, which is correct but the text includes what the codex describes as the collective name for the location."
paragraph
1
substring
"Dymas, Hel"
status
"true_positive"
matchedExpected
entry
"6002"
detail
"headquarters"
summary
"The Crimson Court is headquartered in Dymas per the codex, but Maggie says their base is in Avaros."
location
extractedText
"[not found in paragraph 1]"
inBounds
true
expectedText
"Their base is in Avaros"
locationAccurate
false
2
parsed
entry
"4413"
detail
"bar name"
explanation
"The text doesn't contain what we might look for, however — the text actually refers to Silas, so this actually isn't applicable."
paragraph
1
substring
"the merchant Silas had described"
status
"false_positive"
location
extractedText
"the merchant Silas had described"
inBounds
true
expectedText
""
locationAccurate
true
3
parsed
entry
"4417"
detail
"scarred arm"
explanation
"The text says Tomás' scarred arm is in his left pocket, where his left forearm should be, which doesn't correspond with the codex that mentions it is on his left."
paragraph
2
substring
"Tomás was nearby, his scarred right forearm tucked into his jacket pocket"
status
"true_positive"
matchedExpected
entry
"4417"
detail
"scar"
summary
"Tomás has a scar on his left forearm per the codex, but the passage says right forearm."
location
extractedText
"Tomás was nearby, his scarred right forearm tucked into his jacket pocket"
inBounds
true
expectedText
"his scarred right forearm"
locationAccurate
true
4
parsed
entry
"4415"
detail
"supernatural sight"
explanation
"The text says that Nyx's glowing blue eyes are scanning for Silas' merchant, however since we knew they had heterochromatic eyes ones were Amber and one was black, so Nyx's eyes in the text should be heterochromatic with one of each color."
paragraph
2
substring
"glowing blue eyes scanning for"
status
"false_positive"
location
extractedText
"[not found in paragraph 2]"
inBounds
true
expectedText
""
locationAccurate
false
5
parsed
entry
"2003"
detail
"contrast"
explanation
"The text does not immediately contradict this entry, but when one considers generally when discussing physics or assumption in this regime we equate strength and corruption so this seems like a rather minor point, however the Irathi war gauntlet entry says that sporadic intrusion of this elements isn't that slow and its affects shouldn't be dull — that one things happens scary sooner rather than later."
paragraph
6
substring
"grants superhuman strength but slowly corrupts the wearer's mind with rage"
status
"false_positive"
location
extractedText
"[not found in paragraph 6]"
inBounds
true
expectedText
"a gleaming steel gauntlet with blue runes"
locationAccurate
false
closestExpected
entry
"2003"
detail
"material"
summary
"The Irathi War Gauntlet is blackened iron with red runes per the codex, but the passage says gleaming steel with blue runes."
"The text does not immediately contradict this entry, but if stressing the above points about the details of items especially these materials the artwork Codex, so not scenario"
paragraph
7
substring
"Rory examined the gauntlet carefully, the Veil Compass in her other hand spinning wildly, its glass face smooth and unmarked"