"2026-02-16T00:54:54.311606+00:00"2/16/2026, 12:54:54 AM
model
"meta-llama/llama-3.1-8b-instruct"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
587
moderation_latency
(null)
generation_time
19265
tokens_prompt
3857
tokens_completion
786
native_tokens_prompt
3683
native_tokens_completion
702
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.00011578
router
(null)
provider_responses
0
id
"cmpl-dd29afa34a0348198dfce3f2654444f4"
status
200
is_byok
false
latency
487
endpoint_id
"474a9b4c-3ad1-403a-b84a-763335ae8f61"
provider_name
"Nebius"
model_permaslug
"meta-llama/llama-3.1-8b-instruct"
api_type
"completions"
id
"gen-1771203274-nx980lfXnXonECPWQaxw"
upstream_id
"cmpl-dd29afa34a0348198dfce3f2654444f4"
total_cost
0.00011578
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Nebius"
Evaluation details
Result
Evaluator
Details
Meta Data
0.0000%
Accuracy (recall)
Matched: 3/11, FP: 8
parsedCount
11
matched
3
total
11
falsePositives
8
expectedDetails
0
expected
entry
"856"
detail
"currentLocation"
summary
"The Veil Market is beneath Camden per the codex, but the passage says Shoreditch."
status
"missed"
nearMiss
parsed
entry
"1122"
detail
"currentLocation"
explanation
"The text says Camden, but the codex entry for The Veil Market lists Camden as its current location, which doesn't directly contradict the text. However, the codex's list of aliases does include \"underground market\" which could imply a different location, not directly contradicting the text though."
paragraph
2
substring
"in the abandoned Tube station beneath Shoreditch"
reason
"entry mismatch: got \"1122\", expected \"856\""
1
expected
entry
"4418"
detail
"eyeColor"
summary
"Nyx has violet eyes per the codex, but the passage says blue eyes."
status
"missed"
2
expected
entry
"4417"
detail
"scar"
summary
"Tomás has a scar on his left forearm per the codex, but the passage says right forearm."
status
"missed"
3
expected
entry
"4417"
detail
"birthplace"
summary
"Tomás was born in Seville per the codex, but the passage implies Madrid via his accent."
status
"missed"
4
expected
entry
"4420"
detail
"hair"
summary
"Kai has dyed electric-blue hair per the codex, but the passage says natural black hair."
status
"matched"
matchedBy
entry
"4420"
detail
"hair"
explanation
"The text says black, but the codex entry for Kai says dyed electric-blue in an undercut."
paragraph
2
substring
"%whose natural hair was hidden under a beanie%"
location
extractedText
"[not found in paragraph 2]"
inBounds
true
expectedText
"His natural black hair"
locationAccurate
false
5
expected
entry
"4419"
detail
"eyeColor"
summary
"Maggie has sharp grey eyes per the codex, but the passage says green eyes."
status
"matched"
matchedBy
entry
"4419"
detail
"eye color"
explanation
"The text says green, but the codex entry for Maggie describes her eyes as sharp grey."
paragraph
5
substring
"%Maggie, after all her keen green eyes"
location
extractedText
"[not found in paragraph 5]"
inBounds
true
expectedText
"her keen green eyes"
locationAccurate
false
6
expected
entry
"6002"
detail
"headquarters"
summary
"The Crimson Court is headquartered in Dymas per the codex, but Maggie says their base is in Avaros."
status
"missed"
7
expected
entry
"2003"
detail
"material"
summary
"The Irathi War Gauntlet is blackened iron with red runes per the codex, but the passage says gleaming steel with blue runes."
status
"matched"
matchedBy
entry
"2003"
detail
"material"
explanation
"%Material is actually blackened iron with glowing red runes"
paragraph
6
substring
"%% a gleaming steel gauntlet with blue runes etched into its surface"
location
extractedText
"[not found in paragraph 6]"
inBounds
true
expectedText
"a gleaming steel gauntlet with blue runes"
locationAccurate
false
8
expected
entry
"2003"
detail
"origin"
summary
"The Irathi War Gauntlet is from Irath per the codex, but the merchant says it's from Dymas."
status
"missed"
nearMiss
parsed
entry
"2003"
detail
"specifics"
explanation
"The mentioned material appears blackened but the runes are correctly represented as being red however mentioning blue here is an inconsistency, suggesting other inconsistencies rather than directly stating that text contains incorrect material description."
"The Irathi War Gauntlet was forged by a demon smith named Gorath per the codex, but the merchant attributes it to Prince Abaddon."
status
"missed"
nearMiss
parsed
entry
"2003"
detail
"specifics"
explanation
"The mentioned material appears blackened but the runes are correctly represented as being red however mentioning blue here is an inconsistency, suggesting other inconsistencies rather than directly stating that text contains incorrect material description."
"The Veil Compass face is etched with sigils per the codex, but the passage says the face is smooth and unmarked."
status
"missed"
falsePositiveDetails
0
parsed
entry
"1122"
detail
"realm"
explanation
"The text says Shoreditch, but the codex entry for The Veil Market lists Camden."
paragraph
2
substring
"in the abandoned Tube station beneath Shoreditch"
status
"false_positive"
location
extractedText
"[not found in paragraph 2]"
inBounds
true
expectedText
""
locationAccurate
false
1
parsed
entry
"1122"
detail
"currentLocation"
explanation
"The text says Camden, but the codex entry for The Veil Market lists Camden as its current location, which doesn't directly contradict the text. However, the codex's list of aliases does include \"underground market\" which could imply a different location, not directly contradicting the text though."
paragraph
2
substring
"in the abandoned Tube station beneath Shoreditch"
status
"false_positive"
location
extractedText
"[not found in paragraph 2]"
inBounds
true
expectedText
"the abandoned Tube station beneath Shoreditch"
locationAccurate
false
closestExpected
entry
"856"
detail
"currentLocation"
summary
"The Veil Market is beneath Camden per the codex, but the passage says Shoreditch."
reason
"entry mismatch: got \"1122\", expected \"856\""
2
parsed
entry
"4413"
detail
"name"
explanation
"The text mentions Tomás' right forearm is scarred, but the codex entry for Tomás states it's his left forearm."
paragraph
2
substring
"%whose scarred right forearm tucked into his jacket pocket%"
status
"false_positive"
location
extractedText
"[not found in paragraph 2]"
inBounds
true
expectedText
""
locationAccurate
false
3
parsed
entry
"4420"
detail
"hair"
explanation
"Mentioning one of his \"natural\" hair's current state might imply it is no longer electric blue. However, mentioning natural at this point is a subtle inconsistency as the codex clearly describes Kai's current hair, but it also precedes..."
paragraph
2
substring
"%whose natural hair was hidden under a beanie%"
status
"false_positive"
location
extractedText
"[not found in paragraph 2]"
inBounds
true
expectedText
""
locationAccurate
false
4
parsed
entry
"4420"
detail
"hair"
explanation
"the phrase \"natural black hair\", directly from the ongoing narrative. Thus the entire hair-related detail from the text seems inconsistent and could indeed imply a temporary hair change but no contradiction."
paragraph
2
substring
"%whose natural hair was hidden under a beanie%"
status
"false_positive"
location
extractedText
"[not found in paragraph 2]"
inBounds
true
expectedText
""
locationAccurate
false
5
parsed
entry
"861"
detail
"ruler"
explanation
"The text says Dymas, but the codex entry for the Irathi War Gauntlet indicates it is of Irath origin."
paragraph
6
substring
"%Prince Abaddon's finest work"
status
"false_positive"
location
extractedText
"[not found in paragraph 6]"
inBounds
true
expectedText
""
locationAccurate
false
6
parsed
entry
"861"
detail
"ruler"
explanation
"This item is actually of Irath origin but the ruling Prince in the entry is said to be Abaddon, which matches the mentioned ruler, meaning it's indeed Abaddon that rules but the Gauntlets was forged in Irath."
paragraph
6
substring
"%Prince Abaddon's finest work"
status
"false_positive"
location
extractedText
"[not found in paragraph 6]"
inBounds
true
expectedText
""
locationAccurate
false
7
parsed
entry
"2003"
detail
"specifics"
explanation
"The mentioned material appears blackened but the runes are correctly represented as being red however mentioning blue here is an inconsistency, suggesting other inconsistencies rather than directly stating that text contains incorrect material description."
paragraph
6
substring
"with blue runes etched into its surface"
status
"false_positive"
location
extractedText
"[not found in paragraph 6]"
inBounds
true
expectedText
"a gleaming steel gauntlet with blue runes"
locationAccurate
false
closestExpected
entry
"2003"
detail
"material"
summary
"The Irathi War Gauntlet is blackened iron with red runes per the codex, but the passage says gleaming steel with blue runes."
"The text says Shoreditch, but the codex entry for The Veil Market lists Camden."
paragraph
2
substring
"in the abandoned Tube station beneath Shoreditch"
status
"false_positive"
location
extractedText
"[not found in paragraph 2]"
inBounds
true
expectedText
""
locationAccurate
false
1
parsed
entry
"1122"
detail
"currentLocation"
explanation
"The text says Camden, but the codex entry for The Veil Market lists Camden as its current location, which doesn't directly contradict the text. However, the codex's list of aliases does include \"underground market\" which could imply a different location, not directly contradicting the text though."
paragraph
2
substring
"in the abandoned Tube station beneath Shoreditch"
status
"false_positive"
location
extractedText
"[not found in paragraph 2]"
inBounds
true
expectedText
"the abandoned Tube station beneath Shoreditch"
locationAccurate
false
closestExpected
entry
"856"
detail
"currentLocation"
summary
"The Veil Market is beneath Camden per the codex, but the passage says Shoreditch."
reason
"entry mismatch: got \"1122\", expected \"856\""
2
parsed
entry
"4413"
detail
"name"
explanation
"The text mentions Tomás' right forearm is scarred, but the codex entry for Tomás states it's his left forearm."
paragraph
2
substring
"%whose scarred right forearm tucked into his jacket pocket%"
status
"false_positive"
location
extractedText
"[not found in paragraph 2]"
inBounds
true
expectedText
""
locationAccurate
false
3
parsed
entry
"4420"
detail
"hair"
explanation
"The text says black, but the codex entry for Kai says dyed electric-blue in an undercut."
paragraph
2
substring
"%whose natural hair was hidden under a beanie%"
status
"true_positive"
matchedExpected
entry
"4420"
detail
"hair"
summary
"Kai has dyed electric-blue hair per the codex, but the passage says natural black hair."
location
extractedText
"[not found in paragraph 2]"
inBounds
true
expectedText
"His natural black hair"
locationAccurate
false
4
parsed
entry
"4420"
detail
"hair"
explanation
"Mentioning one of his \"natural\" hair's current state might imply it is no longer electric blue. However, mentioning natural at this point is a subtle inconsistency as the codex clearly describes Kai's current hair, but it also precedes..."
paragraph
2
substring
"%whose natural hair was hidden under a beanie%"
status
"false_positive"
location
extractedText
"[not found in paragraph 2]"
inBounds
true
expectedText
""
locationAccurate
false
5
parsed
entry
"4420"
detail
"hair"
explanation
"the phrase \"natural black hair\", directly from the ongoing narrative. Thus the entire hair-related detail from the text seems inconsistent and could indeed imply a temporary hair change but no contradiction."
paragraph
2
substring
"%whose natural hair was hidden under a beanie%"
status
"false_positive"
location
extractedText
"[not found in paragraph 2]"
inBounds
true
expectedText
""
locationAccurate
false
6
parsed
entry
"4419"
detail
"eye color"
explanation
"The text says green, but the codex entry for Maggie describes her eyes as sharp grey."
paragraph
5
substring
"%Maggie, after all her keen green eyes"
status
"true_positive"
matchedExpected
entry
"4419"
detail
"eyeColor"
summary
"Maggie has sharp grey eyes per the codex, but the passage says green eyes."
location
extractedText
"[not found in paragraph 5]"
inBounds
true
expectedText
"her keen green eyes"
locationAccurate
false
7
parsed
entry
"861"
detail
"ruler"
explanation
"The text says Dymas, but the codex entry for the Irathi War Gauntlet indicates it is of Irath origin."
paragraph
6
substring
"%Prince Abaddon's finest work"
status
"false_positive"
location
extractedText
"[not found in paragraph 6]"
inBounds
true
expectedText
""
locationAccurate
false
8
parsed
entry
"861"
detail
"ruler"
explanation
"This item is actually of Irath origin but the ruling Prince in the entry is said to be Abaddon, which matches the mentioned ruler, meaning it's indeed Abaddon that rules but the Gauntlets was forged in Irath."
paragraph
6
substring
"%Prince Abaddon's finest work"
status
"false_positive"
location
extractedText
"[not found in paragraph 6]"
inBounds
true
expectedText
""
locationAccurate
false
9
parsed
entry
"2003"
detail
"material"
explanation
"%Material is actually blackened iron with glowing red runes"
paragraph
6
substring
"%% a gleaming steel gauntlet with blue runes etched into its surface"
status
"true_positive"
matchedExpected
entry
"2003"
detail
"material"
summary
"The Irathi War Gauntlet is blackened iron with red runes per the codex, but the passage says gleaming steel with blue runes."
location
extractedText
"[not found in paragraph 6]"
inBounds
true
expectedText
"a gleaming steel gauntlet with blue runes"
locationAccurate
false
10
parsed
entry
"2003"
detail
"specifics"
explanation
"The mentioned material appears blackened but the runes are correctly represented as being red however mentioning blue here is an inconsistency, suggesting other inconsistencies rather than directly stating that text contains incorrect material description."
paragraph
6
substring
"with blue runes etched into its surface"
status
"false_positive"
location
extractedText
"[not found in paragraph 6]"
inBounds
true
expectedText
"a gleaming steel gauntlet with blue runes"
locationAccurate
false
closestExpected
entry
"2003"
detail
"material"
summary
"The Irathi War Gauntlet is blackened iron with red runes per the codex, but the passage says gleaming steel with blue runes."