"2026-02-16T00:14:42.935643+00:00"2/16/2026, 12:14:42 AM
model
"meta-llama/llama-3.1-8b-instruct"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
854
moderation_latency
(null)
generation_time
5731
tokens_prompt
3857
tokens_completion
407
native_tokens_prompt
3684
native_tokens_completion
392
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.00009328
router
(null)
provider_responses
0
id
"d288e1155c7541b1a22499d28c74bba0"
status
200
is_byok
false
latency
854
endpoint_id
"baecce7a-5028-432e-aaa8-d78b5b700929"
provider_name
"Novita"
model_permaslug
"meta-llama/llama-3.1-8b-instruct"
api_type
"completions"
id
"gen-1771200876-mYhCGQjUyvtlJZtm7ZKS"
upstream_id
"d288e1155c7541b1a22499d28c74bba0"
total_cost
0.00009328
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Novita"
Evaluation details
Result
Evaluator
Details
Meta Data
0.0000%
Accuracy (recall)
Matched: 0/11, FP: 2
parsedCount
2
matched
0
total
11
falsePositives
2
expectedDetails
0
expected
entry
"856"
detail
"currentLocation"
summary
"The Veil Market is beneath Camden per the codex, but the passage says Shoreditch."
status
"missed"
1
expected
entry
"4418"
detail
"eyeColor"
summary
"Nyx has violet eyes per the codex, but the passage says blue eyes."
status
"missed"
2
expected
entry
"4417"
detail
"scar"
summary
"Tomás has a scar on his left forearm per the codex, but the passage says right forearm."
status
"missed"
3
expected
entry
"4417"
detail
"birthplace"
summary
"Tomás was born in Seville per the codex, but the passage implies Madrid via his accent."
status
"missed"
4
expected
entry
"4420"
detail
"hair"
summary
"Kai has dyed electric-blue hair per the codex, but the passage says natural black hair."
status
"missed"
5
expected
entry
"4419"
detail
"eyeColor"
summary
"Maggie has sharp grey eyes per the codex, but the passage says green eyes."
status
"missed"
6
expected
entry
"6002"
detail
"headquarters"
summary
"The Crimson Court is headquartered in Dymas per the codex, but Maggie says their base is in Avaros."
status
"missed"
7
expected
entry
"2003"
detail
"material"
summary
"The Irathi War Gauntlet is blackened iron with red runes per the codex, but the passage says gleaming steel with blue runes."
status
"missed"
8
expected
entry
"2003"
detail
"origin"
summary
"The Irathi War Gauntlet is from Irath per the codex, but the merchant says it's from Dymas."
status
"missed"
nearMiss
parsed
entry
"4415"
detail
"origin"
explanation
"The text refers to a merchant from Avaros, but the name of Avaros is the correct location mentioned. However, the text states a concern of where an item originated fromvably, describing the item. So this is a negligible whitewash of definition here."
paragraph
5
substring
"from Dymas"
reason
"entry mismatch: got \"4415\", expected \"2003\""
9
expected
entry
"2003"
detail
"creator"
summary
"The Irathi War Gauntlet was forged by a demon smith named Gorath per the codex, but the merchant attributes it to Prince Abaddon."
status
"missed"
10
expected
entry
"2004"
detail
"faceMarkings"
summary
"The Veil Compass face is etched with sigils per the codex, but the passage says the face is smooth and unmarked."
status
"missed"
falsePositiveDetails
0
parsed
entry
"4415"
detail
"origin"
explanation
"The text refers to a merchant from Avaros, but the name of Avaros is the correct location mentioned. However, the text states a concern of where an item originated fromvably, describing the item. So this is a negligible whitewash of definition here."
paragraph
5
substring
"from Dymas"
status
"false_positive"
location
extractedText
"from Dymas"
inBounds
true
expectedText
"Straight from Dymas"
locationAccurate
true
closestExpected
entry
"2003"
detail
"origin"
summary
"The Irathi War Gauntlet is from Irath per the codex, but the merchant says it's from Dymas."
reason
"entry mismatch: got \"4415\", expected \"2003\""
1
parsed
entry
"4416"
detail
"item name"
explanation
"The text states the compass spinning wildly with a smooth glass face; however, the Veil Compass' face has etchings on it, a sigil (just a usual descriptor), according to the codex."
paragraph
6
substring
"spinning wildly, smooth and unmarked"
status
"false_positive"
location
extractedText
"[not found in paragraph 6]"
inBounds
true
expectedText
""
locationAccurate
false
0.0000%
Precision
True positives: 0/2
totalReported
2
truePositives
0
reportedDetails
0
parsed
entry
"4415"
detail
"origin"
explanation
"The text refers to a merchant from Avaros, but the name of Avaros is the correct location mentioned. However, the text states a concern of where an item originated fromvably, describing the item. So this is a negligible whitewash of definition here."
paragraph
5
substring
"from Dymas"
status
"false_positive"
location
extractedText
"from Dymas"
inBounds
true
expectedText
"Straight from Dymas"
locationAccurate
true
closestExpected
entry
"2003"
detail
"origin"
summary
"The Irathi War Gauntlet is from Irath per the codex, but the merchant says it's from Dymas."
reason
"entry mismatch: got \"4415\", expected \"2003\""
1
parsed
entry
"4416"
detail
"item name"
explanation
"The text states the compass spinning wildly with a smooth glass face; however, the Veil Compass' face has etchings on it, a sigil (just a usual descriptor), according to the codex."