"2026-02-16T00:24:49.711616+00:00"2/16/2026, 12:24:49 AM
model
"thedrummer/rocinante-12b"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
295
moderation_latency
(null)
generation_time
1558
tokens_prompt
1811
tokens_completion
132
native_tokens_prompt
1752
native_tokens_completion
151
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.0005135
router
(null)
provider_responses
0
id
"chatcmpl-fbf6b054-15b6-41bb-9cc0-4fba3749c845"
status
200
is_byok
false
latency
125
endpoint_id
"caf29916-6adb-45f8-b895-dd863415d3ed"
provider_name
"Infermatic"
model_permaslug
"thedrummer/rocinante-12b"
api_type
"completions"
id
"gen-1771201487-LrESVlAFA0unqqnoGhBH"
upstream_id
"chatcmpl-fbf6b054-15b6-41bb-9cc0-4fba3749c845"
total_cost
0.0005135
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Infermatic"
Evaluation details
Result
Evaluator
Details
Meta Data
5.0000%
Accuracy (recall)
Matched: 1/10, FP: 1
parsedCount
2
matched
1
total
10
falsePositives
1
expectedDetails
0
expected
entry
"4412"
detail
"eyeColor"
summary
"Aurora has bright blue eyes per codex, but the passage says green eyes."
status
"missed"
1
expected
entry
"854"
detail
"signColor"
summary
"The Raven's Nest has a green neon sign per codex, but the passage says red."
status
"missed"
2
expected
entry
"4413"
detail
"signetRing"
summary
"Silas wears his signet ring on his right hand per codex, but the passage says left hand."
status
"missed"
nearMiss
parsed
entry
"4413"
detail
"hair"
explanation
"The text says Silas has a dark brown beard but the codex says his hair is auburn with grey streaks. Assuming usual context, beard color should match hair color."
"Silas's beard is grey-streaked auburn per codex, but the passage says dark brown."
status
"missed"
nearMiss
parsed
entry
"4413"
detail
"hair"
explanation
"The text says Silas has a dark brown beard but the codex says his hair is auburn with grey streaks. Assuming usual context, beard color should match hair color."
"Silas has a limp in his left leg per codex, but the passage says right leg."
status
"missed"
nearMiss
parsed
entry
"4413"
detail
"hair"
explanation
"The text says Silas has a dark brown beard but the codex says his hair is auburn with grey streaks. Assuming usual context, beard color should match hair color."
"The Heartstone Pendant has a silver chain per codex, but the passage says golden chain."
status
"missed"
6
expected
entry
"853"
detail
"ruler"
summary
"Dymas is Prince Belphegor's realm per codex, but the passage says Prince Mammon."
status
"missed"
7
expected
entry
"4412"
detail
"species"
summary
"Aurora is Human per codex, but the passage says Half-Fae."
status
"missed"
8
expected
entry
"7001"
detail
"solsticeEffect"
summary
"The Veil weakens during the winter solstice per codex, but the passage says summer solstice."
status
"missed"
9
expected
entry
"6001"
detail
"foundingYear"
summary
"The Wardens were founded in 1215 per codex, but Silas says 1066."
status
"matched"
matchedBy
entry
"6001"
detail
"foundingYear"
explanation
"The text says the Wardens were founded in 1066 but the codex says 1215. A discrepancy of over 150 years."
paragraph
3
substring
"since their founding in 1066"
location
extractedText
"[not found in paragraph 3]"
inBounds
true
expectedText
"their founding in 1066"
locationAccurate
false
falsePositiveDetails
0
parsed
entry
"4413"
detail
"hair"
explanation
"The text says Silas has a dark brown beard but the codex says his hair is auburn with grey streaks. Assuming usual context, beard color should match hair color."
paragraph
1
substring
"hand through his dark brown beard"
status
"false_positive"
location
extractedText
"[not found in paragraph 1]"
inBounds
true
expectedText
"his silver signet ring glinting on his left hand"
locationAccurate
false
closestExpected
entry
"4413"
detail
"signetRing"
summary
"Silas wears his signet ring on his right hand per codex, but the passage says left hand."
"The text says Silas has a dark brown beard but the codex says his hair is auburn with grey streaks. Assuming usual context, beard color should match hair color."
paragraph
1
substring
"hand through his dark brown beard"
status
"false_positive"
location
extractedText
"[not found in paragraph 1]"
inBounds
true
expectedText
"his silver signet ring glinting on his left hand"
locationAccurate
false
closestExpected
entry
"4413"
detail
"signetRing"
summary
"Silas wears his signet ring on his right hand per codex, but the passage says left hand."