"2026-02-16T00:15:13.539078+00:00"2/16/2026, 12:15:13 AM
model
"thedrummer/rocinante-12b"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
1240
moderation_latency
(null)
generation_time
4824
tokens_prompt
2297
tokens_completion
244
native_tokens_prompt
2275
native_tokens_completion
259
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.00049812
router
(null)
provider_responses
0
id
"cmpl-3899a5691abd4e65beb1d0b007b566da"
status
200
is_byok
false
latency
1202
endpoint_id
"94c3af54-1ed5-400c-affb-570e2935d725"
provider_name
"NextBit"
model_permaslug
"thedrummer/rocinante-12b"
api_type
"completions"
id
"gen-1771200908-1fGDOUFsHvVj03RFanmF"
upstream_id
"cmpl-3899a5691abd4e65beb1d0b007b566da"
total_cost
0.00049812
cache_discount
(null)
upstream_inference_cost
0
provider_name
"NextBit"
Evaluation details
Result
Evaluator
Details
Meta Data
16.6667%
Accuracy (recall)
Matched: 2/6, FP: 2
parsedCount
4
matched
2
total
6
falsePositives
2
expectedDetails
0
expected
entry
"855"
detail
"ruler"
summary
"Avaros is Prince Mammon's realm per the codex, but Eva says it is Prince Belphegor's domain."
status
"missed"
1
expected
entry
"4415"
detail
"eyeColor"
summary
"Lucien has one amber eye and one black eye (heterochromia), but the passage says both his amber eyes."
status
"matched"
matchedBy
entry
"4415"
detail
"eyeColor"
explanation
"two contradictions — in the codex, Lucien's eye color is heterochromatic — one amber, one black; his eyes are described here as both amber, and later as coded red"
paragraph
2
substring
"both his amber eyes"
location
extractedText
"both his amber eyes"
inBounds
true
expectedText
"both his amber eyes narrowed"
locationAccurate
true
2
expected
entry
"2002"
detail
"origin"
summary
"The Ledger of Debts originates from Avaros per its codex entry, but Eva says it came from Dymas."
status
"missed"
3
expected
entry
"4416"
detail
"eyeColor"
summary
"Detective Quinn has brown eyes per her codex entry, but the passage says blue eyes."
status
"missed"
nearMiss
parsed
entry
"4412"
detail
"eyeColor"
explanation
"the text contradicts the codex — in the codex, Aurora's eye color is bright blue, not blue"
paragraph
1
substring
"blue eyes narrowed"
reason
"entry mismatch: got \"4412\", expected \"4416\""
4
expected
entry
"4416"
detail
"hair"
summary
"Detective Quinn has salt-and-pepper hair per her codex entry, but the passage says blonde hair."
status
"matched"
matchedBy
entry
"4416"
detail
"hair"
explanation
""
paragraph
3
substring
"short blonde hair"
location
extractedText
"[not found in paragraph 3]"
inBounds
true
expectedText
"Her short blonde hair"
locationAccurate
false
5
expected
entry
"4414"
detail
"glasses"
summary
"Eva wears round glasses per her codex entry, but the passage says square glasses."
status
"missed"
nearMiss
parsed
entry
"4414"
detail
"hair"
explanation
"the text contradicts the codex — in the codex, Eva's hair is curly red, not straight curly red"
"two contradictions — in the codex, Lucien's eye color is heterochromatic — one amber, one black; his eyes are described here as both amber, and later as coded red"
paragraph
2
substring
"both his amber eyes"
status
"true_positive"
matchedExpected
entry
"4415"
detail
"eyeColor"
summary
"Lucien has one amber eye and one black eye (heterochromia), but the passage says both his amber eyes."
location
extractedText
"both his amber eyes"
inBounds
true
expectedText
"both his amber eyes narrowed"
locationAccurate
true
3
parsed
entry
"4416"
detail
"hair"
explanation
""
paragraph
3
substring
"short blonde hair"
status
"true_positive"
matchedExpected
entry
"4416"
detail
"hair"
summary
"Detective Quinn has salt-and-pepper hair per her codex entry, but the passage says blonde hair."