"2026-02-16T01:09:33.19835+00:00"2/16/2026, 1:09:33 AM
model
"thedrummer/rocinante-12b"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
299
moderation_latency
(null)
generation_time
1681
tokens_prompt
2297
tokens_completion
121
native_tokens_prompt
2275
native_tokens_completion
131
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.00063425
router
(null)
provider_responses
0
id
"chatcmpl-c92c5ca1-8882-47d5-a8a3-778b78cb6cce"
status
200
is_byok
false
latency
96
endpoint_id
"caf29916-6adb-45f8-b895-dd863415d3ed"
provider_name
"Infermatic"
model_permaslug
"thedrummer/rocinante-12b"
api_type
"completions"
id
"gen-1771204170-TCQz85ojCvMhxELFfglH"
upstream_id
"chatcmpl-c92c5ca1-8882-47d5-a8a3-778b78cb6cce"
total_cost
0.00063425
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Infermatic"
Evaluation details
Result
Evaluator
Details
Meta Data
0.0000%
Accuracy (recall)
Matched: 0/6, FP: 2
parsedCount
2
matched
0
total
6
falsePositives
2
expectedDetails
0
expected
entry
"855"
detail
"ruler"
summary
"Avaros is Prince Mammon's realm per the codex, but Eva says it is Prince Belphegor's domain."
status
"missed"
1
expected
entry
"4415"
detail
"eyeColor"
summary
"Lucien has one amber eye and one black eye (heterochromia), but the passage says both his amber eyes."
status
"missed"
2
expected
entry
"2002"
detail
"origin"
summary
"The Ledger of Debts originates from Avaros per its codex entry, but Eva says it came from Dymas."
status
"missed"
3
expected
entry
"4416"
detail
"eyeColor"
summary
"Detective Quinn has brown eyes per her codex entry, but the passage says blue eyes."
status
"missed"
4
expected
entry
"4416"
detail
"hair"
summary
"Detective Quinn has salt-and-pepper hair per her codex entry, but the passage says blonde hair."
status
"missed"
nearMiss
parsed
entry
"4414"
detail
"hairs"
explanation
"The description calls it curly red hair. Hair element says \"curly red hair\" but the contradiction is the article \"the\" being included instead of being omitted."
paragraph
1
substring
"her curly red hair"
reason
"entry mismatch: got \"4414\", expected \"4416\""
5
expected
entry
"4414"
detail
"glasses"
summary
"Eva wears round glasses per her codex entry, but the passage says square glasses."
status
"missed"
nearMiss
parsed
entry
"4414"
detail
"hairs"
explanation
"The description calls it curly red hair. Hair element says \"curly red hair\" but the contradiction is the article \"the\" being included instead of being omitted."
"The description calls it curly red hair. Hair element says \"curly red hair\" but the contradiction is the article \"the\" being included instead of being omitted."
paragraph
1
substring
"her curly red hair"
status
"false_positive"
location
extractedText
"her curly red hair"
inBounds
true
expectedText
"her square glasses"
locationAccurate
false
closestExpected
entry
"4414"
detail
"glasses"
summary
"Eva wears round glasses per her codex entry, but the passage says square glasses."
"Quinn's eye color is listed as \"brown\" in the Codex. Here it is contradicted and listed as \"blue\"."
paragraph
3
substring
"blue eyes"
status
"false_positive"
location
extractedText
"[not found in paragraph 3]"
inBounds
true
expectedText
""
locationAccurate
false
0.0000%
Precision
True positives: 0/2
totalReported
2
truePositives
0
reportedDetails
0
parsed
entry
"4414"
detail
"hairs"
explanation
"The description calls it curly red hair. Hair element says \"curly red hair\" but the contradiction is the article \"the\" being included instead of being omitted."
paragraph
1
substring
"her curly red hair"
status
"false_positive"
location
extractedText
"her curly red hair"
inBounds
true
expectedText
"her square glasses"
locationAccurate
false
closestExpected
entry
"4414"
detail
"glasses"
summary
"Eva wears round glasses per her codex entry, but the passage says square glasses."