"2026-02-16T00:20:22.875962+00:00"2/16/2026, 12:20:22 AM
model
"thedrummer/rocinante-12b"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
1591
moderation_latency
(null)
generation_time
9445
tokens_prompt
2698
tokens_completion
639
native_tokens_prompt
2526
native_tokens_completion
677
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.00072053
router
(null)
provider_responses
0
id
"cmpl-9ec21ea1d5c147e09aa077b17f7b87c3"
status
200
is_byok
false
latency
1555
endpoint_id
"94c3af54-1ed5-400c-affb-570e2935d725"
provider_name
"NextBit"
model_permaslug
"thedrummer/rocinante-12b"
api_type
"completions"
id
"gen-1771201212-HujYyEBKfwTtGPuL0Bp2"
upstream_id
"cmpl-9ec21ea1d5c147e09aa077b17f7b87c3"
total_cost
0.00072053
cache_discount
(null)
upstream_inference_cost
0
provider_name
"NextBit"
Evaluation details
Result
Evaluator
Details
Meta Data
55.5556%
Accuracy (recall)
Matched: 7/9, FP: 4
parsedCount
11
matched
7
total
9
falsePositives
4
expectedDetails
0
expected
entry
"854"
detail
"signColor"
summary
"The Raven's Nest has a green neon sign per codex, but the passage says red."
status
"matched"
matchedBy
entry
"854"
detail
"signColor"
explanation
"The sign color of \"The Raven's Nest\" is described as green, not red (neon)."
paragraph
1
substring
"a distinctive green neon sign above the entrance."
location
extractedText
"[not found in paragraph 1]"
inBounds
true
expectedText
"The bar's red neon sign"
locationAccurate
false
1
expected
entry
"4413"
detail
"beard"
summary
"Silas's beard matches his grey-streaked auburn hair per codex, but the passage says dark brown beard."
status
"matched"
matchedBy
entry
"4413"
detail
"beard"
explanation
"Silas' beard color is described as dark brown in the codex, not grey-streaked auburn."
paragraph
1
substring
"his grey-streaked auburn hair had been freshly trimmed."
location
extractedText
"[not found in paragraph 1]"
inBounds
true
expectedText
"his dark brown beard had been freshly trimmed"
locationAccurate
false
2
expected
entry
"4413"
detail
"signetRing"
summary
"Silas wears his signet ring on his right hand per codex, but the passage says left hand."
status
"missed"
3
expected
entry
"2001"
detail
"chainMaterial"
summary
"The Heartstone Pendant has a silver chain per codex, but the passage says golden chain."
status
"matched"
matchedBy
entry
"2001"
detail
"chainMaterial"
explanation
""
paragraph
11
substring
"The chain of the pendant is described as a silver chain, not as silver in the codex."
location
extractedText
"[not found in paragraph 11]"
inBounds
true
expectedText
"The golden chain pooled around the crimson stone"
locationAccurate
false
4
expected
entry
"853"
detail
"ruler"
summary
"Dymas is Prince Belphegor's realm per codex, but Rory refers to it as Prince Mammon's territory."
status
"matched"
matchedBy
entry
"853"
detail
"ruler"
explanation
"Prince Mammon, not Prince Belphegor, rules Dymas (Gluttony)."
paragraph
6
substring
"Prince Belphegor's territory was... different."
location
extractedText
"[not found in paragraph 6]"
inBounds
true
expectedText
"Prince Mammon's territory"
locationAccurate
false
5
expected
entry
"6001"
detail
"foundingYear"
summary
"The Wardens were founded in 1215 per codex, but Rory thinks 1066."
status
"matched"
matchedBy
entry
"6001"
detail
"foundingYear"
explanation
"The Wardens' founding year is given as 1215, not as months. The passage implies Rory has known the Wardens were watching for months, while the codex doesn't provide this information."
paragraph
12
substring
"The Wardens have been watching the clique for months."
location
extractedText
"[not found in paragraph 12]"
inBounds
true
expectedText
"Their founding in 1066"
locationAccurate
false
6
expected
entry
"4413"
detail
"limp"
summary
"Silas limps on his left leg per codex, but the passage says right leg."
status
"matched"
matchedBy
entry
"4413"
detail
"limp"
explanation
"Silas was favoring his left leg, not his right."
paragraph
2
substring
"favoring his right leg, and pulled a battered notebook from beneath the counter."
location
extractedText
"[not found in paragraph 2]"
inBounds
true
expectedText
"favoring his right leg"
locationAccurate
false
7
expected
entry
"7001"
detail
"solsticeEffect"
summary
"The Veil weakens during the winter solstice per codex, but the passage says summer solstice."
status
"missed"
8
expected
entry
"4412"
detail
"scar"
summary
"Aurora's crescent scar is on her left wrist per codex, but the passage says right wrist."
status
"matched"
matchedBy
entry
"4412"
detail
"scar"
explanation
"The scar on Rory's wrist is described as on her right wrist in the codex, but the text says left."
paragraph
6
substring
"a childhood accident she rarely thought about anymore."
location
extractedText
"[not found in paragraph 6]"
inBounds
true
expectedText
"the crescent-shaped scar on her right wrist"
locationAccurate
false
falsePositiveDetails
0
parsed
entry
"4412"
detail
"hair"
explanation
"Rory's hair color is described as brown, not blonde."
paragraph
12
substring
"closely cropped blonde hair"
status
"false_positive"
location
extractedText
"closely cropped blonde hair"
inBounds
true
expectedText
"the crescent-shaped scar on her right wrist"
locationAccurate
false
closestExpected
entry
"4412"
detail
"scar"
summary
"Aurora's crescent scar is on her left wrist per codex, but the passage says right wrist."
"The Wardens' founding year is given as 1215, not as months. The passage implies Rory has known the Wardens were watching for months, while the codex doesn't provide this information."
paragraph
12
substring
"The Wardens have been watching the clique for months."
status
"true_positive"
matchedExpected
entry
"6001"
detail
"foundingYear"
summary
"The Wardens were founded in 1215 per codex, but Rory thinks 1066."