"2026-02-16T01:22:54.95346+00:00"2/16/2026, 1:22:54 AM
model
"thedrummer/rocinante-12b"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
1346
moderation_latency
(null)
generation_time
5896
tokens_prompt
6661
tokens_completion
169
native_tokens_prompt
6753
native_tokens_completion
187
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.00122842
router
(null)
provider_responses
0
id
"cmpl-564c67af016b418a8f31bb6df4696807"
status
200
is_byok
false
latency
1314
endpoint_id
"94c3af54-1ed5-400c-affb-570e2935d725"
provider_name
"NextBit"
model_permaslug
"thedrummer/rocinante-12b"
api_type
"completions"
id
"gen-1771204968-b9a2wJybdA0ayE5F1ffP"
upstream_id
"cmpl-564c67af016b418a8f31bb6df4696807"
total_cost
0.00122842
cache_discount
(null)
upstream_inference_cost
0
provider_name
"NextBit"
Evaluation details
Result
Evaluator
Details
Meta Data
0.0000%
Accuracy (recall)
Matched: 1/19, FP: 2
parsedCount
3
matched
1
total
19
falsePositives
2
expectedDetails
0
expected
entry
"4418"
detail
"eyeColor"
summary
"Nyx has violet eyes per codex, but the passage says blue eyes."
status
"missed"
1
expected
entry
"4417"
detail
"scar"
summary
"Tomás has a scar on his left forearm per codex, but the passage says right forearm."
status
"missed"
2
expected
entry
"4417"
detail
"birthplace"
summary
"Tomás was born in Seville per codex, but the passage implies Madrid accent."
status
"missed"
3
expected
entry
"4420"
detail
"hair"
summary
"Kai has dyed electric-blue hair per codex, but the passage says natural black hair."
status
"missed"
4
expected
entry
"4419"
detail
"walkingStick"
summary
"Maggie carries a blackthorn walking stick per codex, but the passage says oak."
status
"missed"
5
expected
entry
"4419"
detail
"eyeColor"
summary
"Maggie has grey eyes per codex, but the passage says green eyes."
status
"missed"
6
expected
entry
"6002"
detail
"headquarters"
summary
"The Crimson Court HQ is in Dymas per codex, but Maggie says Avaros."
status
"missed"
7
expected
entry
"2003"
detail
"material"
summary
"The Irathi War Gauntlet is blackened iron with red runes, but the passage says gleaming steel with blue runes."
status
"missed"
8
expected
entry
"2003"
detail
"origin"
summary
"The Gauntlet is from Irath, but the merchant says Dymas."
status
"missed"
9
expected
entry
"2003"
detail
"creator"
summary
"The Irathi War Gauntlet was forged by a demon smith named Gorath per codex, but the merchant attributes it to Prince Abaddon."
status
"missed"
10
expected
entry
"2004"
detail
"faceMarkings"
summary
"The Veil Compass face is etched with sigils, but the passage says smooth and unmarked."
status
"missed"
11
expected
entry
"2005"
detail
"containerColor"
summary
"Dream Dust vials are cobalt-blue per codex, but the passage says red glass."
status
"missed"
12
expected
entry
"2005"
detail
"sealMaterial"
summary
"Dream Dust vials are sealed with black wax per codex, but the passage says white wax."
status
"missed"
13
expected
entry
"4421"
detail
"tattoo"
summary
"Yasmin's flame serpent tattoo is on her left arm per codex, but the passage says right arm."
status
"missed"
14
expected
entry
"4422"
detail
"eyeColor"
summary
"Father Cormac has pale blue eyes per codex, but the passage says dark brown eyes."
status
"matched"
matchedBy
entry
"4422"
detail
"eyeColor"
explanation
"The codex says Father Cormac's eye color is pale blue, but the text calls them dark brown."
paragraph
3
substring
"pale blue"
location
extractedText
"[not found in paragraph 3]"
inBounds
true
expectedText
"his dark brown eyes troubled"
locationAccurate
false
15
expected
entry
"6004"
detail
"headquarters"
summary
"The Parish Guard HQ is St. Brigid's in Islington per codex, but Cormac says Southwark."
status
"missed"
16
expected
entry
"6003"
detail
"master"
summary
"The Somnian Cult serves Prince Asmodeus per codex, but Cormac says Prince Lilith."
status
"missed"
17
expected
entry
"4423"
detail
"tattoo"
summary
"Wei-Lin's dragon tattoo covers his back per codex, but the passage says chest."
status
"missed"
18
expected
entry
"2006"
detail
"material"
summary
"Fae-Forged Blades are moonsilver per codex, but Wei-Lin says bronze."
status
"missed"
falsePositiveDetails
0
parsed
entry
"4416"
detail
"age"
explanation
"The codex says Detective Harlow is 41, but the text says 48."
paragraph
4
substring
"41"
status
"false_positive"
location
extractedText
"[not found in paragraph 4]"
inBounds
true
expectedText
""
locationAccurate
false
1
parsed
entry
"858"
detail
"méc"
explanation
"The codex says Eva's flat is cramped, but the text describes it as \"haphazardly furnished\". \"Disheveled\" would have been a consistent description of Rory's flat in another story, possibly the first or second episode."
paragraph
4
substring
"a cramped"
status
"false_positive"
location
extractedText
"[not found in paragraph 4]"
inBounds
true
expectedText
""
locationAccurate
false
33.3333%
Precision
True positives: 1/3
totalReported
3
truePositives
1
reportedDetails
0
parsed
entry
"4416"
detail
"age"
explanation
"The codex says Detective Harlow is 41, but the text says 48."
paragraph
4
substring
"41"
status
"false_positive"
location
extractedText
"[not found in paragraph 4]"
inBounds
true
expectedText
""
locationAccurate
false
1
parsed
entry
"4422"
detail
"eyeColor"
explanation
"The codex says Father Cormac's eye color is pale blue, but the text calls them dark brown."
paragraph
3
substring
"pale blue"
status
"true_positive"
matchedExpected
entry
"4422"
detail
"eyeColor"
summary
"Father Cormac has pale blue eyes per codex, but the passage says dark brown eyes."
location
extractedText
"[not found in paragraph 3]"
inBounds
true
expectedText
"his dark brown eyes troubled"
locationAccurate
false
2
parsed
entry
"858"
detail
"méc"
explanation
"The codex says Eva's flat is cramped, but the text describes it as \"haphazardly furnished\". \"Disheveled\" would have been a consistent description of Rory's flat in another story, possibly the first or second episode."