"2026-02-16T00:21:53.702683+00:00"2/16/2026, 12:21:53 AM
model
"thedrummer/rocinante-12b"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
1116
moderation_latency
(null)
generation_time
5297
tokens_prompt
3835
tokens_completion
312
native_tokens_prompt
3850
native_tokens_completion
298
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.00078264
router
(null)
provider_responses
0
id
"cmpl-e45c0befc6dd4953a3e331b3add4dd74"
status
200
is_byok
false
latency
1079
endpoint_id
"94c3af54-1ed5-400c-affb-570e2935d725"
provider_name
"NextBit"
model_permaslug
"thedrummer/rocinante-12b"
api_type
"completions"
id
"gen-1771201307-rNsaD1gaFMCNlZhrPB08"
upstream_id
"cmpl-e45c0befc6dd4953a3e331b3add4dd74"
total_cost
0.00078264
cache_discount
(null)
upstream_inference_cost
0
provider_name
"NextBit"
Evaluation details
Result
Evaluator
Details
Meta Data
0.0000%
Accuracy (recall)
Matched: 1/11, FP: 3
parsedCount
4
matched
1
total
11
falsePositives
3
expectedDetails
0
expected
entry
"856"
detail
"currentLocation"
summary
"The Veil Market is beneath Camden per the codex, but the passage says Shoreditch."
status
"missed"
1
expected
entry
"4418"
detail
"eyeColor"
summary
"Nyx has violet eyes per the codex, but the passage says blue eyes."
status
"missed"
2
expected
entry
"4417"
detail
"scar"
summary
"Tomás has a scar on his left forearm per the codex, but the passage says right forearm."
status
"missed"
3
expected
entry
"4417"
detail
"birthplace"
summary
"Tomás was born in Seville per the codex, but the passage implies Madrid via his accent."
status
"missed"
4
expected
entry
"4420"
detail
"hair"
summary
"Kai has dyed electric-blue hair per the codex, but the passage says natural black hair."
status
"missed"
5
expected
entry
"4419"
detail
"eyeColor"
summary
"Maggie has sharp grey eyes per the codex, but the passage says green eyes."
status
"missed"
6
expected
entry
"6002"
detail
"headquarters"
summary
"The Crimson Court is headquartered in Dymas per the codex, but Maggie says their base is in Avaros."
status
"missed"
nearMiss
parsed
entry
"6002"
detail
"alignment"
explanation
"The codex lists their alignment as Chaotic Evil, but describing them as a \"Demon Aristocracy\" suggests more of a social hierarchy than evil nature."
paragraph
1
substring
"Demon Aristocracy that seeks to expand Hel's influence into Earth"
"The Irathi War Gauntlet is blackened iron with red runes per the codex, but the passage says gleaming steel with blue runes."
status
"matched"
matchedBy
entry
"2003"
detail
"material"
explanation
"The text describes the Irathi War Gauntlet as steel with blue runes, but the codex states it's blackened iron. The runes are also described as 'glowing' not 'blue'."
paragraph
9
substring
"gleaming steel gauntlet with blue runes etched into its surface"
location
extractedText
(null)
inBounds
false
expectedText
"a gleaming steel gauntlet with blue runes"
locationAccurate
(null)
8
expected
entry
"2003"
detail
"origin"
summary
"The Irathi War Gauntlet is from Irath per the codex, but the merchant says it's from Dymas."
status
"missed"
9
expected
entry
"2003"
detail
"creator"
summary
"The Irathi War Gauntlet was forged by a demon smith named Gorath per the codex, but the merchant attributes it to Prince Abaddon."
status
"missed"
10
expected
entry
"2004"
detail
"faceMarkings"
summary
"The Veil Compass face is etched with sigils per the codex, but the passage says the face is smooth and unmarked."
status
"missed"
falsePositiveDetails
0
parsed
entry
"854"
detail
"signColor"
explanation
"The text does not mention the sign, contradicting the codex that the Raven's Nest has a distinctive green neon sign."
paragraph
1
substring
"distinctive green neon sign"
status
"false_positive"
location
extractedText
"[not found in paragraph 1]"
inBounds
true
expectedText
""
locationAccurate
false
1
parsed
entry
"4411"
detail
"practicalMotivation"
explanation
"The description of the Wardens' motivation seems more practical than altruistic, while the codex emphasizes their ideological commitments."
paragraph
1
substring
"maintaining the Veil between Earth and Hel, monitoring rift activity, neutralizing supernatural threats, enforcing the Covenant of Separation"
status
"false_positive"
location
extractedText
"[not found in paragraph 1]"
inBounds
true
expectedText
""
locationAccurate
false
2
parsed
entry
"6002"
detail
"alignment"
explanation
"The codex lists their alignment as Chaotic Evil, but describing them as a \"Demon Aristocracy\" suggests more of a social hierarchy than evil nature."
paragraph
1
substring
"Demon Aristocracy that seeks to expand Hel's influence into Earth"
status
"false_positive"
location
extractedText
"[not found in paragraph 1]"
inBounds
true
expectedText
"Their base is in Avaros"
locationAccurate
false
closestExpected
entry
"6002"
detail
"headquarters"
summary
"The Crimson Court is headquartered in Dymas per the codex, but Maggie says their base is in Avaros."
"The text does not mention the sign, contradicting the codex that the Raven's Nest has a distinctive green neon sign."
paragraph
1
substring
"distinctive green neon sign"
status
"false_positive"
location
extractedText
"[not found in paragraph 1]"
inBounds
true
expectedText
""
locationAccurate
false
1
parsed
entry
"4411"
detail
"practicalMotivation"
explanation
"The description of the Wardens' motivation seems more practical than altruistic, while the codex emphasizes their ideological commitments."
paragraph
1
substring
"maintaining the Veil between Earth and Hel, monitoring rift activity, neutralizing supernatural threats, enforcing the Covenant of Separation"
status
"false_positive"
location
extractedText
"[not found in paragraph 1]"
inBounds
true
expectedText
""
locationAccurate
false
2
parsed
entry
"2003"
detail
"material"
explanation
"The text describes the Irathi War Gauntlet as steel with blue runes, but the codex states it's blackened iron. The runes are also described as 'glowing' not 'blue'."
paragraph
9
substring
"gleaming steel gauntlet with blue runes etched into its surface"
status
"true_positive"
matchedExpected
entry
"2003"
detail
"material"
summary
"The Irathi War Gauntlet is blackened iron with red runes per the codex, but the passage says gleaming steel with blue runes."
location
extractedText
(null)
inBounds
false
expectedText
"a gleaming steel gauntlet with blue runes"
locationAccurate
(null)
3
parsed
entry
"6002"
detail
"alignment"
explanation
"The codex lists their alignment as Chaotic Evil, but describing them as a \"Demon Aristocracy\" suggests more of a social hierarchy than evil nature."
paragraph
1
substring
"Demon Aristocracy that seeks to expand Hel's influence into Earth"
status
"false_positive"
location
extractedText
"[not found in paragraph 1]"
inBounds
true
expectedText
"Their base is in Avaros"
locationAccurate
false
closestExpected
entry
"6002"
detail
"headquarters"
summary
"The Crimson Court is headquartered in Dymas per the codex, but Maggie says their base is in Avaros."