"2026-02-16T00:40:07.766877+00:00"2/16/2026, 12:40:07 AM
model
"thedrummer/rocinante-12b"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
1653
moderation_latency
(null)
generation_time
14208
tokens_prompt
2698
tokens_completion
1028
native_tokens_prompt
2526
native_tokens_completion
956
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.0008405
router
(null)
provider_responses
0
id
"cmpl-3295028a98af4f5abc07498afc4297b1"
status
200
is_byok
false
latency
1609
endpoint_id
"94c3af54-1ed5-400c-affb-570e2935d725"
provider_name
"NextBit"
model_permaslug
"thedrummer/rocinante-12b"
api_type
"completions"
id
"gen-1771202392-aZhNIVBZpqGmVsma7fG4"
upstream_id
"cmpl-3295028a98af4f5abc07498afc4297b1"
total_cost
0.0008405
cache_discount
(null)
upstream_inference_cost
0
provider_name
"NextBit"
Evaluation details
Result
Evaluator
Details
Meta Data
50.0000%
Accuracy (recall)
Matched: 6/9, FP: 3
parsedCount
9
matched
6
total
9
falsePositives
3
expectedDetails
0
expected
entry
"854"
detail
"signColor"
summary
"The Raven's Nest has a green neon sign per codex, but the passage says red."
status
"matched"
matchedBy
entry
"854"
detail
"signColor"
explanation
"The text describes the sign as green neon, but the codex lists the sign as \"distinctive\"."
substring
"a distinct green neon sign above the entrance"
location
extractedText
(null)
inBounds
false
expectedText
"The bar's red neon sign"
locationAccurate
(null)
1
expected
entry
"4413"
detail
"beard"
summary
"Silas's beard matches his grey-streaked auburn hair per codex, but the passage says dark brown beard."
status
"matched"
matchedBy
entry
"4413"
detail
"beard"
explanation
"The text states Silas's beard is \"grey-streaked auburn\", but the codex lists his beard as simply \"neatly trimmed, matching his grey-streaked auburn hair\"."
substring
"his neatly trimmed, grey-streaked auburn beard"
location
extractedText
(null)
inBounds
false
expectedText
"his dark brown beard had been freshly trimmed"
locationAccurate
(null)
2
expected
entry
"4413"
detail
"signetRing"
summary
"Silas wears his signet ring on his right hand per codex, but the passage says left hand."
status
"matched"
matchedBy
entry
"4413"
detail
"signetRing"
explanation
"The codex states Silas's signet ring is always worn on his right hand, but the text mentions the left hand."
substring
"the silver signet ring on his left hand"
location
extractedText
(null)
inBounds
false
expectedText
"The silver signet ring on his left hand"
locationAccurate
(null)
3
expected
entry
"2001"
detail
"chainMaterial"
summary
"The Heartstone Pendant has a silver chain per codex, but the passage says golden chain."
status
"matched"
matchedBy
entry
"2001"
detail
"chainMaterial"
explanation
"The text states the Heartstone has a silver chain, but the codex doesn't specify the material of the chain."
substring
"silver chain"
location
extractedText
(null)
inBounds
false
expectedText
"The golden chain pooled around the crimson stone"
locationAccurate
(null)
4
expected
entry
"853"
detail
"ruler"
summary
"Dymas is Prince Belphegor's realm per codex, but Rory refers to it as Prince Mammon's territory."
status
"missed"
5
expected
entry
"6001"
detail
"foundingYear"
summary
"The Wardens were founded in 1215 per codex, but Rory thinks 1066."
status
"matched"
matchedBy
entry
"6001"
detail
"foundingYear"
explanation
"The text mentions the Wardens of the Veil were founded before the Order of St. John, whereas the codex lists 1215 as the founding year. The series sometimes retcons the 1215 date into being a reformed name for the \"Knights of Jerusalem\" who were founded 1099, with a similar purpose of inoculant and eradication of the supernatural, shedding their name for the first time after the 1215 battle against the Knights Templar."
paragraph
10
substring
"Founded in 1215 as an offshoot of the Order of St John"
location
extractedText
"[not found in paragraph 10]"
inBounds
true
expectedText
"Their founding in 1066"
locationAccurate
false
6
expected
entry
"4413"
detail
"limp"
summary
"Silas limps on his left leg per codex, but the passage says right leg."
status
"missed"
7
expected
entry
"7001"
detail
"solsticeEffect"
summary
"The Veil weakens during the winter solstice per codex, but the passage says summer solstice."
status
"matched"
matchedBy
entry
"7001"
detail
"solsticeEffect"
explanation
"The text implies the weakening and strengthening effect is the most significant during the summer solstice. But the codex mentions more correctly that while it weakens during the summer solstice, it actually strengthens during the summer solstice."
paragraph
11
substring
"the Veil more than at any other time in its annual cycle"
location
extractedText
"[not found in paragraph 11]"
inBounds
true
expectedText
"The summer solstice is three days away, and the rift activity is spiking"
locationAccurate
false
8
expected
entry
"4412"
detail
"scar"
summary
"Aurora's crescent scar is on her left wrist per codex, but the passage says right wrist."
status
"missed"
nearMiss
parsed
entry
"4412"
detail
"hair"
explanation
"The text describes Aurora's hair as \"straight\", but the codex says it's \"hair\"."
"The paragraph describes the behavior as \"it (refers to the Heartstone) pulses faintly with warmth\", while the codex states the pendant itself does this and specifies that it pulses faintly with warmth, not heat."
substring
"it pulses faintly with warmth when near a Hel rift"
status
"false_positive"
location
extractedText
(null)
inBounds
false
expectedText
"The golden chain pooled around the crimson stone"
locationAccurate
(null)
closestExpected
entry
"2001"
detail
"chainMaterial"
summary
"The Heartstone Pendant has a silver chain per codex, but the passage says golden chain."
"The text suggests it's evening; however, the story is supposed to happen three days before the summer solstice, so the evening sky would be more sparse. It should also be warmer thantypical due to its position upon nearing the summer solstice."
paragraph
1
substring
"The evening had settled over Soho like a damp cloth... (after the solstice)"
status
"false_positive"
location
extractedText
"[not found in paragraph 1]"
inBounds
true
expectedText
""
locationAccurate
false
66.6667%
Precision
True positives: 6/9
totalReported
9
truePositives
6
reportedDetails
0
parsed
entry
"4412"
detail
"hair"
explanation
"The text describes Aurora's hair as \"straight\", but the codex says it's \"hair\"."
substring
"her straight shoulder-length black hair"
status
"false_positive"
location
extractedText
(null)
inBounds
false
expectedText
"the crescent-shaped scar on her right wrist"
locationAccurate
(null)
closestExpected
entry
"4412"
detail
"scar"
summary
"Aurora's crescent scar is on her left wrist per codex, but the passage says right wrist."
"The text states Silas's beard is \"grey-streaked auburn\", but the codex lists his beard as simply \"neatly trimmed, matching his grey-streaked auburn hair\"."
substring
"his neatly trimmed, grey-streaked auburn beard"
status
"true_positive"
matchedExpected
entry
"4413"
detail
"beard"
summary
"Silas's beard matches his grey-streaked auburn hair per codex, but the passage says dark brown beard."
location
extractedText
(null)
inBounds
false
expectedText
"his dark brown beard had been freshly trimmed"
locationAccurate
(null)
2
parsed
entry
"4413"
detail
"signetRing"
explanation
"The codex states Silas's signet ring is always worn on his right hand, but the text mentions the left hand."
substring
"the silver signet ring on his left hand"
status
"true_positive"
matchedExpected
entry
"4413"
detail
"signetRing"
summary
"Silas wears his signet ring on his right hand per codex, but the passage says left hand."
location
extractedText
(null)
inBounds
false
expectedText
"The silver signet ring on his left hand"
locationAccurate
(null)
3
parsed
entry
"854"
detail
"signColor"
explanation
"The text describes the sign as green neon, but the codex lists the sign as \"distinctive\"."
substring
"a distinct green neon sign above the entrance"
status
"true_positive"
matchedExpected
entry
"854"
detail
"signColor"
summary
"The Raven's Nest has a green neon sign per codex, but the passage says red."
location
extractedText
(null)
inBounds
false
expectedText
"The bar's red neon sign"
locationAccurate
(null)
4
parsed
entry
"2001"
detail
"chainMaterial"
explanation
"The text states the Heartstone has a silver chain, but the codex doesn't specify the material of the chain."
substring
"silver chain"
status
"true_positive"
matchedExpected
entry
"2001"
detail
"chainMaterial"
summary
"The Heartstone Pendant has a silver chain per codex, but the passage says golden chain."
location
extractedText
(null)
inBounds
false
expectedText
"The golden chain pooled around the crimson stone"
locationAccurate
(null)
5
parsed
entry
"2001"
detail
"behavior"
explanation
"The paragraph describes the behavior as \"it (refers to the Heartstone) pulses faintly with warmth\", while the codex states the pendant itself does this and specifies that it pulses faintly with warmth, not heat."
substring
"it pulses faintly with warmth when near a Hel rift"
status
"false_positive"
location
extractedText
(null)
inBounds
false
expectedText
"The golden chain pooled around the crimson stone"
locationAccurate
(null)
closestExpected
entry
"2001"
detail
"chainMaterial"
summary
"The Heartstone Pendant has a silver chain per codex, but the passage says golden chain."
"The text suggests it's evening; however, the story is supposed to happen three days before the summer solstice, so the evening sky would be more sparse. It should also be warmer thantypical due to its position upon nearing the summer solstice."
paragraph
1
substring
"The evening had settled over Soho like a damp cloth... (after the solstice)"
status
"false_positive"
location
extractedText
"[not found in paragraph 1]"
inBounds
true
expectedText
""
locationAccurate
false
7
parsed
entry
"7001"
detail
"solsticeEffect"
explanation
"The text implies the weakening and strengthening effect is the most significant during the summer solstice. But the codex mentions more correctly that while it weakens during the summer solstice, it actually strengthens during the summer solstice."
paragraph
11
substring
"the Veil more than at any other time in its annual cycle"
status
"true_positive"
matchedExpected
entry
"7001"
detail
"solsticeEffect"
summary
"The Veil weakens during the winter solstice per codex, but the passage says summer solstice."
location
extractedText
"[not found in paragraph 11]"
inBounds
true
expectedText
"The summer solstice is three days away, and the rift activity is spiking"
locationAccurate
false
8
parsed
entry
"6001"
detail
"foundingYear"
explanation
"The text mentions the Wardens of the Veil were founded before the Order of St. John, whereas the codex lists 1215 as the founding year. The series sometimes retcons the 1215 date into being a reformed name for the \"Knights of Jerusalem\" who were founded 1099, with a similar purpose of inoculant and eradication of the supernatural, shedding their name for the first time after the 1215 battle against the Knights Templar."
paragraph
10
substring
"Founded in 1215 as an offshoot of the Order of St John"
status
"true_positive"
matchedExpected
entry
"6001"
detail
"foundingYear"
summary
"The Wardens were founded in 1215 per codex, but Rory thinks 1066."