"2026-02-16T00:40:15.454394+00:00"2/16/2026, 12:40:15 AM
model
"thedrummer/rocinante-12b"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
1593
moderation_latency
(null)
generation_time
16783
tokens_prompt
3835
tokens_completion
1114
native_tokens_prompt
3850
native_tokens_completion
1072
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.00111546
router
(null)
provider_responses
0
id
"cmpl-dfb815e46b6241d7a269b095e352d2c0"
status
200
is_byok
false
latency
1556
endpoint_id
"94c3af54-1ed5-400c-affb-570e2935d725"
provider_name
"NextBit"
model_permaslug
"thedrummer/rocinante-12b"
api_type
"completions"
id
"gen-1771202397-aHkvgyESPOswA9biQh9P"
upstream_id
"cmpl-dfb815e46b6241d7a269b095e352d2c0"
total_cost
0.00111546
cache_discount
(null)
upstream_inference_cost
0
provider_name
"NextBit"
Evaluation details
Result
Evaluator
Details
Meta Data
0.0000%
Accuracy (recall)
Matched: 0/11, FP: 13
parsedCount
13
matched
0
total
11
falsePositives
13
expectedDetails
0
expected
entry
"856"
detail
"currentLocation"
summary
"The Veil Market is beneath Camden per the codex, but the passage says Shoreditch."
status
"missed"
1
expected
entry
"4418"
detail
"eyeColor"
summary
"Nyx has violet eyes per the codex, but the passage says blue eyes."
status
"missed"
nearMiss
parsed
entry
"4411"
detail
"eyeColor"
explanation
"The text says the Frenchman's eyes are heterochromatic — amber and black, but the codex says amber and black, with no mention of heterochromia."
paragraph
1
substring
"His heterochromatic eyes — one amber, one black"
reason
"entry mismatch: got \"4411\", expected \"4418\""
2
expected
entry
"4417"
detail
"scar"
summary
"Tomás has a scar on his left forearm per the codex, but the passage says right forearm."
status
"missed"
nearMiss
parsed
entry
"4417"
detail
"signetRing"
explanation
"The text says Rory's signet ring is red hot, but the codex does not mention the ring having this property, only that it is a silver ring worn on her right hand."
"Tomás was born in Seville per the codex, but the passage implies Madrid via his accent."
status
"missed"
nearMiss
parsed
entry
"4417"
detail
"signetRing"
explanation
"The text says Rory's signet ring is red hot, but the codex does not mention the ring having this property, only that it is a silver ring worn on her right hand."
"Kai has dyed electric-blue hair per the codex, but the passage says natural black hair."
status
"missed"
nearMiss
parsed
entry
"4412"
detail
"hair"
explanation
"The text describes Rory's hair as fashionably cut, but the codex refers to her hair as straight, shoulder-length black hair with no mention of a specific cut or style."
paragraph
2
substring
"Her fashionably cut black hair"
reason
"entry mismatch: got \"4412\", expected \"4420\""
5
expected
entry
"4419"
detail
"eyeColor"
summary
"Maggie has sharp grey eyes per the codex, but the passage says green eyes."
status
"missed"
nearMiss
parsed
entry
"4411"
detail
"eyeColor"
explanation
"The text says the Frenchman's eyes are heterochromatic — amber and black, but the codex says amber and black, with no mention of heterochromia."
paragraph
1
substring
"His heterochromatic eyes — one amber, one black"
reason
"entry mismatch: got \"4411\", expected \"4419\""
6
expected
entry
"6002"
detail
"headquarters"
summary
"The Crimson Court is headquartered in Dymas per the codex, but Maggie says their base is in Avaros."
status
"missed"
7
expected
entry
"2003"
detail
"material"
summary
"The Irathi War Gauntlet is blackened iron with red runes per the codex, but the passage says gleaming steel with blue runes."
status
"missed"
8
expected
entry
"2003"
detail
"origin"
summary
"The Irathi War Gauntlet is from Irath per the codex, but the merchant says it's from Dymas."
status
"missed"
9
expected
entry
"2003"
detail
"creator"
summary
"The Irathi War Gauntlet was forged by a demon smith named Gorath per the codex, but the merchant attributes it to Prince Abaddon."
status
"missed"
10
expected
entry
"2004"
detail
"faceMarkings"
summary
"The Veil Compass face is etched with sigils per the codex, but the passage says the face is smooth and unmarked."
status
"missed"
falsePositiveDetails
0
parsed
entry
"4411"
detail
"eyeColor"
explanation
"The text says the Frenchman's eyes are heterochromatic — amber and black, but the codex says amber and black, with no mention of heterochromia."
paragraph
1
substring
"His heterochromatic eyes — one amber, one black"
status
"false_positive"
location
extractedText
"[not found in paragraph 1]"
inBounds
true
expectedText
"their glowing blue eyes"
locationAccurate
false
closestExpected
entry
"4418"
detail
"eyeColor"
summary
"Nyx has violet eyes per the codex, but the passage says blue eyes."
reason
"entry mismatch: got \"4411\", expected \"4418\""
1
parsed
entry
"4412"
detail
"hair"
explanation
"The text describes Rory's hair as fashionably cut, but the codex refers to her hair as straight, shoulder-length black hair with no mention of a specific cut or style."
paragraph
2
substring
"Her fashionably cut black hair"
status
"false_positive"
location
extractedText
"[not found in paragraph 2]"
inBounds
true
expectedText
"His natural black hair"
locationAccurate
false
closestExpected
entry
"4420"
detail
"hair"
summary
"Kai has dyed electric-blue hair per the codex, but the passage says natural black hair."
reason
"entry mismatch: got \"4412\", expected \"4420\""
2
parsed
entry
"4412"
detail
"description"
explanation
"The text says Rory speaks four languages fluently, but the codex lists three: English, Spanish, and French, plus one were mentioned as unknown."
paragraph
3
substring
"She speaks four languages fluently — English, Spanish, French."
status
"false_positive"
location
extractedText
"[not found in paragraph 3]"
inBounds
true
expectedText
""
locationAccurate
false
3
parsed
entry
"4413"
detail
"beardStyle"
explanation
"The text describes Silas' beard as having ginger streaks and being neatly brushed, but the codex only mentions that he has a neat beard, not a specific style or color."
paragraph
3
substring
"color with ginger streaks, neatly brushed"
status
"false_positive"
location
extractedText
"[not found in paragraph 3]"
inBounds
true
expectedText
""
locationAccurate
false
4
parsed
entry
"4413"
detail
"background"
explanation
"The text says Silas is a retired intelligence agent turned bartender. However, the codex states that he is a bartender turned intelligence operative, implying he retired from the operative role to run the bar."
paragraph
3
substring
"A retired intelligence agent turned bartender."
status
"false_positive"
location
extractedText
"[not found in paragraph 3]"
inBounds
true
expectedText
""
locationAccurate
false
5
parsed
entry
"4415"
detail
"toolbox"
explanation
"The toolbox was a battered steel toolbox with a cracked eyepiece.\" >The text mentions a toolbox, but the codex does not list Rory possessing any toolbox or similar items, only the Heartstone pendant and the Veil Compass."
paragraph
2
substring
"true"
status
"false_positive"
location
extractedText
"[not found in paragraph 2]"
inBounds
true
expectedText
""
locationAccurate
false
6
parsed
entry
"4416"
detail
"browColor"
explanation
"The text describes Detective Harlow Quinn's eyes as light brown, but the codex states they are sharp grey."
paragraph
2
substring
"Her light brown eyes were half-lidded, the lines of her face tight"
status
"false_positive"
location
extractedText
"[not found in paragraph 2]"
inBounds
true
expectedText
""
locationAccurate
false
7
parsed
entry
"4416"
detail
"walkingStick"
explanation
"The text description of Maggie's walking stick (presumably referring to Harlow Quinn since it comes after her) does not match the codex. The codex describes it as a blackthorn walking stick with no mention of strange sigils or power."
paragraph
3
status
"false_positive"
location
extractedText
(null)
inBounds
false
expectedText
""
locationAccurate
(null)
8
parsed
entry
"4417"
detail
"signetRing"
explanation
"The text says Rory's signet ring is red hot, but the codex does not mention the ring having this property, only that it is a silver ring worn on her right hand."
paragraph
4
status
"false_positive"
location
extractedText
(null)
inBounds
false
expectedText
"his scarred right forearm"
locationAccurate
(null)
closestExpected
entry
"4417"
detail
"scar"
summary
"Tomás has a scar on his left forearm per the codex, but the passage says right forearm."
"The text describes Kai's cane as being empty with runic markings, but the codex states that Kai does not have a cane and his primary tool is his noise-cancelling headphones. He carries surveillance equipment in his bag."
paragraph
5
status
"false_positive"
location
extractedText
(null)
inBounds
false
expectedText
"their glowing blue eyes"
locationAccurate
(null)
closestExpected
entry
"4418"
detail
"eyeColor"
summary
"Nyx has violet eyes per the codex, but the passage says blue eyes."
"The text description of Maggie's walking stick does not match the codex. The codex describes it as a blackthorn walking stick with no mention of strange sigils or power, only an ornate silver collar with hanging charms."
paragraph
1
status
"false_positive"
location
extractedText
(null)
inBounds
false
expectedText
"her keen green eyes"
locationAccurate
(null)
closestExpected
entry
"4419"
detail
"eyeColor"
summary
"Maggie has sharp grey eyes per the codex, but the passage says green eyes."
"The text describes Kai's headphones as black, but the codex states they are neon blue with frayed ends and a blinking LED light that pulses in time with his heartbeat, reflecting his biological aspects."
paragraph
2
status
"false_positive"
location
extractedText
(null)
inBounds
false
expectedText
"His natural black hair"
locationAccurate
(null)
closestExpected
entry
"4420"
detail
"hair"
summary
"Kai has dyed electric-blue hair per the codex, but the passage says natural black hair."
"The text refers to the sewers as tunnels, but the codex says the tunnels are the unmapped labyrinthine caverns of Avaros where Mammon's coins constantly resound."
paragraph
3
status
"false_positive"
location
extractedText
(null)
inBounds
false
expectedText
""
locationAccurate
(null)
0.0000%
Precision
True positives: 0/13
totalReported
13
truePositives
0
reportedDetails
0
parsed
entry
"4411"
detail
"eyeColor"
explanation
"The text says the Frenchman's eyes are heterochromatic — amber and black, but the codex says amber and black, with no mention of heterochromia."
paragraph
1
substring
"His heterochromatic eyes — one amber, one black"
status
"false_positive"
location
extractedText
"[not found in paragraph 1]"
inBounds
true
expectedText
"their glowing blue eyes"
locationAccurate
false
closestExpected
entry
"4418"
detail
"eyeColor"
summary
"Nyx has violet eyes per the codex, but the passage says blue eyes."
reason
"entry mismatch: got \"4411\", expected \"4418\""
1
parsed
entry
"4412"
detail
"hair"
explanation
"The text describes Rory's hair as fashionably cut, but the codex refers to her hair as straight, shoulder-length black hair with no mention of a specific cut or style."
paragraph
2
substring
"Her fashionably cut black hair"
status
"false_positive"
location
extractedText
"[not found in paragraph 2]"
inBounds
true
expectedText
"His natural black hair"
locationAccurate
false
closestExpected
entry
"4420"
detail
"hair"
summary
"Kai has dyed electric-blue hair per the codex, but the passage says natural black hair."
reason
"entry mismatch: got \"4412\", expected \"4420\""
2
parsed
entry
"4412"
detail
"description"
explanation
"The text says Rory speaks four languages fluently, but the codex lists three: English, Spanish, and French, plus one were mentioned as unknown."
paragraph
3
substring
"She speaks four languages fluently — English, Spanish, French."
status
"false_positive"
location
extractedText
"[not found in paragraph 3]"
inBounds
true
expectedText
""
locationAccurate
false
3
parsed
entry
"4413"
detail
"beardStyle"
explanation
"The text describes Silas' beard as having ginger streaks and being neatly brushed, but the codex only mentions that he has a neat beard, not a specific style or color."
paragraph
3
substring
"color with ginger streaks, neatly brushed"
status
"false_positive"
location
extractedText
"[not found in paragraph 3]"
inBounds
true
expectedText
""
locationAccurate
false
4
parsed
entry
"4413"
detail
"background"
explanation
"The text says Silas is a retired intelligence agent turned bartender. However, the codex states that he is a bartender turned intelligence operative, implying he retired from the operative role to run the bar."
paragraph
3
substring
"A retired intelligence agent turned bartender."
status
"false_positive"
location
extractedText
"[not found in paragraph 3]"
inBounds
true
expectedText
""
locationAccurate
false
5
parsed
entry
"4415"
detail
"toolbox"
explanation
"The toolbox was a battered steel toolbox with a cracked eyepiece.\" >The text mentions a toolbox, but the codex does not list Rory possessing any toolbox or similar items, only the Heartstone pendant and the Veil Compass."
paragraph
2
substring
"true"
status
"false_positive"
location
extractedText
"[not found in paragraph 2]"
inBounds
true
expectedText
""
locationAccurate
false
6
parsed
entry
"4416"
detail
"browColor"
explanation
"The text describes Detective Harlow Quinn's eyes as light brown, but the codex states they are sharp grey."
paragraph
2
substring
"Her light brown eyes were half-lidded, the lines of her face tight"
status
"false_positive"
location
extractedText
"[not found in paragraph 2]"
inBounds
true
expectedText
""
locationAccurate
false
7
parsed
entry
"4416"
detail
"walkingStick"
explanation
"The text description of Maggie's walking stick (presumably referring to Harlow Quinn since it comes after her) does not match the codex. The codex describes it as a blackthorn walking stick with no mention of strange sigils or power."
paragraph
3
status
"false_positive"
location
extractedText
(null)
inBounds
false
expectedText
""
locationAccurate
(null)
8
parsed
entry
"4417"
detail
"signetRing"
explanation
"The text says Rory's signet ring is red hot, but the codex does not mention the ring having this property, only that it is a silver ring worn on her right hand."
paragraph
4
status
"false_positive"
location
extractedText
(null)
inBounds
false
expectedText
"his scarred right forearm"
locationAccurate
(null)
closestExpected
entry
"4417"
detail
"scar"
summary
"Tomás has a scar on his left forearm per the codex, but the passage says right forearm."
"The text describes Kai's cane as being empty with runic markings, but the codex states that Kai does not have a cane and his primary tool is his noise-cancelling headphones. He carries surveillance equipment in his bag."
paragraph
5
status
"false_positive"
location
extractedText
(null)
inBounds
false
expectedText
"their glowing blue eyes"
locationAccurate
(null)
closestExpected
entry
"4418"
detail
"eyeColor"
summary
"Nyx has violet eyes per the codex, but the passage says blue eyes."
"The text description of Maggie's walking stick does not match the codex. The codex describes it as a blackthorn walking stick with no mention of strange sigils or power, only an ornate silver collar with hanging charms."
paragraph
1
status
"false_positive"
location
extractedText
(null)
inBounds
false
expectedText
"her keen green eyes"
locationAccurate
(null)
closestExpected
entry
"4419"
detail
"eyeColor"
summary
"Maggie has sharp grey eyes per the codex, but the passage says green eyes."
"The text describes Kai's headphones as black, but the codex states they are neon blue with frayed ends and a blinking LED light that pulses in time with his heartbeat, reflecting his biological aspects."
paragraph
2
status
"false_positive"
location
extractedText
(null)
inBounds
false
expectedText
"His natural black hair"
locationAccurate
(null)
closestExpected
entry
"4420"
detail
"hair"
summary
"Kai has dyed electric-blue hair per the codex, but the passage says natural black hair."
"The text refers to the sewers as tunnels, but the codex says the tunnels are the unmapped labyrinthine caverns of Avaros where Mammon's coins constantly resound."