"2026-02-16T00:47:00.502487+00:00"2/16/2026, 12:47:00 AM
model
"thedrummer/rocinante-12b"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
603
moderation_latency
(null)
generation_time
6567
tokens_prompt
7841
tokens_completion
459
native_tokens_prompt
7821
native_tokens_completion
468
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.00218925
router
(null)
provider_responses
0
id
"chatcmpl-73391df7-ffdb-4773-a867-42edb662e7ad"
status
200
is_byok
false
latency
102
endpoint_id
"caf29916-6adb-45f8-b895-dd863415d3ed"
provider_name
"Infermatic"
model_permaslug
"thedrummer/rocinante-12b"
api_type
"completions"
id
"gen-1771202813-MupNZEpruochy4wqNPTD"
upstream_id
"chatcmpl-73391df7-ffdb-4773-a867-42edb662e7ad"
total_cost
0.00218925
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Infermatic"
Evaluation details
Result
Evaluator
Details
Meta Data
0.0000%
Accuracy (recall)
Matched: 0/30, FP: 7
parsedCount
7
matched
0
total
30
falsePositives
7
expectedDetails
0
expected
entry
"861"
detail
"parkLocation"
summary
"The Fae Grove is in Richmond Park per codex, but the passage says Hyde Park."
status
"missed"
1
expected
entry
"861"
detail
"standingStones"
summary
"The grove has oak standing stones per codex, but the passage says elm."
status
"missed"
2
expected
entry
"4424"
detail
"eyeColor"
summary
"Isolde has pale lavender eyes per codex, but the passage says pale blue eyes."
status
"missed"
3
expected
entry
"4424"
detail
"footprints"
summary
"Isolde leaves no footprints per codex, but the passage says she leaves clear prints."
status
"missed"
4
expected
entry
"2006"
detail
"temperature"
summary
"The Fae-Forged Blade is always cold per codex, but the passage says warm."
status
"missed"
5
expected
entry
"4414"
detail
"glasses"
summary
"Eva wears round glasses per codex, but the passage says square glasses."
status
"missed"
6
expected
entry
"2005"
detail
"containerColor"
summary
"Dream Dust is stored in cobalt-blue vials per codex, but Isolde says red glass vials."
status
"missed"
7
expected
entry
"2005"
detail
"sealMaterial"
summary
"Dream Dust vials are sealed with black wax per codex, but Isolde says white wax."
status
"missed"
8
expected
entry
"6003"
detail
"master"
summary
"The Somnian Cult serves Prince Asmodeus per codex, but Isolde says Prince Lilith."
status
"missed"
nearMiss
parsed
entry
"6003"
detail
"Goes by a different name"
explanation
"The cult members don't go by 'Somnians', they go by more common names outside of the cult, when referring to themselves or others."
paragraph
4
substring
"Somnians"
reason
"detail mismatch: got \"Goes by a different name\", expected \"master\""
9
expected
entry
"4422"
detail
"eyeColor"
summary
"Father Cormac has pale blue eyes per codex, but the passage says dark brown eyes."
status
"missed"
nearMiss
parsed
entry
"4422"
detail
"Needs an apartment number."
explanation
"Father Cormac is meeting with representatives of the Parish Guard in an apartment that belonged to his family. It is not mentioned which apartment building this was or what floor it was on."
paragraph
4
substring
"Father Cormac, alert the Parish Guard."
reason
"detail mismatch: got \"Needs an apartment number.\", expected \"eyeColor\""
10
expected
entry
"4422"
detail
"rosary"
summary
"Cormac carries a rowan wood rosary per codex, but the passage says cedar."
status
"missed"
nearMiss
parsed
entry
"4422"
detail
"Needs an apartment number."
explanation
"Father Cormac is meeting with representatives of the Parish Guard in an apartment that belonged to his family. It is not mentioned which apartment building this was or what floor it was on."
paragraph
4
substring
"Father Cormac, alert the Parish Guard."
reason
"detail mismatch: got \"Needs an apartment number.\", expected \"rosary\""
11
expected
entry
"7002"
detail
"signedYear"
summary
"The Covenant of Separation was signed in 1215 per codex, but Cormac says 1066."
status
"missed"
12
expected
entry
"6004"
detail
"headquarters"
summary
"The Parish Guard HQ is St. Brigid's in Islington per codex, but Cormac says Southwark."
status
"missed"
nearMiss
parsed
entry
"6004"
detail
"Goes by a different name"
explanation
"The Parish Guard have no specific name that they are referred to outside of the church, they are part of the church itself and do not have an individual name like this."
paragraph
5
substring
"the Guard"
reason
"detail mismatch: got \"Goes by a different name\", expected \"headquarters\""
13
expected
entry
"4415"
detail
"cane"
summary
"Lucien carries an ivory-handled cane per codex, but the passage says mahogany."
status
"missed"
14
expected
entry
"4415"
detail
"eyeColor"
summary
"Lucien has heterochromatic eyes (one amber, one black), but the passage says both amber."
status
"missed"
15
expected
entry
"4421"
detail
"tattoo"
summary
"Yasmin's flame serpent tattoo is on her left arm per codex, but the passage says right arm."
status
"missed"
16
expected
entry
"4423"
detail
"tattoo"
summary
"Wei-Lin's dragon tattoo covers his back per codex, but the passage says chest."
status
"missed"
17
expected
entry
"2006"
detail
"material"
summary
"Fae-Forged Blades are moonsilver per codex, but Wei-Lin says bronze."
status
"missed"
18
expected
entry
"856"
detail
"currentLocation"
summary
"The Veil Market is under Camden per codex, but Wei-Lin says Shoreditch."
status
"missed"
19
expected
entry
"4420"
detail
"hair"
summary
"Kai has dyed electric-blue hair per codex, but the passage says natural black hair."
status
"missed"
20
expected
entry
"6006"
detail
"logo"
summary
"Blackthorn Security's logo is a thorned branch inside a shield per codex, but Kai says a sword inside a circle."
status
"missed"
21
expected
entry
"4419"
detail
"walkingStick"
summary
"Maggie carries a blackthorn stick per codex, but the passage says oak."
status
"missed"
22
expected
entry
"4419"
detail
"eyeColor"
summary
"Maggie has grey eyes per codex, but the passage says green."
status
"missed"
23
expected
entry
"6001"
detail
"foundingYear"
summary
"The Wardens were founded in 1215 per codex, but Maggie says 1066."
status
"missed"
nearMiss
parsed
entry
"6001"
detail
"Goes by a different name"
explanation
"The Wardens of the Veil don't go by 'Wardens', they go by 'Veil Wardens'."
paragraph
2
substring
"Warden"
reason
"detail mismatch: got \"Goes by a different name\", expected \"foundingYear\""
24
expected
entry
"4417"
detail
"scar"
summary
"Tomás has a scar on his left forearm per codex, but the passage says right forearm."
status
"missed"
25
expected
entry
"4417"
detail
"birthplace"
summary
"Tomás was born in Seville per codex, but the passage implies Madrid accent."
status
"missed"
26
expected
entry
"4418"
detail
"eyeColor"
summary
"Nyx has violet eyes per codex, but the passage says blue."
status
"missed"
27
expected
entry
"2001"
detail
"chainMaterial"
summary
"The Heartstone Pendant has a silver chain per codex, but the passage says golden chain."
status
"missed"
28
expected
entry
"2001"
detail
"origin"
summary
"The Heartstone Pendant was forged in Dymas per codex, but Isolde says it was forged in Avaros."
status
"missed"
29
expected
entry
"855"
detail
"ruler"
summary
"Avaros is Prince Mammon's realm per codex, but Tomás says Prince Belphegor's agents operate there."
status
"missed"
falsePositiveDetails
0
parsed
entry
"6001"
detail
"Goes by a different name"
explanation
"The Wardens of the Veil don't go by 'Wardens', they go by 'Veil Wardens'."
paragraph
2
substring
"Warden"
status
"false_positive"
location
extractedText
"[not found in paragraph 2]"
inBounds
true
expectedText
"The Wardens were founded in 1066"
locationAccurate
false
closestExpected
entry
"6001"
detail
"foundingYear"
summary
"The Wardens were founded in 1215 per codex, but Maggie says 1066."
reason
"detail mismatch: got \"Goes by a different name\", expected \"foundingYear\""
1
parsed
entry
"6002"
detail
"Goes by a different name"
explanation
"The demon aristocracy doesn't go by 'Crimson Court', they go by the more formal 'Court'."
paragraph
3
substring
"Crimson Court"
status
"false_positive"
location
extractedText
"Crimson Court"
inBounds
true
expectedText
""
locationAccurate
true
2
parsed
entry
"6003"
detail
"Goes by a different name"
explanation
"The cult members don't go by 'Somnians', they go by more common names outside of the cult, when referring to themselves or others."
paragraph
4
substring
"Somnians"
status
"false_positive"
location
extractedText
"[not found in paragraph 4]"
inBounds
true
expectedText
"Prince Lilith, demands more dreamers"
locationAccurate
false
closestExpected
entry
"6003"
detail
"master"
summary
"The Somnian Cult serves Prince Asmodeus per codex, but Isolde says Prince Lilith."
reason
"detail mismatch: got \"Goes by a different name\", expected \"master\""
3
parsed
entry
"6004"
detail
"Goes by a different name"
explanation
"The Parish Guard have no specific name that they are referred to outside of the church, they are part of the church itself and do not have an individual name like this."
paragraph
5
substring
"the Guard"
status
"false_positive"
location
extractedText
"[not found in paragraph 5]"
inBounds
true
expectedText
"our cathedral in Southwark"
locationAccurate
false
closestExpected
entry
"6004"
detail
"headquarters"
summary
"The Parish Guard HQ is St. Brigid's in Islington per codex, but Cormac says Southwark."
reason
"detail mismatch: got \"Goes by a different name\", expected \"headquarters\""
4
parsed
entry
"6005"
detail
"Goes by a different name"
explanation
"Blackthorn Security is referred to as 'Blackthorn', they don't go by 'BS', that's too casual for their motivations and methods expressed in the codex."
paragraph
6
substring
"Blackthorn"
status
"false_positive"
location
extractedText
"[not found in paragraph 6]"
inBounds
true
expectedText
""
locationAccurate
false
5
parsed
entry
"4416"
detail
"Eyes color is one detail missing."
explanation
"It is incorrectly stated that Detective Harlow Quinn's eyes are dark brown when the codex explicitly states that her eyes are brown."
paragraph
7
substring
"His dark brown eyes were troubled."
status
"false_positive"
location
extractedText
"[not found in paragraph 7]"
inBounds
true
expectedText
""
locationAccurate
false
6
parsed
entry
"4422"
detail
"Needs an apartment number."
explanation
"Father Cormac is meeting with representatives of the Parish Guard in an apartment that belonged to his family. It is not mentioned which apartment building this was or what floor it was on."
paragraph
4
substring
"Father Cormac, alert the Parish Guard."
status
"false_positive"
location
extractedText
"[not found in paragraph 4]"
inBounds
true
expectedText
"his dark brown eyes troubled"
locationAccurate
false
closestExpected
entry
"4422"
detail
"eyeColor"
summary
"Father Cormac has pale blue eyes per codex, but the passage says dark brown eyes."
reason
"detail mismatch: got \"Needs an apartment number.\", expected \"eyeColor\""
0.0000%
Precision
True positives: 0/7
totalReported
7
truePositives
0
reportedDetails
0
parsed
entry
"6001"
detail
"Goes by a different name"
explanation
"The Wardens of the Veil don't go by 'Wardens', they go by 'Veil Wardens'."
paragraph
2
substring
"Warden"
status
"false_positive"
location
extractedText
"[not found in paragraph 2]"
inBounds
true
expectedText
"The Wardens were founded in 1066"
locationAccurate
false
closestExpected
entry
"6001"
detail
"foundingYear"
summary
"The Wardens were founded in 1215 per codex, but Maggie says 1066."
reason
"detail mismatch: got \"Goes by a different name\", expected \"foundingYear\""
1
parsed
entry
"6002"
detail
"Goes by a different name"
explanation
"The demon aristocracy doesn't go by 'Crimson Court', they go by the more formal 'Court'."
paragraph
3
substring
"Crimson Court"
status
"false_positive"
location
extractedText
"Crimson Court"
inBounds
true
expectedText
""
locationAccurate
true
2
parsed
entry
"6003"
detail
"Goes by a different name"
explanation
"The cult members don't go by 'Somnians', they go by more common names outside of the cult, when referring to themselves or others."
paragraph
4
substring
"Somnians"
status
"false_positive"
location
extractedText
"[not found in paragraph 4]"
inBounds
true
expectedText
"Prince Lilith, demands more dreamers"
locationAccurate
false
closestExpected
entry
"6003"
detail
"master"
summary
"The Somnian Cult serves Prince Asmodeus per codex, but Isolde says Prince Lilith."
reason
"detail mismatch: got \"Goes by a different name\", expected \"master\""
3
parsed
entry
"6004"
detail
"Goes by a different name"
explanation
"The Parish Guard have no specific name that they are referred to outside of the church, they are part of the church itself and do not have an individual name like this."
paragraph
5
substring
"the Guard"
status
"false_positive"
location
extractedText
"[not found in paragraph 5]"
inBounds
true
expectedText
"our cathedral in Southwark"
locationAccurate
false
closestExpected
entry
"6004"
detail
"headquarters"
summary
"The Parish Guard HQ is St. Brigid's in Islington per codex, but Cormac says Southwark."
reason
"detail mismatch: got \"Goes by a different name\", expected \"headquarters\""
4
parsed
entry
"6005"
detail
"Goes by a different name"
explanation
"Blackthorn Security is referred to as 'Blackthorn', they don't go by 'BS', that's too casual for their motivations and methods expressed in the codex."
paragraph
6
substring
"Blackthorn"
status
"false_positive"
location
extractedText
"[not found in paragraph 6]"
inBounds
true
expectedText
""
locationAccurate
false
5
parsed
entry
"4416"
detail
"Eyes color is one detail missing."
explanation
"It is incorrectly stated that Detective Harlow Quinn's eyes are dark brown when the codex explicitly states that her eyes are brown."
paragraph
7
substring
"His dark brown eyes were troubled."
status
"false_positive"
location
extractedText
"[not found in paragraph 7]"
inBounds
true
expectedText
""
locationAccurate
false
6
parsed
entry
"4422"
detail
"Needs an apartment number."
explanation
"Father Cormac is meeting with representatives of the Parish Guard in an apartment that belonged to his family. It is not mentioned which apartment building this was or what floor it was on."
paragraph
4
substring
"Father Cormac, alert the Parish Guard."
status
"false_positive"
location
extractedText
"[not found in paragraph 4]"
inBounds
true
expectedText
"his dark brown eyes troubled"
locationAccurate
false
closestExpected
entry
"4422"
detail
"eyeColor"
summary
"Father Cormac has pale blue eyes per codex, but the passage says dark brown eyes."
reason
"detail mismatch: got \"Needs an apartment number.\", expected \"eyeColor\""