"2026-02-16T01:58:38.944278+00:00"2/16/2026, 1:58:38 AM
model
"z-ai/glm-4.6"4/6/2001, 12:00:00 AM
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
288
moderation_latency
(null)
generation_time
13149
tokens_prompt
6574
tokens_completion
657
native_tokens_prompt
6432
native_tokens_completion
670
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
6400
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.00169155999552
router
(null)
provider_responses
0
id
"chatcmpl-RvRASF65emCAzS9rL3U9e9jG"
status
200
is_byok
false
latency
100
endpoint_id
"c8607edc-8577-4199-b03d-1213da4743dc"
provider_name
"DeepInfra"
model_permaslug
"z-ai/glm-4.6"4/6/2001, 12:00:00 AM
api_type
"completions"
id
"gen-1771207105-93UJZr0Nrdrf9h8941xa"
upstream_id
"chatcmpl-RvRASF65emCAzS9rL3U9e9jG"
total_cost
0.00169155999552
cache_discount
0.00224000000448
upstream_inference_cost
0
provider_name
"DeepInfra"
Evaluation details
Result
Evaluator
Details
Meta Data
15.0000%
Accuracy (recall)
Matched: 2/10, FP: 1
parsedCount
3
matched
2
total
10
falsePositives
1
expectedDetails
0
expected
entry
"861"
detail
"parkLocation"
summary
"The Fae Grove is in Richmond Park per the codex, but the passage places it in Hyde Park."
status
"matched"
matchedBy
entry
"861"
detail
"parkLocation"
explanation
"The codex states the Fae Grove is located in Richmond Park, not Hyde Park."
paragraph
1
substring
"The Fae Grove in Hyde Park"
location
extractedText
"The Fae Grove in Hyde Park"
inBounds
true
expectedText
"The Fae Grove in Hyde Park"
locationAccurate
true
1
expected
entry
"4424"
detail
"eyeColor"
summary
"Isolde has pale lavender eyes per the codex, but the passage says pale blue eyes."
status
"matched"
matchedBy
entry
"4424"
detail
"eyeColor"
explanation
"The codex states Isolde's eyes are pale lavender, not pale blue."
paragraph
1
substring
"Her pale blue eyes"
location
extractedText
"Her pale blue eyes"
inBounds
true
expectedText
"Her pale blue eyes settled on Aurora"
locationAccurate
true
2
expected
entry
"2005"
detail
"containerColor"
summary
"Dream Dust is stored in cobalt-blue glass vials per the codex, but Isolde says red glass vials."
status
"missed"
3
expected
entry
"6003"
detail
"master"
summary
"The Somnian Cult serves Prince Asmodeus per the codex, but Isolde says their master is Prince Lilith."
status
"missed"
4
expected
entry
"4422"
detail
"eyeColor"
summary
"Father Cormac has pale blue eyes per the codex, but the passage says dark brown eyes."
status
"missed"
5
expected
entry
"6004"
detail
"headquarters"
summary
"The Parish Guard is headquartered at St. Brigid's Church, Islington per the codex, but Cormac says their cathedral in Southwark."
status
"missed"
nearMiss
parsed
entry
"6002"
detail
"headquarters"
explanation
"The text implies the Crimson Court is active, but the codex states their headquarters are in Dymas, Hel. The text doesn't contradict this directly, but the context implies Earth-based activity which is their operation, not headquarters. Let's re-read. Ah, no, the text says \"Their servants spread Dream Dust\". This aligns with their operations. No violation here. Let's re-check the next part."
paragraph
2
substring
"The Crimson Court stirs"
reason
"entry mismatch: got \"6002\", expected \"6004\""
6
expected
entry
"4421"
detail
"tattoo"
summary
"Yasmin's flame serpent tattoo is on her left arm per the codex, but the passage says right arm."
status
"missed"
7
expected
entry
"4423"
detail
"tattoo"
summary
"Wei-Lin's dragon tattoo covers his entire back per the codex, but the passage places it on his chest."
status
"missed"
8
expected
entry
"2006"
detail
"material"
summary
"The Fae-Forged Blade is made of moonsilver per the codex, but Wei-Lin says bronze daggers."
status
"missed"
9
expected
entry
"2006"
detail
"temperature"
summary
"The Fae-Forged Blade is always cold to the touch per the codex, but Aurora feels it warm."
status
"missed"
falsePositiveDetails
0
parsed
entry
"6002"
detail
"headquarters"
explanation
"The text implies the Crimson Court is active, but the codex states their headquarters are in Dymas, Hel. The text doesn't contradict this directly, but the context implies Earth-based activity which is their operation, not headquarters. Let's re-read. Ah, no, the text says \"Their servants spread Dream Dust\". This aligns with their operations. No violation here. Let's re-check the next part."
paragraph
2
substring
"The Crimson Court stirs"
status
"false_positive"
location
extractedText
"The Crimson Court stirs"
inBounds
true
expectedText
"our cathedral in Southwark"
locationAccurate
false
closestExpected
entry
"6004"
detail
"headquarters"
summary
"The Parish Guard is headquartered at St. Brigid's Church, Islington per the codex, but Cormac says their cathedral in Southwark."
reason
"entry mismatch: got \"6002\", expected \"6004\""
66.6667%
Precision
True positives: 2/3
totalReported
3
truePositives
2
reportedDetails
0
parsed
entry
"861"
detail
"parkLocation"
explanation
"The codex states the Fae Grove is located in Richmond Park, not Hyde Park."
paragraph
1
substring
"The Fae Grove in Hyde Park"
status
"true_positive"
matchedExpected
entry
"861"
detail
"parkLocation"
summary
"The Fae Grove is in Richmond Park per the codex, but the passage places it in Hyde Park."
location
extractedText
"The Fae Grove in Hyde Park"
inBounds
true
expectedText
"The Fae Grove in Hyde Park"
locationAccurate
true
1
parsed
entry
"4424"
detail
"eyeColor"
explanation
"The codex states Isolde's eyes are pale lavender, not pale blue."
paragraph
1
substring
"Her pale blue eyes"
status
"true_positive"
matchedExpected
entry
"4424"
detail
"eyeColor"
summary
"Isolde has pale lavender eyes per the codex, but the passage says pale blue eyes."
location
extractedText
"Her pale blue eyes"
inBounds
true
expectedText
"Her pale blue eyes settled on Aurora"
locationAccurate
true
2
parsed
entry
"6002"
detail
"headquarters"
explanation
"The text implies the Crimson Court is active, but the codex states their headquarters are in Dymas, Hel. The text doesn't contradict this directly, but the context implies Earth-based activity which is their operation, not headquarters. Let's re-read. Ah, no, the text says \"Their servants spread Dream Dust\". This aligns with their operations. No violation here. Let's re-check the next part."
paragraph
2
substring
"The Crimson Court stirs"
status
"false_positive"
location
extractedText
"The Crimson Court stirs"
inBounds
true
expectedText
"our cathedral in Southwark"
locationAccurate
false
closestExpected
entry
"6004"
detail
"headquarters"
summary
"The Parish Guard is headquartered at St. Brigid's Church, Islington per the codex, but Cormac says their cathedral in Southwark."