"2026-02-16T00:43:00.174193+00:00"2/16/2026, 12:43:00 AM
model
"meta-llama/llama-3.1-70b-instruct"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
978
moderation_latency
(null)
generation_time
3184
tokens_prompt
6618
tokens_completion
586
native_tokens_prompt
6439
native_tokens_completion
563
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.0028008
router
(null)
provider_responses
0
id
"oXY7BGZ-62bZhn-9ce90207ba0db395"
status
200
is_byok
false
latency
882
endpoint_id
"c0841471-73f1-4511-b47f-ac2643802026"
provider_name
"Hyperbolic"
model_permaslug
"meta-llama/llama-3.1-70b-instruct"
api_type
"completions"
id
"gen-1771202576-MKmf3V6pM5E6vUgyw2EQ"
upstream_id
"oXY7BGZ-62bZhn-9ce90207ba0db395"
total_cost
0.0028008
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Hyperbolic"
Evaluation details
Result
Evaluator
Details
Meta Data
35.0000%
Accuracy (recall)
Matched: 5/10, FP: 3
parsedCount
8
matched
5
total
10
falsePositives
3
expectedDetails
0
expected
entry
"861"
detail
"parkLocation"
summary
"The Fae Grove is in Richmond Park per the codex, but the passage places it in Hyde Park."
status
"missed"
nearMiss
parsed
entry
"829"
detail
"location"
explanation
"The text says The Fae Grove is in Hyde Park, but the codex states it's located in Richmond Park."
paragraph
1
substring
"The Fae Grove in Hyde Park"
reason
"entry mismatch: got \"829\", expected \"861\""
1
expected
entry
"4424"
detail
"eyeColor"
summary
"Isolde has pale lavender eyes per the codex, but the passage says pale blue eyes."
status
"matched"
matchedBy
entry
"4424"
detail
"eyeColor"
explanation
"The text says Isolde has pale blue eyes, but the codex says her eye color is pale lavender."
paragraph
1
substring
"her pale blue eyes settled on Aurora"
location
extractedText
"her pale blue eyes settled on Aurora"
inBounds
true
expectedText
"Her pale blue eyes settled on Aurora"
locationAccurate
true
2
expected
entry
"2005"
detail
"containerColor"
summary
"Dream Dust is stored in cobalt-blue glass vials per the codex, but Isolde says red glass vials."
status
"matched"
matchedBy
entry
"2005"
detail
"containerColor"
explanation
"The text says Dream Dust is stored in little red glass vials, but the codex states it's stored in small cobalt-blue glass vials."
substring
"The Crimson Court stirs. Their servants spread Dream Dust through the city — stored in little red glass vials, they tell me."
location
extractedText
(null)
inBounds
false
expectedText
"little red glass vials"
locationAccurate
(null)
3
expected
entry
"6003"
detail
"master"
summary
"The Somnian Cult serves Prince Asmodeus per the codex, but Isolde says their master is Prince Lilith."
status
"missed"
4
expected
entry
"4422"
detail
"eyeColor"
summary
"Father Cormac has pale blue eyes per the codex, but the passage says dark brown eyes."
status
"matched"
matchedBy
entry
"4422"
detail
"eyeColor"
explanation
"The text says Father Cormac has dark brown eyes, but the codex says his eye color is pale blue."
paragraph
2
substring
"his dark brown eyes troubled"
location
extractedText
"[not found in paragraph 2]"
inBounds
true
expectedText
"his dark brown eyes troubled"
locationAccurate
false
5
expected
entry
"6004"
detail
"headquarters"
summary
"The Parish Guard is headquartered at St. Brigid's Church, Islington per the codex, but Cormac says their cathedral in Southwark."
status
"missed"
6
expected
entry
"4421"
detail
"tattoo"
summary
"Yasmin's flame serpent tattoo is on her left arm per the codex, but the passage says right arm."
status
"matched"
matchedBy
entry
"4421"
detail
"tattoo"
explanation
"The text says Yasmin's flame serpent tattoo is on her right arm, but the codex states it's on her left arm."
paragraph
3
substring
"Yasmin uncorked a vial and sniffed it. The flame serpent tattoo on her right arm"
location
extractedText
"[not found in paragraph 3]"
inBounds
true
expectedText
"tattoo on her right arm"
locationAccurate
false
7
expected
entry
"4423"
detail
"tattoo"
summary
"Wei-Lin's dragon tattoo covers his entire back per the codex, but the passage places it on his chest."
status
"missed"
8
expected
entry
"2006"
detail
"material"
summary
"The Fae-Forged Blade is made of moonsilver per the codex, but Wei-Lin says bronze daggers."
status
"matched"
matchedBy
entry
"2006"
detail
"material"
explanation
"The text says the Fae-Forged Blades are bronze daggers, but the codex states the Fae-Forged Blade is made of moonsilver."
substring
"Wei-Lin, leaning against one of the standing stones, folded his tattooed arms. The dragon on his chest was partially visible beneath his open collar. Someone's buying up Fae-Forged Blades — bronze daggers that can cut through wards."
location
extractedText
(null)
inBounds
false
expectedText
"bronze daggers that can cut through wards"
locationAccurate
(null)
9
expected
entry
"2006"
detail
"temperature"
summary
"The Fae-Forged Blade is always cold to the touch per the codex, but Aurora feels it warm."
status
"missed"
falsePositiveDetails
0
parsed
entry
"4420"
detail
"hair"
explanation
"The text says Isolde's hair reaches her waist, but the codex says her hair reaches her waist is incorrect, actually her hair does indeed reach her waist and so this can be considered to be being explained within the bounds of and also accepted to the explanations provided."
paragraph
1
substring
"her waist-length silver hair stirring in a breeze"
status
"false_positive"
location
extractedText
"her waist-length silver hair stirring in a breeze"
inBounds
true
expectedText
""
locationAccurate
true
1
parsed
entry
"829"
detail
"location"
explanation
"The text says The Fae Grove is in Hyde Park, but the codex states it's located in Richmond Park."
paragraph
1
substring
"The Fae Grove in Hyde Park"
status
"false_positive"
location
extractedText
"The Fae Grove in Hyde Park"
inBounds
true
expectedText
"The Fae Grove in Hyde Park"
locationAccurate
true
closestExpected
entry
"861"
detail
"parkLocation"
summary
"The Fae Grove is in Richmond Park per the codex, but the passage places it in Hyde Park."
reason
"entry mismatch: got \"829\", expected \"861\""
2
parsed
entry
"7004"
detail
"Prince"
explanation
"The text says the master of the Somnian Cult is Prince Lilith, but the codex states it's Prince Asmodeus."
substring
"The Somnian Cult grows bolder. Their master, Prince Lilith, demands more dreamers."
status
"false_positive"
location
extractedText
(null)
inBounds
false
expectedText
""
locationAccurate
(null)
62.5000%
Precision
True positives: 5/8
totalReported
8
truePositives
5
reportedDetails
0
parsed
entry
"4424"
detail
"eyeColor"
explanation
"The text says Isolde has pale blue eyes, but the codex says her eye color is pale lavender."
paragraph
1
substring
"her pale blue eyes settled on Aurora"
status
"true_positive"
matchedExpected
entry
"4424"
detail
"eyeColor"
summary
"Isolde has pale lavender eyes per the codex, but the passage says pale blue eyes."
location
extractedText
"her pale blue eyes settled on Aurora"
inBounds
true
expectedText
"Her pale blue eyes settled on Aurora"
locationAccurate
true
1
parsed
entry
"4422"
detail
"eyeColor"
explanation
"The text says Father Cormac has dark brown eyes, but the codex says his eye color is pale blue."
paragraph
2
substring
"his dark brown eyes troubled"
status
"true_positive"
matchedExpected
entry
"4422"
detail
"eyeColor"
summary
"Father Cormac has pale blue eyes per the codex, but the passage says dark brown eyes."
location
extractedText
"[not found in paragraph 2]"
inBounds
true
expectedText
"his dark brown eyes troubled"
locationAccurate
false
2
parsed
entry
"4420"
detail
"hair"
explanation
"The text says Isolde's hair reaches her waist, but the codex says her hair reaches her waist is incorrect, actually her hair does indeed reach her waist and so this can be considered to be being explained within the bounds of and also accepted to the explanations provided."
paragraph
1
substring
"her waist-length silver hair stirring in a breeze"
status
"false_positive"
location
extractedText
"her waist-length silver hair stirring in a breeze"
inBounds
true
expectedText
""
locationAccurate
true
3
parsed
entry
"829"
detail
"location"
explanation
"The text says The Fae Grove is in Hyde Park, but the codex states it's located in Richmond Park."
paragraph
1
substring
"The Fae Grove in Hyde Park"
status
"false_positive"
location
extractedText
"The Fae Grove in Hyde Park"
inBounds
true
expectedText
"The Fae Grove in Hyde Park"
locationAccurate
true
closestExpected
entry
"861"
detail
"parkLocation"
summary
"The Fae Grove is in Richmond Park per the codex, but the passage places it in Hyde Park."
reason
"entry mismatch: got \"829\", expected \"861\""
4
parsed
entry
"4421"
detail
"tattoo"
explanation
"The text says Yasmin's flame serpent tattoo is on her right arm, but the codex states it's on her left arm."
paragraph
3
substring
"Yasmin uncorked a vial and sniffed it. The flame serpent tattoo on her right arm"
status
"true_positive"
matchedExpected
entry
"4421"
detail
"tattoo"
summary
"Yasmin's flame serpent tattoo is on her left arm per the codex, but the passage says right arm."
location
extractedText
"[not found in paragraph 3]"
inBounds
true
expectedText
"tattoo on her right arm"
locationAccurate
false
5
parsed
entry
"2006"
detail
"material"
explanation
"The text says the Fae-Forged Blades are bronze daggers, but the codex states the Fae-Forged Blade is made of moonsilver."
substring
"Wei-Lin, leaning against one of the standing stones, folded his tattooed arms. The dragon on his chest was partially visible beneath his open collar. Someone's buying up Fae-Forged Blades — bronze daggers that can cut through wards."
status
"true_positive"
matchedExpected
entry
"2006"
detail
"material"
summary
"The Fae-Forged Blade is made of moonsilver per the codex, but Wei-Lin says bronze daggers."
location
extractedText
(null)
inBounds
false
expectedText
"bronze daggers that can cut through wards"
locationAccurate
(null)
6
parsed
entry
"7004"
detail
"Prince"
explanation
"The text says the master of the Somnian Cult is Prince Lilith, but the codex states it's Prince Asmodeus."
substring
"The Somnian Cult grows bolder. Their master, Prince Lilith, demands more dreamers."
status
"false_positive"
location
extractedText
(null)
inBounds
false
expectedText
""
locationAccurate
(null)
7
parsed
entry
"2005"
detail
"containerColor"
explanation
"The text says Dream Dust is stored in little red glass vials, but the codex states it's stored in small cobalt-blue glass vials."
substring
"The Crimson Court stirs. Their servants spread Dream Dust through the city — stored in little red glass vials, they tell me."
status
"true_positive"
matchedExpected
entry
"2005"
detail
"containerColor"
summary
"Dream Dust is stored in cobalt-blue glass vials per the codex, but Isolde says red glass vials."