"2026-02-16T01:08:14.944978+00:00"2/16/2026, 1:08:14 AM
model
"google/gemini-2.5-flash-lite"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
273
moderation_latency
(null)
generation_time
1324
tokens_prompt
2275
tokens_completion
317
native_tokens_prompt
2271
native_tokens_completion
331
native_tokens_completion_images
0
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"STOP"
usage
0.0003595
router
(null)
provider_responses
0
status
200
is_byok
false
latency
273
endpoint_id
"ce839073-aa24-4f29-8358-15b319bd05ec"
provider_name
"Google AI Studio"
model_permaslug
"google/gemini-2.5-flash-lite"
api_type
"completions"
id
"gen-1771204093-2KnDeGjv0JO2DNUn3MrS"
upstream_id
(null)
total_cost
0.0003595
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Google AI Studio"
Evaluation details
Result
Evaluator
Details
Meta Data
58.3333%
Accuracy (recall)
Matched: 4/6, FP: 1
parsedCount
5
matched
4
total
6
falsePositives
1
expectedDetails
0
expected
entry
"855"
detail
"ruler"
summary
"Avaros is Prince Mammon's realm per the codex, but Eva says it is Prince Belphegor's domain."
status
"matched"
matchedBy
entry
"855"
detail
"ruler"
explanation
"The codex states that Prince Mammon rules Avaros, not Prince Belphegor."
paragraph
3
substring
"Prince Belphegor's domain of greed"
location
extractedText
"[not found in paragraph 3]"
inBounds
true
expectedText
"Prince Belphegor's domain of greed"
locationAccurate
false
1
expected
entry
"4415"
detail
"eyeColor"
summary
"Lucien has one amber eye and one black eye (heterochromia), but the passage says both his amber eyes."
status
"matched"
matchedBy
entry
"4415"
detail
"eyeColor"
explanation
"The codex states Lucien Moreau has heterochromatic eyes—one amber, one black. The text implies both his eyes are amber."
paragraph
3
substring
"both his amber eyes narrowed in concentration"
location
extractedText
"[not found in paragraph 3]"
inBounds
true
expectedText
"both his amber eyes narrowed"
locationAccurate
false
2
expected
entry
"2002"
detail
"origin"
summary
"The Ledger of Debts originates from Avaros per its codex entry, but Eva says it came from Dymas."
status
"matched"
matchedBy
entry
"2002"
detail
"origin"
explanation
"The text states The Ledger of Debts came from Dymas, but the codex states its origin is Avaros."
paragraph
4
substring
"And it originally came from Dymas, not Avaros"
location
extractedText
"And it originally came from Dymas, not Avaros"
inBounds
true
expectedText
"it originally came from Dymas, not Avaros"
locationAccurate
true
3
expected
entry
"4416"
detail
"eyeColor"
summary
"Detective Quinn has brown eyes per her codex entry, but the passage says blue eyes."
status
"missed"
4
expected
entry
"4416"
detail
"hair"
summary
"Detective Quinn has salt-and-pepper hair per her codex entry, but the passage says blonde hair."
status
"matched"
matchedBy
entry
"4416"
detail
"hair"
explanation
"The codex states Detective Harlow Quinn has closely cropped salt-and-pepper hair, not short blonde hair."
paragraph
5
substring
"Her short blonde hair caught the streetlight"
location
extractedText
"Her short blonde hair caught the streetlight"
inBounds
true
expectedText
"Her short blonde hair"
locationAccurate
true
5
expected
entry
"4414"
detail
"glasses"
summary
"Eva wears round glasses per her codex entry, but the passage says square glasses."
status
"missed"
falsePositiveDetails
0
parsed
entry
"853"
detail
"sin"
explanation
"The text incorrectly associates Prince Belphegor and the sin of Greed with Avaros. The codex states Avaros is the domain of Greed and Prince Mammon, while Prince Belphegor rules Dymas, the domain of Gluttony."
paragraph
3
substring
"Avaros. Prince Belphegor's domain of greed"
status
"false_positive"
location
extractedText
"[not found in paragraph 3]"
inBounds
true
expectedText
""
locationAccurate
false
80.0000%
Precision
True positives: 4/5
totalReported
5
truePositives
4
reportedDetails
0
parsed
entry
"855"
detail
"ruler"
explanation
"The codex states that Prince Mammon rules Avaros, not Prince Belphegor."
paragraph
3
substring
"Prince Belphegor's domain of greed"
status
"true_positive"
matchedExpected
entry
"855"
detail
"ruler"
summary
"Avaros is Prince Mammon's realm per the codex, but Eva says it is Prince Belphegor's domain."
location
extractedText
"[not found in paragraph 3]"
inBounds
true
expectedText
"Prince Belphegor's domain of greed"
locationAccurate
false
1
parsed
entry
"853"
detail
"sin"
explanation
"The text incorrectly associates Prince Belphegor and the sin of Greed with Avaros. The codex states Avaros is the domain of Greed and Prince Mammon, while Prince Belphegor rules Dymas, the domain of Gluttony."
paragraph
3
substring
"Avaros. Prince Belphegor's domain of greed"
status
"false_positive"
location
extractedText
"[not found in paragraph 3]"
inBounds
true
expectedText
""
locationAccurate
false
2
parsed
entry
"2002"
detail
"origin"
explanation
"The text states The Ledger of Debts came from Dymas, but the codex states its origin is Avaros."
paragraph
4
substring
"And it originally came from Dymas, not Avaros"
status
"true_positive"
matchedExpected
entry
"2002"
detail
"origin"
summary
"The Ledger of Debts originates from Avaros per its codex entry, but Eva says it came from Dymas."
location
extractedText
"And it originally came from Dymas, not Avaros"
inBounds
true
expectedText
"it originally came from Dymas, not Avaros"
locationAccurate
true
3
parsed
entry
"4416"
detail
"hair"
explanation
"The codex states Detective Harlow Quinn has closely cropped salt-and-pepper hair, not short blonde hair."
paragraph
5
substring
"Her short blonde hair caught the streetlight"
status
"true_positive"
matchedExpected
entry
"4416"
detail
"hair"
summary
"Detective Quinn has salt-and-pepper hair per her codex entry, but the passage says blonde hair."
location
extractedText
"Her short blonde hair caught the streetlight"
inBounds
true
expectedText
"Her short blonde hair"
locationAccurate
true
4
parsed
entry
"4415"
detail
"eyeColor"
explanation
"The codex states Lucien Moreau has heterochromatic eyes—one amber, one black. The text implies both his eyes are amber."
paragraph
3
substring
"both his amber eyes narrowed in concentration"
status
"true_positive"
matchedExpected
entry
"4415"
detail
"eyeColor"
summary
"Lucien has one amber eye and one black eye (heterochromia), but the passage says both his amber eyes."