Run: 2026-02-25-01KJ9516Q2XVQ7QJT97V1MHZNT

Run Details

Model:
Gemini 2.5 Flash Lite (Reasoning)
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
40.0s
Cost:
$0.002450
Provider:
Google AI Studio

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Here is the scene presented as a voice sheet: **Selvi:** "कल शाम? हाँ, मैंने... मैंने देखा। बहुत... बहुत अंधेरा था। और फिर... वह आवाज़! एक दबी हुई चीख। ओह, भगवान! मैं बहुत डर गई थी! मैंने अपना कैमरा उठाया! पर... वे लोग कौन थे? वे कहाँ गए? मैंने उन्हें देखा, हाँ, पर वे... वे बस... चले गए!" **Hunter:** "Excuse me. Detective Hunter. I'm investigating some incidents in town. Did you see anything unusual out by the old creek road yesterday evening?" **Hunter:** "Unusual? What kind of unusual? Hear something? See someone?" **Selvi:** "आवाज़! चीख! लोग! वे अब नहीं हैं! मेरी कैमरा में... यहाँ कुछ है!" **Hunter:** "No, wait. I don't understand. I don't speak Hindi." **(Hunter's phone rings loudly)** **Hunter:** "Damn it. I have to go. Something's come up."
created_at"2026-02-25T01:01:22.024Z" 2/25/2026, 1:01:22 AM
model"google/gemini-2.5-flash-lite"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency1147
moderation_latency(null)
generation_time39962
tokens_prompt315
tokens_completion10481
native_tokens_prompt289
native_tokens_completion6054
native_tokens_completion_images0
native_tokens_reasoning5861
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"STOP"
usage0.0024505
router(null)
provider_responses
0
endpoint_id"ce839073-aa24-4f29-8358-15b319bd05ec"
is_byokfalse
latency1147
model_permaslug"google/gemini-2.5-flash-lite"
provider_name"Google AI Studio"
status200
api_type"completions"
id"gen-1771981282-7rcTMTQboN2GiUMHyNGQ"
upstream_id(null)
total_cost0.0024505
cache_discount(null)
upstream_inference_cost0
provider_name"Google AI Studio"

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Selvi"
dialogue"कल शाम? हाँ, मैंने... मैंने देखा। बहुत... बहुत अंधेरा था। और फिर... वह आवाज़! एक दबी हुई चीख। ओह, भगवान! मैं बहुत डर गई थी! मैंने अपना कैमरा उठाया! पर... वे लोग कौन थे? वे कहाँ गए? मैंने उन्हें देखा, हाँ, पर वे... वे बस... चले गए!"
detectedLang"hi"
heavyLang"hi"
scores
hi0.876385336743393
mr0.865889752127266
reliabletrue
passestrue
1
name"Hunter"
dialogue"Excuse me. Detective Hunter. I'm investigating some incidents in town. Did you see anything unusual out by the old creek road yesterday evening?"
detectedLang"en"
heavyLang"en"
scores
en0.8001230012300123
tl0.6275783040488923
nl0.5651204281891169
ro0.5068285280728376
pt0.48439978847170806
fr0.4827586206896552
it0.4819341126461211
es0.4613259668508287
no0.4494635798983625
sv0.42781690140845074
da0.42341809580130096
sq0.401840490797546
de0.4011056511056511
ca0.4007375537799632
sl0.38986232790988734
ms0.38291139240506333
et0.36399217221135033
cs0.32525951557093424
sk0.2545871559633027
hr0.25287356321839083
az0.2181234963913392
is0.20278004905968927
pl0.17162276975361088
yo0.16666666666666666
lt0.15948275862068964
lv0.14623467600700527
fi0.12082957619477006
tr0.05705996131528047
reliabletrue
passestrue
2
name"Hunter"
dialogue"Unusual? What kind of unusual? Hear something? See someone?"
detectedLang"en"
heavyLang"en"
scores
en0.8109965635738833
et0.5
tl0.4353182751540041
nl0.4258872651356994
de0.3692660550458715
es0.36046511627906974
ms0.36046511627906974
pt0.36046511627906974
yo0.2912371134020619
no0.25474254742547425
is0.2445054945054945
reliabletrue
passestrue
3
name"Selvi"
dialogue"आवाज़! चीख! लोग! वे अब नहीं हैं! मेरी कैमरा में... यहाँ कुछ है!"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8856956237753103
mr0.8808172531214529
reliabletrue
passestrue
4
name"Hunter"
dialogue"No, wait. I don't understand. I don't speak Hindi."
detectedLang"en"
heavyLang"en"
scores
en0.7767857142857143
tl0.6794871794871795
no0.6424314660309893
da0.5945945945945946
sv0.5377503852080123
it0.49748743718592964
pl0.48186528497409326
ca0.47643979057591623
sk0.45652173913043476
hr0.4444444444444444
is0.4392523364485981
sq0.42418426103646834
lv0.39271255060728744
de0.39148073022312374
cs0.38650306748466257
nl0.3723849372384937
ro0.35344827586206895
tr0.34497816593886466
et0.3435448577680525
pt0.3150684931506849
es0.3135011441647597
yo0.2248062015503876
hi0.20634920634920634
be0.1891891891891892
hu0.18256130790190736
az0.17355371900826447
lt0.17355371900826447
uk0.17355371900826447
vi0.17355371900826447
reliabletrue
passestrue
5
name"Hunter"
dialogue"Damn it. I have to go. Something's come up."
detectedLang"en"
heavyLang"en"
scores
en0.7910863509749304
tl0.5774647887323944
da0.5652173913043478
yo0.5568685376661743
pl0.5515695067264574
it0.4800693240901213
lv0.4746059544658494
hr0.4594594594594595
no0.45848375451263534
cs0.44029850746268656
sq0.4230769230769231
sk0.40476190476190477
lt0.3576017130620985
ca0.3150684931506849
sv0.3150684931506849
sl0.28741092636579574
ro0.23076923076923078
es0.20634920634920634
nl0.20634920634920634
pt0.20634920634920634
be0.1891891891891892
tr0.1891891891891892
hu0.18256130790190736
az0.17355371900826447
et0.17355371900826447
is0.17355371900826447
uk0.17355371900826447
vi0.17355371900826447
reliabletrue
passestrue