Run: 2026-02-25-01KJ94RSPR8DWW08M58SWF4Z8X

Run Details

Model:
Gemini 2.5 Flash Lite (Reasoning)
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
24.0s
Cost:
$0.001741
Provider:
Google AI Studio

Evaluation summary

Score Evaluator
Details Link
66.67% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Selvi: "Oh, it was so scary! Mere saamne hi woh aadmi tha, and then he just… disappeared! No sound, nothing. I couldn't believe my eyes. Bhut dar lag raha hai!" Hunter: "Excuse me, miss." Hunter: "Detective Hunter. I'm investigating a recent incident down by the old Johnson place. I heard you might have been in the area yesterday evening?" Selvi: "Haan, wohi! Maine dekha! Woh khada tha aur phir gayab ho gaya! Bhoot ho gaya? Bahut dar lag raha hai!" Hunter: "Sorry? What was that? Did you see something... strange?" Hunter: "Look, miss, I don't understand Hindi. Can you speak English? Did you see a person? A man? A struggle? Anything at all?" Selvi: "Dekho, dekho! Yahan tha woh! Jaise yeh ped hai, waise hi woh bhi tha! Phir woh raha nahi! Meri madad karo!" Hunter: "Okay, okay. Let's try this differently. Did you *see* someone?" Hunter: "I'm sorry, I have to go. Something's come up. This is important. We'll talk again. Can you find someone who speaks English, or maybe Hindi? Someone who can translate?"
created_at"2026-02-25T00:56:46.558Z" 2/25/2026, 12:56:46 AM
model"google/gemini-2.5-flash-lite"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency1253
moderation_latency(null)
generation_time23953
tokens_prompt315
tokens_completion4472
native_tokens_prompt289
native_tokens_completion4279
native_tokens_completion_images0
native_tokens_reasoning4008
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"STOP"
usage0.0017405
router(null)
provider_responses
0
endpoint_id"ce839073-aa24-4f29-8358-15b319bd05ec"
is_byokfalse
latency1253
model_permaslug"google/gemini-2.5-flash-lite"
provider_name"Google AI Studio"
status200
api_type"completions"
id"gen-1771981006-N36P6jFlj5ZVHWH31kgf"
upstream_id(null)
total_cost0.0017405
cache_discount(null)
upstream_inference_cost0
provider_name"Google AI Studio"

Evaluation details

Result Evaluator Details Meta Data
66.67% Parse dialogue n/a
dialogue
0
name"Selvi"
dialogue"Oh, it was so scary! Mere saamne hi woh aadmi tha, and then he just… disappeared! No sound, nothing. I couldn't believe my eyes. Bhut dar lag raha hai!"
detectedLang"en"
heavyLang"en"
scores
en0.732620320855615
tl0.47368421052631576
ca0.37733499377334995
yo0.36588459099556125
nl0.35064935064935066
it0.3197278911564626
et0.30118798043326345
no0.299719887955182
sq0.29328621908127206
sk0.26199261992619927
sv0.24981245311327827
vi0.2418498862774829
de0.24127465857359634
es0.2389649923896499
ms0.23371647509578544
da0.22898997686969932
ro0.22839506172839508
pl0.22660479505027067
tr0.21996879875195008
lv0.21875
hr0.1935483870967742
pt0.18765231519090173
fi0.1687448046550291
cs0.1603694374475231
fr0.1589571068124474
lt0.1589571068124474
be0.1452991452991453
sl0.13119026933101652
eu0.12203687445127305
hu0.06279287722586692
az0.059266227657572904
is0.059266227657572904
uk0.059266227657572904
reliabletrue
passesfalse
1
name"Hunter"
dialogue"Excuse me, miss."
detectedLang"en"
heavyLang"es"
scores
en0.6527777777777778
sq0.5967741935483871
es0.504950495049505
tl0.5
et0.48717948717948717
fr0.47643979057591623
no0.47643979057591623
pt0.46808510638297873
sl0.46808510638297873
ms0.45652173913043476
nl0.45652173913043476
it0.4444444444444444
fi0.42857142857142855
reliabletrue
passestrue
2
name"Hunter"
dialogue"Detective Hunter. I'm investigating a recent incident down by the old Johnson place. I heard you might have been in the area yesterday evening?"
detectedLang"en"
heavyLang"en"
scores
en0.8096074985354422
tl0.6699390656736628
ro0.6191406250000001
nl0.5875634517766497
fr0.586864406779661
sv0.5866892751165749
da0.5851063829787234
it0.5547945205479452
no0.5547945205479452
ca0.5262390670553936
cs0.521824423737126
pt0.5197044334975369
de0.4677947598253275
es0.4531688166012339
sk0.43641618497109824
sl0.41371016235718583
sq0.4080145719489982
pl0.3996305418719212
hr0.39777640518838797
yo0.36149312377210213
az0.3298969072164949
ms0.3055555555555556
lt0.2872807017543859
is0.28361498897869214
et0.282560706401766
hu0.2243436754176611
tr0.17442845046570704
lv0.17232597623089985
vi0.12003610108303249
fi0.11121239744758432
be0.06698564593301436
eu0.06698564593301436
uk0.06069364161849711
reliabletrue
passestrue
3
name"Selvi"
dialogue"Haan, wohi! Maine dekha! Woh khada tha aur phir gayab ho gaya! Bhoot ho gaya? Bahut dar lag raha hai!"
detectedLang"ro"
heavyLang"de"
scores
ro0.3877551020408163
et0.336283185840708
de0.27184466019417475
sq0.27007299270072993
pt0.25925925925925924
no0.2583436341161928
fr0.25742574257425743
it0.2555831265508685
tl0.24433249370277077
nl0.23273657289002556
en0.21363040629095675
fi0.21363040629095675
vi0.2073976221928666
lt0.17355371900826447
ca0.16666666666666666
sk0.15611814345991562
cs0.1501416430594901
ms0.14285714285714285
es0.1341991341991342
sv0.1341991341991342
lv0.12790697674418602
reliablefalse
passesfalse
4
name"Hunter"
dialogue"Sorry? What was that? Did you see something... strange?"
detectedLang"en"
heavyLang"en"
scores
en0.8233695652173912
tl0.608433734939759
nl0.48
de0.4715447154471545
et0.4133574007220217
da0.37619961612284064
no0.36893203883495146
it0.3602362204724409
pt0.3538767395626242
cs0.33127572016460904
fr0.3157894736842105
ms0.30257510729613735
hr0.214975845410628
sk0.21307506053268765
sl0.21307506053268765
yo0.2111650485436893
es0.1935483870967742
pl0.1935483870967742
ro0.1875
sv0.181360201511335
lv0.17721518987341772
is0.1709183673469388
lt0.1709183673469388
az0.15364583333333331
sq0.15364583333333331
tr0.15364583333333331
reliabletrue
passestrue
5
name"Hunter"
dialogue"Look, miss, I don't understand Hindi. Can you speak English? Did you see a person? A man? A struggle? Anything at all?"
detectedLang"en"
heavyLang"en"
scores
en0.7979525862068966
tl0.6490407112774919
no0.6033844526705446
da0.5934959349593496
sv0.5479204339963833
de0.4915254237288135
sq0.4755244755244755
it0.43138741470811215
is0.4204018547140649
et0.4172494172494172
ro0.4085173501577287
cs0.40805051302288875
nl0.39123376623376627
hr0.37707641196013286
ca0.37027707808564225
lv0.3333333333333333
pl0.32915921288014316
ms0.32432432432432434
sk0.3181818181818182
az0.3042671614100185
lt0.293119698397738
tr0.2795389048991354
hu0.27606177606177607
pt0.2704280155642024
fr0.25742574257425743
es0.22680412371134018
yo0.21548117154811713
sl0.1657397107897664
vi0.1506228765571914
hi0.09420289855072464
be0.08536585365853659
eu0.08536585365853659
fi0.07749077490774908
uk0.07749077490774908
reliabletrue
passestrue
6
name"Selvi"
dialogue"Dekho, dekho! Yahan tha woh! Jaise yeh ped hai, waise hi woh bhi tha! Phir woh raha nahi! Meri madad karo!"
detectedLang"et"
heavyLang"de"
scores
et0.45369406867845996
tl0.4094488188976378
ca0.2391304347826087
eu0.2391304347826087
vi0.23020527859237538
ms0.2081447963800905
sq0.1822429906542056
fr0.1719242902208202
lt0.16666666666666666
sv0.16666666666666666
it0.16
fi0.1435562805872757
en0.12935323383084577
reliablefalse
passesfalse
7
name"Hunter"
dialogue"Okay, okay. Let's try this differently. Did you see someone?"
detectedLang"en"
heavyLang"en"
scores
en0.7914183551847438
tl0.5021337126600285
it0.3482309124767225
et0.3269230769230769
de0.3110236220472441
cs0.28716904276985744
es0.28716904276985744
fr0.24078091106290672
nl0.2222222222222222
da0.22048997772828507
no0.20634920634920634
sv0.1935483870967742
pt0.1822429906542056
az0.1764705882352941
hr0.16666666666666666
ca0.15254237288135594
lt0.15254237288135594
lv0.15254237288135594
pl0.15254237288135594
sk0.15254237288135594
sl0.15254237288135594
sq0.15254237288135594
reliabletrue
passestrue
8
name"Hunter"
dialogue"I'm sorry, I have to go. Something's come up. This is important. We'll talk again. Can you find someone who speaks English, or maybe Hindi? Someone who can translate?"
detectedLang"en"
heavyLang"en"
scores
en0.7941963366947932
tl0.6130030959752323
it0.44812362030905084
da0.4327850255246738
no0.3796526054590571
ro0.3765586034912718
ca0.37027707808564225
nl0.3634627625716105
hr0.3174061433447099
fr0.31412894375857336
pt0.3127147766323024
pl0.3050729673384294
yo0.2962702322308234
cs0.27166788055353236
sq0.2647058823529412
et0.26199261992619927
es0.26035502958579887
sv0.251497005988024
lt0.23371647509578544
tr0.2248062015503876
sk0.2107340173638516
is0.20191540303272149
lv0.20127795527156547
hu0.18099918099918103
az0.1659716430358632
sl0.15254237288135594
vi0.13119026933101652
de0.12203687445127305
ms0.11582670203359859
hi0.07235621521335807
be0.06542056074766354
eu0.06279287722586692
uk0.059266227657572904
reliabletrue
passestrue