Run: 2026-07-25-01KYCSW8F42QSQ61S7YGFSEJH6

Run Details

Model:
Gemini 3.6 Flash (Reasoning)
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
13.3s
Cost:
$0.017833
Provider:
Google AI Studio

Evaluation summary

Score Evaluator
Details Link
54.55% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Hunter: "Excuse me, ma'am. Mind if I take a seat? Detective Hunter, Alborn Police Department. I'm investigating the disappearance over near the orchard yesterday evening." Selvi: "Aap... aap police hain? Kripya meri baat suniye! Maine kuch bohot ajeeb dekha hai... mujhko bohot darr lag raha hai!" Hunter: "Whoa, hold on a second. Slow down. I... wait, do you speak English?" Selvi: "Mujhe Angrezi nahi aati! Dekhiye, yeh tasveerein... yeh mera camera hai. Kal raat, bagiche ke paas... woh aadmi ghaayab ho gaya!" Hunter: "I don't understand a word you're saying, ma'am. Hindi? Is that Hindi? Look, just... take a breath. Did you see anything unusual near the festival grounds last night? A man in a brown jacket?" Selvi: "Bagicha? Haan, orchard! Maine wahan tasveerein li thi! Ek dhundh thi... aur phir ek chikh sunai di. Yeh dekhiye!" Hunter: "You're pointing at your camera. Did you take photos? Can you show me?" Selvi: "Haan, haan! Yeh dekhiye, yeh photo. Yeh dhundh ke beech mein... woh aadmi wahan khada tha, aur phir agli photo mein bas uska joota bacha tha!" Hunter: "Let me see that screen... Squinting at this isn't helping much. That just looks like heavy mist to me. Wait... is that a boot lying on the grass?" Selvi: "Joota! Haan, joota! Woh aadmi achanak ghaayab ho gaya, bas uska joota reh gaya! Koi toh tha wahan dhundh mein!" Hunter: "Joota? I don't know what 'joota' means, ma'am. Look, you seem terrified, and you definitely saw *something* out there..." Selvi: "Kripya meri madad kijiye! Woh saaya... woh abhi bhi wahan ho sakta hai. Mujhe akeli jagah par jaane mein darr lag raha hai!" Hunter: "I wish I had my translator app on me, but cell service in Alborn is garbage today. Hold on, let me try to gesture. You... stay... here?" Selvi: "Aap kya keh rahe hain? Mujhe aapki baat samajh nahi aa rahi hai!" Hunter: "Yeah, this isn't working. Dammit." Selvi: "Aap mere saath chaliye, wahan bagiche mein... maine wahan kuch aur bhi dekha tha!" Hunter: "Hunter here... What? Speak up, Dispatch... Another scene found? Down by the old grain silo? I'm two minutes away, hold the perimeter." Hunter: "Look, ma'am, I have to go. That was dispatch. Duty calls." Selvi: "Aap jaa rahe hain? Nahin, nahi, kripya mat jaaiye! Mujhe yahan akele mat chhodiye!" Hunter: "I don't know what you're saying, but stay right here at the cafe. I'll come back with someone from the county station who can translate. Don't leave town, okay?" Selvi: "Aap... aap wapas aayenge na? Kripya jaldi aana!" Hunter: "Just stay put. I'll be back."
created_at"2026-07-25T14:11:45.261Z" 7/25/2026, 2:11:45 PM
model"google/gemini-3.6-flash-20260721"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency1433
moderation_latency(null)
generation_time13254
tokens_prompt302
tokens_completion1188
native_tokens_prompt289
native_tokens_completion2320
native_tokens_completion_images0
native_tokens_reasoning1551
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
num_fetches(null)
web_search_engine(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"STOP"
service_tier"default"
usage0.0178335
router(null)
provider_responses
0
endpoint_id"5d6d133d-a953-4781-a835-7ee76f4e1388"
id"IcRkavP5FJ-d-8YPo9PxsAY"
is_byokfalse
latency1433
model_permaslug"google/gemini-3.6-flash-20260721"
provider_name"Google AI Studio"
status200
user_agent"langchainjs-openai/1.0.0 ((node/v24.18.0; linux; x64))"
http_referer(null)
request_id"req-1784988705-KMg5DlZytqg1ABh8iYAo"
session_id(null)
preset_id(null)
api_type"completions"
id"gen-1784988705-JHJUJ9WHUr5vnK493Vli"
upstream_id"IcRkavP5FJ-d-8YPo9PxsAY"
total_cost0.0178335
cache_discount(null)
upstream_inference_cost0
provider_name"Google AI Studio"
response_cache_source_id(null)
data_region"global"

Evaluation details

Result Evaluator Details Meta Data
54.55% Parse dialogue n/a
dialogue
0
name"Hunter"
dialogue"Excuse me, ma'am. Mind if I take a seat? Detective Hunter, Alborn Police Department. I'm investigating the disappearance over near the orchard yesterday evening."
detectedLang"en"
heavyLang"en"
scores
en0.7578971639382062
tl0.6240601503759399
nl0.5869394177812746
no0.5776347546259051
fr0.5535714285714286
ro0.5476087893149505
it0.5263870094722598
da0.518127581459385
sv0.5058823529411764
pt0.49952335557673977
sq0.48250369640216856
ca0.46673438293550024
es0.44591029023746703
hr0.4360902255639098
de0.4345718901453958
cs0.41699056079955577
sl0.4111048794167134
ms0.40170940170940167
sk0.3708807669263031
et0.3341788205453392
az0.3037135278514589
hu0.29953302201467646
yo0.29292929292929293
lt0.2890995260663507
is0.26880222841225626
pl0.26880222841225626
lv0.21758569299552907
fi0.21111945905334337
tr0.20933734939759033
eu0.13509060955518945
vi0.11242603550295857
be0.0625
uk0.05660377358490566
reliabletrue
passestrue
1
name"Selvi"
dialogue"Aap... aap police hain? Kripya meri baat suniye! Maine kuch bohot ajeeb dekha hai... mujhko bohot darr lag raha hai!"
detectedLang"et"
heavyLang"id"
scores
et0.4434550311665183
fr0.3718592964824121
en0.34963579604578565
ro0.3407172995780591
de0.3272335844994618
it0.2985409652076319
tl0.284077892325315
fi0.28325688073394495
eu0.2707117852975496
no0.23029556650246305
sq0.23029556650246305
cs0.2255266418835192
sv0.2255266418835192
lv0.2206982543640898
tr0.2206982543640898
hr0.21185372005044137
nl0.20685279187817257
sl0.20584498094027956
sk0.20076726342711
vi0.20076726342711
da0.12587412587412586
pl0.12342215988779803
lt0.12219101123595505
ms0.11598302687411598
az0.10714285714285714
es0.10714285714285714
hu0.10714285714285714
ca0.10329985652797705
pt0.10071942446043164
reliablefalse
passesfalse
2
name"Hunter"
dialogue"Whoa, hold on a second. Slow down. I... wait, do you speak English?"
detectedLang"en"
heavyLang"en"
scores
en0.7982854261220373
tl0.5922528032619776
hr0.5703544575725027
cs0.5666305525460456
pl0.5337995337995338
sk0.5055624227441285
da0.4968553459119497
fr0.4968553459119497
ro0.4845360824742268
ca0.48253557567917205
yo0.47299077733860345
it0.47019867549668876
sq0.4467496542185339
no0.4261119081779053
pt0.42528735632183906
et0.4117647058823529
sv0.40564635958395245
vi0.37888198757763975
hu0.3579454253611557
fi0.3474714518760196
sl0.3442622950819672
tr0.2687385740402194
lt0.26605504587155965
nl0.26605504587155965
de0.25788497217068646
is0.25650557620817843
ms0.2523364485981308
az0.24953095684803
lv0.24953095684803
es0.24812030075187969
hi0.17355371900826447
be0.14893617021276595
eu0.14893617021276595
uk0.13606911447084233
reliabletrue
passestrue
3
name"Selvi"
dialogue"Mujhe Angrezi nahi aati! Dekhiye, yeh tasveerein... yeh mera camera hai. Kal raat, bagiche ke paas... woh aadmi ghaayab ho gaya!"
detectedLang"it"
heavyLang"ber"
scores
it0.39883913764510776
ms0.37607573149741824
de0.32745825602968465
ro0.26619433198380565
ca0.23442449841605068
cs0.22376873661670238
no0.2204301075268817
sv0.2050438596491228
tl0.20242024202420242
eu0.18539325842696627
fr0.1844769403824522
nl0.1844769403824522
vi0.17800453514739228
sk0.13277511961722488
es0.12014563106796115
is0.11477411477411477
da0.1082410824108241
yo0.1082410824108241
en0.09488139825218476
reliablefalse
passesfalse
4
name"Hunter"
dialogue"I don't understand a word you're saying, ma'am. Hindi? Is that Hindi? Look, just... take a breath. Did you see anything unusual near the festival grounds last night? A man in a brown jacket?"
detectedLang"en"
heavyLang"en"
scores
en0.8004754627271183
tl0.6786983866557288
sv0.49375269280482553
nl0.48260678115367683
da0.45475638051044076
no0.45016378100140386
et0.4038559107052258
de0.3877019280875456
it0.36895810955961333
sq0.33840090090090086
yo0.3361581920903955
cs0.3327654741624077
ro0.3239355581127733
ca0.3215935334872979
fr0.3215935334872979
ms0.3188405797101449
sl0.3022565320665083
pl0.2795830778663397
hr0.2778119237861094
hu0.27424336009882644
pt0.2623979912115505
sk0.2582070707070707
is0.25491439441978436
es0.2501595405232929
lt0.23701298701298698
az0.2218543046357616
lv0.2055442866801893
tr0.17369901547116737
vi0.10168195718654435
fi0.09684857801691008
hi0.06225059856344772
be0.05622489959839357
eu0.05622489959839357
uk0.050888529886914384
reliabletrue
passestrue
5
name"Selvi"
dialogue"Bagicha? Haan, orchard! Maine wahan tasveerein li thi! Ek dhundh thi... aur phir ek chikh sunai di. Yeh dekhiye!"
detectedLang"ms"
heavyLang"vi"
scores
ms0.5219546742209632
tl0.38016528925619836
ro0.32567432567432564
de0.30769230769230765
fr0.29540709812108557
it0.28038379530916846
nl0.28038379530916846
vi0.27184466019417475
fi0.2710583153347732
en0.2606790799561884
tr0.23900789177001125
et0.1945107398568019
yo0.16356877323420074
ca0.1412213740458015
es0.1346153846153846
sq0.1346153846153846
hr0.13015463917525774
is0.1222366710013004
lv0.11533420707732633
cs0.10949868073878628
no0.09999999999999999
lt0.09879839786381843
pl0.09879839786381843
reliablefalse
passesfalse
6
name"Hunter"
dialogue"You're pointing at your camera. Did you take photos? Can you show me?"
detectedLang"en"
heavyLang"en"
scores
en0.8012160898035547
tl0.6918056562726613
fr0.5170454545454546
nl0.49101796407185627
it0.47270471464019853
no0.43633952254641906
ms0.43333333333333335
pt0.42333785617367703
ro0.41460055096418735
es0.39801699716713884
da0.371301775147929
ca0.37037037037037035
de0.3441358024691358
lt0.28087986463620984
sl0.28087986463620984
sv0.27597955706984667
sq0.2582897033158813
et0.18269230769230768
pl0.17794970986460348
cs0.1550695825049702
az0.1533864541832669
hi0.1533864541832669
tr0.1533864541832669
fi0.15
is0.15
lv0.1431451612903226
hr0.1361788617886179
reliabletrue
passestrue
7
name"Selvi"
dialogue"Haan, haan! Yeh dekhiye, yeh photo. Yeh dhundh ke beech mein... woh aadmi wahan khada tha, aur phir agli photo mein bas uska joota bacha tha!"
detectedLang"ms"
heavyLang"it"
scores
ms0.39983443708609273
tl0.3015414258188825
fr0.29406037000973706
en0.2757242757242757
sq0.23442449841605068
cs0.20851528384279477
it0.1530373831775701
de0.14705882352941177
pt0.13895486935866982
et0.12650602409638553
ro0.12650602409638553
fi0.1082410824108241
yo0.1082410824108241
hi0.09600997506234414
reliablefalse
passesfalse
8
name"Hunter"
dialogue"Let me see that screen... Squinting at this isn't helping much. That just looks like heavy mist to me. Wait... is that a boot lying on the grass?"
detectedLang"en"
heavyLang"en"
scores
en0.7939893359185652
tl0.605568445475638
no0.5066744051073709
nl0.46941323345817726
et0.4348404255319149
da0.4039270687237027
yo0.3963068181818182
fi0.35654806964420893
fr0.35361216730038025
cs0.34615384615384615
sl0.32216905901116427
sv0.3205435651478817
ms0.3167202572347267
hr0.31062449310624496
pt0.3004115226337448
sk0.2839090143218197
pl0.27597955706984667
ca0.2685025817555938
hu0.2672413793103448
es0.26660914581535805
sq0.2595818815331011
ro0.24977934686672548
lt0.24309884238646481
it0.24242424242424243
is0.2216117216117216
lv0.18426103646833014
tr0.1533864541832669
az0.1474423269809428
de0.1474423269809428
hi0.08993576017130622
eu0.07608695652173912
vi0.07608695652173912
reliabletrue
passestrue
9
name"Selvi"
dialogue"Joota! Haan, joota! Woh aadmi achanak ghaayab ho gaya, bas uska joota reh gaya! Koi toh tha wahan dhundh mein!"
detectedLang"ms"
heavyLang"de"
scores
ms0.4888888888888889
tl0.36252771618625274
sq0.27854454203262236
fr0.26937738246505716
de0.17857142857142858
ca0.1726618705035971
no0.16180758017492713
sk0.16180758017492713
cs0.15565345080763582
it0.15565345080763582
et0.15441176470588236
pt0.14814814814814814
eu0.14688427299703263
hu0.14688427299703263
fi0.13273001508295626
hr0.1274658573596358
tr0.11538461538461538
reliablefalse
passesfalse
10
name"Hunter"
dialogue"Joota? I don't know what 'joota' means, ma'am. Look, you seem terrified, and you definitely saw something out there..."
detectedLang"en"
heavyLang"en"
scores
en0.7972027972027972
tl0.38715131022823335
ca0.32932469935245146
it0.323062558356676
sv0.3153918791312559
ro0.29816069699903197
de0.29543245869776485
pt0.2913000977517107
es0.28781925343811393
sk0.2857142857142857
sq0.28003972194637533
hr0.2728184553660983
no0.2720883534136546
da0.2676767676767676
cs0.25334706488156544
et0.24163179916317992
nl0.21621621621621623
yo0.20417124039517012
pl0.2032967032967033
ms0.19712070874861573
fr0.17425968109339407
fi0.15893271461716937
hu0.15204678362573099
az0.14806110458284372
be0.0880503144654088
tr0.0880503144654088
is0.0799492385786802
lt0.0799492385786802
lv0.0799492385786802
uk0.0799492385786802
vi0.0799492385786802
reliabletrue
passestrue
11
name"Selvi"
dialogue"Kripya meri madad kijiye! Woh saaya... woh abhi bhi wahan ho sakta hai. Mujhe akeli jagah par jaane mein darr lag raha hai!"
detectedLang"et"
heavyLang"id"
scores
et0.43677325581395343
sv0.37600644122383253
sq0.2695570216776626
no0.2688679245283019
tl0.25409047160731474
ms0.23870333988212183
it0.20998980632008157
de0.20675537359263052
vi0.16845493562231761
lv0.16666666666666666
fr0.15669205658324267
ca0.1340782122905028
sk0.1252821670428894
cs0.1203178206583428
tr0.11123853211009174
da0.10714285714285714
fi0.10196987253765932
nl0.0903755868544601
is0.08930669800235018
reliablefalse
passesfalse
12
name"Hunter"
dialogue"I wish I had my translator app on me, but cell service in Alborn is garbage today. Hold on, let me try to gesture. You... stay... here?"
detectedLang"en"
heavyLang"en"
scores
en0.7843628269337786
nl0.544653349001175
tl0.5403321470937129
da0.5162297128589264
sl0.5113493064312736
cs0.5038412291933418
fr0.481951871657754
de0.47421981004070557
hr0.4709897610921502
yo0.4618055555555556
sq0.4595536959553696
pl0.45917655268667135
it0.45879888268156427
sk0.41816816816816815
ro0.4088482074752097
no0.4052187260168841
pt0.39453125
sv0.3912018853102907
ca0.3854084060269627
es0.3616144975288303
et0.35791217895608946
lt0.3011722272317403
ms0.2647058823529412
lv0.24537487828627072
is0.2326732673267327
fi0.225
hu0.22188755020080322
az0.20998980632008157
tr0.20756646216768918
eu0.19855222337125128
vi0.16306695464362853
hi0.09778812572759021
be0.08284023668639054
uk0.07517899761336516
reliabletrue
passestrue
13
name"Selvi"
dialogue"Aap kya keh rahe hain? Mujhe aapki baat samajh nahi aa rahi hai!"
detectedLang"eu"
heavyLang"tl"
scores
eu0.4310099573257468
no0.35170178282009723
vi0.28186714542190305
et0.20634920634920634
fi0.20634920634920634
is0.20318725099601595
it0.2
lv0.19517102615694165
tl0.19517102615694165
da0.17695473251028807
sv0.16666666666666666
ms0.15074309978768577
reliablefalse
passesfalse
14
name"Hunter"
dialogue"Yeah, this isn't working. Dammit."
detectedLang"en"
heavyLang"en"
scores
en0.7666277712952159
tl0.6175908221797323
sv0.4884910485933504
nl0.33774834437086093
no0.3006993006993007
de0.2857142857142857
fr0.26199261992619927
is0.26199261992619927
pt0.26199261992619927
reliabletrue
passestrue
15
name"Selvi"
dialogue"Aap mere saath chaliye, wahan bagiche mein... maine wahan kuch aur bhi dekha tha!"
detectedLang"de"
heavyLang"la"
scores
de0.4552752293577982
fr0.4546498277841562
ms0.43653618030842234
fi0.43045563549160676
en0.37335092348284965
et0.3606998654104979
ro0.3466299862448418
tl0.309593023255814
tr0.28785607196401797
da0.24960505529225907
it0.19763513513513514
sq0.19763513513513514
lv0.15630550621669628
az0.15480427046263345
reliablefalse
passesfalse
16
name"Hunter"
dialogue"Hunter here... What? Speak up, Dispatch... Another scene found? Down by the old grain silo? I'm two minutes away, hold the perimeter."
detectedLang"en"
heavyLang"en"
scores
en0.7956577266922095
tl0.6284254528564793
da0.4747209455022981
fr0.4531784005468216
sv0.39984996249062266
sq0.38791124713083397
no0.3710691823899371
de0.36254980079681276
it0.36153232242617717
nl0.3532740501212611
sk0.34102141680395387
es0.32998324958123953
ro0.32088285229202035
ca0.3144815766923736
pt0.30434782608695654
ms0.30374238468233244
lt0.27404718693284935
cs0.2558139534883721
et0.24741298212605833
sl0.24457034938621341
pl0.24242424242424243
hr0.2007992007992008
tr0.18283963227783454
fi0.15074309978768577
eu0.13232104121475055
yo0.11797133406835722
lv0.06868451688009314
reliabletrue
passestrue
17
name"Hunter"
dialogue"Look, ma'am, I have to go. That was dispatch. Duty calls."
detectedLang"en"
heavyLang"en"
scores
en0.7829861111111112
de0.5398773006134969
tl0.5253164556962026
da0.5098039215686274
yo0.508519003931848
pl0.4959677419354839
ca0.4573082489146165
cs0.4485294117647059
it0.43267776096822996
sk0.4212962962962963
hr0.40476190476190477
no0.4038155802861685
sv0.37913907284768217
sq0.35121107266435986
es0.336283185840708
fr0.33510638297872336
ro0.3315508021390375
lv0.33035714285714285
lt0.3081180811808118
nl0.2632612966601179
sl0.24395161290322584
pt0.21052631578947367
be0.15730337078651685
tr0.15730337078651685
hu0.1515837104072398
az0.14383561643835618
et0.14383561643835618
is0.14383561643835618
uk0.14383561643835618
vi0.14383561643835618
reliabletrue
passestrue
18
name"Selvi"
dialogue"Aap jaa rahe hain? Nahin, nahi, kripya mat jaaiye! Mujhe yahan akele mat chhodiye!"
detectedLang"eu"
heavyLang"tl"
scores
eu0.4615384615384615
tl0.4081172491544532
ms0.2886178861788618
nl0.19230769230769232
tr0.19230769230769232
et0.1758241758241758
sq0.16666666666666666
fi0.1435562805872757
is0.13793103448275862
lt0.125
no0.125
sk0.125
sv0.125
reliablefalse
passesfalse
19
name"Hunter"
dialogue"I don't know what you're saying, but stay right here at the cafe. I'll come back with someone from the county station who can translate. Don't leave town, okay?"
detectedLang"en"
heavyLang"en"
scores
en0.8191593352883676
tl0.6226030191758466
no0.5042872454448016
da0.43597560975609756
fr0.365133836650652
it0.358974358974359
sv0.33019551049963797
sq0.3277616279069767
yo0.3143068939955523
tr0.28516228748068007
hr0.26877470355731226
ro0.2652899126290707
de0.26294820717131473
nl0.24118129614438064
ca0.23868312757201646
ms0.2285237698081735
az0.22072451558550968
pl0.21875
cs0.1970486111111111
lt0.18141592920353983
sk0.17336907953529937
lv0.1726296958855098
et0.16365280289330925
pt0.1458910433979686
es0.14351851851851852
vi0.1403345724907063
sl0.11652340019102196
fi0.0814299900695134
zh0.07684630738522955
be0.07035175879396985
eu0.06754032258064516
hu0.06754032258064516
is0.06376518218623482
uk0.06376518218623482
reliabletrue
passestrue
20
name"Selvi"
dialogue"Aap... aap wapas aayenge na? Kripya jaldi aana!"
detectedLang"pt"
heavyLang"is"
scores
pt0.46393762183235865
sq0.3982494529540482
tl0.38752783964365256
sk0.358974358974359
pl0.3574766355140187
cs0.3559718969555035
sl0.3559718969555035
hr0.3529411764705882
nl0.28756476683937826
eu0.27821522309711283
da0.2744063324538259
es0.26666666666666666
yo0.26666666666666666
is0.25474254742547425
no0.2506811989100818
ca0.23822714681440443
et0.22096317280453256
lt0.21875
de0.21652421652421652
en0.21652421652421652
reliablefalse
passesfalse
21
name"Hunter"
dialogue"Just stay put. I'll be back."
detectedLang"en"
heavyLang"en"
scores
en0.8031496062992126
hr0.4545454545454546
hu0.43820224719101125
lt0.42748091603053434
yo0.4230769230769231
et0.40476190476190477
sv0.40476190476190477
tl0.39999999999999997
ca0.33920704845814975
reliabletrue
passestrue