Run: 2026-09-02-01M1HH3J4A7PMRWZYA197XXW94

Run Details

Model:
Gemini 3.8 Flash (Reasoning, Medium)
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
10.1s
Cost:
$0.008002
Provider:
Google AI Studio

Evaluation summary

Score Evaluator
Details Link
55.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Hunter: "Excuse me, miss. Detective Hunter, county sheriff’s department. Mind if I take a seat?" Selvi: "Ji? Aap... kaun? Mujhse kuch galti ho gayi kya?" Hunter: "Whoa, okay. Hold on. Do you speak English?" Selvi: "Mujhe... mujhe samajh nahi aa raha aap kya keh rahe hain. Main bas yahan chai pi rahi hoon." Hunter: "Foreign exchange student, right? From the college down in Duluth? Look, ma'am, I just need to ask you a couple of quick questions. Were you out by Miller’s Ridge yesterday evening?" Selvi: "Miller's Ridge? Woh... woh pahadi? Haan! Main wahan thi! Main tasveerein le rahi thi, par... par wahan kuch bohot bura hua." Hunter: "I have no idea what you're saying, miss. Hindi? Is that Hindi? Look, did you see anyone near the old apple orchard around dusk? A young woman, about twenty, blonde hair?" Selvi: "Nahi, ladki nahi! Wahan ek aadmi tha. Bohot ajeeb... woh pedon ke peeche chup raha tha. Maine camera mein dekha aur main darr gayi! Dekhiye, meri ungliyan abhi bhi kaanp rahi hain." Hunter: "Slow down, take an easy breath. I can see you're shaken up, but I can't understand a single word. Did you... wait, did you take pictures? Photos? Camera?" Selvi: "Haan, camera! Tasveer! Yeh dekhiye... maine kuch capture kiya tha, par andhere ki wajah se sab saaf nahi hai. Dekhiye ise!" Hunter: "Let me see the playback screen. Don't move it so fast, hold it steady. What is that... shadows? Or someone standing by the treeline?" Selvi: "Woh wahan khada tha! Aur phir achanak... bilkul gayab! Jaise hawa mein mil gaya ho. Mujhe bohot dar lag raha tha, isliye main bhaag aayi. Kya woh wahi shaks hai jise aap dhoond rahe hain?" Hunter: "Damn it, this is frustrating. You saw something out there, didn't you? That figure... that’s by the county drainage ditch." Selvi: "Aap meri baat kyun nahi samajh rahe? Wahan koi khatra hai! Kripya kisi ko wahan bhejiye!" Hunter: "Hold that thought. Don't touch any buttons on that camera, I need to get an interpreter on the line from—" [Hunter's phone rings loudly with a harsh vibration.] Hunter: "Hold on. Hunter here. ... What? Where? The south clearing behind the festival grounds? Don't touch anything, keep the perimeter locked down. I'm three minutes away." Selvi: "Kya hua? Sab theek toh hai na? Aap itne pareshaan kyun lag rahe hain?" Hunter: "I have to run. Stay. Understand? Stay here. Cafe. Don't leave this town. Don't delete those pictures. I will be back for that camera." Selvi: "Rukiye! Suniye toh! Main akele yahan kya karoon? Kripya mujhe aise mat chhod kar jaiye!" Hunter: "Just... stay put, ma'am. I'll find someone who speaks your language. Lock the door behind me."
created_at"2026-09-02T17:01:44.978Z" 9/2/2026, 5:01:44 PM
model"google/gemini-3.8-flash-20260902"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency1545
moderation_latency(null)
generation_time10110
tokens_prompt302
tokens_completion1201
native_tokens_prompt289
native_tokens_completion2076
native_tokens_completion_images0
native_tokens_reasoning1321
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
num_fetches(null)
web_search_engine(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"STOP"
service_tier"default"
usage0.00800175
router(null)
user_agent"langchainjs-openai/1.0.0 ((node/v24.19.0; linux; x64))"
http_referer(null)
request_id"req-1788368504-DOgomG2ekTi5kBA4JNbw"
session_id(null)
preset_id(null)
api_type"completions"
id"gen-1788368504-xJFxk0ZD3k7kywfrbjgc"
upstream_id"eVaYauDXAu_UjMcPg_CyuA0"
provider_responses
0
endpoint_id"d376f781-516d-42f9-936d-46f19abca6cc"
id"eVaYauDXAu_UjMcPg_CyuA0"
is_byokfalse
latency1545
model_permaslug"google/gemini-3.8-flash-20260902"
provider_name"Google AI Studio"
status200
total_cost0.00800175
cache_discount(null)
upstream_inference_cost0
provider_name"Google AI Studio"
response_cache_source_id(null)
data_region"global"
workspace_id"97e315e5-d303-487d-83c1-83180e8a13d4"

Evaluation details

Result Evaluator Details Meta Data
55.00% Parse dialogue n/a
dialogue
0
name"Hunter"
dialogue"Excuse me, miss. Detective Hunter, county sheriff’s department. Mind if I take a seat?"
detectedLang"en"
heavyLang"en"
scores
en0.7703788748564868
tl0.6449704142011835
no0.5645863570391872
sq0.5529061102831594
ca0.5384615384615384
ro0.5381062355658198
fr0.49790794979079495
it0.4809688581314879
pt0.4690265486725664
sv0.4550408719346049
es0.44495837187789083
nl0.4434137291280148
da0.42528735632183906
de0.4180407371483996
sl0.3890020366598778
hr0.38837920489296635
hu0.3839835728952772
cs0.38271604938271603
et0.33993399339933994
pl0.33184855233853006
ms0.3281075027995521
yo0.3095512082853855
az0.3063583815028902
sk0.3063583815028902
lt0.2628992628992629
tr0.2555831265508685
fi0.18699186991869918
is0.18699186991869918
lv0.18144611186903137
vi0.18144611186903137
be0.1044776119402985
eu0.1044776119402985
uk0.09502262443438914
reliabletrue
passestrue
1
name"Selvi"
dialogue"Ji? Aap... kaun? Mujhse kuch galti ho gayi kya?"
detectedLang"cs"
heavyLang"tlh"
scores
cs0.4318181818181818
ca0.3037974683544304
lt0.2912371134020619
no0.28756476683937826
sk0.28756476683937826
it0.27821522309711283
et0.26666666666666666
ro0.26666666666666666
sl0.2647058823529412
reliablefalse
passesfalse
2
name"Hunter"
dialogue"Whoa, okay. Hold on. Do you speak English?"
detectedLang"en"
heavyLang"en"
scores
en0.783923941227312
tl0.5948136142625607
cs0.5335820895522388
hr0.5283018867924528
pl0.47589098532494756
sk0.4529540481400437
da0.423963133640553
pt0.3842364532019704
et0.3811881188118812
yo0.3796526054590571
fi0.375
sl0.32432432432432434
sq0.31880108991825606
vi0.30747922437673125
fr0.30362116991643456
ca0.28366762177650434
hi0.251497005988024
no0.24698795180722888
de0.22360248447204967
ms0.22360248447204967
ro0.22360248447204967
sv0.22360248447204967
reliabletrue
passestrue
3
name"Selvi"
dialogue"Mujhe... mujhe samajh nahi aa raha aap kya keh rahe hain. Main bas yahan chai pi rahi hoon."
detectedLang"ms"
heavyLang"tl"
scores
ms0.38195302843016066
eu0.37733499377334995
et0.3288590604026846
tl0.3131868131868132
no0.302649930264993
fr0.2857142857142857
fi0.2774566473988439
pl0.20760697305863707
is0.16943521594684383
en0.1652754590984975
lv0.1624790619765494
da0.14675767918088736
sv0.13793103448275862
de0.13494809688581316
reliablefalse
passesfalse
4
name"Hunter"
dialogue"Foreign exchange student, right? From the college down in Duluth? Look, ma'am, I just need to ask you a couple of quick questions. Were you out by Miller’s Ridge yesterday evening?"
detectedLang"en"
heavyLang"en"
scores
en0.8039856256125449
tl0.6252342286071205
no0.5379283788987292
fr0.5336183443451225
nl0.5277449822904369
da0.49937421777221525
it0.43741209563994377
sv0.4076999012833169
de0.40711462450592883
yo0.39909864797195793
ca0.3814432989690722
cs0.3746743095362168
pl0.3700787401574803
ro0.3593166043780032
sk0.3329627570872707
et0.30835734870317
is0.3011065812463599
hr0.27007299270072993
sl0.26108374384236455
sq0.26062846580406657
pt0.2518703241895262
az0.2409867172675522
es0.23615531508593254
hu0.23615531508593254
lv0.21311475409836064
tr0.21156373193166886
lt0.21000658327847269
ms0.15254237288135594
fi0.1031390134529148
vi0.099774943735934
be0.05511811023622047
eu0.05511811023622047
uk0.0498812351543943
reliabletrue
passestrue
5
name"Selvi"
dialogue"Miller's Ridge? Woh... woh pahadi? Haan! Main wahan thi! Main tasveerein le rahi thi, par... par wahan kuch bohot bura hua."
detectedLang"fr"
heavyLang"vi"
scores
fr0.4485294117647059
en0.40357852882703776
ms0.3548387096774194
tl0.3258426966292135
fi0.2857142857142857
de0.2840095465393795
it0.2555831265508685
es0.2546583850931677
az0.24433249370277077
hu0.2376111817026684
is0.23273657289002556
et0.22580645161290325
da0.22178988326848248
lv0.2052980132450331
vi0.2052980132450331
yo0.16897506925207756
sl0.16317991631799164
ro0.15966386554621848
ja0.14285714285714285
ca0.1341991341991342
sv0.1341991341991342
nl0.12790697674418602
no0.12023460410557184
tr0.12023460410557184
reliablefalse
passesfalse
6
name"Hunter"
dialogue"I have no idea what you're saying, miss. Hindi? Is that Hindi? Look, did you see anyone near the old apple orchard around dusk? A young woman, about twenty, blonde hair?"
detectedLang"en"
heavyLang"en"
scores
en0.7998856489422527
tl0.6352900312608545
nl0.40911648846370285
fr0.3856056173200702
es0.37050359712230213
it0.3554327808471455
no0.34497816593886466
ca0.31640625
cs0.3105712409717663
sq0.29624664879356566
da0.29340511440107675
yo0.29197572488199597
sv0.2890995260663507
hr0.28716904276985744
de0.27285318559556787
pl0.2723492723492723
et0.27083333333333337
hu0.26419060967063773
sk0.2605633802816902
pt0.2510699001426534
tr0.24187725631768955
is0.23802612481857763
ro0.2273730684326711
lv0.2009132420091324
ms0.1719242902208202
lt0.12133891213389122
fi0.1198658843252305
az0.11242603550295857
vi0.11242603550295857
sl0.07894736842105263
hi0.06914893617021277
be0.0625
eu0.0625
uk0.05660377358490566
reliabletrue
passestrue
7
name"Selvi"
dialogue"Nahi, ladki nahi! Wahan ek aadmi tha. Bohot ajeeb... woh pedon ke peeche chup raha tha. Maine camera mein dekha aur main darr gayi! Dekhiye, meri ungliyan abhi bhi kaanp rahi hain."
detectedLang"de"
heavyLang"la"
scores
de0.3268628678772699
ro0.32389937106918243
tl0.3104554201411161
ms0.2973856209150327
et0.2756064690026954
fr0.25708362128541806
fi0.24877707896575824
en0.23920736022646846
eu0.21988388969521042
tr0.16795665634674922
yo0.16015625
nl0.14068745003996802
it0.1281427412814274
sq0.09815436241610738
cs0.08743633276740237
ca0.08666100254885302
is0.0851063829787234
es0.08432708688245316
lv0.07566638005159072
sv0.07087294727744166
az0.06764960971379011
reliablefalse
passesfalse
8
name"Hunter"
dialogue"Slow down, take an easy breath. I can see you're shaken up, but I can't understand a single word. Did you... wait, did you take pictures? Photos? Camera?"
detectedLang"en"
heavyLang"en"
scores
en0.8019914007694048
tl0.6019108280254777
fr0.4816350710900474
ro0.47761194029850745
ca0.4658119658119659
no0.4618696186961869
nl0.45719602977667495
sv0.4520976831559173
de0.4372990353697749
da0.4002741603838246
it0.34798807749627425
cs0.3131868131868132
et0.31048069345941687
sk0.29149797570850206
es0.2622259696458685
pl0.26097972972972977
yo0.25531914893617025
ms0.25341296928327645
tr0.25213675213675213
lv0.24698795180722888
hr0.22291296625222026
vi0.21665174574753807
lt0.20454545454545453
hu0.20309653916211293
pt0.2009132420091324
is0.19503219871205152
az0.1935483870967742
sq0.19056429232192415
eu0.16587225929456625
sl0.1610738255033557
hi0.08088235294117647
be0.07407407407407407
fi0.06716417910447761
uk0.06716417910447761
reliabletrue
passestrue
9
name"Selvi"
dialogue"Haan, camera! Tasveer! Yeh dekhiye... maine kuch capture kiya tha, par andhere ki wajah se sab saaf nahi hai. Dekhiye ise!"
detectedLang"fr"
heavyLang"tl"
scores
fr0.5178571428571429
en0.45520581113801456
it0.3951612903225807
ro0.38636363636363635
yo0.3744207599629287
sq0.358974358974359
de0.3528283796740172
sl0.3509615384615385
ms0.31749241658240646
es0.3112244897959183
ca0.2887249736564805
et0.2887249736564805
fi0.28191489361702127
sv0.27884615384615385
lv0.2647058823529412
tl0.25742574257425743
tr0.24832962138084633
hr0.24496644295302009
pt0.22413793103448276
nl0.22235023041474655
da0.21511627906976746
eu0.19642857142857142
vi0.18870192307692307
az0.18772563176895307
cs0.16769420468557336
hu0.1520100502512563
no0.09999999999999999
reliablefalse
passesfalse
10
name"Hunter"
dialogue"Let me see the playback screen. Don't move it so fast, hold it steady. What is that... shadows? Or someone standing by the treeline?"
detectedLang"en"
heavyLang"en"
scores
en0.8076026119402985
tl0.5852187028657617
nl0.5030120481927711
da0.4923076923076923
no0.4919950738916256
et0.4234800838574424
sl0.40604751619870405
de0.3820224719101124
ms0.3544600938967136
sk0.35243328100470955
sq0.3483412322274882
yo0.34210526315789475
cs0.3136439267886855
fr0.30904522613065327
es0.28633217993079585
is0.2763157894736842
sv0.2737676056338028
tr0.26339285714285715
ro0.23255813953488372
fi0.21800947867298578
pt0.21428571428571427
it0.20520231213872833
pl0.19590643274853803
hu0.15730337078651685
lt0.14772727272727273
hr0.14596273291925466
az0.13883089770354906
vi0.10714285714285714
lv0.09440175631174533
ja0.0667420814479638
reliabletrue
passestrue
11
name"Selvi"
dialogue"Woh wahan khada tha! Aur phir achanak... bilkul gayab! Jaise hawa mein mil gaya ho. Mujhe bohot dar lag raha tha, isliye main bhaag aayi. Kya woh wahi shaks hai jise aap dhoond rahe hain?"
detectedLang"ms"
heavyLang"de"
scores
ms0.2857142857142857
tl0.27512886597938147
pt0.2685305591677503
et0.26132632961260666
ro0.21438547486033518
fr0.20886075949367086
de0.199288256227758
en0.19757489300998574
eu0.17400881057268722
no0.15667166416791606
it0.15477084898572502
sk0.15094339622641512
ca0.1470811220621683
es0.14253048780487806
nl0.13925019127773527
tr0.13793103448275862
sv0.12925696594427244
vi0.12246489859594385
lt0.10071942446043164
sq0.09420289855072464
cs0.08610885458976443
hu0.08088235294117647
fi0.07254740313272877
hr0.06947890818858561
reliablefalse
passesfalse
12
name"Hunter"
dialogue"Damn it, this is frustrating. You saw something out there, didn't you? That figure... that’s by the county drainage ditch."
detectedLang"en"
heavyLang"en"
scores
en0.809204440333025
tl0.579938900203666
nl0.3806306306306307
no0.3721461187214612
sq0.3687834736036725
de0.3187448389760529
fr0.3130724396336387
ms0.2960750853242321
it0.26861702127659576
yo0.26861702127659576
da0.26141450313339304
ro0.25942549371633755
pt0.25742574257425743
cs0.2479489516864175
is0.21503330161750714
es0.20977011494252876
sv0.20825335892514396
hr0.20135527589545013
sk0.1943359375
pl0.17992047713717693
hu0.15730337078651685
lv0.15297741273100618
lt0.14948453608247422
ca0.14507772020725387
eu0.07094594594594594
az0.0667420814479638
sl0.0667420814479638
reliabletrue
passestrue
13
name"Selvi"
dialogue"Aap meri baat kyun nahi samajh rahe? Wahan koi khatra hai! Kripya kisi ko wahan bhejiye!"
detectedLang"tl"
heavyLang"tl"
scores
tl0.419953596287703
ms0.3857493857493857
lv0.3726474278544542
eu0.35064935064935066
et0.29478138222849076
fi0.2774566473988439
sq0.2668621700879765
vi0.2389649923896499
yo0.20760697305863707
sl0.20127795527156547
is0.16943521594684383
it0.16666666666666666
no0.16666666666666666
lt0.15966386554621848
hr0.1482112436115843
da0.14675767918088736
sv0.13793103448275862
ro0.1334488734835355
reliablefalse
passesfalse
14
name"Hunter"
dialogue"Hold that thought. Don't touch any buttons on that camera, I need to get an interpreter on the line from—"
detectedLang"en"
heavyLang"en"
scores
en0.8101635514018692
fr0.5498614958448753
tl0.5448179271708684
ca0.5262390670553936
de0.48083067092651754
da0.47958366693354687
no0.4463373083475298
it0.44349315068493156
ro0.4415807560137457
yo0.4347826086956522
et0.4283201407211962
sv0.4196428571428571
cs0.417562724014337
pl0.3964716805942433
hr0.3959107806691449
sq0.3959107806691449
sk0.3930905695611578
es0.38330170777988615
ms0.36149312377210213
tr0.35000000000000003
nl0.33537832310838445
lv0.2942453854505972
sl0.2872807017543859
lt0.27293064876957496
vi0.2655367231638418
pt0.2605233219567691
hu0.2554410080183276
eu0.22248803827751198
is0.2004920049200492
fi0.1875
az0.16666666666666666
hi0.11444141689373298
be0.09722222222222222
uk0.08835904628330996
reliabletrue
passestrue
15
name"Hunter"
dialogue"Hold on. Hunter here. ... What? Where? The south clearing behind the festival grounds? Don't touch anything, keep the perimeter locked down. I'm three minutes away."
detectedLang"en"
heavyLang"en"
scores
en0.8031117940837496
tl0.594059405940594
fr0.4892874937717987
da0.4570974576271186
sv0.4550770866560341
no0.4330752212389381
sq0.4212309429700734
nl0.41695108077360643
ms0.4051073708647707
de0.3847539015606243
ca0.3621655258245177
et0.34462915601023014
pt0.3374272786037492
cs0.297945205479452
hr0.2881944444444444
it0.2807017543859649
es0.2709815078236131
sl0.26994301994301995
fi0.25724637681159424
sk0.24632352941176466
ro0.24074074074074073
lt0.23735119047619047
tr0.2054263565891473
pl0.1700404858299595
yo0.15078707539353772
eu0.120926243567753
lv0.1063644289450741
az0.10323709536307961
hi0.07574391343552751
is0.07239819004524886
hu0.06135531135531135
reliabletrue
passestrue
16
name"Selvi"
dialogue"Kya hua? Sab theek toh hai na? Aap itne pareshaan kyun lag rahe hain?"
detectedLang"nl"
heavyLang"la"
scores
nl0.40807799442896936
tl0.3722304283604136
pt0.3410852713178295
fi0.3055555555555556
lt0.2916666666666667
it0.288107202680067
sv0.27101200686106347
vi0.2697594501718213
sk0.2659758203799654
pl0.2647058823529412
cs0.26343154246100525
sl0.26343154246100525
hr0.2608695652173913
eu0.24511545293072823
yo0.1904761904761905
no0.18738049713193117
lv0.17794970986460348
es0.17475728155339806
et0.17475728155339806
ca0.16173570019723865
de0.1533864541832669
sq0.1533864541832669
en0.1448692152917505
fr0.1448692152917505
ro0.1326530612244898
reliablefalse
passesfalse
17
name"Hunter"
dialogue"I have to run. Stay. Understand? Stay here. Cafe. Don't leave this town. Don't delete those pictures. I will be back for that camera."
detectedLang"en"
heavyLang"en"
scores
en0.8154527559055118
tl0.5738636363636364
da0.5687176538240368
no0.5562130177514794
ro0.4509516837481699
sv0.4318181818181818
ca0.38875305623471884
de0.3713327745180218
yo0.36601859678782755
sq0.3483927019982624
nl0.3438320209973753
fr0.336283185840708
it0.3119266055045872
pl0.3112947658402204
cs0.29906542056074764
sk0.2809204218600192
lt0.2711370262390671
hu0.2632612966601179
lv0.2632612966601179
hr0.2537313432835821
et0.23935091277890466
sl0.20718816067653278
es0.1812227074235808
pt0.1812227074235808
tr0.16201117318435754
is0.1544532130777903
ms0.08759124087591241
be0.08536585365853659
az0.07749077490774908
uk0.07749077490774908
vi0.07749077490774908
reliabletrue
passestrue
18
name"Selvi"
dialogue"Rukiye! Suniye toh! Main akele yahan kya karoon? Kripya mujhe aise mat chhod kar jaiye!"
detectedLang"tr"
heavyLang"tl"
scores
tr0.36575052854122625
tl0.3135011441647597
ms0.26199261992619927
fi0.23857868020304565
sk0.22580645161290325
sl0.20634920634920634
nl0.17241379310344826
et0.15730337078651685
sq0.14893617021276595
lv0.14285714285714285
en0.14163090128755365
fr0.12790697674418602
is0.12280701754385964
de0.11504424778761062
lt0.1111111111111111
no0.1111111111111111
sv0.1111111111111111
reliablefalse
passesfalse
19
name"Hunter"
dialogue"Just... stay put, ma'am. I'll find someone who speaks your language. Lock the door behind me."
detectedLang"en"
heavyLang"en"
scores
en0.7899961817487591
nl0.4335736354273944
et0.4294605809128631
tl0.38547486033519557
ms0.37286202964652226
no0.3357487922705314
da0.3251533742331288
fr0.302915082382763
sq0.2912371134020619
eu0.28478543563068925
ro0.2537313432835821
es0.24657534246575344
sv0.24657534246575344
yo0.23611111111111113
pt0.23184357541899442
hr0.1851851851851852
sl0.13793103448275862
de0.13657770800627944
is0.13249211356466878
it0.12698412698412698
ca0.12280701754385964
fi0.12
lt0.10277324632952692
reliabletrue
passestrue