Run: 2026-07-25-01KYCSSTPR7XW1Y8DR9746HD94

Run Details

Model:
Gemini 3.6 Flash (Reasoning)
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
11.6s
Cost:
$0.016836
Provider:
Google AI Studio

Evaluation summary

Score Evaluator
Details Link
56.25% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Hunter: "Excuse me, ma'am. Mind if I sit? Detective Hunter, Alborn PD." Selvi: "Ji? Aap... aap kaun hain? Mujhe samajh nahi aa raha." Hunter: "I'm investigating a disappearance from yesterday evening near the orchard. A few witnesses mentioned seeing a woman with a camera near the tree line around five. I need to ask you a few questions." Selvi: "Mujhe... mujhe angrezi nahi aati. Aap kya kah rahe hain?" Hunter: "Uh... right. Do you speak English? English?" Selvi: "Nahi, English nahi! Lekin... dekhiye! Woh bahut bhayanak tha. Maine wahan kuch dekha... jungle ke paas!" Hunter: "Whoa, take it easy. Just slow down. I don't understand Hindi, ma'am." Selvi: "Aap meri baat kyun nahi sun rahe? Yahan dekhiye! Maine camera mein sab record kar liya hai!" Hunter: "Wait... your camera? Can I see that? May I look?" Selvi: "Haan, haan, dekhiye! Yeh dekhiye... yeh photo. Is aadmi ko dekhiye, woh kisi ko pedon ke peeche kheench raha tha!" Hunter: "Hold on... let me see the display screen. What is that in the tree line? Is that... a red jacket?" Selvi: "Haan! Wahi ladki thi! Maine shor machane ki koshish ki, lekin woh use le gaya! Mujhe bahut darr lag raha hai!" Hunter: "Damn it... that's her. Ma'am, whatever you're saying, this photograph is—" Hunter: "Hunter speaking. What? Another one? Where? Down on Miller Road?" Hunter: "Listen to me, I have to get to Miller Road right now. Stay right here at this cafe. Don't delete those photos. Don't touch anything. I'm coming back with an interpreter, understood? Stay. Here." Selvi: "Aap kahan ja rahe hain? Suniye! Woh aadmi abhi bhi wahan ho sakta hai! Aap mujhe akela chhod kar kyun ja rahe hain?"
created_at"2026-07-25T14:10:25.631Z" 7/25/2026, 2:10:25 PM
model"google/gemini-3.6-flash-20260721"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency1365
moderation_latency(null)
generation_time11542
tokens_prompt302
tokens_completion1065
native_tokens_prompt289
native_tokens_completion2187
native_tokens_completion_images0
native_tokens_reasoning1706
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
num_fetches(null)
web_search_engine(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"STOP"
service_tier"default"
usage0.016836
router(null)
provider_responses
0
endpoint_id"5d6d133d-a953-4781-a835-7ee76f4e1388"
id"0cNkate0LOfQ-8YPy8Tm-Ak"
is_byokfalse
latency1365
model_permaslug"google/gemini-3.6-flash-20260721"
provider_name"Google AI Studio"
status200
user_agent"langchainjs-openai/1.0.0 ((node/v24.18.0; linux; x64))"
http_referer(null)
request_id"req-1784988625-qwIX8S8jdcAd5RG3oGEf"
session_id(null)
preset_id(null)
api_type"completions"
id"gen-1784988625-6xoT3gKuU9FV821kWeXj"
upstream_id"0cNkate0LOfQ-8YPy8Tm-Ak"
total_cost0.016836
cache_discount(null)
upstream_inference_cost0
provider_name"Google AI Studio"
response_cache_source_id(null)
data_region"global"

Evaluation details

Result Evaluator Details Meta Data
56.25% Parse dialogue n/a
dialogue
0
name"Hunter"
dialogue"Excuse me, ma'am. Mind if I sit? Detective Hunter, Alborn PD."
detectedLang"en"
heavyLang"en"
scores
en0.678030303030303
it0.5609504132231405
ro0.541036717062635
no0.5375408052230685
da0.5058139534883721
sq0.5052386495925495
ca0.4700748129675811
sv0.46874999999999994
tl0.46540880503144655
fr0.4558258642765685
pt0.43029490616621985
es0.39716312056737585
et0.36661698956780925
nl0.3501529051987768
sl0.3348982785602504
hr0.3264659270998415
cs0.29401993355481726
de0.288107202680067
hu0.2672413793103448
ms0.2517605633802817
tr0.2328519855595668
pl0.22867513611615245
yo0.169921875
fi0.15
sk0.1448692152917505
be0.1414141414141414
az0.1290983606557377
is0.1290983606557377
lt0.1290983606557377
lv0.1290983606557377
uk0.1290983606557377
vi0.1290983606557377
reliabletrue
passestrue
1
name"Selvi"
dialogue"Ji? Aap... aap kaun hain? Mujhe samajh nahi aa raha."
detectedLang"eu"
heavyLang"tl"
scores
eu0.5242214532871973
et0.47115384615384615
no0.4410569105691057
lt0.2912371134020619
fi0.2744063324538259
cs0.2724867724867725
is0.27055702917771884
sl0.2647058823529412
lv0.260752688172043
tl0.260752688172043
da0.23822714681440443
sv0.22535211267605632
ms0.20520231213872833
reliablefalse
passesfalse
2
name"Hunter"
dialogue"I'm investigating a disappearance from yesterday evening near the orchard. A few witnesses mentioned seeing a woman with a camera near the tree line around five. I need to ask you a few questions."
detectedLang"en"
heavyLang"en"
scores
en0.7966776258868317
tl0.6215780998389694
fr0.5480769230769231
it0.5260185558693021
nl0.5206038351693187
no0.47939743021710235
ro0.4634703196347032
da0.443391757460919
pt0.43967572722937526
ca0.4340077071290945
sv0.42288801571709234
cs0.4026436197254702
hr0.39464193714580115
es0.38255386232264843
de0.37830687830687837
ms0.35332966428178314
sq0.31165787932044525
sk0.3112543962485346
yo0.3022565320665083
sl0.25396825396825395
et0.25111536010197577
is0.24727738629083926
lt0.24193548387096775
pl0.23750811161583385
fi0.232527759634226
lv0.21666666666666667
hu0.20392953929539293
az0.17601683029453014
tr0.11119515885022693
vi0.10168195718654435
be0.05622489959839357
eu0.05622489959839357
uk0.050888529886914384
reliabletrue
passestrue
3
name"Selvi"
dialogue"Mujhe... mujhe angrezi nahi aati. Aap kya kah rahe hain?"
detectedLang"eu"
heavyLang"tl"
scores
eu0.5242214532871973
ro0.2763157894736842
no0.25474254742547425
da0.24242424242424243
de0.22096317280453256
reliablefalse
passesfalse
4
name"Hunter"
dialogue"Uh... right. Do you speak English? English?"
detectedLang"en"
heavyLang"en"
scores
en0.8051948051948052
tl0.6274834437086093
cs0.48394495412844035
hr0.460431654676259
no0.4094488188976378
pt0.4094488188976378
yo0.40318302387267907
da0.3935309973045822
de0.3935309973045822
pl0.3885869565217392
sk0.3697478991596639
sl0.34782608695652173
sq0.34210526315789475
vi0.33035714285714285
fr0.2474916387959866
ms0.24242424242424243
ro0.24242424242424243
sv0.24242424242424243
reliabletrue
passestrue
5
name"Selvi"
dialogue"Nahi, English nahi! Lekin... dekhiye! Woh bahut bhayanak tha. Maine wahan kuch dekha... jungle ke paas!"
detectedLang"ms"
heavyLang"de"
scores
ms0.48364888123924266
en0.4392523364485981
eu0.4065281899109792
tl0.38461538461538464
fi0.36507936507936506
de0.3644067796610169
fr0.3227990970654628
sq0.27007299270072993
ro0.2673992673992674
et0.21363040629095675
hr0.20634920634920634
az0.16317991631799164
lt0.15730337078651685
cs0.1465149359886202
hu0.14163090128755365
is0.12790697674418602
lv0.12790697674418602
yo0.12790697674418602
no0.12023460410557184
tr0.1111111111111111
da0.10714285714285714
sv0.10714285714285714
reliablefalse
passesfalse
6
name"Hunter"
dialogue"Whoa, take it easy. Just slow down. I don't understand Hindi, ma'am."
detectedLang"en"
heavyLang"en"
scores
en0.7414841849148418
tl0.5893719806763285
sv0.5148401826484018
no0.5098039215686274
da0.5086705202312138
sq0.4193989071038251
et0.3786549707602339
is0.356060606060606
it0.33800623052959505
ca0.3359375
pl0.32432432432432434
de0.3122977346278317
cs0.3078175895765472
nl0.2951907131011609
ro0.2784380305602716
yo0.2772108843537415
sk0.2747440273037543
lv0.2595818815331011
hr0.24645390070921988
hi0.1550695825049702
sl0.1550695825049702
be0.1414141414141414
tr0.1414141414141414
hu0.1361788617886179
az0.1290983606557377
lt0.1290983606557377
uk0.1290983606557377
vi0.1290983606557377
reliabletrue
passestrue
7
name"Selvi"
dialogue"Aap meri baat kyun nahi sun rahe? Yahan dekhiye! Maine camera mein sab record kar liya hai!"
detectedLang"en"
heavyLang"tl"
scores
en0.48837209302325585
ro0.46236559139784944
fr0.4602551521099117
tl0.4516450648055832
it0.4216614090431125
de0.38478747203579416
ca0.3574766355140187
es0.3365500603136309
et0.3276283618581907
fi0.31335830212234705
nl0.28478543563068925
ms0.2763157894736842
eu0.23076923076923078
vi0.22206506364922204
sl0.22096317280453256
yo0.1691842900302115
pt0.15384615384615385
tr0.15384615384615385
lv0.13793103448275862
sv0.12974683544303797
reliablefalse
passesfalse
8
name"Hunter"
dialogue"Wait... your camera? Can I see that? May I look?"
detectedLang"en"
heavyLang"en"
scores
en0.8130142109199702
tl0.6513249651324965
ca0.5590828924162257
it0.5219885277246654
ro0.497991967871486
et0.48240165631469983
sv0.46808510638297873
yo0.42528735632183906
vi0.3842364532019704
ms0.375
tr0.37027707808564225
no0.3670886075949367
az0.358974358974359
da0.3573264781491003
hr0.3573264781491003
sq0.34895833333333337
pl0.33510638297872336
cs0.29577464788732394
es0.28366762177650434
fr0.2331288343558282
nl0.2331288343558282
de0.22360248447204967
sk0.22360248447204967
be0.21875
hu0.21135646687697163
is0.20127795527156547
lt0.20127795527156547
lv0.20127795527156547
uk0.20127795527156547
reliabletrue
passestrue
9
name"Selvi"
dialogue"Haan, haan, dekhiye! Yeh dekhiye... yeh photo. Is aadmi ko dekhiye, woh kisi ko pedon ke peeche kheench raha tha!"
detectedLang"en"
heavyLang"de"
scores
en0.4570837642192347
yo0.39236111111111116
tl0.37200956937799046
cs0.26675977653631283
fr0.26573426573426573
nl0.2324561403508772
hu0.22680412371134018
et0.21171171171171171
ms0.21052631578947367
sl0.1935483870967742
lv0.1898148148148148
sq0.1822429906542056
eu0.16666666666666666
fi0.16666666666666666
ro0.16666666666666666
lt0.15322580645161288
is0.14910858995137766
hi0.12790697674418602
reliablefalse
passesfalse
10
name"Hunter"
dialogue"Hold on... let me see the display screen. What is that in the tree line? Is that... a red jacket?"
detectedLang"en"
heavyLang"en"
scores
en0.8226950354609929
tl0.6572995202193284
nl0.5644599303135889
sl0.5059288537549407
yo0.5044598612487611
fr0.49647532729103727
es0.49443882709807885
et0.4908350305498982
cs0.48240165631469983
it0.47257383966244726
da0.4529540481400437
de0.4337485843714609
ro0.4298745724059293
fi0.42660550458715596
sv0.42660550458715596
sq0.4232987312572088
no0.3983152827918171
pt0.3961352657004831
ca0.3939393939393939
hu0.38271604938271603
ms0.375
hr0.3548387096774194
sk0.3540051679586563
pl0.3531694695989651
is0.25037481259370314
az0.23547400611620795
hi0.14383561643835618
lt0.14089347079037798
tr0.1334488734835355
eu0.12280701754385964
lv0.12280701754385964
vi0.12280701754385964
reliabletrue
passestrue
11
name"Selvi"
dialogue"Haan! Wahi ladki thi! Maine shor machane ki koshish ki, lekin woh use le gaya! Mujhe bahut darr lag raha hai!"
detectedLang"fr"
heavyLang"de"
scores
fr0.40528634361233484
en0.36679174484052535
de0.3343195266272189
vi0.3161094224924012
et0.3105209397344229
sl0.2857142857142857
tl0.2849576271186441
ro0.27884615384615385
fi0.2757510729613734
it0.266304347826087
yo0.25824175824175827
hu0.24496644295302009
tr0.23642533936651583
nl0.19258373205741627
az0.18772563176895307
eu0.17883211678832117
es0.14987405541561713
sq0.1346153846153846
ms0.12903225806451613
no0.12677878395860284
sv0.12109375000000001
is0.11533420707732633
lv0.11533420707732633
pt0.09999999999999999
reliablefalse
passesfalse
12
name"Hunter"
dialogue"Damn it... that's her. Ma'am, whatever you're saying, this photograph is—"
detectedLang"en"
heavyLang"en"
scores
en0.8029045643153527
tl0.47222222222222227
fr0.3658210947930574
nl0.34210526315789475
tr0.32142857142857145
da0.31059506531204645
no0.2983751846381093
yo0.29210134128166915
sq0.2813918305597579
hu0.2448330683624801
is0.16225749559082892
sv0.15630550621669628
lv0.1532976827094474
hi0.1394927536231884
pt0.1316270566727605
reliabletrue
passestrue
13
name"Hunter"
dialogue"Hunter speaking. What? Another one? Where? Down on Miller Road?"
detectedLang"en"
heavyLang"en"
scores
en0.8220640569395018
tl0.6705107084019769
fr0.5203836930455635
de0.5180722891566265
no0.48186528497409326
da0.4805194805194805
ca0.45725915875169604
sv0.40119760479041916
et0.38650306748466257
nl0.3798449612403101
tr0.3620414673046252
fi0.36
es0.3174061433447099
hr0.30434782608695654
pl0.29947460595446584
is0.2844364937388193
ms0.2673992673992674
sq0.25512104283054005
pt0.250936329588015
it0.2366412213740458
az0.18200408997955012
hu0.18200408997955012
lt0.17864476386036962
hi0.17355371900826447
cs0.15789473684210525
sk0.15789473684210525
yo0.15789473684210525
ro0.12854030501089325
sl0.12854030501089325
reliabletrue
passestrue
14
name"Hunter"
dialogue"Listen to me, I have to get to Miller Road right now. Stay right here at this cafe. Don't delete those photos. Don't touch anything. I'm coming back with an interpreter, understood? Stay. Here."
detectedLang"en"
heavyLang"en"
scores
en0.8053786270346781
no0.5887850467289719
da0.5833333333333334
tl0.5714842228282041
fr0.5385906040268457
de0.5080500894454383
sq0.4570582428430405
sv0.4444444444444444
es0.4222689075630252
ca0.42074776197998953
nl0.40987124463519314
tr0.375
ro0.3746446844798181
it0.36890418818129667
pt0.36562860438292966
sk0.3099121706398996
pl0.30730478589420657
sl0.3055555555555556
hu0.30203045685279184
et0.29577464788732394
cs0.2948717948717949
ms0.2939666238767651
lv0.2801047120418848
hr0.2729676140118969
yo0.26273458445040215
fi0.23504867872044508
lt0.22752808988764048
is0.2258972554539057
eu0.21596578759800428
vi0.1760299625468165
az0.16603487490523125
hi0.06542056074766354
be0.05982905982905983
uk0.05417024935511608
reliabletrue
passestrue
15
name"Selvi"
dialogue"Aap kahan ja rahe hain? Suniye! Woh aadmi abhi bhi wahan ho sakta hai! Aap mujhe akela chhod kar kyun ja rahe hain?"
detectedLang"tr"
heavyLang"de"
scores
tr0.3172268907563025
tl0.2988133764832794
sq0.282560706401766
ms0.27211646136618145
fi0.27048260381593714
sl0.26636568848758463
ca0.2605233219567691
it0.24065420560747666
sk0.23076923076923078
no0.22341696535244923
vi0.19454770755885997
et0.19154228855721395
sv0.18851435705368288
eu0.1751269035532995
lv0.15032679738562094
cs0.1402116402116402
de0.11924119241192413
da0.10958904109589042
pl0.10958904109589042
is0.10468319559228649
yo0.10344827586206896
reliablefalse
passesfalse