Run: 2026-11-11-01M75PJVVAHB3B7NT2JN1RFD1P

Run Details

Model:
Gemini 4 Carbon (Reasoning, Medium)
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
1m 2s
Cost:
$0.045064
Provider:
Google AI Studio

Evaluation summary

Score Evaluator
Details Link
50.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Hunter: "Excuse me, ma'am. Detective Hunter, Alborn PD. I don't mean to interrupt your coffee, but the barista mentioned you're the college student who's always out taking landscape shots. With the string of disappearances we've had lately—and another local vanishing near the apple festival grounds last night—I was hoping you might've seen something out there." Selvi: "Kya... kya hua? Aap adhikari hain, hai na? Main... main kal shaam wahan pahadiyon ki tasveerein le rahi thi, tabhi maine kuch bohot ajeeb dekha..." Hunter: "Whoa, hold on there. Sorry, I don't... Wait a second. Do you not speak any English?" Selvi: "Mujhe aapki bhasha bilkul samajh nahi aa rahi hai! Kripya meri madad kijiye, kal shaam wahan kuch bohot galat hua tha. Mere haath abhi bhi kaanp rahe hain!" Hunter: "Okay, I have zero idea what you're saying, ma'am, and you're shaking like a leaf. Let's keep this simple. Take a breath. You're safe in here. I'm just going to point at that fancy lens on the table between us. Pictures. Did you take pictures last night?" Selvi: "Tasveerein? Haan, haan! Seb ke bagiche ke paas andhera ho raha tha, aur main aakhiri roshni kheench rahi thi. Rukiye, main aapko abhi dikhati hoon." Hunter: "Alright, now we're getting somewhere. The Marine Corps taught me how to read a room, even if I don't know a single word of your language. Go ahead and pull it up on the little screen there. Show me what's got you so rattled." Selvi: "Yeh dekhiye! Wahan, un pedon ke peeche. Woh lambi parchhayi dekh rahe hain aap? Wahan koi chhup raha tha, aur phir achanak dhundh mein gayab ho gaya!" Hunter: "Let me get a closer look at that... That's the north fence by the Alborn orchard, alright. Wait a minute. Right there in the treeline, is that a— Hang on. Sorry, that's my phone ringing. Hold that thought." Selvi: "Kya hua? Aap ruk kyun gaye? Is tasveer mein kuch zaroori hai, hai na?" Hunter: "Detective Hunter, go ahead. ... Slow down, Deputy. Where? Out behind the old cider mill? Copy that. Keep the apple festival volunteers back and secure the perimeter, I'm two minutes out. ... Look, ma'am, I have to run. Take my card. Don't let anyone touch those photos, alright? I'm going to track down someone from your study abroad program who can translate, and I'll find you later." Selvi: "Arre, rukiye! Aap aise kaise ja sakte hain? Meri baat toh poori sun lijiye!"
created_at"2026-11-11T16:20:47.124Z" 11/11/2026, 4:20:47 PM
model"google/gemini-4-carbon-20261110"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency5948
moderation_latency(null)
generation_time61539
tokens_prompt302
tokens_completion2157
native_tokens_prompt322
native_tokens_completion4442
native_tokens_completion_images0
native_tokens_reasoning3759
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
num_fetches(null)
web_search_engine(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"STOP"
service_tier"default"
usage0.045064
router(null)
user_agent"langchainjs-openai/1.0.0 ((node/v24.22.2; linux; x64))"
http_referer(null)
request_id"req-1794414047-x7kFkKijbxJGcwqNveIN"
session_id(null)
preset_id(null)
api_type"completions"
id"gen-1794414047-GGTX74Fwa1TjhDsAnoZI"
upstream_id"35X0aoLbEomu5NoPxZOp4QI"
provider_responses
0
endpoint_id"f0c9681d-e99b-4bcb-8031-752429da222d"
id"35X0aoLbEomu5NoPxZOp4QI"
is_byokfalse
latency5948
model_permaslug"google/gemini-4-carbon-20261110"
provider_name"Google AI Studio"
status200
total_cost0.045064
cache_discount(null)
upstream_inference_cost0
provider_name"Google AI Studio"
response_cache_source_id(null)
data_region"global"
workspace_id"97e315e5-d303-487d-83c1-83180e8a13d4"

Evaluation details

Result Evaluator Details Meta Data
50.00% Parse dialogue n/a
dialogue
0
name"Hunter"
dialogue"Excuse me, ma'am. Detective Hunter, Alborn PD. I don't mean to interrupt your coffee, but the barista mentioned you're the college student who's always out taking landscape shots. With the string of disappearances we've had lately—and another local vanishing near the apple festival grounds last night—I was hoping you might've seen something out there."
detectedLang"en"
heavyLang"en"
scores
en0.7636765888978279
tl0.5888733379986004
nl0.4897959183673469
fr0.4803184431667404
no0.4432598910210851
de0.4093993465694898
it0.4024917365878464
da0.3980532786885246
sv0.37978358405911844
ro0.37748344370860926
ca0.37366737739872063
es0.36929683306494904
pt0.3658931462493254
ms0.342841163310962
sq0.3130663548669979
hr0.2911010558069381
sl0.2710918114143921
cs0.2667706708268331
sk0.2551505546751189
pl0.25111536010197577
yo0.2482405630198337
et0.22976073418551293
lv0.18713248011068834
lt0.17514917514917516
fi0.16873010258224266
hu0.14885910901847155
is0.14545454545454545
az0.12083800972689861
tr0.10883579825559349
eu0.09406322282189669
vi0.050888529886914384
hi0.031327287716405604
be0.02892561983471074
uk0.026108578532946538
reliabletrue
passestrue
1
name"Selvi"
dialogue"Kya... kya hua? Aap adhikari hain, hai na? Main... main kal shaam wahan pahadiyon ki tasveerein le rahi thi, tabhi maine kuch bohot ajeeb dekha..."
detectedLang"tl"
heavyLang"vi"
scores
tl0.3939393939393939
fr0.3401759530791789
sl0.31921331316187596
fi0.3108728943338438
eu0.2834394904458599
yo0.27125506072874495
ms0.2682926829268293
vi0.25742574257425743
nl0.2524916943521595
de0.2518703241895262
pl0.23273657289002556
en0.225473321858864
ro0.2248062015503876
it0.21397379912663753
et0.21052631578947367
hu0.19571045576407506
tr0.1935483870967742
is0.16820702402957485
az0.14772727272727273
sk0.14611005692599618
cs0.14448669201520914
hr0.14285714285714285
pt0.13294797687861273
es0.11678115799803727
lv0.08906882591093118
lt0.07881269191402251
sq0.07881269191402251
reliablefalse
passesfalse
2
name"Hunter"
dialogue"Whoa, hold on there. Sorry, I don't... Wait a second. Do you not speak any English?"
detectedLang"en"
heavyLang"en"
scores
en0.8107364074328974
tl0.5798319327731093
hr0.4912118408880666
cs0.4874184529356943
ca0.4791666666666667
pl0.45436507936507936
it0.4527363184079602
sk0.4264859228362878
sq0.4216614090431125
pt0.4186046511627907
da0.41798941798941797
fr0.41798941798941797
ro0.40604751619870405
yo0.3949394939493949
de0.36562860438292966
no0.35064935064935066
et0.3373493975903614
sv0.33171324422843257
vi0.30730478589420657
tr0.29032258064516125
hu0.28848641655886154
fi0.2791612057667104
sl0.2763157894736842
lt0.20863309352517986
nl0.20863309352517986
is0.2005813953488372
ms0.19708029197080293
az0.19472913616398244
lv0.19472913616398244
es0.1935483870967742
hi0.13249211356466878
be0.11290322580645161
eu0.11290322580645161
uk0.10277324632952692
reliabletrue
passestrue
3
name"Selvi"
dialogue"Mujhe aapki bhasha bilkul samajh nahi aa rahi hai! Kripya meri madad kijiye, kal shaam wahan kuch bohot galat hua tha. Mere haath abhi bhi kaanp rahe hain!"
detectedLang"tl"
heavyLang"id"
scores
tl0.3761140819964349
et0.2738589211618257
ms0.27083333333333337
sq0.2374727668845316
eu0.22394678492239467
sv0.1984732824427481
da0.18856259659969088
no0.1712707182320442
fi0.15458937198067632
lv0.14145543744889613
vi0.1300745650372825
ro0.1257285595337219
nl0.09090909090909091
is0.08854166666666667
it0.08695652173913043
es0.0674955595026643
ca0.06666666666666668
tr0.06666666666666668
reliablefalse
passesfalse
4
name"Hunter"
dialogue"Okay, I have zero idea what you're saying, ma'am, and you're shaking like a leaf. Let's keep this simple. Take a breath. You're safe in here. I'm just going to point at that fancy lens on the table between us. Pictures. Did you take pictures last night?"
detectedLang"en"
heavyLang"en"
scores
en0.8088274751811108
tl0.6622422374970373
fr0.46002273588480486
da0.4309105431309905
ca0.42002442002442
no0.39490445859872614
yo0.35549525101763907
ro0.3418013856812933
nl0.32814710042432815
sv0.3069066147859922
pl0.3052169673330083
es0.302154750244858
de0.2966436327739388
hr0.2928039702233251
sl0.28856714927608584
et0.281029263370333
cs0.26772867420349433
it0.25470711297071125
sq0.23959445037353258
sk0.22300981461286806
ms0.20391061452513964
pt0.20078519349411103
lv0.19171866137266025
tr0.18849658314350795
lt0.14874551971326164
hu0.13531553398058252
az0.13215590742996344
fi0.13003663003663005
is0.12790697674418602
vi0.08536585365853659
hi0.05566600397614314
be0.04682274247491639
eu0.04682274247491639
uk0.04233870967741936
reliabletrue
passestrue
5
name"Selvi"
dialogue"Tasveerein? Haan, haan! Seb ke bagiche ke paas andhera ho raha tha, aur main aakhiri roshni kheench rahi thi. Rukiye, main aapko abhi dikhati hoon."
detectedLang"ms"
heavyLang"da"
scores
ms0.300087489063867
de0.2599444958371878
it0.2179863147605083
en0.20870425321463898
cs0.20713577799801783
sq0.20398009950248755
tl0.18200408997955012
fr0.18032786885245902
vi0.16230366492146597
et0.14984059511158343
tr0.14984059511158343
eu0.13513513513513514
ca0.13043478260869565
no0.12184412733260154
sk0.12184412733260154
ro0.11602209944751381
is0.10514541387024609
nl0.0990990990990991
yo0.0990990990990991
reliablefalse
passesfalse
6
name"Hunter"
dialogue"Alright, now we're getting somewhere. The Marine Corps taught me how to read a room, even if I don't know a single word of your language. Go ahead and pull it up on the little screen there. Show me what's got you so rattled."
detectedLang"en"
heavyLang"en"
scores
en0.8151688973868706
tl0.605227334603866
no0.4757772957339118
yo0.4561140285071268
nl0.42115768463073855
fr0.4169682348210696
de0.36431389741341513
da0.3471409275101306
sq0.3357764544205222
ro0.3330266789328427
it0.3262081784386617
hr0.31636020744931637
sv0.31636020744931637
sk0.30853600381497376
ms0.3015414258188825
pl0.30120481927710846
et0.2998551424432641
pt0.2964580300824842
cs0.2857142857142857
es0.26693629929221435
sl0.2647058823529412
ca0.2609582059123343
fi0.22913343965975547
lv0.21621621621621623
is0.210239651416122
lt0.2072170585019136
tr0.15746658919233003
vi0.13793103448275862
hu0.13329348475791988
eu0.12703190848886212
az0.08401768793430196
hi0.054758800521512385
be0.046052631578947366
uk0.04163912756113682
reliabletrue
passestrue
7
name"Selvi"
dialogue"Yeh dekhiye! Wahan, un pedon ke peeche. Woh lambi parchhayi dekh rahe hain aap? Wahan koi chhup raha tha, aur phir achanak dhundh mein gayab ho gaya!"
detectedLang"ms"
heavyLang"ga"
scores
ms0.4290123456790123
ro0.3277616279069767
it0.3218475073313783
ca0.27336999214454044
fr0.26992896606156275
tl0.2611821086261981
eu0.20395869191049915
es0.19774501300954034
sq0.1935483870967742
cs0.18430335097001763
pt0.17410714285714285
yo0.17336907953529937
fi0.1726296958855098
lv0.15293040293040291
et0.13227016885553472
de0.11904761904761905
no0.10714285714285714
sk0.10714285714285714
hu0.0966796875
hr0.08325074331020813
tr0.075
reliablefalse
passesfalse
8
name"Hunter"
dialogue"Let me get a closer look at that... That's the north fence by the Alborn orchard, alright. Wait a minute. Right there in the treeline, is that a— Hang on. Sorry, that's my phone ringing. Hold that thought."
detectedLang"en"
heavyLang"en"
scores
en0.793610911701364
tl0.6157701303040428
da0.4927216585796207
nl0.4909251881363435
no0.48174853537629564
fr0.4547178757705074
de0.4188984335522991
et0.4147582697201017
cs0.3960084033613445
it0.3886230728335992
sl0.38403856454204605
yo0.3611111111111111
ms0.36075597554196775
sq0.3451025056947608
pt0.3439817455790074
sk0.3294460641399417
pl0.32193396226415094
ro0.3059746529873265
fi0.27261227071473754
sv0.25902061855670105
hr0.2580645161290322
es0.2517891997397528
hu0.21232876712328766
ca0.21070693205216195
tr0.203601108033241
is0.18842625264643612
vi0.15003695491500368
az0.11809815950920245
lt0.11196911196911197
lv0.10644910644910643
hi0.06807131280388978
zh0.06351791530944625
eu0.05737704918032788
ja0.04880066170388751
reliabletrue
passestrue
9
name"Selvi"
dialogue"Kya hua? Aap ruk kyun gaye? Is tasveer mein kuch zaroori hai, hai na?"
detectedLang"nl"
heavyLang"nl"
scores
nl0.5078740157480316
sk0.3822075782537067
pl0.3811881188118812
sl0.38016528925619836
yo0.3697478991596639
tl0.3169398907103825
en0.29775280898876405
vi0.2951127819548872
hu0.29111531190926276
cs0.28842504743833014
hr0.2857142857142857
pt0.2690058479532163
de0.25
et0.21875
it0.21052631578947367
is0.19700214132762314
lt0.17035398230088497
sq0.17035398230088497
reliablefalse
passesfalse
10
name"Hunter"
dialogue"Detective Hunter, go ahead. ... Slow down, Deputy. Where? Out behind the old cider mill? Copy that. Keep the apple festival volunteers back and secure the perimeter, I'm two minutes out. ... Look, ma'am, I have to run. Take my card. Don't let anyone touch those photos, alright? I'm going to track down someone from your study abroad program who can translate, and I'll find you later."
detectedLang"en"
heavyLang"en"
scores
en0.7913345212416768
tl0.5724442736356649
fr0.46604271658267343
da0.42222799272916123
no0.3895747599451303
ro0.38056792873051226
it0.36735854421381864
ca0.36699857752489334
de0.3574935027432862
sq0.3554461181923523
es0.3480808672721945
sv0.3338323353293413
cs0.3330335731414868
pt0.3328335832083958
nl0.32019553926061717
hr0.31284743668931436
sl0.30986352357320096
pl0.2794689119170984
ms0.27144728225278325
sk0.2680921052631579
lt0.2416496250852079
lv0.2343427391603579
yo0.23407917383821
tr0.21461348393928698
et0.2039355992844365
az0.175009269558769
hu0.11071143085531573
eu0.10857371794871795
fi0.08436213991769548
vi0.06355218855218855
hi0.03344917463075586
be0.030501089324618737
is0.027534965034965036
uk0.027534965034965036
reliabletrue
passestrue
11
name"Selvi"
dialogue"Arre, rukiye! Aap aise kaise ja sakte hain? Meri baat toh poori sun lijiye!"
detectedLang"et"
heavyLang"tlh"
scores
et0.4820065430752454
fi0.35197817189631647
sq0.35020519835841313
yo0.2824773413897281
de0.27480916030534347
en0.2725880551301685
da0.24722662440570525
tr0.22889610389610393
eu0.22512234910277326
lv0.19491525423728812
ca0.18664383561643835
fr0.18664383561643835
nl0.1739130434782609
sk0.15026833631484796
pl0.14414414414414414
sl0.14414414414414414
no0.13793103448275862
sv0.13636363636363635
reliablefalse
passesfalse