Run: 2026-11-11-01M75R05HY3SQ19PH122E008ED

Run Details

Model:
Gemini 4 Carbon (Reasoning, Medium)
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
57.3s
Cost:
$0.045414
Provider:
Google AI Studio

Evaluation summary

Score Evaluator
Details Link
50.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Selvi: "Yeh kya hai...? Kal shaam toh maine sirf seb ke pedon ki tasveer li thi... Yeh parchhai kiski hai?" Hunter: "Excuse me, ma'am. Hate to interrupt your coffee and your photo review there. I'm Detective Hunter, Alborn PD. We had another townsfolk go missing near the Apple Festival grounds last night, and people say you're always out taking pictures of the countryside. Did you happen to see anything unusual?" Selvi: "Hain?! Aap... aap kaun hain? Mujhe aapki baat samajh nahi aa rahi... Par kal shaam, bagiche mein... wahan sach mein kuch hua tha! Mera dil abhi tak ghabra raha hai!" Hunter: "Whoa, easy there. Take a breath. Look, I don't—what language is that? Do you speak any English at all, ma'am?" Selvi: "Nahi, mujhe angrezi nahi aati! Par kripya meri baat suniye... Yeh dekhiye, is parde par dekhiye! Jab suraj dhal raha tha, wahan pedon ke peeche koi aadmi tha!" Hunter: "I haven't got a clue what you're saying, ma'am, not a single word. You're shaking like a leaf, though. Here, slow down—are you trying to show me your camera screen? Let me take a look." Selvi: "Haan, haan! Dekhiye! Yeh lamba sa aadmi... aur phir andhere se koi aaya aur use kheench kar le gaya! Main dar ke maare wahan se bhaag aayi!" Hunter: "Hold it steady for a second... That's out by the old cider mill, alright. And that blurry shape... damn, that looks like Miller's red flannel. You actually caught something out there, didn't you? Look at me—was this yesterday? Right before dark?" Selvi: "Aap kya pooch rahe hain? Mujhe kuch samajh nahi aa raha! Par wahan khatra hai, aapko abhi wahan jaana chahiye! Koi badi musibat mein hai!" Hunter: "This language barrier is hell, isn't it? Look, you're here with that study abroad program, right? Don't touch any buttons on that thing, and don't delete a single file—hold on, that's my phone. Gotta take this. ... Hunter here. Go ahead, dispatch. ... Out by the north orchard? Copy that. Tell the deputy to secure the perimeter, I'm five minutes out." Selvi: "Arre, aap kahan ja rahe hain?! Rukiye! Meri baat toh poori sun lijiye!" Hunter: "Sorry, ma'am, I have to roll. Stay right here in the cafe, finish your drink, and keep that camera safe. I'm gonna track down someone who speaks your language and I'll be back to get a full statement. Sit tight."
created_at"2026-11-11T16:45:31.604Z" 11/11/2026, 4:45:31 PM
model"google/gemini-4-carbon-20261110"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency4313
moderation_latency(null)
generation_time57231
tokens_prompt302
tokens_completion2137
native_tokens_prompt322
native_tokens_completion4477
native_tokens_completion_images0
native_tokens_reasoning3815
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
num_fetches(null)
web_search_engine(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"STOP"
service_tier"default"
usage0.045414
router(null)
user_agent"langchainjs-openai/1.0.0 ((node/v24.22.2; linux; x64))"
http_referer(null)
request_id"req-1794415531-aBUNiPvC8l5yPt2VGF21"
session_id(null)
preset_id(null)
api_type"completions"
id"gen-1794415531-k6RnJilMcY0czTa8izaJ"
upstream_id"q5v0asSZL9mco_UP_83j-QY"
provider_responses
0
endpoint_id"f0c9681d-e99b-4bcb-8031-752429da222d"
id"q5v0asSZL9mco_UP_83j-QY"
is_byokfalse
latency4313
model_permaslug"google/gemini-4-carbon-20261110"
provider_name"Google AI Studio"
status200
total_cost0.045414
cache_discount(null)
upstream_inference_cost0
provider_name"Google AI Studio"
response_cache_source_id(null)
data_region"global"
workspace_id"97e315e5-d303-487d-83c1-83180e8a13d4"

Evaluation details

Result Evaluator Details Meta Data
50.00% Parse dialogue n/a
dialogue
0
name"Selvi"
dialogue"Yeh kya hai...? Kal shaam toh maine sirf seb ke pedon ki tasveer li thi... Yeh parchhai kiski hai?"
detectedLang"ro"
heavyLang"tlh"
scores
ro0.34497816593886466
vi0.34210526315789475
fr0.3325917686318131
et0.33035714285714285
fi0.3087557603686636
it0.3006993006993007
lv0.2762364294330519
nl0.27007299270072993
yo0.250936329588015
ca0.2366412213740458
cs0.2366412213740458
en0.21363040629095675
az0.20634920634920634
sl0.20318725099601595
de0.19678714859437751
ms0.1891891891891892
hu0.1678224687933426
sk0.14893617021276595
tr0.14772727272727273
hr0.14407988587731813
pt0.1366906474820144
tl0.12023460410557184
es0.1111111111111111
lt0.10979228486646886
pl0.10979228486646886
reliablefalse
passesfalse
1
name"Hunter"
dialogue"Excuse me, ma'am. Hate to interrupt your coffee and your photo review there. I'm Detective Hunter, Alborn PD. We had another townsfolk go missing near the Apple Festival grounds last night, and people say you're always out taking pictures of the countryside. Did you happen to see anything unusual?"
detectedLang"en"
heavyLang"en"
scores
en0.7816473189607518
tl0.605
fr0.4653492149431511
nl0.45652173913043476
no0.42869540063639
da0.40133373749621104
de0.379126060987111
es0.34450713574510455
pt0.3341200269723533
sq0.33344583192710087
et0.32708688245315165
it0.3222374742621825
ro0.32083906464924344
ca0.3180248618784531
sv0.31375955524669913
ms0.3087154357717886
sl0.2730953257269047
cs0.24271472392638038
yo0.2350890782339272
pl0.23211508553654742
hr0.21346077260055754
sk0.1670181358076761
lv0.15199656504937742
is0.13642326191517273
lt0.1345311130587204
fi0.13033905768383972
az0.11235955056179775
hu0.10471441523118767
tr0.09899635036496351
eu0.039863879436071954
hi0.03752436647173489
vi0.030912659470068698
reliabletrue
passestrue
2
name"Selvi"
dialogue"Hain?! Aap... aap kaun hain? Mujhe aapki baat samajh nahi aa rahi... Par kal shaam, bagiche mein... wahan sach mein kuch hua tha! Mera dil abhi tak ghabra raha hai!"
detectedLang"ms"
heavyLang"tl"
scores
ms0.38226744186046513
eu0.26279271465741544
sv0.24645390070921988
lv0.22867513611615245
de0.22727272727272727
et0.22374429223744294
fr0.2144177449168207
tl0.21150278293135436
it0.20337394564198688
no0.20337394564198688
fi0.18426103646833014
da0.17395529640427598
vi0.15590863952333664
cs0.1326530612244898
sk0.13087934560327197
pl0.12551440329218108
sq0.12099276111685627
tr0.12099276111685627
es0.1099476439790576
nl0.1099476439790576
is0.10714285714285714
reliablefalse
passesfalse
3
name"Hunter"
dialogue"Whoa, easy there. Take a breath. Look, I don't—what language is that? Do you speak any English at all, ma'am?"
detectedLang"en"
heavyLang"en"
scores
en0.816316189511021
tl0.5868945868945868
no0.462962962962963
da0.42913385826771655
ro0.40230832646331405
de0.39633638634471274
sq0.39482470784641066
yo0.3917785234899329
cs0.38192668371696503
hr0.37928082191780826
ca0.35954063604240283
hu0.34210526315789475
pl0.3403093721565059
sv0.32242990654205606
sk0.3153918791312559
nl0.30355427473583096
is0.3022136669874879
it0.3008678881388621
pt0.2899118511263467
et0.28711897738446407
sl0.28430404738400794
vi0.2518059855521156
ms0.23442449841605068
lt0.2229367631296892
fr0.2050438596491228
eu0.16953035509736541
tr0.16857798165137614
az0.15501165501165504
lv0.15501165501165504
es0.15402567094515754
be0.0880503144654088
fi0.0799492385786802
uk0.0799492385786802
reliabletrue
passestrue
4
name"Selvi"
dialogue"Nahi, mujhe angrezi nahi aati! Par kripya meri baat suniye... Yeh dekhiye, is parde par dekhiye! Jab suraj dhal raha tha, wahan pedon ke peeche koi aadmi tha!"
detectedLang"ms"
heavyLang"vi"
scores
ms0.35281065088757396
ro0.25468483816013626
nl0.22429078014184398
et0.21944692239072258
fr0.20598911070780399
sq0.2023701002734731
lt0.19205909510618652
yo0.19205909510618652
cs0.1883116883116883
fi0.18071161048689138
da0.17140151515151517
hr0.1650763358778626
eu0.15865384615384615
en0.15377176015473887
lv0.15048543689320387
hu0.14965986394557826
tl0.13021868787276342
tr0.10714285714285714
no0.09700722394220845
sv0.09607438016528924
is0.09513960703205791
es0.08663883089770355
pt0.08663883089770355
de0.08184679958027283
sl0.0779768177028451
reliablefalse
passesfalse
5
name"Hunter"
dialogue"I haven't got a clue what you're saying, ma'am, not a single word. You're shaking like a leaf, though. Here, slow down—are you trying to show me your camera screen? Let me take a look."
detectedLang"en"
heavyLang"en"
scores
en0.7933884297520661
tl0.5962858296326201
no0.4577006507592191
nl0.39283545840922895
ro0.38461538461538464
cs0.3581514762516046
it0.35358758888170655
ca0.3519118600129617
sv0.331997327989312
sl0.32523616734143057
da0.3220338983050847
pt0.3145990404386566
sq0.31224209078404397
fr0.3021632937892533
es0.28977272727272724
sk0.28724162508909473
ms0.27483683828861494
hr0.2684711046086321
pl0.26793557833089315
yo0.2553983618763961
tr0.24528301886792453
de0.22839506172839508
lv0.20318725099601595
lt0.19935948759007205
hu0.1823385118560916
fi0.18166939443535188
et0.18099918099918103
is0.1728701406120761
az0.11738746690203002
vi0.11738746690203002
be0.06542056074766354
eu0.06542056074766354
uk0.059266227657572904
reliabletrue
passestrue
6
name"Selvi"
dialogue"Haan, haan! Dekhiye! Yeh lamba sa aadmi... aur phir andhere se koi aaya aur use kheench kar le gaya! Main dar ke maare wahan se bhaag aayi!"
detectedLang"tl"
heavyLang"da"
scores
tl0.46949602122015915
ro0.4306049822064057
ms0.42363112391930835
en0.37888198757763975
fr0.37597503900156004
sl0.3360995850622407
es0.29947460595446584
it0.2857142857142857
yo0.2837958818263205
et0.2640294388224471
sq0.2626728110599078
de0.250936329588015
hr0.23076923076923078
cs0.2300288739172281
pt0.20948616600790515
fi0.1919191919191919
sv0.17525773195876287
no0.16579770594369134
sk0.16230366492146597
lt0.13606911447084233
tr0.1111111111111111
hu0.1091314031180401
ca0.10714285714285714
nl0.10514541387024609
da0.1031390134529148
reliablefalse
passesfalse
7
name"Hunter"
dialogue"Hold it steady for a second... That's out by the old cider mill, alright. And that blurry shape... damn, that looks like Miller's red flannel. You actually caught something out there, didn't you? Look at me—was this yesterday? Right before dark?"
detectedLang"en"
heavyLang"en"
scores
en0.8081596112034787
tl0.5677233429394812
da0.41792782305005816
no0.4040524433849821
fr0.36895246108540175
nl0.3294590970049173
de0.28639391056137015
es0.2798847815650504
sq0.2725509214354995
yo0.2725509214354995
ro0.24887330996494744
pt0.24050632911392408
it0.20255183413078148
cs0.18522542096686584
ca0.1847826086956522
hu0.17627677100494232
ms0.16805324459234608
sv0.1638795986622074
sk0.1506228765571914
et0.14578587699316628
sl0.14432401597261837
az0.13194444444444445
tr0.13194444444444445
pl0.1294254207777133
fi0.1243432574430823
hr0.11084765856550088
is0.09801563439567047
lv0.09420289855072464
ja0.0625
lt0.051833122629582805
eu0.0445859872611465
vi0.0445859872611465
reliabletrue
passestrue
8
name"Selvi"
dialogue"Aap kya pooch rahe hain? Mujhe kuch samajh nahi aa raha! Par wahan khatra hai, aapko abhi wahan jaana chahiye! Koi badi musibat mein hai!"
detectedLang"ms"
heavyLang"tl"
scores
ms0.3911719939117199
et0.3197278911564626
eu0.3191489361702128
fi0.3174061433447099
lv0.2914083259521701
no0.26538108356290174
tl0.2640294388224471
da0.23736892278360344
sv0.23076923076923078
fr0.20556107249255212
de0.1902834008097166
ca0.18283963227783454
it0.17269906928645296
vi0.16405433646812956
is0.1130820399113082
hr0.09808342728297632
ro0.08779931584948689
sq0.08779931584948689
en0.08045977011494253
pl0.08045977011494253
sk0.07727797001153403
az0.07300115874855156
es0.06868451688009314
nl0.06868451688009314
pt0.06868451688009314
reliablefalse
passesfalse
9
name"Hunter"
dialogue"This language barrier is hell, isn't it? Look, you're here with that study abroad program, right? Don't touch any buttons on that thing, and don't delete a single file—hold on, that's my phone. Gotta take this. ... Hunter here. Go ahead, dispatch. ... Out by the north orchard? Copy that. Tell the deputy to secure the perimeter, I'm five minutes out."
detectedLang"en"
heavyLang"en"
scores
en0.7918617962326985
tl0.5738333688472192
fr0.4739610731194108
no0.41400527395253445
da0.4006592747977225
ro0.3848046754844663
it0.3757802746566792
de0.375
nl0.37460913070669166
sq0.35773924213230573
sk0.3423216047352844
ca0.3414553836022391
sv0.33862433862433866
yo0.3373094764744864
pl0.31295087598763305
pt0.3127147766323024
cs0.31153184165232356
ms0.31058255773871074
es0.2917847025495751
sl0.27166788055353236
et0.258160237388724
hr0.25037481259370314
hu0.2438563327032136
lv0.22269724057520401
lt0.2057188244638602
tr0.19387343812978639
fi0.1892987434130523
eu0.13457377758546085
is0.111505997334518
vi0.09214707217430776
az0.07235621521335807
hi0.04030710172744722
reliabletrue
passestrue
10
name"Selvi"
dialogue"Arre, aap kahan ja rahe hain?! Rukiye! Meri baat toh poori sun lijiye!"
detectedLang"et"
heavyLang"tlh"
scores
et0.4613434727503169
tl0.39458689458689455
fi0.36186186186186187
yo0.3055555555555556
tr0.24911660777385158
eu0.24511545293072823
ms0.24511545293072823
lv0.21296296296296297
ca0.20411985018726592
en0.1904761904761905
de0.17153996101364524
sk0.1650294695481336
da0.15841584158415842
pl0.15841584158415842
sl0.15841584158415842
sq0.15
sv0.15
reliablefalse
passesfalse
11
name"Hunter"
dialogue"Sorry, ma'am, I have to roll. Stay right here in the cafe, finish your drink, and keep that camera safe. I'm gonna track down someone who speaks your language and I'll be back to get a full statement. Sit tight."
detectedLang"en"
heavyLang"en"
scores
en0.7847738014854828
tl0.5657356948228883
it0.45928753180661575
da0.44995685936151847
yo0.4420131291028446
no0.43433895297249336
ro0.4069767441860465
sv0.4022503516174402
fr0.3991517436380773
nl0.3547570850202429
de0.34514637904468415
ca0.31963713980789754
sq0.3156199677938808
pl0.31266846361185985
et0.2904841402337229
ms0.28651371012870736
lt0.2812852311161218
cs0.2792538157150932
hr0.27884615384615385
sk0.26343154246100525
sl0.2513211978860834
hu0.24016686531585218
pt0.2333132892363199
es0.22914147521160824
az0.21199011124845488
is0.2016280525986224
lv0.19962335216572505
tr0.13909520594193112
fi0.12250516173434273
eu0.10400562192550948
vi0.09446022727272727
be0.05204460966542751
uk0.04708520179372198
reliabletrue
passestrue