Run: 2026-02-20-01KHY9ZA86Z3CN39S2NEDF1B00

Run Details

Model:
Grok 4.1 Fast
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
15.3s
Cost:
$0.000652
Provider:
xAI

Evaluation summary

Score Evaluator
Details Link
55.56% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Selvi: *muttering to herself, looking troubled at her camera* Yeh photo... yeh aadmi... kahaan gayab ho gaya? Hunter: Excuse me, miss. I'm Detective Hunter with the Alborn PD. That's a nice camera. Were you taking pictures at the apple festival last night? See anything unusual? Selvi: *shaken, eyes wide, speaking rapidly in Hindi* Haan! Maine dekha! Woh aadmi... apple stall ke paas tha... achanak gayab! Koi shadow... le gaya usko! Bhoot? Nahi, sach mein! Hunter: Uh... ma'am? Sorry, I didn't catch that. Do you speak any English? English? Selvi: *gesturing frantically at her camera screen, voice trembling* Dekho! Yeh photo! Yahaan tha woh... ab nahi! Madad karo, please! Police? Hunter: Okay, photos—yeah, I see a guy in the crowd. Disappeared? *confused frown, mimicking disappearance with hands* Like this? Who took him? You point? Selvi: *nodding vigorously, pointing at shadows in photo* Haan, haan! Yeh shadow... black coat wala aadmi... usne kheencha! Kahaan le gaya? Dar lagta hai! Hunter: Black coat? Got it, maybe. *pulling out notebook, struggling* Shadow man... pulled him? Festival stall? *phone buzzes* Hold on— Hunter: *answering call* Hunter here. Yeah? Another one? On my way—stay here, ma'am, I'll get a translator!
created_at"2026-02-20T19:56:04.24Z" 2/20/2026, 7:56:04 PM
model"x-ai/grok-4.1-fast"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency320
moderation_latency(null)
generation_time15123
tokens_prompt315
tokens_completion476
native_tokens_prompt418
native_tokens_completion1182
native_tokens_completion_images0
native_tokens_reasoning842
native_tokens_cached151
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"completed"
usage0.00065195
router(null)
provider_responses
0
endpoint_id"9821aa0e-dce3-4c27-9716-161359123d0b"
id"6ae9600b-e397-c186-7562-c06391f2eba4"
is_byokfalse
latency125
model_permaslug"x-ai/grok-4.1-fast"
provider_name"xAI"
status200
api_type"completions"
id"gen-1771617364-Acnc2ikMvh0Jeg1SGQOz"
upstream_id"6ae9600b-e397-c186-7562-c06391f2eba4"
total_cost0.00065195
cache_discount0.00002265
upstream_inference_cost0
provider_name"xAI"

Evaluation details

Result Evaluator Details Meta Data
55.56% Parse dialogue n/a
dialogue
0
name"Selvi"
dialogue"muttering to herself, looking troubled at her camera Yeh photo... yeh aadmi... kahaan gayab ho gaya?"
detectedLang"en"
heavyLang"ber"
scores
en0.685230024213075
tl0.5757180156657963
no0.5619946091644205
da0.47368421052631576
nl0.4444444444444444
de0.4268077601410935
fr0.4080145719489982
cs0.37137330754352027
sv0.336734693877551
fi0.33537832310838445
it0.3319630010277493
ms0.3319630010277493
sk0.3172268907563025
ca0.3114406779661017
ro0.2502883506343714
tr0.22062350119904073
lv0.21780986762936222
sl0.21686746987951808
hr0.21212121212121213
lt0.20440636474908203
es0.19950738916256158
sq0.18341708542713567
yo0.17407878017789072
pl0.17197452229299362
pt0.16666666666666666
hi0.10591471801925723
eu0.09972299168975068
is0.0984743411927878
et0.08835904628330996
reliabletrue
passesfalse
1
name"Hunter"
dialogue"Excuse me, miss. I'm Detective Hunter with the Alborn PD. That's a nice camera. Were you taking pictures at the apple festival last night? See anything unusual?"
detectedLang"en"
heavyLang"en"
scores
en0.7785787847579815
tl0.6342293297039808
fr0.549266247379455
it0.4799225931301403
no0.47866149369544136
ro0.47637603507062837
nl0.4740704500978474
es0.461961961961962
ca0.4424273858921162
sq0.44184839044652124
da0.4339125855713533
pt0.4297082228116711
et0.42697228144989335
ms0.41671188279978294
de0.4138495092693566
sv0.3926553672316384
sl0.34331093463653023
cs0.30375647668393785
hr0.26116838487972505
sk0.22883787661406027
yo0.2181818181818182
fi0.20722713864306785
pl0.20311341734618235
hu0.17180277349768877
tr0.17116422513492677
lv0.1673121611154144
lt0.16212003117692905
az0.14885193982581155
is0.11957411957411958
eu0.061135371179039305
vi0.061135371179039305
reliabletrue
passestrue
2
name"Selvi"
dialogue"shaken, eyes wide, speaking rapidly in Hindi Haan! Maine dekha! Woh aadmi... apple stall ke paas tha... achanak gayab! Koi shadow... le gaya usko! Bhoot? Nahi, sach mein!"
detectedLang"en"
heavyLang"en"
scores
en0.5349867139061116
tl0.5111731843575419
fr0.43426724137931033
de0.41699056079955577
nl0.34782608695652173
it0.34497816593886466
ms0.3264913406029506
ro0.32038834951456313
sv0.2822966507177033
sl0.25213675213675213
yo0.22106824925816024
no0.21991084695393756
es0.20514761544284632
eu0.2009132420091324
et0.19663351185921957
pt0.1904394757131843
sq0.16267942583732056
hu0.15797914995990378
cs0.15458937198067632
lt0.13934426229508196
is0.1386382280557834
hr0.1372226787181594
pl0.1372226787181594
fi0.13437757625721353
sk0.07813871817383669
lv0.07732864674868191
az0.07407407407407407
hi0.06914893617021277
tr0.06666666666666668
reliablefalse
passesfalse
3
name"Hunter"
dialogue"Uh... ma'am? Sorry, I didn't catch that. Do you speak any English? English?"
detectedLang"en"
heavyLang"en"
scores
en0.7820823244552059
tl0.5398773006134969
hr0.4238156209987196
cs0.412532637075718
sv0.4007989347536618
it0.39189189189189183
ca0.37586685159500693
pl0.37413073713490963
pt0.3626062322946175
sq0.3580599144079886
no0.3353028064992614
da0.31921331316187596
sk0.3119266055045872
vi0.27884615384615385
yo0.2682926829268293
ro0.2647058823529412
de0.24623115577889448
sl0.21052631578947367
fr0.16820702402957485
ms0.13793103448275862
be0.1346153846153846
tr0.1346153846153846
hu0.12959381044487428
az0.12280701754385964
et0.12280701754385964
is0.12280701754385964
lt0.12280701754385964
lv0.12280701754385964
uk0.12280701754385964
reliabletrue
passestrue
4
name"Selvi"
dialogue"gesturing frantically at her camera screen, voice trembling Dekho! Yeh photo! Yahaan tha woh... ab nahi! Madad karo, please! Police?"
detectedLang"en"
heavyLang"vi"
scores
en0.6850944716585025
tl0.5916515426497277
fr0.46492271105826394
no0.45021380574221137
da0.4325346784363178
ro0.4278448823903369
nl0.42344650864830236
sv0.41329856584093866
de0.39999999999999997
it0.3979933110367893
ms0.3098159509202454
es0.3082244427363567
sq0.2805755395683453
cs0.2741935483870968
eu0.2736077481840194
tr0.2730210016155089
sl0.2724333063864187
ca0.27125506072874495
fi0.23273657289002556
hr0.21397379912663753
pt0.20424403183023873
sk0.20283436669619131
is0.1935483870967742
et0.18256130790190736
lt0.1758241758241758
ja0.16512059369202228
pl0.14933837429111532
lv0.1412213740458015
hu0.13875598086124402
az0.13294797687861273
yo0.0816326530612245
hi0.07881269191402251
reliabletrue
passesfalse
5
name"Hunter"
dialogue"Okay, photos—yeah, I see a guy in the crowd. Disappeared? confused frown, mimicking disappearance with hands Like this? Who took him? You point?"
detectedLang"en"
heavyLang"en"
scores
en0.7937569676700111
tl0.621056943875461
fr0.5393426294820717
nl0.49231613611416025
no0.44874851013110845
da0.42582247051520794
it0.40970006381620927
sv0.40818937939859246
de0.3946335078534032
ro0.36946148602590323
pl0.3425728500355366
yo0.3321299638989169
pt0.33116413593637023
et0.32580174927113703
ca0.3248175182481752
is0.29817905918057663
ms0.2976461655277145
cs0.2922723794950268
es0.29064417177914115
sq0.2705047318611987
eu0.25821972734562953
hr0.2510121457489879
sl0.24918831168831165
sk0.22006745362563238
lt0.19565217391304346
hu0.19425087108013936
az0.19001751313485116
lv0.18069087688219662
tr0.13712686567164178
vi0.12570888468809074
hi0.07684630738522955
be0.07035175879396985
fi0.06376518218623482
uk0.06376518218623482
reliabletrue
passestrue
6
name"Selvi"
dialogue"nodding vigorously, pointing at shadows in photo Haan, haan! Yeh shadow... black coat wala aadmi... usne kheencha! Kahaan le gaya? Dar lagta hai!"
detectedLang"tl"
heavyLang"en"
scores
tl0.600274097761535
en0.5956561922365989
fr0.41783100465735196
it0.4119623655913978
ro0.40878378378378377
da0.31853582554517135
de0.303343949044586
nl0.29775280898876405
ms0.29605792437650846
pt0.2816091954022989
no0.2714404662781016
es0.26593959731543626
sl0.23647469458987785
lt0.19503219871205152
yo0.1935483870967742
sv0.1760828625235405
pl0.16745956232159848
vi0.15213178294573643
is0.14383561643835618
fi0.10714285714285714
hu0.10071942446043164
cs0.09138110072689512
az0.08759124087591241
tr0.08184679958027283
hi0.08088235294117647
sk0.07602956705385427
hr0.07112526539278131
reliabletrue
passesfalse
7
name"Hunter"
dialogue"Black coat? Got it, maybe. pulling out notebook, struggling Shadow man... pulled him? Festival stall? phone buzzes Hold on—"
detectedLang"en"
heavyLang"en"
scores
en0.7520793346129239
tl0.5670391061452514
da0.557648401826484
fr0.5060548119821543
de0.5028864656831302
no0.4695414099931554
nl0.45993031358885017
sv0.4159758854559156
hr0.3935837245696401
ms0.3785084202085004
cs0.3770096463022508
it0.37449556093623887
ca0.356312292358804
lv0.35416666666666663
sl0.3336199484092863
sk0.3080357142857143
pt0.29545454545454547
es0.2837338262476894
lt0.28107606679035246
ro0.27973977695167285
pl0.2716165413533835
sq0.2674858223062382
az0.2633079847908745
et0.26260704091341575
fi0.2597898758357211
yo0.16306695464362853
vi0.14647577092511013
hu0.143646408839779
is0.11428571428571428
hi0.09778812572759021
reliabletrue
passestrue
8
name"Hunter"
dialogue"answering call Hunter here. Yeah? Another one? On my way—stay here, ma'am, I'll get a translator!"
detectedLang"en"
heavyLang"en"
scores
en0.7840781073976718
tl0.5563271604938271
pl0.46759259259259256
da0.4534220532319392
hr0.41683569979716023
no0.4053774560496381
nl0.3985355648535565
fr0.3966421825813221
sq0.3966421825813221
de0.39217758985200846
ca0.39088983050847464
sv0.3895966029723991
ro0.3843683083511777
sk0.38105489773950485
cs0.37971952535059333
pt0.37431991294885747
et0.36951754385964913
ms0.36743674367436746
es0.3495475113122172
sl0.3187203791469194
it0.30387409200968524
fi0.2703045685279188
tr0.2571059431524548
yo0.25227568270481143
is0.23333333333333334
vi0.21555252387448842
hu0.213406292749658
lt0.2058011049723757
eu0.19241573033707865
lv0.19241573033707865
az0.18323863636363635
hi0.1274658573596358
reliabletrue
passestrue