Run: 2026-02-20-01KHY9JERPTK429Q118261GGFT

Run Details

Model:
Grok 4.1 Fast
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
15.6s
Cost:
$0.000623
Provider:
xAI

Evaluation summary

Score Evaluator
Details Link
45.45% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Selvi: *muttering to herself, looking troubled at her camera* Yeh photo... yeh sach mein... kaise ho sakta hai? Hunter: Excuse me, miss. I'm Detective Hunter with the Alborn PD. Mind if I ask—were you at the apple festival last night? Did you see anything unusual near the cider tent around 10 PM? There was a disappearance... Selvi: *eyes widening, shaken, speaking rapidly in Hindi* Nahi! Main ne dekha! Woh aadmi... black coat mein... woh tent ke peeche gayab ho gaya! Koi saaya... bhoot jaise! Police ko batao, please! Hunter: *confused frown* Uh... sorry? English? Festival? Cider tent? Disappearance? Selvi: *gesturing frantically at her camera, voice trembling* Camera mein proof hai! Dekho! Yeh photo... woh chehra... gayab! Khatra hai yahan, sabko batao! Hunter: *leaning in, puzzled, no recognition* Look, I don't understand. Hindi? You took pictures? *mimes camera* Photo? Of the man in the black coat? Selvi: *nodding vigorously, still shaken* Haan, haan! Black coat wala aadmi! Tent ke paas... raat ko... poof! Gayab! Main darr gayi thi... koi madad karo! Hunter: *scratching head, trying gestures for "show me"* Can you show me? Camera? Please? Important for the case... Selvi: *fumbling with camera, tears welling, in Hindi* Yeh dekho... yahan tha woh... ab nahi! Kya karoon? India se aayi hoon, yeh sheher... andhera hai! Hunter: *phone buzzing in pocket* Okay, hold on— *glances at phone* Damn, I gotta take this. Stay here, alright? We'll figure this out—translator or something! *stands, answering call* Hunter here... yeah, on my way. Selvi: *calling after him desperately* Ruko! Suno!
created_at"2026-02-20T19:49:02.881Z" 2/20/2026, 7:49:02 PM
model"x-ai/grok-4.1-fast"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency433
moderation_latency(null)
generation_time15196
tokens_prompt315
tokens_completion545
native_tokens_prompt418
native_tokens_completion1123
native_tokens_completion_images0
native_tokens_reasoning681
native_tokens_cached150
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"completed"
usage0.0006226
router(null)
provider_responses
0
endpoint_id"9821aa0e-dce3-4c27-9716-161359123d0b"
id"84056524-c7f7-5cee-83aa-9542aaeff8f9"
is_byokfalse
latency194
model_permaslug"x-ai/grok-4.1-fast"
provider_name"xAI"
status200
api_type"completions"
id"gen-1771616942-UVVLbxx7Kz7kZ7QCeiSX"
upstream_id"84056524-c7f7-5cee-83aa-9542aaeff8f9"
total_cost0.0006226
cache_discount0.0000225
upstream_inference_cost0
provider_name"xAI"

Evaluation details

Result Evaluator Details Meta Data
45.45% Parse dialogue n/a
dialogue
0
name"Selvi"
dialogue"muttering to herself, looking troubled at her camera Yeh photo... yeh sach mein... kaise ho sakta hai?"
detectedLang"en"
heavyLang"ber"
scores
en0.6966868875408306
no0.5833333333333334
tl0.4897959183673469
de0.48371723590150917
da0.47368421052631576
fr0.4614747307373654
nl0.4444444444444444
it0.39422180801491147
sv0.38446969696969696
cs0.37137330754352027
fi0.33537832310838445
sq0.33469805527123847
sk0.3172268907563025
ca0.3114406779661017
tr0.3018259935553169
ms0.2554410080183276
ro0.2502883506343714
lv0.21780986762936222
sl0.21686746987951808
hr0.21212121212121213
lt0.20440636474908203
es0.19950738916256158
vi0.19454770755885997
is0.18444165621079048
et0.17825537294563845
yo0.17407878017789072
pl0.17197452229299362
pt0.16666666666666666
hi0.10591471801925723
eu0.09972299168975068
reliabletrue
passesfalse
1
name"Hunter"
dialogue"Excuse me, miss. I'm Detective Hunter with the Alborn PD. Mind if I ask—were you at the apple festival last night? Did you see anything unusual near the cider tent around 10 PM? There was a disappearance..."
detectedLang"en"
heavyLang"en"
scores
en0.7842323651452282
tl0.592348698651615
fr0.48494453248811414
no0.4616977225672878
it0.4572025052192067
nl0.4569757727652465
da0.44349315068493156
de0.4290733421168204
sq0.42247889826743673
es0.40557841792409693
pt0.40202391904323825
ms0.40092165898617516
ro0.38881053126469206
sv0.3764988009592326
et0.3759001440230437
ca0.3561168895492818
cs0.3302421432251416
hr0.3077742279020234
sl0.2988133764832794
yo0.2907801418439716
sk0.22572960095294817
hu0.22526817640047678
az0.19753086419753088
pl0.18444165621079048
tr0.1746031746031746
lt0.1725015913430936
fi0.13391072618254496
lv0.13101604278074866
is0.09596662030598052
vi0.0928122819260293
hi0.0660919540229885
be0.051094890510948905
eu0.051094890510948905
uk0.046221570066030816
reliabletrue
passestrue
2
name"Selvi"
dialogue"eyes widening, shaken, speaking rapidly in Hindi Nahi! Main ne dekha! Woh aadmi... black coat mein... woh tent ke peeche gayab ho gaya! Koi saaya... bhoot jaise! Police ko batao, please!"
detectedLang"en"
heavyLang"tl"
scores
en0.6022538945972821
tl0.5990644837955229
fr0.4216867469879518
ro0.39668174962292607
nl0.39148073022312374
it0.36339522546419095
de0.35965848452508004
no0.3258426966292135
sl0.3220338983050847
ms0.31662870159453305
cs0.31310818546078995
sv0.28994082840236685
lt0.2784125075165364
eu0.2753623188405797
da0.2438563327032136
sk0.22178988326848248
ca0.21875
et0.2182410423452769
lv0.2079207920792079
yo0.20371599203715993
pt0.19408999328408327
sq0.19082939986513822
hr0.18973666441593517
is0.18864097363083165
pl0.17241379310344826
fi0.12536443148688048
tr0.12152269399707175
az0.11699779249448124
hu0.11569638909358881
es0.1091314031180401
hi0.06103286384976526
reliabletrue
passesfalse
3
name"Hunter"
dialogue"confused frown Uh... sorry? English? Festival? Cider tent? Disappearance?"
detectedLang"en"
heavyLang"en"
scores
en0.7051886792452831
tl0.5471014492753623
it0.5251661918328585
fr0.5183044315992292
nl0.49849548645937813
pt0.4834710743801653
no0.45054945054945056
da0.4469026548672566
ro0.4206257242178447
es0.4117647058823529
ms0.4110718492343934
hr0.39903846153846156
ca0.3796526054590571
de0.3646759847522236
et0.3531694695989651
sv0.34810951760104303
cs0.3368700265251989
sl0.3333333333333333
sq0.274310595065312
az0.27219796215429404
sk0.26144756277695713
lt0.20127795527156547
tr0.12126537785588754
hu0.11816578483245149
fi0.11190053285968028
lv0.11190053285968028
pl0.11190053285968028
yo0.10554561717352416
reliabletrue
passestrue
4
name"Selvi"
dialogue"gesturing frantically at her camera, voice trembling Camera mein proof hai! Dekho! Yeh photo... woh chehra... gayab! Khatra hai yahan, sabko batao!"
detectedLang"en"
heavyLang"en"
scores
en0.5865970409051349
tl0.5297029702970297
fr0.42143727161997563
da0.38551099611901685
no0.37623112278397897
ro0.3649732620320856
de0.3606998654104979
ms0.358974358974359
it0.35767410412440837
nl0.3356643356643356
sv0.2759146341463415
ca0.2607003891050583
es0.2537313432835821
pt0.19695688926458157
sq0.19423240033927056
is0.18524871355060035
tr0.16520210896309317
ja0.15780141843971632
sl0.15555555555555556
eu0.1532976827094474
hr0.14721723518850988
cs0.14259927797833935
vi0.14182475158084915
lv0.1252302025782689
et0.0995260663507109
fi0.08477842003853564
yo0.07766990291262135
hi0.07497565725413825
sk0.07045009784735812
hu0.06862745098039216
pl0.06862745098039216
az0.06219151036525173
reliabletrue
passesfalse
5
name"Hunter"
dialogue"leaning in, puzzled, no recognition Look, I don't understand. Hindi? You took pictures? mimes camera Photo? Of the man in the black coat?"
detectedLang"en"
heavyLang"en"
scores
en0.7755610972568578
tl0.673794853207684
fr0.5592556317335945
sv0.5570866141732284
da0.5529061102831594
no0.5484194681384846
nl0.5386981035366478
de0.5179432244242099
ca0.4545454545454546
ro0.43820224719101125
it0.4278448823903369
yo0.3515850144092219
is0.3253373313343328
lv0.2996108949416343
pl0.28741092636579574
cs0.2828685258964143
es0.27652733118971057
pt0.25925925925925924
sq0.2493744787322769
et0.22077922077922074
sk0.21875
hr0.21052631578947367
ms0.2
tr0.14933837429111532
lt0.14853358561967833
hi0.14691943127962084
sl0.14611005692599618
az0.14040114613180515
fi0.0835030549898167
zh0.07881269191402251
be0.07216494845360825
hu0.06928645294725957
uk0.06542056074766354
vi0.06542056074766354
reliabletrue
passestrue
6
name"Selvi"
dialogue"nodding vigorously, still shaken Haan, haan! Black coat wala aadmi! Tent ke paas... raat ko... poof! Gayab! Main darr gayi thi... koi madad karo!"
detectedLang"en"
heavyLang"en"
scores
en0.532437171244886
tl0.494949494949495
sv0.2963940193491645
nl0.2747053490480508
no0.25512104283054005
lt0.25023430178069356
fr0.23954372623574144
da0.23518164435946462
ms0.23224568138195778
de0.21645445641527913
yo0.21491658488714427
is0.21337266470009833
lv0.1919191919191919
vi0.16230366492146597
it0.15343915343915343
sl0.13606911447084233
et0.12280701754385964
eu0.11602209944751381
cs0.11406423034330011
pt0.0888382687927107
ro0.0888382687927107
sq0.08571428571428572
sk0.08256880733944955
hr0.07727797001153403
reliablefalse
passesfalse
7
name"Hunter"
dialogue"show me"
detectedLang"en"
heavyLang"en"
scores
en0.7835497835497836
pt0.7674418604651163
nl0.7630331753554502
sq0.7474747474747475
es0.6710526315789473
tl0.6710526315789473
et0.6551724137931034
fr0.6453900709219859
no0.6453900709219859
sl0.6376811594202898
ms0.6268656716417911
it0.6153846153846154
fi0.6
reliablefalse
passestrue
8
name"Selvi"
dialogue"fumbling with camera, tears welling, in Hindi Yeh dekho... yahan tha woh... ab nahi! Kya karoon? India se aayi hoon, yeh sheher... andhera hai!"
detectedLang"tl"
heavyLang"en"
scores
tl0.5620814013395157
en0.49644549763033174
de0.4723774053382992
it0.4690818238600874
ms0.4186046511627907
nl0.3988684582743989
sv0.3772893772893773
ro0.36661698956780925
sq0.34765924788948577
eu0.3134087237479806
es0.30668841761827076
yo0.29401993355481726
ca0.2892976588628763
sl0.28870292887029286
no0.2747440273037543
fi0.25438596491228066
da0.23835125448028674
fr0.23561151079136694
pt0.2349234923492349
cs0.18970448045757865
hr0.18426103646833014
lv0.15758176412289396
sk0.15758176412289396
vi0.15590863952333664
az0.1533864541832669
et0.15254237288135594
tr0.14228052472250252
is0.10337552742616034
pl0.08993576017130622
hi0.08405172413793104
lt0.06490649064906491
reliablefalse
passesfalse
9
name"Hunter"
dialogue"phone buzzing in pocket Okay, hold on— glances at phone Damn, I gotta take this. Stay here, alright? We'll figure this out—translator or something! stands, answering call Hunter here... yeah, on my way."
detectedLang"en"
heavyLang"en"
scores
en0.7654975530179445
tl0.6038580778504995
da0.49539271610355423
no0.4425593795443529
fr0.4409333981526494
sv0.4376528117359413
de0.41653982749873164
nl0.41025641025641024
it0.38666666666666666
ro0.3653421633554084
pl0.3451025056947608
sq0.33371958285052145
ca0.31220095693779903
sl0.29706601466992666
ms0.29577464788732394
hr0.2735312697409981
pt0.2698412698412699
cs0.2580645161290322
sk0.24242424242424243
et0.22663080026899796
yo0.21981004070556312
es0.21394395078605602
vi0.19804741980474197
az0.18957011980267793
fi0.18555240793201136
tr0.18381831085876507
is0.16907514450867053
lv0.15066469719350073
lt0.14115011202389843
hu0.1320754716981132
hi0.06807131280388978
be0.05737704918032788
eu0.055053410024650785
uk0.05193734542456719
reliabletrue
passestrue
10
name"Selvi"
dialogue"calling after him desperately Ruko! Suno!"
detectedLang"en"
heavyLang"en"
scores
en0.7704507512520868
da0.5919881305637982
no0.5592948717948718
sv0.5141342756183745
es0.494485294117647
tl0.4878957169459963
ro0.48308270676691734
de0.4433198380566802
ca0.4136460554371002
nl0.3902439024390244
pt0.367816091954023
ms0.3648960739030023
sk0.3559718969555035
hr0.34988179669030733
sl0.32598039215686275
cs0.25474254742547425
et0.23184357541899442
fi0.22096317280453256
it0.1863905325443787
sq0.1863905325443787
lt0.17664670658682635
lv0.17664670658682635
reliabletrue
passesfalse