Run: 2026-02-20-01KHY9JERPTK429Q118261GGFT

Run Details

Model:
Grok 4.1 Fast
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
15.6s
Cost:
$0.000623
Provider:
xAI

Evaluation summary

Score Evaluator
Details Link
54.55% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Selvi: *muttering to herself, looking troubled at her camera* Yeh photo... yeh sach mein... kaise ho sakta hai? Hunter: Excuse me, miss. I'm Detective Hunter with the Alborn PD. Mind if I ask—were you at the apple festival last night? Did you see anything unusual near the cider tent around 10 PM? There was a disappearance... Selvi: *eyes widening, shaken, speaking rapidly in Hindi* Nahi! Main ne dekha! Woh aadmi... black coat mein... woh tent ke peeche gayab ho gaya! Koi saaya... bhoot jaise! Police ko batao, please! Hunter: *confused frown* Uh... sorry? English? Festival? Cider tent? Disappearance? Selvi: *gesturing frantically at her camera, voice trembling* Camera mein proof hai! Dekho! Yeh photo... woh chehra... gayab! Khatra hai yahan, sabko batao! Hunter: *leaning in, puzzled, no recognition* Look, I don't understand. Hindi? You took pictures? *mimes camera* Photo? Of the man in the black coat? Selvi: *nodding vigorously, still shaken* Haan, haan! Black coat wala aadmi! Tent ke paas... raat ko... poof! Gayab! Main darr gayi thi... koi madad karo! Hunter: *scratching head, trying gestures for "show me"* Can you show me? Camera? Please? Important for the case... Selvi: *fumbling with camera, tears welling, in Hindi* Yeh dekho... yahan tha woh... ab nahi! Kya karoon? India se aayi hoon, yeh sheher... andhera hai! Hunter: *phone buzzing in pocket* Okay, hold on— *glances at phone* Damn, I gotta take this. Stay here, alright? We'll figure this out—translator or something! *stands, answering call* Hunter here... yeah, on my way. Selvi: *calling after him desperately* Ruko! Suno!
created_at"2026-02-20T19:49:02.881Z" 2/20/2026, 7:49:02 PM
model"x-ai/grok-4.1-fast"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency433
moderation_latency(null)
generation_time15196
tokens_prompt315
tokens_completion545
native_tokens_prompt418
native_tokens_completion1123
native_tokens_completion_images0
native_tokens_reasoning681
native_tokens_cached150
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"completed"
usage0.0006226
router(null)
provider_responses
0
endpoint_id"9821aa0e-dce3-4c27-9716-161359123d0b"
id"84056524-c7f7-5cee-83aa-9542aaeff8f9"
is_byokfalse
latency194
model_permaslug"x-ai/grok-4.1-fast"
provider_name"xAI"
status200
api_type"completions"
id"gen-1771616942-UVVLbxx7Kz7kZ7QCeiSX"
upstream_id"84056524-c7f7-5cee-83aa-9542aaeff8f9"
total_cost0.0006226
cache_discount0.0000225
upstream_inference_cost0
provider_name"xAI"

Evaluation details

Result Evaluator Details Meta Data
54.55% Parse dialogue n/a
dialogue
0
name"Selvi"
dialogue"Yeh photo... yeh sach mein... kaise ho sakta hai?"
detectedLang"fr"
heavyLang"ber"
scores
fr0.5209059233449477
en0.4751908396946565
it0.42827442827442824
cs0.4136460554371002
no0.40476190476190477
sq0.39692982456140347
vi0.36342592592592593
de0.3125
ca0.3037974683544304
sk0.28756476683937826
fi0.2763157894736842
tr0.260752688172043
et0.22096317280453256
hi0.21875
tl0.21875
is0.21652421652421652
sv0.21652421652421652
reliablefalse
passesfalse
1
name"Hunter"
dialogue"Excuse me, miss. I'm Detective Hunter with the Alborn PD. Mind if I ask—were you at the apple festival last night? Did you see anything unusual near the cider tent around 10 PM? There was a disappearance..."
detectedLang"en"
heavyLang"en"
scores
en0.7842323651452282
tl0.592348698651615
fr0.48494453248811414
no0.4616977225672878
it0.4572025052192067
nl0.4569757727652465
da0.44349315068493156
de0.4290733421168204
sq0.42247889826743673
es0.40557841792409693
pt0.40202391904323825
ms0.40092165898617516
ro0.38881053126469206
sv0.3764988009592326
et0.3759001440230437
ca0.3561168895492818
cs0.3302421432251416
hr0.3077742279020234
sl0.2988133764832794
yo0.2907801418439716
sk0.22572960095294817
hu0.22526817640047678
az0.19753086419753088
pl0.18444165621079048
tr0.1746031746031746
lt0.1725015913430936
fi0.13391072618254496
lv0.13101604278074866
is0.09596662030598052
vi0.0928122819260293
hi0.0660919540229885
be0.051094890510948905
eu0.051094890510948905
uk0.046221570066030816
reliabletrue
passestrue
2
name"Selvi"
dialogue"Nahi! Main ne dekha! Woh aadmi... black coat mein... woh tent ke peeche gayab ho gaya! Koi saaya... bhoot jaise! Police ko batao, please!"
detectedLang"tl"
heavyLang"de"
scores
tl0.5072463768115942
en0.4775660725261217
fr0.4558258642765685
ro0.395017793594306
cs0.35752078609221466
eu0.3491577335375191
sl0.3285939968404423
ms0.3167202572347267
it0.2975206611570248
de0.29693961952026465
ca0.28330522765598654
lv0.2703862660944206
lt0.2563429571303587
hr0.24845269672855883
sk0.23971377459749554
yo0.2048643592142189
no0.1904761904761905
sq0.18738049713193117
nl0.1834774255523535
fi0.16829745596868884
et0.16420845624385447
da0.16338582677165356
tr0.16338582677165356
hu0.15590863952333664
es0.1474423269809428
pt0.1431451612903226
sv0.09478168264110756
pl0.09381663113006397
az0.08108108108108109
reliablefalse
passesfalse
3
name"Hunter"
dialogue"Uh... sorry? English? Festival? Cider tent? Disappearance?"
detectedLang"en"
heavyLang"en"
scores
en0.6973365617433415
it0.5421245421245421
fr0.5353159851301116
nl0.5318352059925093
tl0.5271122320302648
no0.5222929936305732
da0.5186136071887034
pt0.4897959183673469
ms0.4820441988950276
hr0.4695898161244696
de0.4335347432024169
sv0.41588785046728977
ro0.4085173501577287
cs0.4038155802861685
sl0.39999999999999997
es0.3961352657004831
ca0.35456110154905335
sq0.33510638297872336
az0.33274021352313166
sk0.3206521739130435
lt0.251497005988024
et0.2454728370221328
tr0.15540540540540537
hu0.1515837104072398
fi0.14383561643835618
lv0.14383561643835618
pl0.14383561643835618
yo0.1359447004608295
reliabletrue
passestrue
4
name"Selvi"
dialogue"Camera mein proof hai! Dekho! Yeh photo... woh chehra... gayab! Khatra hai yahan, sabko batao!"
detectedLang"tl"
heavyLang"tl"
scores
tl0.4490358126721763
fr0.3603411513859275
ro0.33847850055126794
ms0.3197278911564626
it0.3006993006993007
en0.29161747343565525
de0.24717691342534504
ca0.2248062015503876
es0.22178988326848248
vi0.2073976221928666
et0.14893617021276595
eu0.13294797687861273
cs0.12790697674418602
fi0.12790697674418602
hr0.12663755458515283
sv0.12023460410557184
hi0.1137370753323486
lv0.1137370753323486
sq0.1137370753323486
nl0.11242603550295857
pt0.10714285714285714
reliablefalse
passesfalse
5
name"Hunter"
dialogue"Look, I don't understand. Hindi? You took pictures? Photo? Of the man in the black coat?"
detectedLang"en"
heavyLang"en"
scores
en0.7943490701001431
tl0.6980042016806722
no0.5809037900874635
da0.5802919708029197
sv0.5603975535168195
nl0.5546088303640588
de0.5443740095087163
fr0.5204336947456214
ro0.44336882865440463
yo0.4072164948453608
it0.3876464323748669
cs0.3817204301075269
is0.3604004449388209
ca0.3488108720271801
sq0.34210526315789475
pl0.33371958285052145
et0.3072289156626506
lv0.30639324487334135
sk0.21875
lt0.2144808743169399
hi0.21232876712328766
sl0.21124828532235942
ms0.2101648351648352
az0.203601108033241
hr0.19467787114845939
be0.10852713178294573
tr0.10852713178294573
hu0.1043613707165109
uk0.0987460815047022
vi0.0987460815047022
reliabletrue
passestrue
6
name"Selvi"
dialogue"Haan, haan! Black coat wala aadmi! Tent ke paas... raat ko... poof! Gayab! Main darr gayi thi... koi madad karo!"
detectedLang"tl"
heavyLang"vi"
scores
tl0.5021645021645021
en0.32193396226415094
fr0.3047158403869408
yo0.2758186397984887
lt0.2580645161290322
vi0.21232876712328766
de0.21124828532235942
ms0.1958041958041958
sl0.1797432239657632
lv0.17621776504297992
et0.16302765647743814
eu0.15441176470588236
sv0.15441176470588236
cs0.15191740412979352
da0.11674347158218126
reliablefalse
passesfalse
7
name"Hunter"
dialogue"show me"
detectedLang"en"
heavyLang"en"
scores
en0.7835497835497836
pt0.7674418604651163
nl0.7630331753554502
sq0.7474747474747475
es0.6710526315789473
tl0.6710526315789473
et0.6551724137931034
fr0.6453900709219859
no0.6453900709219859
sl0.6376811594202898
ms0.6268656716417911
it0.6153846153846154
fi0.6
reliablefalse
passestrue
8
name"Selvi"
dialogue"Yeh dekho... yahan tha woh... ab nahi! Kya karoon? India se aayi hoon, yeh sheher... andhera hai!"
detectedLang"eu"
heavyLang"ber"
scores
eu0.4136460554371002
sq0.39956331877729256
it0.38478747203579416
tl0.377123442808607
fi0.34523809523809523
ms0.3436754176610978
de0.3349455864570738
es0.3349455864570738
yo0.32598039215686275
pt0.32182490752157833
sv0.29214929214929214
no0.27821522309711283
cs0.26568758344459276
hr0.25876010781671155
ro0.25876010781671155
sl0.25775978407557354
fr0.25271739130434784
ca0.23184357541899442
lv0.22425952045133993
sk0.22425952045133993
vi0.22206506364922204
da0.2198581560283688
en0.21203438395415475
tr0.2040520984081042
nl0.19941775836972345
az0.11290322580645161
et0.09688013136288999
lt0.09688013136288999
reliablefalse
passesfalse
9
name"Hunter"
dialogue"Okay, hold on— Damn, I gotta take this. Stay here, alright? We'll figure this out—translator or something! Hunter here... yeah, on my way."
detectedLang"en"
heavyLang"en"
scores
en0.7649639611407082
tl0.5941558441558442
da0.4444444444444444
fr0.42748091603053434
sq0.40805051302288875
it0.4038155802861685
no0.3951612903225807
ro0.3786246893123446
ca0.37395659432387307
pl0.36921783010933557
sv0.35064935064935066
de0.3273542600896861
hr0.31880108991825606
pt0.31880108991825606
et0.31002759889604414
cs0.3023255813953488
sk0.2829827915869981
fi0.258893280632411
ms0.25521350546176763
sl0.25521350546176763
yo0.23935091277890466
es0.2299794661190965
nl0.2046659597030753
tr0.20382165605095542
hu0.1891891891891892
vi0.16759156492785796
lt0.14772727272727273
lv0.14772727272727273
az0.13990825688073394
hi0.10071942446043164
be0.08536585365853659
eu0.08200734394124846
is0.07749077490774908
uk0.07749077490774908
reliabletrue
passestrue
10
name"Selvi"
dialogue"Ruko! Suno!"
detectedLang""
heavyLang"sk"
scores
reliablefalse
passestrue