Run: 2026-02-20-01KHYBBB803TNFH1D0TED3GGKY

Run Details

Model:
Grok 4
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
30.0s
Cost:
$0.013506
Provider:
xAI

Evaluation summary

Score Evaluator
Details Link
55.56% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Selvi: (troubled and shaken, in Hindi) "Mujhe kuch ajeeb laga... woh vyakti gayab ho gaya, jaise hava mein mil gaya. Mainne photo li thi, lekin ab dar lag raha hai." Hunter: "Excuse me, ma'am? I'm Detective Hunter. I noticed your camera—did you happen to see anything unusual at the apple festival last night? We're looking into a disappearance." Selvi: (gesturing animatedly with her camera, still in Hindi, voice rising in distress) "Festival mein, apple ke bagal mein! Ek aadmi tha, phir... poof! Gayab! Meri tasveer dekho, yeh sab such hai!" Hunter: (frowning, confused) "I'm sorry, I don't understand. Do you speak English? English? Uh... disappearance? Missing person?" Selvi: (shaking her head, pointing at her camera screen insistently, in Hindi) "Nahin samajh rahe ho? Yeh photo! Dekho, yahan tha, phir nahin! Mujhe madad chahiye, police!" Hunter: (scratching his head, trying to peer at the camera) "Photos? Okay, that might help. Can you show me? Point to what you saw?" Selvi: (nodding vigorously, switching to more rapid Hindi) "Haan, yahan! Yeh aadmi, black coat mein. Festival ke baad, raat mein gayab. Main akeli thi, ab darr lag raha hai!" Hunter: (nodding slowly, still puzzled) "Black coat... festival... got it, sort of. Look, if you saw something suspicious, we need to get a translator. Hang on—" *(Hunter's phone rings. He pulls it out and answers.)* Hunter: "This is Hunter. Yeah? Another lead? Alright, I'm on my way." (to Selvi) "Ma'am, I've gotta run. Stay here—I'll send someone who can help translate. Thanks for trying to tell me... whatever that was."
created_at"2026-02-20T20:20:07.052Z" 2/20/2026, 8:20:07 PM
model"x-ai/grok-4-07-09" 4/7/2009, 12:00:00 AM
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency11478
moderation_latency(null)
generation_time29956
tokens_prompt315
tokens_completion414
native_tokens_prompt947
native_tokens_completion813
native_tokens_completion_images0
native_tokens_reasoning378
native_tokens_cached680
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"completed"
usage0.013506
router(null)
provider_responses
0
endpoint_id"d40bef9d-6936-4c57-9749-bf7399de4a77"
id"8d752094-75dd-2bba-0d76-809e5762df73"
is_byokfalse
latency76
model_permaslug"x-ai/grok-4-07-09" 4/7/2009, 12:00:00 AM
provider_name"xAI"
status200
api_type"completions"
id"gen-1771618807-TEpeJnUXHzBx4cZ8iQFN"
upstream_id"8d752094-75dd-2bba-0d76-809e5762df73"
total_cost0.013506
cache_discount0.00153
upstream_inference_cost0
provider_name"xAI"

Evaluation details

Result Evaluator Details Meta Data
55.56% Parse dialogue n/a
dialogue
0
name"Selvi"
dialogue"Mujhe kuch ajeeb laga... woh vyakti gayab ho gaya, jaise hava mein mil gaya. Mainne photo li thi, lekin ab dar lag raha hai."
detectedLang"de"
heavyLang"de"
scores
de0.3724696356275304
no0.3547044129891757
fr0.3353344768439108
et0.3201754385964912
ro0.3098842386464826
en0.3030575539568345
sv0.2935278030993619
vi0.28702851885924563
ca0.2824074074074074
it0.2716165413533835
cs0.2633079847908745
tl0.2590822179732314
fi0.25766283524904215
is0.2051282051282051
lt0.2051282051282051
sk0.2051282051282051
pt0.20185375901132854
tr0.19689119170984457
es0.1943866943866944
eu0.1594360086767896
sq0.11931818181818182
hr0.11529680365296804
az0.11428571428571428
ms0.11428571428571428
lv0.10196987253765932
hi0.0903755868544601
nl0.0903755868544601
pl0.08716136631330978
reliablefalse
passesfalse
1
name"Hunter"
dialogue"Excuse me, ma'am? I'm Detective Hunter. I noticed your camera—did you happen to see anything unusual at the apple festival last night? We're looking into a disappearance."
detectedLang"en"
heavyLang"en"
scores
en0.7828840238827574
tl0.6096291476903059
fr0.5327102803738317
no0.5249406175771971
it0.5061728395061729
nl0.4919559695173582
da0.48870899020025566
es0.47252747252747257
pt0.4400373308446104
sq0.4211287988422576
ms0.4191674733785092
sv0.4180407371483996
de0.41147621383030897
ca0.4062345373577437
ro0.40476190476190477
cs0.39148073022312374
et0.36675461741424803
hr0.36642027455121434
sl0.36
sk0.3277310924369748
yo0.32697700504767246
lv0.26695174098961516
pl0.26335174953959484
hu0.24242424242424243
lt0.23809523809523808
az0.1729841488628532
is0.1483321504613201
tr0.1465149359886202
fi0.14346895074946467
vi0.099774943735934
be0.05511811023622047
eu0.05511811023622047
uk0.0498812351543943
reliabletrue
passestrue
2
name"Selvi"
dialogue"Festival mein, apple ke bagal mein! Ek aadmi tha, phir... poof! Gayab! Meri tasveer dekho, yeh sab such hai!"
detectedLang"ms"
heavyLang"vi"
scores
ms0.45606694560669453
nl0.4227353463587922
en0.4003690036900369
tl0.3925233644859813
it0.36954413191076624
de0.34804413239719156
fr0.34738955823293177
es0.34010152284263956
cs0.30851063829787234
sl0.3010752688172043
sq0.2753623188405797
lt0.25968109339407747
et0.2588369441277081
ca0.24065420560747666
hr0.236192714453584
pt0.236192714453584
sv0.22802850356294538
da0.22341696535244923
no0.22341696535244923
vi0.19454770755885997
az0.15364583333333331
ro0.15364583333333331
sk0.15364583333333331
tr0.14698162729658792
yo0.11924119241192413
hu0.09344490934449094
fi0.08835904628330996
lv0.08835904628330996
pl0.08835904628330996
reliablefalse
passesfalse
3
name"Hunter"
dialogue"I'm sorry, I don't understand. Do you speak English? English? Uh... disappearance? Missing person?"
detectedLang"en"
heavyLang"en"
scores
en0.7811816192560175
da0.5896032831737346
no0.5786516853932584
tl0.5495495495495496
sv0.5327102803738317
nl0.49706621961441744
de0.47643979057591623
cs0.46714031971580816
pt0.4633273703041145
it0.4614003590664273
sq0.43289224952741023
hr0.4280266920877026
is0.41348973607038125
sk0.4065281899109792
pl0.40357852882703776
ms0.38016528925619836
fr0.3562231759656652
ro0.34782608695652173
ca0.3333333333333333
yo0.27184466019417475
az0.2376111817026684
et0.2376111817026684
sl0.23371647509578544
vi0.2248062015503876
es0.2010652463382157
lv0.18699186991869918
tr0.18588873812754408
lt0.1836734693877551
hu0.1780821917808219
fi0.11504424778761062
be0.1044776119402985
uk0.09502262443438914
reliabletrue
passestrue
4
name"Selvi"
dialogue"Nahin samajh rahe ho? Yeh photo! Dekho, yahan tha, phir nahin! Mujhe madad chahiye, police!"
detectedLang"tl"
heavyLang"tl"
scores
tl0.5921985815602837
cs0.39537329127234494
fr0.37971952535059333
en0.37431991294885747
et0.34659090909090906
no0.34285714285714286
ms0.3360277136258661
fi0.32432432432432434
sv0.32273262661955243
it0.32113341204250295
sk0.3179122182680902
eu0.2953431372549019
sq0.2571059431524548
ca0.25032594524119944
lv0.24441524310118265
da0.23435419440745675
ro0.23435419440745675
hr0.22611036339165547
sl0.21981004070556312
is0.15066469719350073
pl0.13273001508295626
lt0.1314199395770393
nl0.13010590015128592
de0.12213740458015267
hi0.11809815950920245
az0.11538461538461538
es0.11538461538461538
hu0.11538461538461538
tr0.11128284389489954
pt0.10852713178294573
reliabletrue
passesfalse
5
name"Hunter"
dialogue"Photos? Okay, that might help. Can you show me? Point to what you saw?"
detectedLang"en"
heavyLang"en"
scores
en0.817351598173516
tl0.6768982229402262
fr0.5793901156677181
da0.4528043775649795
no0.4065281899109792
pt0.3798449612403101
nl0.3670886075949367
pl0.3620414673046252
yo0.3453355155482815
cs0.34318555008210183
sl0.34318555008210183
lv0.3254637436762226
lt0.3150684931506849
ms0.3150684931506849
es0.3127147766323024
ca0.27007299270072993
sq0.27007299270072993
de0.26605504587155965
sk0.24812030075187969
hr0.2248062015503876
et0.1919191919191919
it0.16666666666666666
az0.16142557651991615
hi0.16142557651991615
tr0.16142557651991615
fi0.15789473684210525
reliabletrue
passestrue
6
name"Selvi"
dialogue"Haan, yahan! Yeh aadmi, black coat mein. Festival ke baad, raat mein gayab. Main akeli thi, ab darr lag raha hai!"
detectedLang"de"
heavyLang"vi"
scores
de0.44214876033057854
tl0.4073748902546093
en0.40423654015887023
ms0.40371024734982336
fr0.38969258589511757
vi0.3161094224924012
it0.30626927029804724
cs0.3005181347150259
sv0.299792531120332
no0.296875
da0.28038379530916846
et0.28038379530916846
nl0.27961579509071505
ca0.23382519863791143
hr0.22945205479452058
pt0.22945205479452058
sl0.21693735498839908
es0.21328671328671328
fi0.18280871670702178
sq0.16149068322981366
lt0.15730337078651685
az0.14880201765447668
ro0.14880201765447668
sk0.14880201765447668
yo0.11533420707732633
tr0.10358565737051792
hu0.09029649595687331
lv0.08536585365853659
pl0.08536585365853659
reliablefalse
passesfalse
7
name"Hunter"
dialogue"Black coat... festival... got it, sort of. Look, if you saw something suspicious, we need to get a translator. Hang on—"
detectedLang"en"
heavyLang"en"
scores
en0.7961956521739131
tl0.6263079222720478
fr0.5158166559070368
ca0.4703389830508474
cs0.4688385269121813
da0.4669509594882729
pt0.46351931330472107
hr0.4608195542774982
nl0.4608195542774982
pl0.4553376906318083
ms0.44933920704845814
et0.44362017804154297
no0.4377811094452773
es0.4195046439628483
yo0.4094488188976378
sk0.4085173501577287
sl0.4085173501577287
ro0.4028662420382166
sq0.3670886075949367
de0.3644067796610169
lv0.35233160621761656
sv0.3483927019982624
it0.3397887323943662
lt0.3356953055801594
hu0.293119698397738
fi0.2690058479532163
is0.26035502958579887
az0.24774322968906717
vi0.17400881057268722
tr0.15730337078651685
eu0.1544532130777903
hi0.10071942446043164
reliabletrue
passestrue
8
name"Hunter"
dialogue"Ma'am, I've gotta run. Stay here—I'll send someone who can help translate. Thanks for trying to tell me... whatever that was."
detectedLang"en"
heavyLang"en"
scores
en0.7990666320974851
tl0.4647790055248619
no0.4297277409860191
nl0.38296178343949044
da0.3503772003352892
it0.3492863140218304
pt0.3426632739609839
yo0.2941712204007286
sq0.2922374429223744
sl0.2569511025886865
es0.249031007751938
hr0.24684159378036927
fr0.23870333988212183
vi0.23115079365079366
sv0.22422422422422422
pl0.20918367346938777
sk0.20103092783505155
cs0.19689119170984457
lv0.19605809128630705
fi0.1943866943866944
de0.1935483870967742
lt0.18076109936575055
ro0.17728237791932058
et0.16576964477933262
ca0.16396979503775622
ms0.15577342047930284
tr0.15300546448087432
az0.14928649835345773
hu0.12231030577576443
eu0.07957244655581948
reliabletrue
passestrue