Run: 2026-02-20-01KHYAFPJXW08DMN1EFD5S3VHQ

Run Details

Model:
Grok 4 Fast
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
12.6s
Cost:
$0.000622
Provider:
xAI

Evaluation summary

Score Evaluator
Details Link
45.45% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Selvi: (looking troubled, speaking rapidly in Hindi, her voice shaky) Main... maine festival mein kuch dekha. Ek aadmi ko koi kheench raha tha andhere mein. Woh chillaya, phir gayab ho gaya. Mujhe darr lag raha hai! Hunter: Excuse me, miss. I'm Detective Hunter with the Alborn police. Did you happen to see anything unusual at the apple festival last night? There was another disappearance, and we're talking to folks who were there. Selvi: (shaking her head, eyes wide, continuing in Hindi, gesturing vaguely) Haan, apple festival... wahan log the, music, lekin raat ko... woh shadow, jaise bhoot! Police ko batana chahiye, par koi samajh nahi raha! Hunter: (frowning, leaning in slightly, confused) Uh... I'm sorry, I didn't catch that. Do you speak English? Anything about the festival? A missing person, maybe? Selvi: (frustrated and still shaken, pointing at her camera) Camera... photo li thi. Dekho, yeh shadow... aadmi ka chehra, phir andhera. Yeh sheher mein ho raha hai, har roz! Hunter: (scratching his head, glancing at the camera but not understanding) Camera? Photos? Look, if you saw something, it's important. Can you describe it? Or... write it down? This town's got too many ghosts lately. Selvi: (nodding emphatically, her voice trembling as she speaks faster in Hindi) Haan, ghosts nahi, asli log! Woh detective lagte ho, madad karo. Main India se hoon, yahan akeli... please, samjho! Hunter: (sighing, still puzzled, pulling out his notebook) Alright, miss... Selvi, right? I see your name on the program. India, huh? Wish I had a translator app or something. Just nod if you saw a man in a dark jacket near the cider tent? Selvi: (waving her hands, distressed) Jacket? Haan, kaala jacket! Cider tent ke paas, woh ladai kar raha tha. Phir... chup. Koi le gaya usko! Hunter: (phone buzzing in his pocket; he checks it quickly, expression turning urgent) Black jacket... okay, that's something. Hold on— (answers the call) Hunter here. Yeah? Another one? Damn it, I'm on my way. (to Selvi, apologetic) Look, I gotta run—lead on the case. If you can get those photos to the station somehow, we'd appreciate it. Sorry about the language thing. Selvi: (calling after him in Hindi, voice fading) Ruko! Photo dikhaun? Please... darr lag raha hai!
created_at"2026-02-20T20:05:01.159Z" 2/20/2026, 8:05:01 PM
model"x-ai/grok-4-fast"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency5248
moderation_latency(null)
generation_time12399
tokens_prompt315
tokens_completion585
native_tokens_prompt418
native_tokens_completion1202
native_tokens_completion_images0
native_tokens_reasoning605
native_tokens_cached417
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"completed"
usage0.00062205
router(null)
provider_responses
0
endpoint_id"c9586d9d-97ff-40ca-ae94-22504d6f9b7e"
id"47a35200-b3bc-e80c-2ea5-1ba6c6368371"
is_byokfalse
latency112
model_permaslug"x-ai/grok-4-fast"
provider_name"xAI"
status200
api_type"completions"
id"gen-1771617901-3iZtr6TljWyqYzSjcrXR"
upstream_id"47a35200-b3bc-e80c-2ea5-1ba6c6368371"
total_cost0.00062205
cache_discount0.00006255
upstream_inference_cost0
provider_name"xAI"

Evaluation details

Result Evaluator Details Meta Data
45.45% Parse dialogue n/a
dialogue
0
name"Selvi"
dialogue"Main... maine festival mein kuch dekha. Ek aadmi ko koi kheench raha tha andhere mein. Woh chillaya, phir gayab ho gaya. Mujhe darr lag raha hai!"
detectedLang"en"
heavyLang"en"
scores
en0.476361460203471
tl0.4722557297949337
de0.396551724137931
it0.35424354243542433
fr0.35185185185185186
et0.3274404304381245
no0.31156569630212433
nl0.2926434923201294
ca0.2714404662781016
sq0.27083333333333337
sl0.26346801346801346
fi0.25658453695836875
cs0.2508561643835616
ms0.24176776429809357
lv0.23846823324630112
es0.23513986013986016
ro0.2324561403508772
sk0.20742753623188404
lt0.20164233576642335
az0.19945105215004574
sv0.19429097605893186
hr0.18680297397769516
pt0.18680297397769516
da0.1760828625235405
vi0.15213178294573643
yo0.13021868787276342
tr0.11347517730496455
eu0.10714285714285714
hu0.07112526539278131
pl0.06716417910447761
reliablefalse
passesfalse
1
name"Hunter"
dialogue"Excuse me, miss. I'm Detective Hunter with the Alborn police. Did you happen to see anything unusual at the apple festival last night? There was another disappearance, and we're talking to folks who were there."
detectedLang"en"
heavyLang"en"
scores
en0.7935148363413889
tl0.612180407928756
no0.4915254237288135
fr0.48335246842709534
nl0.4779582366589328
da0.4730679156908665
de0.4437577255871446
es0.40789473684210525
it0.402390438247012
sq0.4010647737355812
ms0.37586685159500693
pt0.37180083759888316
sv0.3620037807183365
sl0.3562231759656652
cs0.34687953555878087
et0.3276892430278885
hr0.3115757266700663
ro0.309462915601023
yo0.294302143230528
ca0.27691483663631494
sk0.2566079295154185
lt0.1901619676064787
pl0.17481662591687042
lv0.1687192118226601
hu0.14880201765447668
fi0.1412213740458015
az0.12508101101749838
tr0.08845374746792707
eu0.06509695290858726
is0.04996481351161154
reliabletrue
passestrue
2
name"Selvi"
dialogue"Haan, apple festival... wahan log the, music, lekin raat ko... woh shadow, jaise bhoot! Police ko batana chahiye, par koi samajh nahi raha!"
detectedLang"tl"
heavyLang"tl"
scores
tl0.5510518214468959
fr0.5267712276906436
ms0.5252306022788931
en0.5106263982102908
eu0.43548387096774194
es0.41156691324815065
da0.4083840432724814
sv0.40637720488466755
nl0.4039509536784741
it0.4006849315068493
fi0.39696760854583046
sl0.3842364532019704
no0.3829337094499295
et0.37899219304471254
lv0.37589158345221113
ca0.35803374908290536
pt0.3508902077151336
hr0.3346007604562738
cs0.2966237942122186
ro0.29492344883158744
de0.29435483870967744
sk0.28101889893179954
az0.2774566473988439
lt0.26035502958579887
sq0.24892703862660948
yo0.21383647798742136
pl0.20164233576642335
is0.1784037558685446
hu0.13962635201573254
tr0.07602956705385427
reliablefalse
passesfalse
3
name"Hunter"
dialogue"Uh... I'm sorry, I didn't catch that. Do you speak English? Anything about the festival? A missing person, maybe?"
detectedLang"en"
heavyLang"en"
scores
en0.805352798053528
tl0.6031746031746031
da0.5107033639143731
sv0.5070856438693777
no0.5061728395061729
pt0.5
sq0.493350221659278
it0.4891443167305236
hr0.46773120425815035
cs0.464524765729585
ms0.4550408719346049
ca0.44521497919556174
fr0.4370161857846587
nl0.4244604316546763
sk0.3897787948131198
ro0.3860322333077513
de0.38556067588325654
pl0.38271604938271603
is0.3464052287581699
es0.3349958437240233
sl0.3316624895572264
yo0.32829554995801846
az0.3191489361702128
et0.3174061433447099
hu0.3061578490893322
lt0.300087489063867
lv0.2530345471521942
vi0.23371647509578544
tr0.21104536489151873
fi0.20318725099601595
be0.08045977011494253
eu0.08045977011494253
uk0.07300115874855156
reliabletrue
passestrue
4
name"Selvi"
dialogue"Camera... photo li thi. Dekho, yeh shadow... aadmi ka chehra, phir andhera. Yeh sheher mein ho raha hai, har roz!"
detectedLang"it"
heavyLang"ber"
scores
it0.39839572192513373
ca0.33035714285714285
vi0.3161094224924012
de0.3091095189355169
et0.2961418143899896
cs0.29096638655462187
no0.2834394904458599
fr0.2826780021253985
tl0.27961579509071505
en0.26789587852494573
sv0.26310043668122274
ro0.2557883131201764
da0.18967587034813926
pl0.18967587034813926
lv0.18576598311218334
sq0.17481662591687042
eu0.15625
sk0.1412213740458015
yo0.13682864450127877
hr0.13015463917525774
es0.12790697674418602
hi0.10239361702127658
nl0.10119840213049268
lt0.09879839786381843
ms0.09638554216867469
reliablefalse
passesfalse
5
name"Hunter"
dialogue"Camera? Photos? Look, if you saw something, it's important. Can you describe it? Or... write it down? This town's got too many ghosts lately."
detectedLang"en"
heavyLang"en"
scores
en0.8081697133829836
tl0.49101796407185627
fr0.4791666666666667
es0.4710640945861854
ca0.43295530353569045
ro0.42333785617367703
it0.36990363232023726
pt0.3501529051987768
nl0.2778249787595582
ms0.22727272727272727
sv0.22656960873521384
lt0.20782851817334574
de0.2048643592142189
sk0.15841584158415842
lv0.15590863952333664
tr0.15590863952333664
hi0.15254237288135594
sq0.15254237288135594
da0.13967611336032387
no0.13967611336032387
et0.09766454352441614
cs0.08405172413793104
fi0.08405172413793104
az0.08306364617044228
pl0.08207343412526999
yo0.08207343412526999
sl0.07809110629067245
reliabletrue
passestrue
6
name"Selvi"
dialogue"Haan, ghosts nahi, asli log! Woh detective lagte ho, madad karo. Main India se hoon, yahan akeli... please, samjho!"
detectedLang"en"
heavyLang"tl"
scores
en0.5595382746051032
tl0.473110465116279
ro0.4286840031520882
it0.41907051282051283
ms0.4071954210956664
fr0.3917785234899329
ca0.39126784214945426
es0.3855932203389831
pt0.3728373702422146
no0.3572695035460993
cs0.34210526315789475
de0.33056325023084027
sq0.32052483598875353
da0.318609022556391
sv0.3068833652007648
yo0.2684157416750757
eu0.26619433198380565
hr0.26321138211382117
sl0.2624618514750763
nl0.23199152542372883
fi0.20765027322404372
et0.19084821428571427
sk0.18994413407821228
lt0.1844769403824522
az0.0880503144654088
tr0.0799492385786802
lv0.07525510204081631
reliablefalse
passesfalse
7
name"Hunter"
dialogue"Alright, miss... Selvi, right? I see your name on the program. India, huh? Wish I had a translator app or something. Just nod if you saw a man in a dark jacket near the cider tent?"
detectedLang"en"
heavyLang"en"
scores
en0.7820220053975503
tl0.6357960457856401
sv0.5406824146981627
nl0.49856733524355296
no0.4980879541108987
da0.4895478852698104
de0.47049924357034795
ms0.4631901840490798
ro0.4351802044109737
et0.43058568329718006
fr0.42052980132450335
ca0.41471571906354515
yo0.40306992609437176
sq0.3996569468267582
it0.39271255060728744
pl0.39130434782608703
hr0.38988959907030796
cs0.3797991730655641
pt0.35503685503685506
sl0.3453865336658354
sk0.34045226130653267
es0.3251928020565552
tr0.31906614785992216
lt0.29624664879356566
lv0.29624664879356566
az0.2832764505119454
hu0.2584745762711864
fi0.23525127458120904
eu0.22106824925816024
vi0.17387883556254916
is0.11616161616161616
hi0.07407407407407407
be0.0625
uk0.05660377358490566
reliabletrue
passestrue
8
name"Selvi"
dialogue"Jacket? Haan, kaala jacket! Cider tent ke paas, woh ladai kar raha tha. Phir... chup. Koi le gaya usko!"
detectedLang"tl"
heavyLang"de"
scores
tl0.4549058473736373
ms0.38547486033519557
sl0.33171324422843257
en0.3167701863354037
fr0.3081761006289308
et0.30467762326169406
yo0.2763157894736842
sv0.26764314247669774
ro0.24965893587994542
tr0.23504867872044508
it0.20863309352517986
es0.17787742899850523
sq0.17541229385307347
cs0.15773353751914243
hu0.15123456790123457
da0.12974683544303797
de0.12974683544303797
no0.12974683544303797
nl0.12280701754385964
az0.11147011308562196
reliablefalse
passesfalse
9
name"Hunter"
dialogue"Black jacket... okay, that's something. Hold on— Hunter here. Yeah? Another one? Damn it, I'm on my way. Look, I gotta run—lead on the case. If you can get those photos to the station somehow, we'd appreciate it. Sorry about the language thing."
detectedLang"en"
heavyLang"en"
scores
en0.8012492901760363
tl0.5940852420991591
fr0.4395516413130504
da0.4022203245089668
it0.3783303730017762
yo0.36363636363636365
sv0.35424354243542433
sq0.3408662900188324
no0.325626204238921
pl0.2954202315047811
ro0.29185634800202326
nl0.2827868852459016
cs0.2776057791537668
de0.2673992673992674
hr0.26043317485472794
ca0.24078091106290672
et0.23539049699617695
sk0.2324561403508772
lv0.22437673130193908
pt0.221357063403782
lt0.21568627450980393
ms0.20499716070414536
es0.1977077363896848
fi0.19724770642201836
tr0.19632606199770378
is0.14996964177292046
sl0.147900182592818
az0.12663755458515283
hu0.1111111111111111
hi0.1031390134529148
eu0.05277401894451962
zh0.052132701421800945
be0.047619047619047616
uk0.0430622009569378
vi0.0430622009569378
reliabletrue
passestrue
10
name"Selvi"
dialogue"Ruko! Photo dikhaun? Please... darr lag raha hai!"
detectedLang"en"
heavyLang"en"
scores
en0.6065808297567954
fr0.40860215053763443
tl0.39159292035398224
vi0.36342592592592593
et0.33894230769230765
it0.26666666666666666
ro0.26666666666666666
no0.26273458445040215
sv0.25271739130434784
cs0.24242424242424243
de0.21875
hi0.21875
nl0.21875
reliabletrue
passesfalse