Run: 2026-02-20-01KHY7KGE461S8Y36276B6YKMT

Run Details

Model:
Grok 4 Fast
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
5.7s
Cost:
$0.000390
Provider:
xAI

Evaluation summary

Score Evaluator
Details Link
57.14% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Selvi: "Arre, main... maine dekha tha. Wo andhera mein... ek aadmi... woh le gaya us ladki ko! Bhayankar tha, detective sahab!" Hunter: "Excuse me, miss. I'm Detective Hunter with the Alborn PD. Mind if I ask—were you at the apple festival grounds last night? Did you notice anything unusual, like someone acting suspicious near the orchard?" Selvi: "Nahi, nahi English. Hindi... bas Hindi. Aapko bataun? Woh raat ko... chhup-chhup ke... kidnapping! Main darr gayi thi, camera mein photo li thi!" Hunter: "Uh, okay... I don't speak Hindi. Sorry about that. Can you describe it? Point? Anything? This could be important for the missing persons case." Selvi: "Dekho, yeh photo... yahan, ismein woh shadow... woh bhag raha tha! Police ko batao, please! Main akeli hoon yahan." Hunter: "Photo? Can I see that? Shadow... running? Wait, is this from last night? Miss, this looks like it could be a lead. If you could just—" [Phone rings] Hunter: "Hold on, that's my dispatch. Damn it. Look, I gotta take this. Stay here—I'll be right back. We'll figure out how to translate this."
created_at"2026-02-20T19:14:40.206Z" 2/20/2026, 7:14:40 PM
model"x-ai/grok-4-fast"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency2914
moderation_latency(null)
generation_time5565
tokens_prompt315
tokens_completion283
native_tokens_prompt418
native_tokens_completion666
native_tokens_completion_images0
native_tokens_reasoning371
native_tokens_cached175
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"completed"
usage0.00039035
router(null)
provider_responses
0
endpoint_id"c9586d9d-97ff-40ca-ae94-22504d6f9b7e"
id"6f674529-acd4-78ba-f28e-3f6773c4c704"
is_byokfalse
latency108
model_permaslug"x-ai/grok-4-fast"
provider_name"xAI"
status200
api_type"completions"
id"gen-1771614880-lFcMkLf2RRrZWFSZ46TQ"
upstream_id"6f674529-acd4-78ba-f28e-3f6773c4c704"
total_cost0.00039035
cache_discount0.00002625
upstream_inference_cost0
provider_name"xAI"

Evaluation details

Result Evaluator Details Meta Data
57.14% Parse dialogue n/a
dialogue
0
name"Selvi"
dialogue"Arre, main... maine dekha tha. Wo andhera mein... ek aadmi... woh le gaya us ladki ko! Bhayankar tha, detective sahab!"
detectedLang"en"
heavyLang"de"
scores
en0.4806590257879656
fr0.47539797395079597
de0.4727272727272728
tl0.46886446886446886
ro0.41437802907915994
yo0.3679163034001744
es0.33910665451230626
it0.30488974113135187
sl0.2995169082125604
et0.27860696517412936
ca0.2602040816326531
pt0.25257731958762886
ms0.25103305785123964
eu0.24083769633507857
tr0.22625400213447172
lv0.22542735042735043
sq0.22459893048128343
nl0.20066152149944874
sv0.19175027870680048
fi0.18355855855855857
hu0.11907654921020656
lt0.11585365853658537
da0.103831891223733
no0.09937888198757763
cs0.0903387703889586
hr0.0845959595959596
reliablefalse
passesfalse
1
name"Hunter"
dialogue"Excuse me, miss. I'm Detective Hunter with the Alborn PD. Mind if I ask—were you at the apple festival grounds last night? Did you notice anything unusual, like someone acting suspicious near the orchard?"
detectedLang"en"
heavyLang"en"
scores
en0.7796024200518583
tl0.6325648414985592
fr0.5174110522331568
no0.48233861144945184
es0.446133796698523
pt0.43658859920459564
it0.43458980044345896
ro0.43333333333333335
nl0.41966317705962675
da0.3911174785100286
sv0.3864292589027912
ms0.3843553838725253
ca0.3706811451135242
sq0.36787307882994547
de0.3282402528977871
hr0.3044189852700491
et0.30136986301369867
cs0.2920599666851749
sl0.2392601431980907
hu0.19558359621451105
yo0.17368762151652625
sk0.17153996101364524
lv0.1611842105263158
lt0.1290983606557377
pl0.1290983606557377
az0.12431318681318682
fi0.09766454352441614
is0.09766454352441614
tr0.09188034188034187
be0.05204460966542751
uk0.04708520179372198
vi0.04708520179372198
reliabletrue
passestrue
2
name"Selvi"
dialogue"Nahi, nahi English. Hindi... bas Hindi. Aapko bataun? Woh raat ko... chhup-chhup ke... kidnapping! Main darr gayi thi, camera mein photo li thi!"
detectedLang"tl"
heavyLang"vi"
scores
tl0.5205026455026455
en0.473110465116279
fr0.4561140285071268
ms0.42414614773629866
ro0.34150772025431425
eu0.3330266789328427
de0.32369402985074625
it0.32116104868913853
sv0.31732580037664787
ca0.28217821782178215
cs0.27427427427427425
yo0.23199152542372883
hr0.19265033407572385
es0.19084821428571427
lt0.1890380313199105
et0.1844769403824522
hi0.17613636363636365
vi0.17613636363636365
no0.1733181299885975
nl0.16762342135476463
da0.1637831603229527
pt0.1637831603229527
sl0.14806110458284372
lv0.14504716981132076
is0.11907654921020656
sq0.10714285714285714
pl0.09261576971214018
reliablefalse
passesfalse
3
name"Hunter"
dialogue"Uh, okay... I don't speak Hindi. Sorry about that. Can you describe it? Point? Anything? This could be important for the missing persons case."
detectedLang"en"
heavyLang"en"
scores
en0.8089359200470312
tl0.6730382293762576
fr0.5117676514772158
da0.4752421959095802
it0.45561139028475717
ca0.4431753283837807
no0.41686602870813394
ro0.39214463840399005
sq0.39214463840399005
pt0.3879472693032015
es0.37619961612284064
sv0.36191099476439786
nl0.2939898624185373
yo0.28044280442804426
is0.2783123612139156
ms0.26636568848758463
lt0.2459396751740139
lv0.2358934169278997
tr0.2316784869976359
et0.22372611464968153
pl0.22124600638977635
az0.21307506053268765
hu0.20212765957446807
cs0.1988496302382909
hr0.16879795396419436
de0.13101604278074866
sk0.11844484629294756
fi0.07407407407407407
hi0.07407407407407407
be0.06698564593301436
uk0.06069364161849711
vi0.06069364161849711
reliabletrue
passestrue
4
name"Selvi"
dialogue"Dekho, yeh photo... yahan, ismein woh shadow... woh bhag raha tha! Police ko batao, please! Main akeli hoon yahan."
detectedLang"tl"
heavyLang"tl"
scores
tl0.5569188820722564
en0.5170876671619613
fr0.4406196213425129
ro0.3486973947895792
ms0.30997876857749473
eu0.3092454835281615
sl0.30703624733475476
cs0.2934782608695652
et0.26136363636363635
hu0.24681344148319811
lv0.2459396751740139
sq0.23439340400471145
lt0.21875
fi0.20924574209245742
hr0.20537897310513448
it0.2034313725490196
de0.19554455445544552
sk0.19454770755885997
es0.18444165621079048
ca0.181360201511335
pt0.1792929292929293
yo0.1677336747759283
da0.12162162162162163
no0.12043301759133965
sv0.12043301759133965
pl0.11924119241192413
nl0.11684782608695651
hi0.10591471801925723
az0.10344827586206896
tr0.09972299168975068
reliablefalse
passesfalse
5
name"Hunter"
dialogue"Photo? Can I see that? Shadow... running? Wait, is this from last night? Miss, this looks like it could be a lead. If you could just—"
detectedLang"en"
heavyLang"en"
scores
en0.8292349726775956
tl0.6452223273415326
yo0.438622754491018
sv0.41815360744763375
no0.416796267496112
hu0.39710610932475876
fr0.3966210780370072
et0.3877551020408163
ca0.36332767402376914
da0.3573264781491003
nl0.3573264781491003
cs0.3495229835212489
is0.3119266055045872
sq0.28023032629558536
lt0.25521350546176763
hr0.25074925074925075
it0.24242424242424243
pl0.23547400611620795
ro0.23391215526046988
tr0.2299794661190965
lv0.2260061919504644
az0.21875
sk0.21218487394957983
de0.15824915824915825
pt0.15730337078651685
vi0.1506228765571914
es0.14965986394557826
sl0.10714285714285714
hi0.09310761789600969
be0.08536585365853659
eu0.08536585365853659
fi0.07749077490774908
ms0.07749077490774908
uk0.07749077490774908
reliabletrue
passestrue
6
name"Hunter"
dialogue"Hold on, that's my dispatch. Damn it. Look, I gotta take this. Stay here—I'll be right back. We'll figure out how to translate this."
detectedLang"en"
heavyLang"en"
scores
en0.7883530015392509
tl0.5907738095238095
it0.45580474934036935
sq0.4360902255639098
fr0.4206460674157303
da0.40476190476190477
yo0.40390173410404623
no0.39338235294117646
cs0.3888888888888889
pl0.3806306306306307
ro0.3773584905660377
sk0.37594553706505296
hr0.3683001531393568
ca0.36733128834355827
sv0.3067226890756302
de0.3002544529262086
lt0.2954739538855679
lv0.29062768701633707
hu0.26141450313339304
et0.2506811989100818
fi0.2410303587856486
sl0.23822714681440443
pt0.23184357541899442
es0.22680412371134018
vi0.15471311475409835
tr0.13883089770354906
az0.12882787750791974
hi0.0924092409240924
be0.0782122905027933
eu0.07511210762331838
is0.07094594594594594
nl0.07094594594594594
uk0.07094594594594594
ms0.0667420814479638
reliabletrue
passestrue