Run: 2026-02-20-01KHY7RKQPN6V79FNNA6KH0Z54

Run Details

Model:
Grok 4
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
26.0s
Cost:
$0.013222
Provider:
xAI

Evaluation summary

Score Evaluator
Details Link
50.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Selvi: (in Hindi, looking troubled and shaken, gesturing at her camera) "Kya hua tha? Mainne dekha... woh admi gayab ho gaya! Bahut darawna tha!" Hunter: "Excuse me, ma'am? I'm Detective Hunter. I saw you around town with that camera. Did you happen to notice anything unusual at the apple festival last night? There was another disappearance." Selvi: (in Hindi, voice trembling, pointing emphatically) "Main samajh nahi paa rahi! Camera mein photo hai... laapata aadmi! Police ko batao!" Hunter: "Whoa, slow down. I don't understand... is that Hindi? Look, if you saw something, can you show me on the camera? Point to it or something?" Selvi: (in Hindi, frustrated and shaking her head) "English nahi aati! Yeh photo dekho... raat mein, andhera tha, aur woh chala gaya!" Hunter: "Okay, okay, I get that you're upset. Let me try to... uh, photo? You mean pictures? Can I see?" Selvi: (in Hindi, nodding vigorously and holding up her camera) "Haan! Yeh dekh! Dar lag raha hai mujhe!" Hunter: "Alright, these shots from the festival... wait, that shadow there looks suspicious. You might have captured something important. Hang on, I need to get a translator or—" *(Hunter's phone rings)* Hunter: "Sorry, I have to take this. It's the station. Stay here, okay? I'll be right back." Selvi: (in Hindi, worried) "Mat jao! Kuch aur batao!"
created_at"2026-02-20T19:17:27.427Z" 2/20/2026, 7:17:27 PM
model"x-ai/grok-4-07-09" 4/7/2009, 12:00:00 AM
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency13682
moderation_latency(null)
generation_time25945
tokens_prompt315
tokens_completion352
native_tokens_prompt947
native_tokens_completion834
native_tokens_completion_images0
native_tokens_reasoning478
native_tokens_cached946
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"completed"
usage0.0132225
router(null)
provider_responses
0
endpoint_id"d40bef9d-6936-4c57-9749-bf7399de4a77"
id"26a1a0c7-5ff1-c20b-5ba6-88b3e61ee8d9"
is_byokfalse
latency85
model_permaslug"x-ai/grok-4-07-09" 4/7/2009, 12:00:00 AM
provider_name"xAI"
status200
api_type"completions"
id"gen-1771615047-1fR9ULtWTgPe2BeGgMMz"
upstream_id"26a1a0c7-5ff1-c20b-5ba6-88b3e61ee8d9"
total_cost0.0132225
cache_discount0.0021285
upstream_inference_cost0
provider_name"xAI"

Evaluation details

Result Evaluator Details Meta Data
50.00% Parse dialogue n/a
dialogue
0
name"Selvi"
dialogue"Kya hua tha? Mainne dekha... woh admi gayab ho gaya! Bahut darawna tha!"
detectedLang"tl"
heavyLang"vi"
scores
tl0.39716312056737585
de0.3694362017804154
sq0.3431221020092735
no0.3369734789391576
ms0.3044189852700491
fi0.2916666666666667
ca0.22018348623853207
sk0.20708955223880596
cs0.19962335216572505
it0.19962335216572505
pl0.19811320754716982
fr0.17794970986460348
en0.17153996101364524
lv0.17153996101364524
eu0.16829745596868884
sv0.1533864541832669
yo0.15169660678642716
et0.1448692152917505
ro0.1448692152917505
reliablefalse
passesfalse
1
name"Hunter"
dialogue"Excuse me, ma'am? I'm Detective Hunter. I saw you around town with that camera. Did you happen to notice anything unusual at the apple festival last night? There was another disappearance."
detectedLang"en"
heavyLang"en"
scores
en0.7926154847104749
tl0.6221102548903379
fr0.4978337928318236
no0.4785276073619632
da0.4748764415156508
nl0.468528553563985
it0.46428571428571425
es0.44995685936151847
de0.4368374558303887
ms0.41460055096418735
sq0.40807799442896936
ro0.3783520234032179
pt0.36472346786248133
sv0.36345481777334004
cs0.36218109054527264
ca0.3494897959183674
hr0.3431221020092735
sl0.31451612903225806
yo0.3017524644030668
et0.2659758203799654
sk0.2630057803468208
lv0.22350791717417784
pl0.2026266416510319
lt0.1868622448979592
hu0.15169660678642716
az0.12431318681318682
fi0.09766454352441614
tr0.09188034188034187
be0.05204460966542751
is0.04708520179372198
uk0.04708520179372198
vi0.04708520179372198
reliabletrue
passestrue
2
name"Selvi"
dialogue"Main samajh nahi paa rahi! Camera mein photo hai... laapata aadmi! Police ko batao!"
detectedLang"tl"
heavyLang"tl"
scores
tl0.6195652173913043
fr0.5283018867924528
it0.5018975332068311
en0.4971264367816092
eu0.4648318042813456
ro0.4360902255639098
de0.40340909090909094
lv0.37050359712230213
no0.3644067796610169
ms0.3613138686131387
sl0.35424354243542433
cs0.33962264150943394
sv0.3234536082474227
ca0.31906614785992216
es0.31906614785992216
et0.26880222841225626
fi0.2636746143057504
lt0.25742574257425743
da0.2510699001426534
hr0.24242424242424243
nl0.23580786026200873
sk0.23020527859237538
vi0.23020527859237538
pt0.2128935532233883
yo0.19969512195121952
is0.16267942583732056
pl0.1435562805872757
sq0.13509060955518945
hi0.12790697674418602
az0.125
hu0.125
tr0.12060301507537688
reliabletrue
passesfalse
3
name"Hunter"
dialogue"Whoa, slow down. I don't understand... is that Hindi? Look, if you saw something, can you show me on the camera? Point to it or something?"
detectedLang"en"
heavyLang"en"
scores
en0.8048780487804879
tl0.65650493774152
da0.49206349206349204
no0.47950553025374104
nl0.4513031550068587
fr0.4428969359331476
sv0.43222143364088006
yo0.42938659058487877
sq0.39984996249062266
pl0.3916349809885932
cs0.3715632364493323
it0.36254980079681276
ca0.34210526315789475
ms0.33993399339933994
et0.33665008291873966
sk0.3150684931506849
hr0.300087489063867
is0.290150842945874
ro0.28698752228163993
es0.25857275254865614
lv0.2530345471521942
de0.24882629107981222
pt0.23298178331735378
fi0.21951219512195122
hu0.21645445641527913
sl0.20713577799801783
lt0.17269906928645296
hi0.1683991683991684
tr0.15522703273495247
az0.14893617021276595
be0.08045977011494253
uk0.07300115874855156
vi0.07300115874855156
reliabletrue
passestrue
4
name"Selvi"
dialogue"English nahi aati! Yeh photo dekho... raat mein, andhera tha, aur woh chala gaya!"
detectedLang"en"
heavyLang"de"
scores
en0.5148110316649642
eu0.4424882629107981
fr0.3790849673202614
tl0.3675099866844208
de0.2931547619047619
ro0.2714723926380368
ms0.2658423493044822
cs0.2578125
sq0.19763513513513514
no0.14721723518850988
hi0.1394927536231884
sk0.1394927536231884
da0.1316270566727605
hr0.1316270566727605
sv0.1316270566727605
reliablefalse
passesfalse
5
name"Hunter"
dialogue"Okay, okay, I get that you're upset. Let me try to... uh, photo? You mean pictures? Can I see?"
detectedLang"en"
heavyLang"en"
scores
en0.7845671758715237
tl0.5510204081632653
cs0.48308270676691734
fr0.46236559139784944
et0.4364754098360656
no0.43123061013443637
da0.416135881104034
ca0.4117647058823529
sl0.36342592592592593
sq0.33894230769230765
lv0.3276283618581907
pl0.32182490752157833
nl0.3176178660049628
hr0.3167701863354037
ro0.3055555555555556
yo0.289405684754522
sv0.2763157894736842
sk0.27055702917771884
it0.26174496644295303
fi0.24657534246575344
lt0.2329149232914923
is0.2286115007012623
tr0.2109038737446198
az0.20289855072463767
es0.15644171779141106
pt0.13793103448275862
ms0.13249211356466878
hi0.12280701754385964
de0.11575562700964631
be0.11290322580645161
hu0.1085899513776337
uk0.10277324632952692
vi0.10277324632952692
reliabletrue
passestrue
6
name"Selvi"
dialogue"Haan! Yeh dekh! Dar lag raha hai mujhe!"
detectedLang"vi"
heavyLang"ber"
scores
vi0.4109947643979057
et0.38524590163934425
ro0.3626062322946175
lt0.358974358974359
it0.30769230769230765
no0.303405572755418
es0.29245283018867924
pt0.29245283018867924
sv0.29245283018867924
de0.2549668874172185
nl0.2549668874172185
reliablefalse
passesfalse
7
name"Hunter"
dialogue"Alright, these shots from the festival... wait, that shadow there looks suspicious. You might have captured something important. Hang on, I need to get a translator or—"
detectedLang"en"
heavyLang"en"
scores
en0.8002840404757678
tl0.6034543531899894
fr0.5253164556962026
ca0.5102307357422725
da0.5022123893805309
no0.47405329593267886
pt0.45014662756598234
ro0.43637274549098193
es0.4201030927835051
sq0.4174003107198343
it0.4143675169182717
hr0.4094488188976378
cs0.40539112050739956
et0.4034994697773065
sv0.36833239752947783
pl0.36619718309859156
nl0.35233160621761656
yo0.3474477958236659
de0.34593023255813954
ms0.3440233236151603
sk0.3440233236151603
sl0.3152769324406573
lt0.3131868131868132
lv0.2549668874172185
hu0.251497005988024
az0.21602787456445993
tr0.2049469964664311
fi0.19700214132762314
is0.17461482024944974
vi0.16419019316493313
eu0.10855784469096671
hi0.06947890818858561
be0.058577405857740586
uk0.05303030303030303
reliabletrue
passestrue
8
name"Hunter"
dialogue"Sorry, I have to take this. It's the station. Stay here, okay? I'll be right back."
detectedLang"en"
heavyLang"en"
scores
en0.8182166092613853
tl0.7058823529411765
da0.6051537822111388
yo0.5855148342059336
no0.5497630331753555
sv0.4552752293577982
sq0.44379391100702575
fr0.433849821215733
lt0.42702050663449936
pl0.40550688360450565
hr0.4010088272383354
it0.4010088272383354
cs0.3863049095607235
de0.35636856368563685
sk0.35636856368563685
sl0.35549525101763907
lv0.343015214384509
nl0.3271954674220963
hu0.27921092564491656
ro0.2601246105919003
ca0.22512234910277326
ms0.2238562091503268
tr0.21357615894039736
az0.2096505823627288
et0.20435510887772196
pt0.1739130434782609
fi0.14721723518850988
zh0.1394927536231884
be0.12844036697247707
is0.1171003717472119
uk0.1171003717472119
vi0.1171003717472119
reliabletrue
passestrue
9
name"Selvi"
dialogue"Mat jao! Kuch aur batao!"
detectedLang"tl"
heavyLang"tl"
scores
tl0.5821727019498607
ro0.5412844036697247
ms0.494949494949495
eu0.38016528925619836
is0.358974358974359
lt0.3333333333333333
no0.3333333333333333
sk0.3333333333333333
sv0.3333333333333333
ca0.32432432432432434
es0.32432432432432434
fr0.32432432432432434
pt0.32432432432432434
reliablefalse
passesfalse