Run: 2026-02-20-01KHY8M82K6YQ7A2KR0DRZ9DVE

Run Details

Model:
Grok 4.1 Fast
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
20.5s
Cost:
$0.000761
Provider:
xAI

Evaluation summary

Score Evaluator
Details Link
55.56% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Selvi: "Arre, yeh kya... maine kal raat apple festival mein dekha... woh aadmi ko koi kheench kar le gaya tha andhere mein!" Hunter: "Excuse me, miss? Detective Hunter, Alborn PD. Saw you with that camera—mind if I ask about the disappearance last night at the festival? You catch anything on film?" Selvi: "Haan! Haan! Camera mein photo hai! Ladka... gayab! Dar lag raha tha mujhe... please, samjho!" Hunter: "Whoa, slow down. Sorry, I don't speak... Hindi, right? English? Parlez-vous anglais? You saw something? This guy?" *[shows phone photo]* Selvi: "Yeh wohi! Raat ko, tent ke peeche... do aadmi usko zabardasti le gaye! Main chillayi, par koi nahi aaya... mujhe darr lag gaya!" Hunter: "Okay, point to it. Here? The festival grounds? Drag—gone? Shit, I need a translator app... or gestures. You got the photo? Show me?" Selvi: "Yeh dekho! Camera yahaan..." *[fumbles with camera, shows blurry photo]* "Woh! Police ko batao, please!" Hunter: "That's him—Blaine Whitaker, third missing in a week. Good work, miss. Stay put, I'll—" *[phone rings]* Hunter: "Hunter. Yeah? Another one? Where? Festival cleanup site? On my way—five out!"
created_at"2026-02-20T19:32:32.989Z" 2/20/2026, 7:32:32 PM
model"x-ai/grok-4.1-fast"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency967
moderation_latency(null)
generation_time20408
tokens_prompt315
tokens_completion411
native_tokens_prompt418
native_tokens_completion1401
native_tokens_completion_images0
native_tokens_reasoning1066
native_tokens_cached151
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"completed"
usage0.00076145
router(null)
provider_responses
0
endpoint_id"9821aa0e-dce3-4c27-9716-161359123d0b"
id"cbb8f7a7-0bc2-802d-ecd5-56816ec6975b"
is_byokfalse
latency851
model_permaslug"x-ai/grok-4.1-fast"
provider_name"xAI"
status200
api_type"completions"
id"gen-1771615952-MGUos7rNDg2PjkfjcI1j"
upstream_id"cbb8f7a7-0bc2-802d-ecd5-56816ec6975b"
total_cost0.00076145
cache_discount0.00002265
upstream_inference_cost0
provider_name"xAI"

Evaluation details

Result Evaluator Details Meta Data
55.56% Parse dialogue n/a
dialogue
0
name"Selvi"
dialogue"Arre, yeh kya... maine kal raat apple festival mein dekha... woh aadmi ko koi kheench kar le gaya tha andhere mein!"
detectedLang"fr"
heavyLang"de"
scores
fr0.5077355836849508
en0.49856733524355296
tl0.4644223412394797
sl0.45567651632970446
de0.4496855345911949
es0.3934142114384749
it0.3783303730017762
ro0.35125115848007415
sq0.3170731707317073
et0.2893401015228426
ms0.2849846782431052
lv0.2813141683778234
nl0.27007299270072993
yo0.2654774396642183
fi0.24406047516198706
lt0.23995656894679696
ca0.2273730684326711
hr0.22308546059933407
pt0.22308546059933407
sv0.21524663677130043
cs0.21082299887260428
da0.21082299887260428
no0.21082299887260428
hu0.19075144508670522
az0.14425427872860636
sk0.14425427872860636
eu0.13043478260869565
tr0.125
pl0.08256880733944955
reliablefalse
passesfalse
1
name"Hunter"
dialogue"Excuse me, miss? Detective Hunter, Alborn PD. Saw you with that camera—mind if I ask about the disappearance last night at the festival? You catch anything on film?"
detectedLang"en"
heavyLang"en"
scores
en0.785941855834329
tl0.6411882510013351
fr0.5293345008756567
it0.5247568523430592
no0.48736289938006677
da0.4667658730158731
nl0.4495647721454173
sq0.4444444444444444
ro0.4374672946101517
ms0.43450815360336664
sv0.4275825346112886
ca0.4217321140398063
cs0.3742724097788126
es0.3676470588235294
hr0.36727486756915834
et0.35782556750298683
de0.35240963855421686
pt0.3508454106280193
sl0.3289637952559301
yo0.27217332430602575
sk0.2626886145404664
pl0.2359630419331912
fi0.21129860601614087
hu0.17116422513492677
lt0.1495253164556962
tr0.14885193982581155
az0.14410828025477707
lv0.10491257285595336
hi0.0724762726488352
be0.061135371179039305
is0.05536028119507908
uk0.05536028119507908
vi0.05536028119507908
reliabletrue
passestrue
2
name"Selvi"
dialogue"Haan! Haan! Camera mein photo hai! Ladka... gayab! Dar lag raha tha mujhe... please, samjho!"
detectedLang"en"
heavyLang"vi"
scores
en0.4878048780487805
ro0.42371020856201974
de0.3429286608260325
fr0.336283185840708
it0.32950191570881227
tl0.3217054263565891
es0.2677824267782427
sv0.25
vi0.23020527859237538
nl0.22566371681415928
et0.21171171171171171
lt0.1935483870967742
sq0.1822429906542056
ca0.16267942583732056
no0.15730337078651685
pt0.15048543689320387
cs0.1435562805872757
hi0.12790697674418602
ms0.12060301507537688
reliablefalse
passesfalse
3
name"Hunter"
dialogue"Whoa, slow down. Sorry, I don't speak... Hindi, right? English? Parlez-vous anglais? You saw something? This guy?"
detectedLang"en"
heavyLang"en"
scores
en0.7627922738054896
tl0.6020466173962479
fr0.4102780117944398
it0.3607305936073059
sq0.3433395872420263
no0.33962264150943394
da0.32950191570881227
cs0.317738791423002
ms0.3089832181638697
ro0.3020937188434696
ca0.29221435793731043
lt0.2886178861788618
hr0.2813141683778234
sv0.2776057791537668
pt0.25611052072263546
et0.2391304347826087
lv0.23580786026200873
sk0.23329682365826945
de0.2299229922992299
pl0.21612541993281076
is0.18699186991869918
yo0.18699186991869918
sl0.16963226571767495
es0.16367980884109917
hu0.1606714628297362
az0.15966386554621848
tr0.15560916767189384
hi0.10025706940874037
be0.09090909090909091
nl0.08256880733944955
uk0.08256880733944955
vi0.08256880733944955
reliabletrue
passestrue
4
name"Selvi"
dialogue"Yeh wohi! Raat ko, tent ke peeche... do aadmi usko zabardasti le gaye! Main chillayi, par koi nahi aaya... mujhe darr lag gaya!"
detectedLang"sl"
heavyLang"rn"
scores
sl0.4186046511627907
yo0.35842600513259193
fr0.34782608695652173
eu0.336283185840708
lv0.3212669683257918
ms0.30362116991643456
tl0.30037313432835816
cs0.2944496707431797
en0.2917847025495751
it0.27884615384615385
hr0.27466150870406186
pt0.2378048780487805
sk0.22839506172839508
pl0.22680412371134018
ro0.2260061919504644
es0.21465968586387435
fi0.19871794871794873
sv0.19871794871794873
lt0.19527896995708155
de0.1712707182320442
sq0.13494809688581316
vi0.1289198606271777
et0.11764705882352942
az0.1166077738515901
hu0.11556603773584906
no0.11556603773584906
tr0.11137440758293839
da0.11032028469750889
nl0.09310761789600969
is0.08424908424908424
reliablefalse
passesfalse
5
name"Hunter"
dialogue"Okay, point to it. Here? The festival grounds? Drag—gone? Shit, I need a translator app... or gestures. You got the photo? Show me?"
detectedLang"en"
heavyLang"en"
scores
en0.7831390620764435
tl0.6681874740771464
fr0.6360327570518653
da0.5373048004626952
sq0.528023598820059
no0.5274660366213821
ca0.5034140285536933
nl0.49874686716791977
cs0.4936708860759494
pt0.4798439531859558
et0.4666666666666667
hr0.46380697050938335
it0.4546693933197001
sv0.4546693933197001
pl0.4513031550068587
ro0.4494150034411562
sl0.4310099573257468
es0.4177583697234352
lv0.4091580502215657
de0.4052044609665427
yo0.39668174962292607
ms0.3957703927492447
sk0.3916349809885932
lt0.355877616747182
az0.27927927927927926
hu0.26605504587155965
vi0.21645445641527913
is0.21414538310412573
tr0.2079207920792079
fi0.2007992007992008
eu0.14621131270010673
hi0.08779931584948689
be0.08045977011494253
uk0.07300115874855156
reliabletrue
passestrue
6
name"Selvi"
dialogue"Woh! Police ko batao, please!"
detectedLang"tl"
heavyLang"tl"
scores
tl0.7527812113720643
en0.6805111821086262
ro0.635036496350365
eu0.5926680244399185
sl0.5901639344262295
fr0.5391705069124424
lv0.5145631067961165
cs0.47643979057591623
lt0.47643979057591623
hr0.45652173913043476
it0.453551912568306
sk0.43977591036414565
ms0.4350282485875706
es0.42363112391930835
ca0.4186046511627907
pt0.4152046783625731
yo0.3957703927492447
da0.3103448275862069
et0.3079584775086505
no0.3079584775086505
sv0.3079584775086505
pl0.3055555555555556
nl0.3006993006993007
fi0.29577464788732394
sq0.2907801418439716
de0.2857142857142857
az0.2727272727272727
hu0.2727272727272727
tr0.2647058823529412
reliabletrue
passesfalse
7
name"Hunter"
dialogue"That's him—Blaine Whitaker, third missing in a week. Good work, miss. Stay put, I'll—"
detectedLang"en"
heavyLang"en"
scores
en0.796037296037296
tl0.630801687763713
nl0.5304114490161002
sv0.46537678207739314
fr0.4211686879823594
de0.4074492099322799
ro0.4040862656072645
no0.4006849315068493
it0.39095127610208813
is0.38380281690140844
sq0.3312101910828026
ms0.3208279430789133
sl0.31729518855656696
hr0.3110236220472441
az0.29435483870967744
et0.29435483870967744
fi0.29149797570850206
da0.2866847826086956
ca0.2837653478854025
yo0.2827868852459016
pt0.28082191780821925
pl0.2647058823529412
hu0.2290748898678414
cs0.2009132420091324
es0.2009132420091324
sk0.1984732824427481
lt0.13509060955518945
tr0.12790697674418602
eu0.11764705882352942
lv0.11764705882352942
vi0.11764705882352942
reliabletrue
passestrue
8
name"Hunter"
dialogue"Hunter. Yeah? Another one? Where? Festival cleanup site? On my way—five out!"
detectedLang"en"
heavyLang"en"
scores
en0.8009220452640402
tl0.5929734361610968
fr0.49841605068637806
hr0.4418331374853114
ca0.433849821215733
pt0.42493946731234866
cs0.42284325637910086
da0.4221411192214112
pl0.4069912609238452
es0.37335092348284965
sk0.370026525198939
et0.3675099866844208
sq0.35983827493261455
no0.3581081081081081
it0.3546195652173913
ro0.3484224965706447
nl0.343015214384509
sl0.34119278779472956
ms0.3338008415147265
de0.3319268635724332
fi0.309593023255814
sv0.2835595776772248
lt0.2096505823627288
az0.19898819561551434
hi0.15026833631484796
yo0.13636363636363635
hu0.12361623616236161
lv0.1171003717472119
tr0.11048689138576778
reliabletrue
passestrue