Run: 2026-02-20-01KHY9ZA86Z3CN39S2NEDF1B00

Run Details

Model:
Grok 4.1 Fast
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
15.3s
Cost:
$0.000652
Provider:
xAI

Evaluation summary

Score Evaluator
Details Link
55.56% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Selvi: *muttering to herself, looking troubled at her camera* Yeh photo... yeh aadmi... kahaan gayab ho gaya? Hunter: Excuse me, miss. I'm Detective Hunter with the Alborn PD. That's a nice camera. Were you taking pictures at the apple festival last night? See anything unusual? Selvi: *shaken, eyes wide, speaking rapidly in Hindi* Haan! Maine dekha! Woh aadmi... apple stall ke paas tha... achanak gayab! Koi shadow... le gaya usko! Bhoot? Nahi, sach mein! Hunter: Uh... ma'am? Sorry, I didn't catch that. Do you speak any English? English? Selvi: *gesturing frantically at her camera screen, voice trembling* Dekho! Yeh photo! Yahaan tha woh... ab nahi! Madad karo, please! Police? Hunter: Okay, photos—yeah, I see a guy in the crowd. Disappeared? *confused frown, mimicking disappearance with hands* Like this? Who took him? You point? Selvi: *nodding vigorously, pointing at shadows in photo* Haan, haan! Yeh shadow... black coat wala aadmi... usne kheencha! Kahaan le gaya? Dar lagta hai! Hunter: Black coat? Got it, maybe. *pulling out notebook, struggling* Shadow man... pulled him? Festival stall? *phone buzzes* Hold on— Hunter: *answering call* Hunter here. Yeah? Another one? On my way—stay here, ma'am, I'll get a translator!
created_at"2026-02-20T19:56:04.24Z" 2/20/2026, 7:56:04 PM
model"x-ai/grok-4.1-fast"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency320
moderation_latency(null)
generation_time15123
tokens_prompt315
tokens_completion476
native_tokens_prompt418
native_tokens_completion1182
native_tokens_completion_images0
native_tokens_reasoning842
native_tokens_cached151
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"completed"
usage0.00065195
router(null)
provider_responses
0
endpoint_id"9821aa0e-dce3-4c27-9716-161359123d0b"
id"6ae9600b-e397-c186-7562-c06391f2eba4"
is_byokfalse
latency125
model_permaslug"x-ai/grok-4.1-fast"
provider_name"xAI"
status200
api_type"completions"
id"gen-1771617364-Acnc2ikMvh0Jeg1SGQOz"
upstream_id"6ae9600b-e397-c186-7562-c06391f2eba4"
total_cost0.00065195
cache_discount0.00002265
upstream_inference_cost0
provider_name"xAI"

Evaluation details

Result Evaluator Details Meta Data
55.56% Parse dialogue n/a
dialogue
0
name"Selvi"
dialogue"Yeh photo... yeh aadmi... kahaan gayab ho gaya?"
detectedLang"tl"
heavyLang"tl"
scores
tl0.5491803278688524
cs0.4136460554371002
fr0.40860215053763443
en0.3834080717488789
ca0.3037974683544304
no0.28756476683937826
sk0.28756476683937826
it0.27821522309711283
fi0.2763157894736842
ms0.26666666666666666
hi0.21875
reliablefalse
passesfalse
1
name"Hunter"
dialogue"Excuse me, miss. I'm Detective Hunter with the Alborn PD. That's a nice camera. Were you taking pictures at the apple festival last night? See anything unusual?"
detectedLang"en"
heavyLang"en"
scores
en0.7785787847579815
tl0.6342293297039808
fr0.549266247379455
it0.4799225931301403
no0.47866149369544136
ro0.47637603507062837
nl0.4740704500978474
es0.461961961961962
ca0.4424273858921162
sq0.44184839044652124
da0.4339125855713533
pt0.4297082228116711
et0.42697228144989335
ms0.41671188279978294
de0.4138495092693566
sv0.3926553672316384
sl0.34331093463653023
cs0.30375647668393785
hr0.26116838487972505
sk0.22883787661406027
yo0.2181818181818182
fi0.20722713864306785
pl0.20311341734618235
hu0.17180277349768877
tr0.17116422513492677
lv0.1673121611154144
lt0.16212003117692905
az0.14885193982581155
is0.11957411957411958
eu0.061135371179039305
vi0.061135371179039305
reliabletrue
passestrue
2
name"Selvi"
dialogue"Haan! Maine dekha! Woh aadmi... apple stall ke paas tha... achanak gayab! Koi shadow... le gaya usko! Bhoot? Nahi, sach mein!"
detectedLang"fr"
heavyLang"vi"
scores
fr0.4615936826992103
de0.4113029827315541
ms0.3163172288058341
tl0.2704280155642024
es0.2654260528893242
en0.2618110236220473
eu0.26035502958579887
ro0.258160237388724
it0.2331288343558282
yo0.21875
sl0.21052631578947367
hu0.20802534318901794
cs0.20382165605095542
nl0.19268030139935413
hr0.18211559432933477
et0.17853231106243156
fi0.17853231106243156
sv0.1648106904231626
sq0.13494809688581316
no0.12993039443155452
pt0.11764705882352942
sk0.10607866507747318
lv0.10501193317422433
lt0.09963985594237695
pl0.09963985594237695
tr0.09090909090909091
reliablefalse
passesfalse
3
name"Hunter"
dialogue"Uh... ma'am? Sorry, I didn't catch that. Do you speak any English? English?"
detectedLang"en"
heavyLang"en"
scores
en0.7820823244552059
tl0.5398773006134969
hr0.4238156209987196
cs0.412532637075718
sv0.4007989347536618
it0.39189189189189183
ca0.37586685159500693
pl0.37413073713490963
pt0.3626062322946175
sq0.3580599144079886
no0.3353028064992614
da0.31921331316187596
sk0.3119266055045872
vi0.27884615384615385
yo0.2682926829268293
ro0.2647058823529412
de0.24623115577889448
sl0.21052631578947367
fr0.16820702402957485
ms0.13793103448275862
be0.1346153846153846
tr0.1346153846153846
hu0.12959381044487428
az0.12280701754385964
et0.12280701754385964
is0.12280701754385964
lt0.12280701754385964
lv0.12280701754385964
uk0.12280701754385964
reliabletrue
passestrue
4
name"Selvi"
dialogue"Dekho! Yeh photo! Yahaan tha woh... ab nahi! Madad karo, please! Police?"
detectedLang"en"
heavyLang"de"
scores
en0.5702005730659025
tl0.5140388768898488
fr0.43890274314214467
ro0.38016528925619836
sv0.3767313019390581
cs0.375
eu0.3653032440056418
et0.3087557603686636
sq0.3066255778120185
lt0.29906542056074764
de0.29577464788732394
fi0.29577464788732394
hr0.27184466019417475
it0.2694805194805195
sl0.2647058823529412
sk0.25864909390444807
tr0.25
da0.16666666666666666
lv0.16512059369202228
no0.16512059369202228
pl0.16356877323420074
nl0.16044776119402984
ms0.15413533834586465
hi0.14611005692599618
az0.14285714285714285
es0.14285714285714285
hu0.14285714285714285
ca0.13793103448275862
pt0.1346153846153846
reliablefalse
passesfalse
5
name"Hunter"
dialogue"Okay, photos—yeah, I see a guy in the crowd. Disappeared? Like this? Who took him? You point?"
detectedLang"en"
heavyLang"en"
scores
en0.8116760828625236
tl0.6228786926461346
fr0.5230524642289348
nl0.44751381215469616
it0.441340782122905
da0.42418426103646834
no0.42028985507246375
pl0.4041708043694141
yo0.40059940059940063
sv0.39148073022312374
ro0.38208032955715754
ca0.36507936507936506
cs0.3442622950819672
ms0.3435448577680525
et0.33035714285714285
de0.3220338983050847
sq0.3212669683257918
hr0.29494712103407755
sl0.2890995260663507
lt0.2727272727272727
hu0.2709599027946537
pt0.2682926829268293
az0.26560587515299877
es0.26108374384236455
eu0.2583436341161928
lv0.2537313432835821
sk0.2518703241895262
tr0.19678714859437751
is0.18699186991869918
vi0.18144611186903137
hi0.1137370753323486
be0.1044776119402985
fi0.09502262443438914
uk0.09502262443438914
reliabletrue
passestrue
6
name"Selvi"
dialogue"Haan, haan! Yeh shadow... black coat wala aadmi... usne kheencha! Kahaan le gaya? Dar lagta hai!"
detectedLang"tl"
heavyLang"tl"
scores
tl0.5093666369313113
fr0.3764172335600907
es0.36562860438292966
it0.3081761006289308
ro0.3055555555555556
pt0.2647058823529412
en0.2403314917127072
vi0.22206506364922204
lt0.1863905325443787
yo0.18154761904761904
sl0.17541229385307347
fi0.16030534351145037
ms0.15384615384615385
hu0.15123456790123457
da0.12140575079872205
de0.12140575079872205
reliablefalse
passesfalse
7
name"Hunter"
dialogue"Black coat? Got it, maybe. Shadow man... pulled him? Festival stall? Hold on—"
detectedLang"en"
heavyLang"en"
scores
en0.7550220480156786
da0.5471014492753623
tl0.5412844036697247
fr0.4747899159663866
no0.44008958566629336
hr0.42660550458715596
de0.419953596287703
cs0.41245593419506466
sv0.38949938949938945
ca0.37888198757763975
lt0.37733499377334995
nl0.3630573248407643
sk0.36061381074168797
et0.3556701030927836
sl0.35064935064935066
lv0.3394980184940555
pl0.3150684931506849
az0.30362116991643456
sq0.30167597765363136
fi0.29873772791023845
pt0.2867332382310985
it0.28366762177650434
es0.26793557833089315
ms0.2636229749631811
yo0.23195084485407066
ro0.19093851132686085
hi0.14383561643835618
hu0.11816578483245149
reliabletrue
passestrue
8
name"Hunter"
dialogue"Hunter here. Yeah? Another one? On my way—stay here, ma'am, I'll get a translator!"
detectedLang"en"
heavyLang"en"
scores
en0.7835990888382688
tl0.5642201834862386
pl0.5153061224489796
hr0.463882618510158
fr0.4431418522860493
sq0.4431418522860493
ca0.43720379146919436
ro0.43045563549160676
da0.42839951865222625
sk0.42702050663449936
cs0.4256348246674728
pt0.42002442002442
et0.41502463054187194
es0.39413265306122447
de0.3782722513089006
no0.36412315930388217
sl0.36155913978494625
nl0.35636856368563685
sv0.3475274725274725
it0.3457300275482094
ms0.33751743375174337
fi0.309593023255814
tr0.2952522255192878
yo0.2899850523168909
is0.2692307692307693
vi0.24960505529225907
hu0.24722662440570525
lt0.23878205128205127
eu0.2238562091503268
lv0.2238562091503268
az0.21357615894039736
hi0.15026833631484796
reliabletrue
passestrue