Run: 2026-03-12-01KKHYYZ438TKYK3C3RW782FRG

Run Details

Model:
Grok 4.20 (Beta)
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
4.4s
Cost:
$0.003509
Provider:
xAI

Evaluation summary

Score Evaluator
Details Link
60.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
**Scene:** The cozy corner café in Alborn, MN was quiet that afternoon, sunlight filtering through the windows onto the wooden tables. Selvi sat alone near the window, her sleek digital camera resting on the table as she scrolled through her latest landscape photos from the orchard trails. Her brow was furrowed in concentration. Hunter entered the café, scanning the room with his usual sharp, no-nonsense gaze. Spotting the young woman with the camera—who matched the description of the foreign student seen near the latest disappearance site—he approached her table. **Voice Sheet:** Selvi: "..." Hunter: "Excuse me, miss. I'm Detective Hunter with the Alborn PD. Mind if I ask you a few questions about the incident at the old mill last week? Some folks mentioned seeing someone matching your description taking photos out that way." Selvi: "Kya? Main samajh nahi rahi hoon. Woh raat bahut darravni thi... main sirf photos le rahi thi, aur phir woh awaaz... jaise koi chillaya, lekin jab main pahunchi toh kuch nahi tha. Bahut ghabrahat ho rahi hai mujhe, main yahan naya hoon, please samajhiye..." Hunter: "..." Selvi: "Mujhe kuch pata nahi hai, main sirf apne camera ke saath ghum rahi thi. Kya hua tha wahan? Kya koi gayab ho gaya hai? Main bahut dar rahi hoon abhi bhi..." Hunter: "I'm sorry, I don't speak... whatever that is. Do you speak any English at all? Hindi? Wait, is that Hindi? Damn it. Look, I just need to know if you saw anything unusual near the mill. Anyone acting strange? Anything out of the ordinary?" Selvi: "Main English nahi bolti. Sirf Hindi. Aap detective hain? Kya hua tha? Main sirf photography karti hoon, landscape... lekin us raat kuch galat tha. Main ghar jana chahti hoon ab." Hunter: "This isn't getting us anywhere. Alright, here's my card—if you remember anything or if someone who speaks English can translate, give me a call. Thanks for your time." Selvi: "Theek hai... shukriya. Main koshish karungi." Hunter's phone suddenly buzzed loudly in his pocket. He glanced at the screen, his expression tightening. Hunter: "I have to take this—it's the station. We'll talk again soon. Stay safe out there." He gave a curt nod and strode out of the café, phone already to his ear, leaving Selvi staring anxiously at her camera once more.
created_at"2026-03-12T21:24:08.969Z" 3/12/2026, 9:24:08 PM
model"x-ai/grok-4.20-beta-20260309"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency292
moderation_latency(null)
generation_time4295
tokens_prompt315
tokens_completion601
native_tokens_prompt387
native_tokens_completion571
native_tokens_completion_images0
native_tokens_reasoning0
native_tokens_cached384
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"completed"
usage0.0035088
router(null)
provider_responses
0
endpoint_id"33f49f24-a0de-4dcf-872d-ca514e83fbae"
id"4943693d-8ee8-4803-ea71-3ab604807e38"
is_byokfalse
latency255
model_permaslug"x-ai/grok-4.20-beta-20260309"
provider_name"xAI"
status200
user_agent"langchainjs-openai/1.0.0 ((node/v24.14.0; linux; x64))"
http_referer(null)
api_type"completions"
id"gen-1773350648-boPEkrlkzcYAot3kkYl5"
upstream_id"4943693d-8ee8-4803-ea71-3ab604807e38"
total_cost0.0035088
cache_discount0.0006912
upstream_inference_cost0
provider_name"xAI"

Evaluation details

Result Evaluator Details Meta Data
60.00% Parse dialogue n/a
dialogue
0
name"Selvi"
dialogue"..."
detectedLang""
heavyLang""
scores
reliablefalse
passestrue
1
name"Hunter"
dialogue"Excuse me, miss. I'm Detective Hunter with the Alborn PD. Mind if I ask you a few questions about the incident at the old mill last week? Some folks mentioned seeing someone matching your description taking photos out that way."
detectedLang"en"
heavyLang"en"
scores
en0.7930178004691596
tl0.6196754563894523
fr0.5842572062084257
it0.4889267461669506
ca0.4586791771923493
nl0.4405072734054457
no0.438622754491018
pt0.43630214205186024
da0.42835365853658536
ro0.4270435446906035
es0.42263279445727486
sv0.4140625
sq0.3617021276595745
de0.3464052287581699
ms0.29145016532829476
et0.2809204218600192
cs0.25484351713859915
sl0.251497005988024
hu0.2299794661190965
hr0.22760041194644695
pl0.21342422653382276
yo0.21301154249737672
sk0.21135646687697163
fi0.1965720407070166
tr0.16294642857142855
lt0.1591928251121076
az0.156355455568054
is0.12229373902867173
lv0.11971830985915494
vi0.08144519289650949
hi0.04882688649334179
zh0.04882688649334179
be0.0445859872611465
eu0.0445859872611465
uk0.04030710172744722
reliabletrue
passestrue
2
name"Selvi"
dialogue"Kya? Main samajh nahi rahi hoon. Woh raat bahut darravni thi... main sirf photos le rahi thi, aur phir woh awaaz... jaise koi chillaya, lekin jab main pahunchi toh kuch nahi tha. Bahut ghabrahat ho rahi hai mujhe, main yahan naya hoon, please samajhiye..."
detectedLang"tl"
heavyLang"tl"
scores
tl0.35000000000000003
en0.3493493493493494
it0.29805615550755943
fr0.2961559285327558
fi0.2520138089758343
ca0.2058643860720831
sl0.20098340503995082
ro0.19703520691785054
eu0.1935483870967742
vi0.1935483870967742
es0.1798107255520505
ms0.1798107255520505
sq0.14586070959264125
no0.13964262078093978
hr0.13735899137358992
cs0.12926992632283993
is0.12751677852348994
sk0.12634408602150538
az0.12516823687752357
et0.12280701754385964
lv0.11444141689373298
de0.1028295376121463
yo0.08579465541490858
hu0.07010014306151645
da0.06204906204906205
lt0.057971014492753624
pt0.057971014492753624
sv0.057971014492753624
hi0.05591866376180102
tr0.055232558139534885
nl0.051787016776075855
reliablefalse
passesfalse
3
name"Hunter"
dialogue"..."
detectedLang""
heavyLang""
scores
reliablefalse
passestrue
4
name"Selvi"
dialogue"Mujhe kuch pata nahi hai, main sirf apne camera ke saath ghum rahi thi. Kya hua tha wahan? Kya koi gayab ho gaya hai? Main bahut dar rahi hoon abhi bhi..."
detectedLang"ms"
heavyLang"tlh"
scores
ms0.40217391304347827
it0.30613961312026916
tl0.2763157894736842
vi0.2744063324538259
ro0.25742574257425743
ca0.21203438395415475
sq0.21203438395415475
cs0.20212765957446807
fi0.19196865817825662
es0.1887905604719764
en0.175
eu0.16666666666666666
fr0.16582406471183014
de0.15384615384615385
lt0.13249211356466878
no0.1185897435897436
sk0.1185897435897436
et0.11290322580645161
pt0.10130718954248366
yo0.09638554216867469
az0.09539473684210525
tr0.09539473684210525
sv0.09040793825799338
nl0.08435072142064373
reliablefalse
passesfalse
5
name"Hunter"
dialogue"I'm sorry, I don't speak... whatever that is. Do you speak any English at all? Hindi? Wait, is that Hindi? Damn it. Look, I just need to know if you saw anything unusual near the mill. Anyone acting strange? Anything out of the ordinary?"
detectedLang"en"
heavyLang"en"
scores
en0.8084722848129788
tl0.6392190152801358
no0.4683069224353628
sv0.40531716417910446
da0.4016893477240733
nl0.3916984732824428
sq0.3650398406374502
yo0.36026091319618664
it0.3544303797468354
hr0.3488253319713994
et0.33766233766233766
cs0.3189102564102564
ms0.3047982551799346
ro0.3047982551799346
pt0.3028977583378896
is0.3017524644030668
pl0.2743312464428002
de0.2726754135767256
fr0.27142857142857146
ca0.2582897033158813
sk0.2495585638610948
sl0.242874109263658
lv0.2110148514851485
lt0.19098984771573604
es0.15841584158415842
hu0.14772727272727273
vi0.12008281573498965
tr0.09188034188034187
az0.08732999284180387
eu0.05904059040590406
hi0.05764966740576496
be0.05204460966542751
uk0.04708520179372198
reliabletrue
passestrue
6
name"Selvi"
dialogue"Main English nahi bolti. Sirf Hindi. Aap detective hain? Kya hua tha? Main sirf photography karti hoon, landscape... lekin us raat kuch galat tha. Main ghar jana chahti hoon ab."
detectedLang"en"
heavyLang"vi"
scores
en0.5718050065876153
tl0.4900627615062762
fr0.4036697247706422
eu0.38134517766497467
de0.3765984654731458
ro0.35813034891375906
sv0.3495663775850567
is0.34121621621621623
it0.3285123966942149
sq0.3035714285714286
et0.29552023121387283
da0.2903930131004367
no0.2903930131004367
ca0.25287356321839083
es0.2523006134969325
ms0.23828125
tr0.22863924050632914
fi0.21370967741935482
pt0.20081967213114754
cs0.1948802642444261
hr0.16879795396419436
nl0.15364583333333331
lt0.1409691629955947
hi0.13716814159292035
lv0.12477558348294435
sl0.11444141689373298
az0.05705996131528047
pl0.05705996131528047
sk0.05705996131528047
reliablefalse
passesfalse
7
name"Hunter"
dialogue"This isn't getting us anywhere. Alright, here's my card—if you remember anything or if someone who speaks English can translate, give me a call. Thanks for your time."
detectedLang"en"
heavyLang"en"
scores
en0.8107038375494752
tl0.6014492753623188
no0.461839530332681
da0.4430379746835443
ms0.38820912124582874
pt0.38820912124582874
nl0.3861607142857143
de0.3837535014005602
fr0.32926829268292684
es0.3288590604026846
sv0.3226600985221675
it0.3167701863354037
sk0.30861093651791327
hr0.3006993006993007
sq0.29936305732484075
ro0.28802588996763756
et0.28292046936114734
cs0.28104575163398693
yo0.25775978407557354
sl0.24914675767918087
ca0.24812030075187969
hu0.23237962316817865
is0.21652421652421652
vi0.21596578759800428
pl0.19531821506949523
tr0.16476841305998483
az0.15773353751914243
lt0.11929543634907926
fi0.11147011308562196
eu0.11075181891673404
lv0.11075181891673404
reliabletrue
passestrue
8
name"Selvi"
dialogue"Theek hai... shukriya. Main koshish karungi."
detectedLang"vi"
heavyLang"rn"
scores
vi0.36342592592592593
ms0.3226600985221675
az0.298469387755102
nl0.2763157894736842
it0.26666666666666666
en0.2647058823529412
fr0.24242424242424243
de0.22096317280453256
reliablefalse
passesfalse
9
name"Hunter"
dialogue"I have to take this—it's the station. We'll talk again soon. Stay safe out there."
detectedLang"en"
heavyLang"en"
scores
en0.8260869565217391
tl0.6251874062968515
da0.5667244367417678
no0.5029821073558649
yo0.49341438703140833
nl0.4629430719656284
sv0.44258639910813824
de0.4232987312572088
sq0.4165694282380397
pl0.39320388349514557
hr0.38875305623471884
cs0.37421777221526903
fr0.3670886075949367
sk0.34469200524246396
sl0.3438320209973753
lv0.3315508021390375
lt0.32614555256064687
it0.30362116991643456
ro0.25037481259370314
ca0.2163009404388715
ms0.21507064364207218
tr0.20508744038155804
az0.20127795527156547
et0.19614147909967844
ja0.16666666666666666
fi0.14089347079037798
zh0.1334488734835355
be0.12280701754385964
hu0.11816578483245149
is0.11190053285968028
uk0.11190053285968028
vi0.11190053285968028
reliabletrue
passestrue