Run: 2026-03-12-01KKHYRKWHVKVV6SWA5Y4GJ94X

Run Details

Model:
Grok 4.20 (Beta, Reasoning)
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
20.0s
Cost:
$0.025845
Provider:
xAI

Evaluation summary

Score Evaluator
Details Link
53.85% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Selvi: "Camera mein dekh rahi thi... yeh photos..." Hunter: "Excuse me, miss. I'm Detective Hunter. I'm investigating the recent disappearance in Alborn. Did you see anything unusual at the cafe yesterday?" Selvi: "Maaf kijiye, mujhe English nahi aati. Lekin main bahut ghabrayi hui hoon. Kal ek aadmi yahan se achanak gayab ho gaya. Main landscape photo le rahi thi aur woh... woh bas nahi raha." Hunter: "I'm sorry, I don't understand a word of Hindi. English? Do you speak English?" Selvi: "Nahi, main sirf Hindi bolti hoon. Yeh sheher bahut ajeeb hai. Main study abroad ke liye aayi hoon aur ab dar lag raha hai. Kya ho raha hai yahan?" Hunter: "This language barrier is not helping. Saw? You saw the man disappear? Man gone?" Selvi: "Haan, maine dekha. Woh coffee pee raha tha, phir bahar gaya aur ek pal mein gayab. Camera mein shayad kuch capture hua hai background mein. Mujhe madad chahiye." Hunter: "Camera... photos? I need to see if there's evidence. You understand 'evidence'?" Selvi: "Camera? Ji haan, yeh lijiye. Is photo mein dekho, kuch toh nazar aa raha hai pedon ke peeche. Main bohot pareshan hoon, please samajhiye." Hunter: "These might actually show something. The angle is interesting... but how do I ask you more without a translator?" Selvi: "Kya aap police hain? Main aur photos dikha sakti hoon agar aap bataaye ki kya dekhna hai. Yeh sab bahut mysterious lag raha hai." Hunter: "My phone is ringing. Hello? This is Hunter. Another disappearance at the festival grounds? I'm on my way right now." Hunter: "I have to leave immediately. Emergency. Stay safe, miss."
created_at"2026-03-12T21:20:41.214Z" 3/12/2026, 9:20:41 PM
model"x-ai/grok-4.20-beta-20260309"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency17542
moderation_latency(null)
generation_time19436
tokens_prompt315
tokens_completion407
native_tokens_prompt389
native_tokens_completion4197
native_tokens_completion_images0
native_tokens_reasoning3752
native_tokens_cached64
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"completed"
usage0.0258448
router(null)
provider_responses
0
endpoint_id"33f49f24-a0de-4dcf-872d-ca514e83fbae"
id"08bf7535-6ebd-8c55-bb14-99a747dde1c4"
is_byokfalse
latency519
model_permaslug"x-ai/grok-4.20-beta-20260309"
provider_name"xAI"
status200
user_agent"langchainjs-openai/1.0.0 ((node/v24.14.0; linux; x64))"
http_referer(null)
api_type"completions"
id"gen-1773350441-h5In56UdF5SKycFzJNCB"
upstream_id"08bf7535-6ebd-8c55-bb14-99a747dde1c4"
total_cost0.0258448
cache_discount0.0001152
upstream_inference_cost0
provider_name"xAI"

Evaluation details

Result Evaluator Details Meta Data
53.85% Parse dialogue n/a
dialogue
0
name"Selvi"
dialogue"Camera mein dekh rahi thi... yeh photos..."
detectedLang"de"
heavyLang"vi"
scores
de0.5436105476673428
fr0.5341614906832298
en0.5161290322580645
es0.44306930693069313
ca0.43467336683417085
it0.412532637075718
ro0.412532637075718
vi0.40789473684210525
tl0.39839572192513373
nl0.3951612903225807
sv0.267100977198697
lt0.26229508196721313
pt0.26229508196721313
hi0.2549668874172185
ms0.24242424242424243
lv0.2398648648648649
reliablefalse
passesfalse
1
name"Hunter"
dialogue"Excuse me, miss. I'm Detective Hunter. I'm investigating the recent disappearance in Alborn. Did you see anything unusual at the cafe yesterday?"
detectedLang"en"
heavyLang"en"
scores
en0.77149209486166
tl0.6038543897216274
nl0.5584725536992841
fr0.5126448893572181
ro0.4934282584884994
it0.49203734211971445
pt0.4791666666666667
no0.45071258907363415
ms0.4318181818181818
da0.4290123456790123
sv0.4279529993815708
sq0.41455696202531644
es0.4059087989723828
sl0.40129449838187703
de0.38863185723727695
ca0.3620689655172413
et0.35042134831460675
cs0.347212420606916
hr0.29817905918057663
sk0.2727987421383648
yo0.2154368108566582
az0.17923691215616683
lt0.1696588868940754
pl0.14192949907235622
is0.12982126058325494
fi0.12653446647780925
lv0.07035175879396985
tr0.059959349593495935
reliabletrue
passestrue
2
name"Selvi"
dialogue"Maaf kijiye, mujhe English nahi aati. Lekin main bahut ghabrayi hui hoon. Kal ek aadmi yahan se achanak gayab ho gaya. Main landscape photo le rahi thi aur woh... woh bas nahi raha."
detectedLang"fr"
heavyLang"tl"
scores
fr0.4421906693711968
en0.377123442808607
ms0.34795494961470064
eu0.3103448275862069
tl0.301143583227446
ro0.27200529450694905
no0.25524712254570076
it0.2403314917127072
cs0.23076923076923078
hr0.20806335493160547
fi0.20520231213872833
da0.1976659372720642
sv0.19236417033773862
es0.18458117123795403
sl0.18458117123795403
de0.18032786885245902
yo0.17231000752445447
pt0.16603487490523125
sq0.16476841305998483
ca0.1641337386018237
is0.15514592933947774
hu0.15188897455666925
nl0.15057915057915058
tr0.1452991452991453
vi0.12350597609561753
et0.11361804995970992
sk0.0916597853014038
hi0.06542056074766354
reliablefalse
passesfalse
3
name"Hunter"
dialogue"I'm sorry, I don't understand a word of Hindi. English? Do you speak English?"
detectedLang"en"
heavyLang"en"
scores
en0.7933884297520661
tl0.648876404494382
no0.5791245791245792
da0.5387453874538745
cs0.5155038759689923
sv0.49186991869918695
pl0.4747899159663866
hr0.46977730646871685
it0.4692144373673036
sk0.4582881906825569
de0.453551912568306
sq0.45054945054945056
is0.44382647385984425
yo0.44258639910813824
pt0.44196428571428575
ro0.42857142857142855
nl0.4279176201372997
ca0.3540051679586563
vi0.32795698924731176
hu0.3084370677731674
et0.3055555555555556
sl0.29577464788732394
tr0.22720247295208654
lt0.2248062015503876
ms0.2125984251968504
az0.21011058451816747
lv0.21011058451816747
es0.20886075949367086
fr0.18962722852512154
hi0.13494809688581316
be0.12280701754385964
eu0.12280701754385964
fi0.11190053285968028
uk0.11190053285968028
reliabletrue
passestrue
4
name"Selvi"
dialogue"Nahi, main sirf Hindi bolti hoon. Yeh sheher bahut ajeeb hai. Main study abroad ke liye aayi hoon aur ab dar lag raha hai. Kya ho raha hai yahan?"
detectedLang"it"
heavyLang"en"
scores
it0.3860322333077513
tl0.3850883935434281
de0.354317998385795
en0.33554817275747506
is0.2747053490480508
ro0.2747053490480508
cs0.26199261992619927
no0.2599444958371878
ms0.25788497217068646
sq0.2537313432835821
sv0.23150816522574447
et0.22705314009661837
lt0.19678714859437751
sk0.17525773195876287
eu0.17098445595854922
vi0.16405433646812956
fr0.15522703273495247
nl0.15522703273495247
ca0.13043478260869565
es0.10414333706606943
pt0.10414333706606943
fi0.0990990990990991
yo0.0990990990990991
hi0.0888382687927107
tr0.0888382687927107
hr0.08779931584948689
lv0.08045977011494253
pl0.07727797001153403
da0.07300115874855156
sl0.06868451688009314
reliablefalse
passesfalse
5
name"Hunter"
dialogue"This language barrier is not helping. Saw? You saw the man disappear? Man gone?"
detectedLang"en"
heavyLang"en"
scores
en0.8102066638549136
nl0.6062992125984252
tl0.6017699115044248
fr0.503858875413451
da0.5027624309392266
ms0.494949494949495
no0.4915254237288135
yo0.44512946979038226
sv0.44306930693069313
de0.3818681318681319
ro0.293563579277865
eu0.2834394904458599
is0.281150159744409
it0.2598684210526316
lt0.25864909390444807
pt0.25742574257425743
hu0.2549668874172185
et0.2474916387959866
lv0.1935483870967742
fi0.18032786885245902
ca0.17279411764705882
es0.16044776119402984
cs0.14772727272727273
sq0.14772727272727273
tr0.14772727272727273
reliabletrue
passestrue
6
name"Selvi"
dialogue"Haan, maine dekha. Woh coffee pee raha tha, phir bahar gaya aur ek pal mein gayab. Camera mein shayad kuch capture hua hai background mein. Mujhe madad chahiye."
detectedLang"tl"
heavyLang"en"
scores
tl0.4616234124792932
en0.45039458850056363
fr0.3261921216309606
et0.29906542056074764
de0.29856115107913667
ro0.296028880866426
it0.2608036391205459
ms0.2388758782201405
sv0.23469387755102045
ca0.23228346456692914
tr0.1820469798657718
sq0.16165090283748923
nl0.1529105125977411
es0.15217391304347824
fi0.14323374340949035
vi0.13869257950530034
lv0.08278457196613359
hr0.08105560791705939
sl0.07582938388625592
az0.07407407407407407
pt0.07231208372978117
yo0.06787762906309751
reliablefalse
passesfalse
7
name"Hunter"
dialogue"Camera... photos? I need to see if there's evidence. You understand 'evidence'?"
detectedLang"en"
heavyLang"en"
scores
en0.7956681651001226
no0.5751911639762107
tl0.5531724754244861
cs0.5507637017070979
da0.5466908431550317
sv0.5150339476236664
fr0.503968253968254
de0.49748743718592964
ro0.4840041279669762
nl0.4742376445846478
ca0.47145877378435525
et0.4629430719656284
sk0.4588744588744588
it0.4577006507592191
es0.4487320837927233
lv0.44382647385984425
pt0.414519906323185
pl0.4040524433849821
hr0.3857493857493857
lt0.3796526054590571
yo0.3678887484197219
sq0.34210526315789475
sl0.33774834437086093
is0.21507064364207218
tr0.21507064364207218
hi0.1334488734835355
ms0.12587412587412586
be0.12280701754385964
hu0.11816578483245149
az0.11190053285968028
uk0.11190053285968028
vi0.11190053285968028
reliabletrue
passestrue
8
name"Selvi"
dialogue"Camera? Ji haan, yeh lijiye. Is photo mein dekho, kuch toh nazar aa raha hai pedon ke peeche. Main bohot pareshan hoon, please samajhiye."
detectedLang"en"
heavyLang"tlh"
scores
en0.4729344729344729
ro0.3163340724316335
fr0.3153219837157661
tl0.3143068939955523
et0.26587301587301587
it0.26294820717131473
cs0.24118129614438064
fi0.2393092105263158
ms0.23427152317880795
de0.22916666666666666
es0.223993288590604
nl0.20258620689655174
sv0.1970486111111111
no0.19001751313485116
sl0.18930762489044697
lt0.1857394366197183
yo0.18358340688437777
is0.17336907953529937
lv0.1696588868940754
ca0.1659152389540126
vi0.14510166358595195
hu0.14272474513438368
tr0.08687068114511352
da0.0850642927794263
pt0.0814299900695134
az0.0777666999002991
hi0.07684630738522955
reliablefalse
passesfalse
9
name"Hunter"
dialogue"These might actually show something. The angle is interesting... but how do I ask you more without a translator?"
detectedLang"en"
heavyLang"en"
scores
en0.8243688254665203
tl0.629286376274328
pt0.5495495495495496
nl0.5394358088658607
sq0.5235259082787374
ro0.5171997585998793
no0.5006242197253433
hr0.49558638083228246
fr0.49174078780177893
ca0.4851994851994852
it0.46773120425815035
cs0.453551912568306
pl0.45054945054945056
da0.4448299791811242
sl0.44328462073764785
sv0.43820224719101125
es0.43622269203664554
yo0.4223826714801444
sk0.4043186895011169
de0.3907083015993907
hu0.3893129770992366
lt0.38837920489296635
ms0.38319198149575945
vi0.3305439330543933
is0.3220338983050847
lv0.31212381771281167
et0.2831541218637993
eu0.26538108356290174
tr0.26062846580406657
az0.24457034938621341
fi0.14712153518123666
be0.08045977011494253
uk0.07300115874855156
reliabletrue
passestrue
10
name"Selvi"
dialogue"Kya aap police hain? Main aur photos dikha sakti hoon agar aap bataaye ki kya dekhna hai. Yeh sab bahut mysterious lag raha hai."
detectedLang"en"
heavyLang"ber"
scores
en0.45014662756598234
tl0.4140625
fr0.40191387559808617
sq0.37810945273631835
ro0.35456110154905335
eu0.34554973821989526
sl0.33274021352313166
de0.3297587131367293
ms0.31444241316270566
it0.3023255813953488
et0.2809204218600192
nl0.2809204218600192
es0.27884615384615385
ca0.2767598842815815
hu0.27466150870406186
pt0.2725509214354995
no0.25
sv0.24623115577889448
cs0.24318869828456105
tr0.23857868020304565
az0.23547400611620795
lt0.23469387755102045
hr0.2323439099283521
lv0.2260061919504644
sk0.22360248447204967
vi0.1730981256890849
da0.16943521594684383
fi0.1638795986622074
yo0.13093858632676708
pl0.10501193317422433
hi0.09310761789600969
reliablefalse
passesfalse
11
name"Hunter"
dialogue"My phone is ringing. Hello? This is Hunter. Another disappearance at the festival grounds? I'm on my way right now."
detectedLang"en"
heavyLang"en"
scores
en0.7983328851841893
tl0.6822033898305085
da0.570446735395189
no0.5468277945619335
fr0.5401594114040466
nl0.5300751879699248
it0.44933920704845814
ms0.4335347432024169
sv0.4094488188976378
de0.37290969899665555
yo0.3670886075949367
es0.36061381074168797
cs0.3562231759656652
et0.32855863921217543
ca0.3267504488330341
hr0.3169398907103825
sk0.31066176470588236
sq0.3029739776951673
pt0.30102516309412863
sl0.2917847025495751
fi0.28977272727272724
pl0.2416582406471183
hu0.22760041194644695
ro0.19093851132686085
is0.1830065359477124
vi0.1506228765571914
lt0.14383561643835618
az0.1359447004608295
hi0.10071942446043164
lv0.07749077490774908
tr0.07292954264524104
reliabletrue
passestrue
12
name"Hunter"
dialogue"I have to leave immediately. Emergency. Stay safe, miss."
detectedLang"en"
heavyLang"en"
scores
en0.8102226720647773
da0.5535714285714286
it0.5381773399014779
tl0.49186991869918695
sk0.48700410396716826
pl0.4806094182825485
hr0.47844228094575797
cs0.46808510638297873
ca0.43524096385542166
no0.4038155802861685
es0.3872549019607844
yo0.37395659432387307
sl0.34210526315789475
lv0.33035714285714285
ro0.31569343065693434
lt0.3081180811808118
fr0.2857142857142857
nl0.2857142857142857
et0.28023032629558536
sv0.2690058479532163
sq0.2632612966601179
de0.22839506172839508
ms0.18655097613882862
fi0.17218543046357618
pt0.16851441241685144
be0.15730337078651685
tr0.15730337078651685
hu0.1515837104072398
az0.14383561643835618
is0.14383561643835618
uk0.14383561643835618
vi0.14383561643835618
reliabletrue
passestrue