Run: 2026-09-01-01M1EMGAZ81R89ZWVJZ7XR89ZB

Run Details

Model:
Grok 4.6 (Reasoning, High)
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
1m 9s
Cost:
$0.020160
Provider:
xAI

Evaluation summary

Score Evaluator
Details Link
57.14% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Hunter: "Excuse me, miss. Detective Hunter. Investigating the mysterious disappearances here in Alborn. Seen anything unusual lately, maybe around the apple festival?" Selvi: "Maaf kijiye, mujhe English nahi aati. Yeh photo dekho... log gayab ho rahe hain. Main bahut ghabra gayi hoon." Hunter: "Sorry, I don't speak any Hindi. English? Missing people? Festival?" Selvi: "Festival? Haan, wahan maine landscape shots liye. Ek aadmi tha jo ab nahi dikhta. Yeh kya mystery hai is shehar mein?" Hunter: "A man who vanished from your photos? That could be a lead. Can you show me on the camera?" Selvi: "Yeh raha. Main student hoon study abroad pe. Camera hamesha saath rehta hai. Lekin ab darr lag raha hai ki main bhi next hoon." Hunter: "I wish I understood. Hold on—my phone. I have to take this and leave. Stay around, okay?"
created_at"2026-09-01T14:03:26.065Z" 9/1/2026, 2:03:26 PM
model"x-ai/grok-4.6-20260810"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency581
moderation_latency(null)
generation_time68698
tokens_prompt302
tokens_completion566
native_tokens_prompt477
native_tokens_completion3297
native_tokens_completion_images(null)
native_tokens_reasoning3064
native_tokens_cached384
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
num_fetches(null)
web_search_engine(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"completed"
service_tier"default"
usage0.02016
router(null)
user_agent"langchainjs-openai/1.0.0 ((node/v24.19.0; linux; x64))"
http_referer(null)
request_id"req-1788271406-IOsDTiv7pn74YIBepBW8"
session_id(null)
preset_id(null)
api_type"completions"
id"gen-1788271406-je95P80aoCJWu4sCTASp"
upstream_id"91731991-472b-98cf-9d08-bd008043f897"
provider_responses
0
endpoint_id"0d0536e3-7eb1-4acb-8249-c8813365c2d8"
id"91731991-472b-98cf-9d08-bd008043f897"
is_byokfalse
latency148
model_permaslug"x-ai/grok-4.6-20260810"
provider_name"xAI"
status200
total_cost0.02016
cache_discount0.000576
upstream_inference_cost0
provider_name"xAI"
response_cache_source_id(null)
data_region"global"
workspace_id"97e315e5-d303-487d-83c1-83180e8a13d4"

Evaluation details

Result Evaluator Details Meta Data
57.14% Parse dialogue n/a
dialogue
0
name"Hunter"
dialogue"Excuse me, miss. Detective Hunter. Investigating the mysterious disappearances here in Alborn. Seen anything unusual lately, maybe around the apple festival?"
detectedLang"en"
heavyLang"en"
scores
en0.7695605573419079
tl0.5790916209866875
fr0.5490771812080537
nl0.5342287694974003
pt0.5098039215686274
it0.507332722273144
es0.48017408123791105
ms0.4667658730158731
ro0.46623634558093346
de0.4518103008669046
sq0.451530612244898
ca0.4312169312169313
no0.4254409406734367
sv0.4201725997842502
sl0.40771349862258954
da0.36578171091445427
hr0.33063511830635123
et0.3234738829452486
cs0.29415627051871307
sk0.2677111716621254
fi0.23920736022646846
az0.22939068100358423
lt0.22661870503597123
lv0.19835943325876212
pl0.17180277349768877
yo0.15354330708661418
hu0.12601626016260162
is0.11376751854905194
tr0.0989103101424979
hi0.06602953953084274
eu0.06277244986922406
reliabletrue
passestrue
1
name"Selvi"
dialogue"Maaf kijiye, mujhe English nahi aati. Yeh photo dekho... log gayab ho rahe hain. Main bahut ghabra gayi hoon."
detectedLang"en"
heavyLang"es"
scores
en0.41709844559585496
eu0.3098159509202454
fr0.291710388247639
cs0.2232451093210587
no0.22235023041474655
ms0.2077464788732394
de0.1818181818181818
ca0.15094339622641512
sk0.1412213740458015
it0.1357234314980794
es0.1346153846153846
sq0.1346153846153846
hi0.10239361702127658
tl0.10239361702127658
da0.09638554216867469
hr0.09638554216867469
ro0.09638554216867469
sv0.09638554216867469
reliablefalse
passesfalse
2
name"Hunter"
dialogue"Sorry, I don't speak any Hindi. English? Missing people? Festival?"
detectedLang"en"
heavyLang"en"
scores
en0.7799907364520612
tl0.6703678001387926
it0.5497630331753555
ca0.5361328125
da0.5306324110671937
no0.5113168724279835
sv0.4716351501668521
hr0.4644870349492672
pt0.4351961950059453
ms0.4318181818181818
nl0.4318181818181818
sq0.42493946731234866
et0.42002442002442
is0.39720812182741116
cs0.3807040417209909
ro0.3708609271523179
fr0.3457300275482094
az0.34119278779472956
de0.31059506531204645
sk0.2857142857142857
lt0.2846385542168675
pl0.2846385542168675
sl0.2824773413897281
es0.27811550151975684
fi0.22889610389610393
hu0.22003284072249588
lv0.2096505823627288
yo0.15480427046263345
hi0.1410488245931284
be0.12844036697247707
tr0.12844036697247707
uk0.1171003717472119
vi0.1171003717472119
reliabletrue
passestrue
3
name"Selvi"
dialogue"Festival? Haan, wahan maine landscape shots liye. Ek aadmi tha jo ab nahi dikhta. Yeh kya mystery hai is shehar mein?"
detectedLang"en"
heavyLang"ber"
scores
en0.4968553459119497
de0.4043186895011169
nl0.40253920836445106
eu0.38837920489296635
ms0.38080495356037153
tl0.36608557844690964
fi0.3464052287581699
da0.3311036789297659
fr0.32603201347935973
no0.3185689948892675
sq0.29947460595446584
sv0.2727272727272727
it0.27140255009107467
ca0.2694063926940639
sl0.26806953339432754
et0.2626728110599078
lv0.250936329588015
ro0.24882629107981222
lt0.2277992277992278
hu0.21645445641527913
yo0.20948616600790515
is0.2047713717693837
hr0.2007992007992008
pt0.2007992007992008
tr0.1919191919191919
cs0.1894630192502533
es0.1861648016276704
pl0.1794871794871795
vi0.16405433646812956
az0.12854030501089325
sk0.12854030501089325
reliablefalse
passesfalse
4
name"Hunter"
dialogue"A man who vanished from your photos? That could be a lead. Can you show me on the camera?"
detectedLang"en"
heavyLang"en"
scores
en0.8236196319018404
tl0.649176327028676
fr0.5708955223880597
nl0.49428320140721194
ca0.45754716981132076
es0.4180161943319838
yo0.41683569979716023
pt0.4010416666666667
da0.39727463312368977
ms0.3947368421052632
lt0.3902439024390244
it0.3869936034115139
no0.37837837837837834
sv0.37837837837837834
de0.3618201997780244
et0.35174746335963925
sq0.3413516609392898
ro0.34059633027522934
fi0.33371958285052145
cs0.33139534883720934
hu0.32193396226415094
lv0.3021844660194175
sk0.26282051282051283
hr0.2580645161290322
pl0.24738219895287958
sl0.23638778220451526
hi0.21875
tr0.21124828532235942
az0.203601108033241
is0.11538461538461538
eu0.10852713178294573
vi0.10852713178294573
reliabletrue
passestrue
5
name"Selvi"
dialogue"Yeh raha. Main student hoon study abroad pe. Camera hamesha saath rehta hai. Lekin ab darr lag raha hai ki main bhi next hoon."
detectedLang"en"
heavyLang"la"
scores
en0.5036764705882353
de0.409965034965035
ro0.40318302387267907
sv0.36380772855796417
it0.3270189431704885
az0.3202416918429003
et0.31886982845610495
fr0.3112244897959183
tl0.3084016393442623
nl0.30268595041322316
tr0.2849576271186441
sq0.26550598476605003
yo0.26310043668122274
no0.2598684210526316
sl0.23900789177001125
fi0.2303306727480046
ca0.21420256111757857
hu0.21052631578947367
ms0.19161676646706588
vi0.18870192307692307
eu0.17883211678832117
cs0.17380660954712362
pl0.1687192118226601
sk0.16044776119402984
da0.15730337078651685
es0.12790697674418602
is0.11533420707732633
hr0.10239361702127658
lt0.09395973154362416
lv0.09395973154362416
reliablefalse
passesfalse
6
name"Hunter"
dialogue"I wish I understood. Hold on—my phone. I have to take this and leave. Stay around, okay?"
detectedLang"en"
heavyLang"en"
scores
en0.8230535894843277
tl0.6527777777777778
da0.5977011494252874
pl0.4951923076923077
cs0.47813121272365805
no0.46808510638297873
sk0.4637385086823289
yo0.4312026002166848
sv0.3993135011441648
hr0.3951612903225807
ca0.3110236220472441
et0.29245283018867924
sl0.27486187845303867
vi0.27184466019417475
fr0.26880222841225626
lv0.2605633802816902
de0.2446043165467626
lt0.24132947976878616
nl0.2324561403508772
fi0.2222222222222222
sq0.2033383915022762
it0.1796875
ro0.14634146341463414
hi0.13793103448275862
be0.11764705882352942
tr0.11764705882352942
hu0.11317567567567569
az0.10714285714285714
is0.10714285714285714
uk0.10714285714285714
reliabletrue
passestrue