Run: 2026-09-01-01M1EM99VBY76YF3JFKQYTD3AJ

Run Details

Model:
Grok 4.6 (Reasoning, High)
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
1m 14s
Cost:
$0.020754
Provider:
xAI

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Hunter: "Excuse me, miss. Detective Hunter, Alborn PD. Investigating the disappearances around the apple festival. You were photographing out there, right? See anything?" Selvi: "मैं आपकी बात समझ नहीं पा रही। मैं बहुत व्याकुल हूँ। मेरे कैमरे की तस्वीरों में कुछ डरावना दिख रहा है।" Hunter: "I don't speak Hindi at all. English? The missing people. Last night's event. Your camera." Selvi: "कैमरा हाँ। सेब के बाग में मैं लैंडस्केप ले रही थी। एक छाया जंगल की तरफ गई और वापस नहीं आई। मैं कांप रही हूँ।" Hunter: "Orchard photos? Someone heading into the woods? That's exactly the area. Still can't follow you though." Selvi: "यह शहर अजीब लगता है। लोग गायब हो रहे हैं। कृपया मेरी तस्वीरें देखो, मैं डरी हुई हूँ।" Hunter: "Hold on, phone. Hunter here. Another one? On my way. Miss, I have to go. Stay put."
created_at"2026-09-01T13:59:35.542Z" 9/1/2026, 1:59:35 PM
model"x-ai/grok-4.6-20260810"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency687
moderation_latency(null)
generation_time74091
tokens_prompt302
tokens_completion1257
native_tokens_prompt477
native_tokens_completion3396
native_tokens_completion_images(null)
native_tokens_reasoning3159
native_tokens_cached384
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
num_fetches(null)
web_search_engine(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"completed"
service_tier"default"
usage0.020754
router(null)
user_agent"langchainjs-openai/1.0.0 ((node/v24.19.0; linux; x64))"
http_referer(null)
request_id"req-1788271175-l8CmLOdGylaLx1DBRFHl"
session_id(null)
preset_id(null)
api_type"completions"
id"gen-1788271175-6UoIERmJK5tpte8YJDmg"
upstream_id"b904c20d-785e-9c25-b4dd-88e5c7d4513f"
provider_responses
0
endpoint_id"0d0536e3-7eb1-4acb-8249-c8813365c2d8"
id"b904c20d-785e-9c25-b4dd-88e5c7d4513f"
is_byokfalse
latency313
model_permaslug"x-ai/grok-4.6-20260810"
provider_name"xAI"
status200
total_cost0.020754
cache_discount0.000576
upstream_inference_cost0
provider_name"xAI"
response_cache_source_id(null)
data_region"global"
workspace_id"97e315e5-d303-487d-83c1-83180e8a13d4"

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Hunter"
dialogue"Excuse me, miss. Detective Hunter, Alborn PD. Investigating the disappearances around the apple festival. You were photographing out there, right? See anything?"
detectedLang"en"
heavyLang"en"
scores
en0.7857285230217261
tl0.6213455442057063
fr0.6105072463768116
it0.48515325670498083
pt0.47739426349052017
nl0.4581653225806452
es0.4424273858921162
de0.4421380384016606
ro0.4380554103502352
no0.42879914984059514
sq0.4278871740287387
ca0.4086908690869087
ms0.4044321329639889
da0.3698710433763188
sv0.3616389548693587
sl0.3289637952559301
et0.32432432432432434
hr0.30510665804783454
cs0.3028534370946822
sk0.19233658903080392
lt0.1899020346646571
az0.18001525553012968
lv0.16146645865834633
fi0.154874213836478
yo0.14410828025477707
is0.11376751854905194
hi0.06684027777777778
hu0.05866900175131349
pl0.05536028119507908
tr0.05202821869488536
reliabletrue
passestrue
1
name"Selvi"
dialogue"मैं आपकी बात समझ नहीं पा रही। मैं बहुत व्याकुल हूँ। मेरे कैमरे की तस्वीरों में कुछ डरावना दिख रहा है।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8821428571428571
mr0.877795882091542
reliabletrue
passestrue
2
name"Hunter"
dialogue"I don't speak Hindi at all. English? The missing people. Last night's event. Your camera."
detectedLang"en"
heavyLang"en"
scores
en0.7948016415868673
tl0.7188378631677601
no0.5419847328244275
da0.5283018867924528
sv0.5028997514498758
it0.49748743718592964
nl0.4545454545454546
ms0.40594059405940597
ro0.4041708043694141
ca0.39332659251769464
et0.39209726443769
sq0.38208032955715754
de0.3730407523510972
fr0.3617021276595745
is0.3428258488499452
hr0.2601726263871763
yo0.24433249370277077
es0.22680412371134018
pt0.2052980132450331
az0.1758241758241758
pl0.17355371900826447
cs0.14893617021276595
fi0.11504424778761062
hi0.11504424778761062
sk0.10714285714285714
be0.1044776119402985
tr0.1044776119402985
hu0.10044977511244377
lt0.09502262443438914
lv0.09502262443438914
uk0.09502262443438914
vi0.09502262443438914
reliabletrue
passestrue
3
name"Selvi"
dialogue"कैमरा हाँ। सेब के बाग में मैं लैंडस्केप ले रही थी। एक छाया जंगल की तरफ गई और वापस नहीं आई। मैं कांप रही हूँ।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8818046737808997
mr0.8734085648148148
reliabletrue
passestrue
4
name"Hunter"
dialogue"Orchard photos? Someone heading into the woods? That's exactly the area. Still can't follow you though."
detectedLang"en"
heavyLang"en"
scores
en0.8153933541607499
tl0.5560109289617486
nl0.38679245283018865
no0.34738955823293177
fr0.34010152284263956
sq0.28017718715393136
da0.27616926503340755
es0.26636568848758463
it0.2554410080183276
sv0.2554410080183276
is0.2502883506343714
de0.24681344148319811
ms0.21686746987951808
pt0.19554455445544552
lt0.18444165621079048
lv0.1751269035532995
yo0.14134742404227213
cs0.10714285714285714
ro0.10714285714285714
hi0.10591471801925723
sk0.09972299168975068
ca0.0984743411927878
hr0.09344490934449094
reliabletrue
passestrue
5
name"Selvi"
dialogue"यह शहर अजीब लगता है। लोग गायब हो रहे हैं। कृपया मेरी तस्वीरें देखो, मैं डरी हुई हूँ।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8790712673331184
mr0.8756218905472637
reliabletrue
passestrue
6
name"Hunter"
dialogue"Hold on, phone. Hunter here. Another one? On my way. Miss, I have to go. Stay put."
detectedLang"en"
heavyLang"en"
scores
en0.8240088921822898
tl0.6354566385264774
da0.6080858085808581
pl0.5709123757904245
hr0.5388349514563107
cs0.4552752293577982
yo0.4418331374853114
sk0.43452380952380953
no0.4114002478314746
ca0.38391699092088194
sq0.3815104166666667
fr0.3581081081081081
et0.31358381502890176
sv0.30453879941434847
vi0.29210134128166915
lv0.2803030303030303
sl0.27480916030534347
it0.2725880551301685
lt0.2601246105919003
de0.2554858934169279
fi0.24000000000000002
ro0.23878205128205127
nl0.22512234910277326
tr0.21357615894039736
es0.1739130434782609
hi0.15026833631484796
be0.12844036697247707
hu0.12361623616236161
az0.1171003717472119
is0.1171003717472119
pt0.1171003717472119
uk0.1171003717472119
ms0.11048689138576778
reliabletrue
passestrue