NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-10-07-01M4AVST473YFNF941V3GYMEF4
Run Details
Model:
Mistral Large 4.0 (Reasoning)
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
1m 7s
Cost:
$0.008702
Provider:
Mistral
Evaluation summary
Score
Evaluator
Details Link
80.00%
Parse dialogue
(details)
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."
Model response
Messages
Meta
AI
**Scene: The Apple Core Café, Alborn, MN – Morning** *Selvi sits at a corner table, her Nikon camera cradled in her lap, reviewing landscape photographs on the LCD screen—golden hour light spilling over the Miller orchard, the Apple Festival banner snapping in the wind. A man approaches, posture rigid, scanning the room with sharp, assessing eyes.* **Hunter:** "Excuse me. Detective Hunter, Alborn PD. I'm investigating the disappearances. Were you near the old Miller orchard last Tuesday? Around dusk?" *Selvi looks up, startled. Her eyes widen, and she clutches the camera tighter to her chest.* **Selvi:** "नहीं... नहीं, मैं वहाँ थी... मैंने कुछ देखा... वहाँ shadows थीं... और awaazein... awaazein thi, baar-baar... mera dil tez ho raha hai..." *(No... no, I was there... I saw something... there were shadows... and sounds... sounds were there, again and again... my heart is beating fast...)* *Hunter frowns, leaning forward, straining to catch syllables he doesn't recognize.* **Hunter:** "Sorry? I didn't catch that. You were there? Can you speak English? Slowly?" *Selvi shakes her head violently, flipping the camera screen toward him—showing a grainy photo of a dark figure standing motionless between rows of apple trees, barely visible in the twilight.* **Selvi:** "तस्वीर... yahan dekho... woh aadmi... akela tha... uski aankhein... bahut bhayanak thi... woh mujhe dekh raha tha..." *(Picture... look here... that man... he was alone... his eyes... they were very terrifying... he was looking at me...)* *Hunter squints at the image, then back at her face, completely lost.* **Hunter:** "Ma'am, I need you to understand—I don't speak whatever language that is. Do you have a friend? Anyone who can translate?" *Selvi's hands tremble as she lowers the camera. Tears spill down her cheeks.* **Selvi:** "Koi nahi... main akeli hoon... main ghabra rahi hoon... woh wapas aa sakta hai... usne mujhe dekha... woh jaanta hai..." *(No one... I am alone... I am getting scared... he can come back... he saw me... he knows...)* *Hunter's radio crackles. He glances at it, frustration hardening his features, then forces himself to stay calm.* **Hunter:** "I'm going to need you to stay right here. I'll find a translator. But tell me—did you see someone take Sarah Chen? Did you see the suspect?" *Selvi stares at him, terrified, nodding slowly.* **Selvi:** "Haan... haan, maine dekha... lekin main kuch nahi keh sakti... main dar rahi hoon..." *(Yes... yes, I saw... but I can't say anything... I am scared...)* *Hunter's phone buzzes urgently against his hip. He checks the screen, jaw tightening—a new text about another missing person.* **Hunter:** "I have to take this. Stay put. Don't go anywhere." *He strides toward the exit, then stops, turning back with a stern, no-nonsense look.* **Hunter:** "And listen—whatever you saw, you're not in trouble. You're safe here. I'll be back with help. Do you understand? Nod if you do." *Selvi nods silently, hugging her camera to her chest, watching him disappear through the glass door into the morning light.*
created_at
"2026-10-07T09:41:04.271Z"
10/7/2026, 9:41:04 AM
model
"mistralai/mistral-large-4-0-20261006"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
962
moderation_latency
(null)
generation_time
66672
tokens_prompt
302
tokens_completion
4280
native_tokens_prompt
276
native_tokens_completion
4074
native_tokens_completion_images
(null)
native_tokens_reasoning
3459
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
"default"
usage
0.00870234
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1791366064-4QcF7qN7x8SPRtJs8fXI"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1791366064-1GzcGHpKpBqE07Ry4As4"
upstream_id
"8b0c213711634c758268f93ddebcf777"
provider_responses
0
endpoint_id
"19b3b5d7-23f6-4b63-8109-64a6cc37d996"
id
"8b0c213711634c758268f93ddebcf777"
is_byok
false
latency
939
model_permaslug
"mistralai/mistral-large-4-0-20261006"
provider_name
"Mistral"
status
200
total_cost
0.00870234
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Mistral"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
80.00%
Parse dialogue
n/a
dialogue
0
name
"Hunter"
dialogue
"Excuse me. Detective Hunter, Alborn PD. I'm investigating the disappearances. Were you near the old Miller orchard last Tuesday? Around dusk?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.7695852534562212
tl
0.6179966044142614
fr
0.5754716981132075
nl
0.494949494949495
no
0.4794679005205321
it
0.46839929119905493
pt
0.4646044021415824
ro
0.4444444444444444
ca
0.44306930693069313
de
0.41444372153545866
es
0.4015957446808511
da
0.39189189189189183
sv
0.3767313019390581
sq
0.3553008595988539
ms
0.34450109249817923
et
0.3071593533487298
sl
0.2741935483870968
cs
0.23728813559322032
hr
0.2314261315115286
tr
0.20141969831410825
is
0.20071047957371224
fi
0.18845807033363388
az
0.18699186991869918
lv
0.13793103448275862
sk
0.13294797687861273
lt
0.12280701754385964
yo
0.10625620655412116
hu
0.08998988877654197
reliable
true
passes
true
1
name
"Selvi"
dialogue
"नहीं... नहीं, मैं वहाँ थी... मैंने कुछ देखा... वहाँ shadows थीं... और awaazein... awaazein thi, baar-baar... mera dil tez ho raha hai..."
detectedLang
"hi"
heavyLang
"hi"
scores
hi
0.797001873828857
mr
0.7750086535133264
vi
0.32432432432432434
tr
0.31216931216931215
it
0.24065420560747666
et
0.17825537294563845
eu
0.16129032258064516
ca
0.15584415584415584
az
0.14698162729658792
no
0.14586070959264125
sk
0.14586070959264125
cs
0.1402116402116402
sv
0.1390728476821192
de
0.10714285714285714
en
0.10714285714285714
reliable
true
passes
true
2
name
"Hunter"
dialogue
"Sorry? I didn't catch that. You were there? Can you speak English? Slowly?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8127709893575088
tl
0.5264207377866401
de
0.40624999999999994
sv
0.38788659793814434
it
0.3790849673202614
no
0.3233618233618234
ca
0.3115942028985507
sq
0.30858806404657935
da
0.30758017492711365
hr
0.30758017492711365
cs
0.27811550151975684
ro
0.2543171114599686
tr
0.23633440514469453
az
0.22764227642276424
pl
0.2096505823627288
pt
0.1739130434782609
fr
0.1607773851590106
yo
0.15480427046263345
ms
0.1316270566727605
sk
0.1316270566727605
be
0.12844036697247707
hu
0.12361623616236161
et
0.1171003717472119
is
0.1171003717472119
lt
0.1171003717472119
lv
0.1171003717472119
uk
0.1171003717472119
vi
0.1171003717472119
reliable
true
passes
true
3
name
"Selvi"
dialogue
"तस्वीर... yahan dekho... woh aadmi... akela tha... uski aankhein... bahut bhayanak thi... woh mujhe dekh raha tha..."
detectedLang
"mr"
heavyLang
"de"
scores
mr
0.5320855614973261
hi
0.5162404975812024
ms
0.25925925925925924
nl
0.24078091106290672
sq
0.24078091106290672
tl
0.2349726775956284
vi
0.18128654970760233
et
0.16765755053507728
az
0.14320685434516522
de
0.13043478260869565
eu
0.12390488110137672
hu
0.12390488110137672
fi
0.1116751269035533
hr
0.10714285714285714
tr
0.0967741935483871
reliable
false
passes
true
4
name
"Hunter"
dialogue
"Ma'am, I need you to understand—I don't speak whatever language that is. Do you have a friend? Anyone who can translate?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8136856368563685
tl
0.5848012078510317
da
0.5491803278688524
no
0.532312925170068
nl
0.5018115942028986
cs
0.46670976082740795
pl
0.4433198380566802
ro
0.4433198380566802
hr
0.43103448275862066
sk
0.42827442827442824
yo
0.42267319804058784
sv
0.40390173410404623
de
0.3778280542986425
pt
0.3519245875883739
ca
0.3405275779376499
et
0.3276283618581907
sq
0.32377049180327866
sl
0.32098765432098764
is
0.31986809563066776
lt
0.31478405315614616
it
0.314214463840399
hu
0.3136439267886855
fr
0.2912371134020619
vi
0.28694900605012963
lv
0.2807323452484743
tr
0.2580935251798561
az
0.24588665447897623
eu
0.20673076923076925
es
0.20212765957446807
ms
0.20212765957446807
be
0.0782122905027933
fi
0.07094594594594594
uk
0.07094594594594594
reliable
true
passes
true
5
name
"Selvi"
dialogue
"Koi nahi... main akeli hoon... main ghabra rahi hoon... woh wapas aa sakta hai... usne mujhe dekha... woh jaanta hai..."
detectedLang
"es"
heavyLang
"de"
scores
es
0.32748538011695905
sq
0.29792429792429787
no
0.25130208333333337
it
0.23333333333333334
pt
0.23333333333333334
eu
0.222972972972973
en
0.21981004070556312
vi
0.2144808743169399
sv
0.19467787114845939
et
0.18555240793201136
tr
0.14434523809523808
ro
0.13403614457831325
fr
0.13273001508295626
ca
0.1248097412480974
de
0.11944869831546708
is
0.11674347158218126
tl
0.11538461538461538
fi
0.10852713178294573
hr
0.0987460815047022
lt
0.0987460815047022
lv
0.0987460815047022
sl
0.0987460815047022
reliable
false
passes
false
6
name
"Hunter"
dialogue
"I'm going to need you to stay right here. I'll find a translator. But tell me—did you see someone take Sarah Chen? Did you see the suspect?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8035620743844945
tl
0.6
fr
0.47442186405045556
ms
0.4646680942184154
da
0.4533527696793003
sq
0.45054945054945056
et
0.4390426327599103
no
0.42878903274942876
pt
0.4163424124513619
ro
0.4163424124513619
sl
0.3985565356856456
es
0.38067712634186623
nl
0.3723849372384937
yo
0.36815501263689976
hr
0.36006825938566556
cs
0.34782608695652173
pl
0.3345164152617569
it
0.32249322493224936
lv
0.31002759889604414
sk
0.3023255813953488
ca
0.27395934172313646
de
0.2682926829268293
sv
0.258160237388724
lt
0.25224327018943166
tr
0.21875
az
0.20969441517386725
vi
0.17400881057268722
hu
0.17218543046357618
fi
0.15540540540540537
eu
0.1544532130777903
is
0.09090909090909091
reliable
true
passes
true
7
name
"Selvi"
dialogue
"Haan... haan, maine dekha... lekin main kuch nahi keh sakti... main dar rahi hoon..."
detectedLang
"eu"
heavyLang
"tl"
scores
eu
0.43820224719101125
fr
0.42528735632183906
ro
0.4074074074074074
en
0.3957703927492447
fi
0.3911719939117199
de
0.36
sq
0.3442622950819672
et
0.2895204262877442
lt
0.23954372623574144
es
0.18864097363083165
pt
0.18864097363083165
is
0.18032786885245902
lv
0.18032786885245902
tl
0.17012448132780084
reliable
false
passes
false
8
name
"Hunter"
dialogue
"I have to take this. Stay put. Don't go anywhere."
detectedLang
"en"
heavyLang
"en"
scores
en
0.821917808219178
tl
0.6144721233689205
da
0.5454545454545454
hr
0.5390070921985816
pl
0.531700288184438
yo
0.48083067092651754
no
0.43868739205526774
cs
0.4206773618538324
sq
0.39478584729981375
sk
0.385633270321361
sl
0.37977099236641226
lv
0.36274509803921573
lt
0.3394308943089431
ca
0.29805615550755943
sv
0.29805615550755943
it
0.26136363636363635
ro
0.21686746987951808
de
0.1935483870967742
be
0.17721518987341772
tr
0.17721518987341772
hu
0.1709183673469388
az
0.16237113402061853
et
0.16237113402061853
is
0.16237113402061853
uk
0.16237113402061853
vi
0.16237113402061853
reliable
true
passes
true
9
name
"Hunter"
dialogue
"And listen—whatever you saw, you're not in trouble. You're safe here. I'll be back with help. Do you understand? Nod if you do."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8056994818652848
tl
0.5475871313672922
sv
0.4985141158989599
nl
0.47714949651433
da
0.4556451612903226
no
0.4547657512116317
de
0.4379683597002498
yo
0.3571428571428572
pl
0.3553008595988539
cs
0.3465634075508229
fr
0.33102081268582756
sl
0.33035714285714285
pt
0.30124223602484473
sk
0.29319371727748694
sq
0.29319371727748694
ro
0.29245283018867924
ms
0.2726293103448276
it
0.23382519863791143
hu
0.22591743119266056
hr
0.22413793103448276
fi
0.21784472769409038
tr
0.17682926829268292
is
0.1758241758241758
eu
0.14772727272727273
lt
0.1423125794155019
vi
0.1412213740458015
lv
0.11300919842312747
az
0.11067193675889328
es
0.08536585365853659
reliable
true
passes
true