NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-09-25-01M3CKDW8SRGCRKJ1YDE8DGR9M
Run Details
Model:
Mistral Medium 3.5 (Reasoning)
Test:
Language Writing
Scenario:
Character dialogue (Spanish) in a story
Duration:
4.3s
Cost:
$0.003992
Provider:
Mistral
Evaluation summary
Score
Evaluator
Details Link
87.50%
Parse dialogue
(details)
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Maria"> Maria is a 30-year old college student on a study abroad program. Born in Spain, she is fluent in Spanish and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Spanish, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Maria is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Spanish, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Maria and Hunter as a voice sheet: Maria: "..." Hunter: "..."
Model response
Messages
Meta
AI
**Voice Sheet: Café Encounter** --- **Maria:** *(softly, in Spanish, examining her camera)* "Qué hermoso paisaje... pero algo no está bien aquí." *(What a beautiful landscape... but something isn’t right here.)* *(Hunter approaches, clearing his throat. Maria looks up, startled.)* **Hunter:** *(firm but polite)* "Ma’am, I’m Detective Hunter. I need to ask you a few questions about the festival last night. You were there, right?" **Maria:** *(nervously, in rapid Spanish)* "¡Sí, estuve allí! Pero... pero vi algo extraño. Un hombre... desapareció. Nadie más lo vio, pero yo sé lo que vi." *(Yes, I was there! But... but I saw something strange. A man... he disappeared. No one else saw it, but I know what I saw.)* **Hunter:** *(frowning, rubbing his temple)* "Slow down, ma’am. I don’t—uh—*no hablo español*." *(I don’t speak Spanish.)* **Maria:** *(frustrated, gesturing with her hands)* "¡No entiende! ¡No es justo!" *(You don’t understand! It’s not fair!)* *(She points at her camera, then mimes a person vanishing.)* **Hunter:** *(sighs, pulling out a notepad)* "Look, just—point to where it happened. On this map." *(He slides a town map toward her.)* **Maria:** *(relieved, pointing at the orchard edge on the map)* "Ahí. Cerca de los árboles viejos. Escuché... un ruido. Como un susurro." *(There. Near the old trees. I heard... a noise. Like a whisper.)* **Hunter:** *(jotting notes, nodding)* "Old orchard. Got it. And you heard—" *(His phone rings. He checks the caller ID and groans.)* "I’ve gotta take this. *(To Maria, apologetic)* Stay here. I’ll find someone who speaks—uh—*español*." *(Spanish.)* *(He steps away, answering the call as Maria watches, clutching her camera tightly.)* --- **End Scene.**
created_at
"2026-09-25T15:37:31.681Z"
9/25/2026, 3:37:31 PM
model
"mistralai/mistral-medium-3.5-20260430"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
369
moderation_latency
(null)
generation_time
4232
tokens_prompt
304
tokens_completion
457
native_tokens_prompt
281
native_tokens_completion
476
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
"default"
usage
0.0039915
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1790350651-tTF4TAb1at7Yr2rSWbLl"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1790350651-d5ml19TdZhLOXIRIxPRp"
upstream_id
"8e9fbebac6f14f3a942dbe2922773b31"
provider_responses
0
endpoint_id
"38ef23a9-5cb3-46fa-85ec-7aed174f04eb"
id
"8e9fbebac6f14f3a942dbe2922773b31"
is_byok
false
latency
369
model_permaslug
"mistralai/mistral-medium-3.5-20260430"
provider_name
"Mistral"
status
200
total_cost
0.0039915
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Mistral"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
87.50%
Parse dialogue
n/a
dialogue
0
name
"Maria"
dialogue
"Qué hermoso paisaje... pero algo no está bien aquí."
detectedLang
"es"
heavyLang
"es"
scores
es
0.8090481786133961
ca
0.6380846325167038
pt
0.608433734939759
tl
0.4268077601410935
no
0.35000000000000003
sk
0.34077079107505076
fr
0.3128964059196617
lv
0.2872807017543859
en
0.24242424242424243
hr
0.23708920187793428
et
0.21307506053268765
tr
0.21307506053268765
cs
0.2111650485436893
it
0.19753086419753088
fi
0.1935483870967742
nl
0.1935483870967742
pl
0.1875
reliable
true
passes
true
1
name
"Hunter"
dialogue
"Ma’am, I’m Detective Hunter. I need to ask you a few questions about the festival last night. You were there, right?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8168498168498168
tl
0.6644295302013423
fr
0.570123589468028
it
0.5302407516147974
ca
0.518362432269717
no
0.5115995115995116
da
0.5061728395061729
pt
0.48320413436692505
cs
0.4684385382059801
nl
0.45242984257357977
ro
0.4513031550068587
sq
0.44598337950138506
hr
0.4425087108013937
es
0.4156318480642805
de
0.41219691403379866
sv
0.4002998500749625
sl
0.3957703927492447
yo
0.3957703927492447
et
0.3670886075949367
sk
0.3610223642172524
pl
0.34906427990235966
ms
0.32145886344359625
lt
0.3191489361702128
lv
0.2844364937388193
hu
0.26605504587155965
az
0.23882017126546146
tr
0.2047713717693837
is
0.14712153518123666
vi
0.14255091103965703
fi
0.13606911447084233
be
0.08045977011494253
eu
0.08045977011494253
uk
0.07300115874855156
reliable
true
passes
true
2
name
"Maria"
dialogue
"¡Sí, estuve allí! Pero... pero vi algo extraño. Un hombre... desapareció. Nadie más lo vio, pero yo sé lo que vi."
detectedLang
"es"
heavyLang
"es"
scores
es
0.8114302291847983
ca
0.6671786994367639
pt
0.5520330806340454
fr
0.5072024260803639
yo
0.46764946764946763
it
0.46058091286307057
tl
0.4283201407211962
ro
0.25968109339407747
hu
0.2562929061784897
sv
0.2537313432835821
vi
0.22711058263971462
lv
0.20440636474908203
sk
0.2004920049200492
en
0.1965389369592089
da
0.1792929292929293
no
0.16237113402061853
is
0.1591203104786546
eu
0.12398921832884095
nl
0.11202185792349727
az
0.10714285714285714
de
0.10591471801925723
ms
0.10591471801925723
tr
0.10591471801925723
cs
0.09596662030598052
reliable
true
passes
true
3
name
"Hunter"
dialogue
"Slow down, ma’am. I don’t—uh—no hablo español."
detectedLang
"es"
heavyLang
"es"
scores
es
0.6663489037178265
en
0.6323529411764706
ca
0.5726495726495726
tl
0.4664634146341463
no
0.40878378378378377
pt
0.40878378378378377
hr
0.4067796610169492
tr
0.40273037542662116
pl
0.36479128856624315
it
0.35779816513761464
lv
0.3566176470588235
sk
0.317738791423002
da
0.2842535787321063
sv
0.2827868852459016
sq
0.2768595041322314
eu
0.2537313432835821
cs
0.23076923076923078
fr
0.2081447963800905
ro
0.20454545454545453
yo
0.19908466819221968
be
0.16666666666666666
hu
0.1606714628297362
az
0.15254237288135594
et
0.15254237288135594
is
0.15254237288135594
lt
0.15254237288135594
uk
0.15254237288135594
vi
0.15254237288135594
reliable
true
passes
false
4
name
"Maria"
dialogue
"¡No entiende! ¡No es justo!"
detectedLang
"es"
heavyLang
"es"
scores
es
0.8029279279279279
pt
0.7299382716049383
ca
0.7121710526315789
de
0.6391752577319588
no
0.6128318584070797
nl
0.5977011494252874
it
0.5967741935483871
tl
0.5958429561200923
en
0.5939675174013921
lv
0.5892018779342723
et
0.5843230403800476
fr
0.5772946859903382
da
0.5231607629427792
fi
0.4883040935672514
eu
0.47447447447447455
sv
0.46808510638297873
hu
0.36823104693140796
hr
0.36594202898550726
lt
0.34210526315789475
sk
0.34210526315789475
tr
0.3346007604562738
sq
0.3055555555555556
pl
0.3
ms
0.2768595041322314
ro
0.2768595041322314
reliable
true
passes
true
5
name
"Hunter"
dialogue
"Look, just—point to where it happened. On this map."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8369818351187703
tl
0.6446700507614213
fr
0.4720965309200603
pl
0.47049924357034795
yo
0.4514106583072101
da
0.4233937397034596
et
0.42244224422442245
lv
0.37275985663082434
sk
0.37163375224416517
cs
0.37050359712230213
hr
0.36823104693140796
ca
0.3346007604562738
sq
0.31906614785992216
fi
0.3
sl
0.25690021231422505
no
0.2374727668845316
lt
0.2290748898678414
sv
0.22566371681415928
hi
0.1935483870967742
de
0.1822429906542056
reliable
true
passes
true
6
name
"Maria"
dialogue
"Ahí. Cerca de los árboles viejos. Escuché... un ruido. Como un susurro."
detectedLang
"es"
heavyLang
"es"
scores
es
0.7665847665847666
it
0.5994940978077572
ca
0.5984784446322908
pt
0.5803886925795053
fr
0.509297520661157
ro
0.49360341151385934
tl
0.3725231175693527
ms
0.3708609271523179
lv
0.3384401114206128
yo
0.29629629629629634
cs
0.2725880551301685
nl
0.24363057324840762
de
0.23387096774193547
en
0.2263843648208469
da
0.20033670033670034
sv
0.1935483870967742
no
0.18664383561643835
sk
0.1739130434782609
tr
0.17102966841186737
hu
0.16958041958041958
eu
0.12844036697247707
az
0.1171003717472119
sq
0.1171003717472119
reliable
true
passes
true
7
name
"Hunter"
dialogue
"I’ve gotta take this. Stay here. I’ll find someone who speaks—uh—español."
detectedLang
"en"
heavyLang
"en"
scores
en
0.7664700098328417
es
0.47339246119733924
tl
0.4431418522860493
it
0.29420505200594355
pt
0.2770167427701674
et
0.2263843648208469
eu
0.20033670033670034
ca
0.19898819561551434
fi
0.1908006814310051
hu
0.18524871355060035
da
0.1739130434782609
sq
0.1739130434782609
fr
0.16225749559082892
sl
0.1410488245931284
sv
0.1394927536231884
reliable
true
passes
true