NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-09-25-01M3CKDZXHG3FRTVEBY4VEHHHF
Run Details
Model:
Mistral Medium 3.5 (Reasoning)
Test:
Language Writing
Scenario:
Character dialogue (French) in a story
Duration:
3.9s
Cost:
$0.003624
Provider:
Mistral
Evaluation summary
Score
Evaluator
Details Link
100.00%
Parse dialogue
(details)
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Marie"> Marie is a 30-year old college student on a study abroad program. Born in France, she is fluent in French and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of French, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Marie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in French, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Marie and Hunter as a voice sheet: Marie: "..." Hunter: "..."
Model response
Messages
Meta
AI
Here’s the dialogue formatted as a voice sheet, capturing the tension and language barrier between Marie and Hunter: --- **Marie:** *(muttering to herself in French, adjusting her camera)* "Je n'arrive pas à croire que cela se soit produit ici..." **Hunter:** *(approaching, stern but polite)* "Ma'am, I’m Detective Hunter. Mind if I ask you a few questions about what happened at the festival last night?" **Marie:** *(startled, switching to rapid French, hands trembling)* "Quoi? Non, non, je ne comprends pas... C'était terrible! Personne ne sait où il est passé!" **Hunter:** *(frowning, leaning in slightly)* "I’m sorry, I don’t speak French. Could you... slow down? Or maybe point me to someone who can translate?" **Marie:** *(frustrated, gesturing wildly)* "Mais... vous êtes la police, non? Vous devez comprendre! Il a disparu, comme les autres!" **Hunter:** *(sighing, rubbing his temple)* "Look, I want to help, but I don’t know what you’re saying. *(pulls out a notepad)* Can you write it down? Or draw something?" **Marie:** *(nodding, still agitated, scribbling in her notebook)* "Oui, oui... *(writes frantically, then pushes the notebook toward him)* Voila. C’est lui. Je l’ai vu avant..." **Hunter:** *(examining the sketch, a photo of a missing person)* "This is... helpful. *(pauses, phone rings)* Hold on. *(answers call)* Hunter. ... Yeah, I’ll be right there. *(to Marie, apologetic)* I’ve gotta go. But stay in town, okay? We’ll figure this out." **Marie:** *(calling after him, desperate)* "Attendez! Vous devez—" *(Hunter is already walking away, shaking his head in confusion)* --- This keeps the tension high while emphasizing the language barrier and the urgency of the mystery.
created_at
"2026-09-25T15:37:35.416Z"
9/25/2026, 3:37:35 PM
model
"mistralai/mistral-medium-3.5-20260430"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
405
moderation_latency
(null)
generation_time
3892
tokens_prompt
303
tokens_completion
447
native_tokens_prompt
281
native_tokens_completion
427
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
"default"
usage
0.003624
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1790350655-KKXcpS4PLftwhhT3BEpQ"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1790350655-1Bt9Ju3QN3KKFfGSCiVi"
upstream_id
"85aa558e4d14483e9fe92e85e1b736b1"
provider_responses
0
endpoint_id
"d21d316f-d540-4718-b36e-3beff85d0cf9"
id
"85aa558e4d14483e9fe92e85e1b736b1"
is_byok
false
latency
405
model_permaslug
"mistralai/mistral-medium-3.5-20260430"
provider_name
"Mistral"
status
200
total_cost
0.003624
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Mistral"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
100.00%
Parse dialogue
n/a
dialogue
0
name
"Marie"
dialogue
"Je n'arrive pas à croire que cela se soit produit ici..."
detectedLang
"fr"
heavyLang
"fr"
scores
fr
0.8231132075471699
pt
0.5743473325766175
ca
0.5398773006134969
sq
0.5148771021992239
es
0.5098039215686274
yo
0.5098039215686274
hr
0.503968253968254
sl
0.5033112582781457
cs
0.49186991869918695
nl
0.43095599393019723
da
0.3961352657004831
it
0.39418416801292405
no
0.37913907284768217
sk
0.3644067796610169
ro
0.3444055944055944
en
0.30683918669131244
pl
0.3029739776951673
lt
0.2964352720450282
ms
0.2937853107344633
sv
0.28977272727272724
de
0.28842504743833014
fi
0.21383647798742136
lv
0.15730337078651685
eu
0.1515837104072398
tl
0.1515837104072398
reliable
true
passes
true
1
name
"Hunter"
dialogue
"Ma'am, I’m Detective Hunter. Mind if I ask you a few questions about what happened at the festival last night?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8116868294909838
tl
0.6688077077478924
fr
0.5625662778366914
it
0.5225694444444445
da
0.5192307692307693
no
0.5169789227166276
ca
0.5106761565836299
pt
0.4755244755244755
nl
0.4448183041722746
ro
0.4436952124072825
sv
0.43454420836189167
cs
0.41029306647605435
es
0.4081779053084649
sq
0.406901509705248
hr
0.3861607142857143
et
0.3336025848142165
sl
0.32817589576547235
yo
0.3193069306930693
de
0.3170529801324503
ms
0.31478405315614616
hu
0.314214463840399
sk
0.27947598253275113
pl
0.26273458445040215
lt
0.24726277372262775
az
0.23327137546468402
tr
0.19980601357904945
lv
0.19196865817825662
is
0.14330218068535827
vi
0.13883089770354906
fi
0.13249211356466878
be
0.0782122905027933
eu
0.0782122905027933
uk
0.07094594594594594
reliable
true
passes
true
2
name
"Marie"
dialogue
"Quoi? Non, non, je ne comprends pas... C'était terrible! Personne ne sait où il est passé!"
detectedLang
"fr"
heavyLang
"fr"
scores
fr
0.8178073510773132
it
0.6285529715762274
ca
0.5913290689410092
en
0.5290745290745291
nl
0.47584320875113945
ro
0.45958646616541354
es
0.4492337164750958
de
0.44336882865440463
sq
0.4010416666666667
pt
0.3882978723404255
lt
0.3850267379679145
hr
0.37363834422657954
tl
0.35101580135440186
hu
0.3488108720271801
sl
0.343607305936073
cs
0.33371958285052145
tr
0.2987804878048781
az
0.29187192118226607
ms
0.29187192118226607
sv
0.28393524283935245
da
0.27854454203262236
no
0.2758186397984887
pl
0.26658163265306123
sk
0.26187419768934533
et
0.24540682414698162
lv
0.23638778220451526
yo
0.22086720867208673
fi
0.203601108033241
is
0.18207681365576103
eu
0.1314199395770393
reliable
true
passes
true
3
name
"Hunter"
dialogue
"I’m sorry, I don’t speak French. Could you... slow down? Or maybe point me to someone who can translate?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8127808287568647
tl
0.635036496350365
fr
0.4296577946768061
it
0.40476190476190477
no
0.39172749391727496
da
0.3796526054590571
pt
0.36921783010933557
pl
0.36061381074168797
hr
0.3438320209973753
cs
0.3321460373998219
es
0.3212669683257918
sq
0.3206521739130435
ca
0.27884615384615385
sl
0.2632612966601179
sk
0.2625368731563422
ro
0.25521350546176763
lv
0.251497005988024
lt
0.2378048780487805
yo
0.2299794661190965
et
0.22440537745604963
tr
0.21875
az
0.20969441517386725
sv
0.20802534318901794
vi
0.16759156492785796
nl
0.1638795986622074
ms
0.1601343784994401
fi
0.09090909090909091
be
0.08536585365853659
de
0.08200734394124846
eu
0.08200734394124846
hu
0.08200734394124846
is
0.07749077490774908
uk
0.07749077490774908
reliable
true
passes
true
4
name
"Marie"
dialogue
"Mais... vous êtes la police, non? Vous devez comprendre! Il a disparu, comme les autres!"
detectedLang
"fr"
heavyLang
"fr"
scores
fr
0.8236048749198204
it
0.6824480369515012
ca
0.6758986446670595
ro
0.6104815864022662
en
0.6062992125984252
es
0.5880149812734082
pt
0.5873968492123031
tl
0.556809024979855
no
0.5045045045045045
da
0.41921858500527986
cs
0.41050375133976424
hr
0.39759036144578314
sk
0.39293598233995586
nl
0.38478747203579416
sl
0.3785310734463277
sq
0.35370152761457113
az
0.32098765432098764
lt
0.3167701863354037
eu
0.31335830212234705
sv
0.30730478589420657
tr
0.29757343550446996
hu
0.29577464788732394
et
0.2939666238767651
de
0.2819843342036553
yo
0.27726675427069647
pl
0.2597577388963661
lv
0.22425952045133993
vi
0.21875
fi
0.2109038737446198
ms
0.20863309352517986
is
0.12
reliable
true
passes
true
5
name
"Hunter"
dialogue
"Look, I want to help, but I don’t know what you’re saying. Can you write it down? Or draw something?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8293067226890757
tl
0.5960223741454319
cs
0.3257261410788381
yo
0.3157894736842105
sk
0.3055555555555556
lv
0.2942453854505972
pl
0.2864983534577387
hr
0.281767955801105
no
0.2809734513274336
tr
0.2753623188405797
da
0.27211646136618145
lt
0.2688413948256468
fr
0.268018018018018
sq
0.25287356321839083
ca
0.24855491329479767
sl
0.22894424673784108
it
0.22341696535244923
ro
0.214975845410628
et
0.19254658385093168
az
0.17721518987341772
sv
0.1751269035532995
nl
0.16666666666666666
es
0.10714285714285714
ms
0.10714285714285714
pt
0.10714285714285714
be
0.09722222222222222
hu
0.09344490934449094
is
0.08835904628330996
uk
0.08835904628330996
vi
0.08835904628330996
reliable
true
passes
true
6
name
"Marie"
dialogue
"Oui, oui... Voila. C’est lui. Je l’ai vu avant..."
detectedLang
"fr"
heavyLang
"fr"
scores
fr
0.8110831234256928
it
0.6005326231691078
ca
0.5363214837712519
ro
0.4845360824742268
sl
0.36575052854122625
hr
0.3630573248407643
yo
0.35205183585313177
cs
0.3288590604026846
sk
0.3258426966292135
nl
0.29577464788732394
pl
0.23273657289002556
de
0.21052631578947367
es
0.20634920634920634
pt
0.20634920634920634
en
0.20212765957446807
no
0.20212765957446807
et
0.1891891891891892
sq
0.1891891891891892
sv
0.1891891891891892
tr
0.1891891891891892
reliable
true
passes
true
7
name
"Hunter"
dialogue
"This is... helpful. Hold on. Hunter. ... Yeah, I’ll be right there. I’ve gotta go. But stay in town, okay? We’ll figure this out."
detectedLang
"en"
heavyLang
"en"
scores
en
0.799944812362031
tl
0.5809248554913294
de
0.43403590944574555
yo
0.4286840031520882
fr
0.40329218106995884
it
0.39683860232945084
nl
0.39126784214945426
hu
0.34329710144927533
fi
0.3324125230202578
ro
0.32432432432432434
da
0.31732580037664787
pl
0.2757242757242757
sv
0.25944841675178754
ca
0.24479166666666666
no
0.23361522198731502
sq
0.22790202342917998
sl
0.22707889125799574
et
0.1751990898748578
ms
0.1559953434225844
pt
0.15402567094515754
lt
0.13381123058542413
is
0.11260709914320685
hr
0.1082410824108241
az
0.103831891223733
hi
0.103831891223733
cs
0.09375000000000001
sk
0.09375000000000001
es
0.08690176322418136
tr
0.07525510204081631
reliable
true
passes
true
8
name
"Marie"
dialogue
"Attendez! Vous devez—"
detectedLang
"fr"
heavyLang
"fr"
scores
fr
0.8015873015873016
en
0.660633484162896
pt
0.5562130177514794
it
0.5481927710843374
es
0.5297805642633229
ca
0.5033112582781457
tl
0.5016611295681063
no
0.4845360824742268
de
0.375
ro
0.3723849372384937
hr
0.3562231759656652
sl
0.3562231759656652
da
0.35344827586206895
nl
0.34210526315789475
lv
0.336283185840708
et
0.3023255813953488
sv
0.3023255813953488
tr
0.3023255813953488
reliable
true
passes
true