NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-10-07-01M4ATBT9QS2HTVK9514K2SN9P
Run Details
Model:
Mistral Medium 3.5
Test:
Language Writing
Scenario:
Character dialogue (French) in a story
Duration:
5.7s
Cost:
$0.003639
Provider:
Mistral
Evaluation summary
Score
Evaluator
Details Link
100.00%
Parse dialogue
(details)
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Marie"> Marie is a 30-year old college student on a study abroad program. Born in France, she is fluent in French and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of French, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Marie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in French, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Marie and Hunter as a voice sheet: Marie: "..." Hunter: "..."
Model response
Messages
Meta
AI
**Voice Sheet: Café Encounter** --- **Marie:** *(muttering to herself, adjusting her camera)* "C'est étrange... je n'arrive pas à croire que cela se passe ici." *(She sighs, looking troubled as she flips through the photos on her camera.)* **Hunter:** *(approaches the table, badge visible)* "Ma'am, I’m Detective Hunter. I need to ask you a few questions about what happened at the festival last night. You were there, right?" **Marie:** *(startled, switching to rapid French)* "Quoi? Je... je ne comprends pas. Qu'est-ce que vous voulez? Je n'ai rien vu, je vous assure!" *(Her hands tremble slightly as she clutches her camera.)* **Hunter:** *(frowning, leaning in slightly)* "Slow down, ma'am. I don’t speak French. You’re gonna have to speak English. Did you see anything unusual last night?" **Marie:** *(shaking her head, still in French)* "Non, non, je ne parle pas anglais! Je suis désolée, mais... c'était effrayant. Les gens ont disparu, et puis..." *(She trails off, looking around nervously.)* **Hunter:** *(rubbing his temple, frustrated)* "Alright, this isn’t working. Look, do you know anyone who can translate for us? Maybe another student or a professor?" **Marie:** *(relieved, nodding)* "Oui! Oui, il y a mon professeur, Monsieur Laurent. Il parle les deux langues." *(She points toward the university building in the distance.)* **Hunter:** *(pulling out his phone as it rings)* "Good, that’s a start. Listen, I’ve gotta take this. Don’t go anywhere, okay? We’ll figure this out." *(He answers the call, stepping away.)* "Hunter here. What’ve you got?" **Marie:** *(watching him leave, whispering to herself)* "Mon Dieu, qu'est-ce que je fais ici..." --- **End Scene**
created_at
"2026-10-07T09:15:57.12Z"
10/7/2026, 9:15:57 AM
model
"mistralai/mistral-medium-3.5-20260430"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
430
moderation_latency
(null)
generation_time
5694
tokens_prompt
303
tokens_completion
440
native_tokens_prompt
281
native_tokens_completion
429
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
"default"
usage
0.003639
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1791364557-JpvQT6jQyapPqHRQ1BUA"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1791364557-o21DjNdObQ34HSs6UMHl"
upstream_id
"89955a0bfaf547f3a89b3724148a47b1"
provider_responses
0
endpoint_id
"d21d316f-d540-4718-b36e-3beff85d0cf9"
id
"89955a0bfaf547f3a89b3724148a47b1"
is_byok
false
latency
430
model_permaslug
"mistralai/mistral-medium-3.5-20260430"
provider_name
"Mistral"
status
200
total_cost
0.003639
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Mistral"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
100.00%
Parse dialogue
n/a
dialogue
0
name
"Marie"
dialogue
"C'est étrange... je n'arrive pas à croire que cela se passe ici."
detectedLang
"fr"
heavyLang
"fr"
scores
fr
0.8226950354609929
pt
0.5919243986254296
ca
0.5673952641165756
da
0.5005257623554153
nl
0.485373781148429
no
0.47687224669603523
yo
0.4508670520231214
it
0.43113772455089816
de
0.4193154034229829
sq
0.4025157232704403
sv
0.39567430025445294
es
0.39490445859872614
sl
0.391025641025641
hr
0.3902439024390244
cs
0.37335092348284965
en
0.36412315930388217
et
0.25196850393700787
ms
0.23878205128205127
sk
0.23387096774193547
ro
0.20168067226890754
fi
0.17677642980935876
lt
0.1607773851590106
pl
0.1607773851590106
tl
0.13479052823315119
is
0.12037037037037036
reliable
true
passes
true
1
name
"Hunter"
dialogue
"Ma'am, I’m Detective Hunter. I need to ask you a few questions about what happened at the festival last night. You were there, right?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8201089070400622
tl
0.6671464555595539
fr
0.5342396777442094
da
0.5182291666666667
no
0.5174752217005738
it
0.4939824945295405
ca
0.48208286674132134
pt
0.44710101613867304
cs
0.4325153374233129
nl
0.4167717528373266
ro
0.4156664560960202
sq
0.4104525175270874
hr
0.40705128205128205
es
0.3808567603748327
de
0.3775235531628533
sv
0.3660041124057573
sl
0.3616287094547964
yo
0.3616287094547964
et
0.33405327573794097
sk
0.32824981844589685
pl
0.3168389955686854
ms
0.29064417177914115
lt
0.28846153846153844
lv
0.25583266291230894
hu
0.23868312757201646
az
0.21343537414965988
tr
0.18213969938107868
is
0.12982126058325494
vi
0.12570888468809074
fi
0.11988582302568983
be
0.07035175879396985
eu
0.07035175879396985
uk
0.06376518218623482
reliable
true
passes
true
2
name
"Marie"
dialogue
"Quoi? Je... je ne comprends pas. Qu'est-ce que vous voulez? Je n'ai rien vu, je vous assure!"
detectedLang
"fr"
heavyLang
"fr"
scores
fr
0.8137254901960784
ca
0.5658135283363803
it
0.5338567222767419
en
0.4521337946943483
pt
0.45150115473441105
es
0.4489559164733179
ro
0.42771084337349397
nl
0.3933588761174968
sl
0.38788659793814434
lt
0.37745740498034075
hr
0.3741765480895916
tl
0.34027777777777785
sq
0.3338008415147265
cs
0.3252840909090909
yo
0.2554858934169279
de
0.24841772151898736
sk
0.23387096774193547
lv
0.1782006920415225
tr
0.16520210896309317
pl
0.1607773851590106
fi
0.15630550621669628
ms
0.15026833631484796
hu
0.14721723518850988
reliable
true
passes
true
3
name
"Hunter"
dialogue
"Slow down, ma'am. I don’t speak French. You’re gonna have to speak English. Did you see anything unusual last night?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.7930021367521367
tl
0.5568896512292738
da
0.4088482074752097
et
0.4083969465648855
no
0.3459915611814346
hr
0.29673321234119787
cs
0.2883379247015611
yo
0.2777260018639329
it
0.2695570216776626
pl
0.2519305019305019
sq
0.2319127849355798
ms
0.22654690618762477
sv
0.2131979695431472
sk
0.2083758937691522
lv
0.19270833333333331
es
0.1842105263157895
pt
0.17989417989417988
lt
0.17728237791932058
ro
0.17289220917822837
de
0.15852334419109665
ca
0.15115005476451257
sl
0.13504464285714288
fi
0.1292134831460674
nl
0.0903755868544601
fr
0.08716136631330978
be
0.08284023668639054
tr
0.08284023668639054
hu
0.07957244655581948
az
0.07517899761336516
is
0.07517899761336516
uk
0.07517899761336516
vi
0.07517899761336516
reliable
true
passes
true
4
name
"Marie"
dialogue
"Non, non, je ne parle pas anglais! Je suis désolée, mais... c'était effrayant. Les gens ont disparu, et puis..."
detectedLang
"fr"
heavyLang
"fr"
scores
fr
0.8061437518640024
ca
0.5353824160114368
sl
0.44491887275832626
it
0.43032427695004377
sq
0.41016333938294003
cs
0.4042163153070577
lt
0.39422180801491147
sk
0.35323383084577115
hr
0.34804413239719156
es
0.3460764587525151
ro
0.34277047522750254
pt
0.3394308943089431
en
0.3222106360792492
no
0.3062966915688367
nl
0.3010752688172043
lv
0.282560706401766
et
0.25287356321839083
de
0.2459396751740139
da
0.24065420560747666
yo
0.2004920049200492
sv
0.1965389369592089
pl
0.19554455445544552
tr
0.19053549190535493
hu
0.18648310387984982
ms
0.18444165621079048
tl
0.13333333333333333
fi
0.11924119241192413
eu
0.11804613297150611
az
0.09722222222222222
reliable
true
passes
true
5
name
"Hunter"
dialogue
"Alright, this isn’t working. Look, do you know anyone who can translate for us? Maybe another student or a professor?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8179896665100985
tl
0.6650821089023335
no
0.528588807785888
pt
0.5245398773006136
da
0.5003223726627982
fr
0.4812583668005355
ca
0.46662078458362005
de
0.4546094299788881
cs
0.4392185238784371
sv
0.40613026819923376
ro
0.4020061728395061
pl
0.4006187161639598
sk
0.4001547987616099
hr
0.3987587276958883
nl
0.39453125
it
0.386381631037213
az
0.38296178343949044
sq
0.3785084202085004
es
0.3704305442729488
sl
0.3353344768439108
et
0.2909423604757548
lt
0.2716165413533835
tr
0.26540284360189575
hu
0.2612011439466158
lv
0.2612011439466158
yo
0.2590822179732314
vi
0.25766283524904215
ms
0.19270833333333331
is
0.15852334419109665
eu
0.15021929824561403
fi
0.13600891861761427
reliable
true
passes
true
6
name
"Marie"
dialogue
"Oui! Oui, il y a mon professeur, Monsieur Laurent. Il parle les deux langues."
detectedLang
"fr"
heavyLang
"fr"
scores
fr
0.8096192384769538
ca
0.6262785208497246
it
0.5869565217391305
es
0.5685740236148955
en
0.5630174793008279
ro
0.5601851851851852
no
0.5577281191806331
nl
0.5249999999999999
da
0.5113168724279835
pt
0.4831338411316649
et
0.45776255707762553
az
0.44509345794392524
de
0.42493946731234866
lt
0.4235436893203884
pl
0.4171779141104295
sl
0.3815104166666667
tr
0.37335092348284965
hu
0.3725231175693527
ms
0.3675099866844208
lv
0.35983827493261455
sk
0.35636856368563685
cs
0.35197817189631647
sv
0.3466299862448418
hr
0.33751743375174337
sq
0.2994100294985251
tl
0.2899850523168909
fi
0.28892215568862273
yo
0.2770167427701674
vi
0.26127527216174184
is
0.250788643533123
eu
0.2375601926163724
hi
0.1410488245931284
reliable
true
passes
true
7
name
"Hunter"
dialogue
"Hunter here. What’ve you got?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8225377107364685
it
0.4490358126721763
sq
0.4428969359331476
tl
0.42028985507246375
de
0.3055555555555556
da
0.2907801418439716
cs
0.2805755395683453
no
0.2805755395683453
fr
0.2647058823529412
sv
0.25925925925925924
nl
0.23954372623574144
pt
0.23954372623574144
ca
0.2277992277992278
ms
0.2277992277992278
ro
0.2277992277992278
sl
0.2277992277992278
tr
0.2277992277992278
reliable
true
passes
true
8
name
"Marie"
dialogue
"Mon Dieu, qu'est-ce que je fais ici..."
detectedLang
"fr"
heavyLang
"fr"
scores
fr
0.8212867355043686
es
0.4444444444444444
ca
0.44168734491315137
sl
0.43467336683417085
pt
0.43324937027707805
hr
0.4318181818181818
yo
0.4201030927835051
cs
0.3951612903225807
sk
0.39189189189189183
ro
0.38524590163934425
nl
0.358974358974359
pl
0.2879746835443038
de
0.26229508196721313
da
0.25742574257425743
hi
0.25742574257425743
it
0.25742574257425743
reliable
true
passes
true