NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-10-07-01M4AV766V1HSV4FERNXN40W1X
Run Details
Model:
Mistral Medium 3.5
Test:
Language Writing
Scenario:
Character dialogue (French) in a story
Duration:
5.8s
Cost:
$0.004592
Provider:
Mistral
Evaluation summary
Score
Evaluator
Details Link
100.00%
Parse dialogue
(details)
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Marie"> Marie is a 30-year old college student on a study abroad program. Born in France, she is fluent in French and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of French, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Marie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in French, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Marie and Hunter as a voice sheet: Marie: "..." Hunter: "..."
Model response
Messages
Meta
AI
**Voice Sheet: Café Encounter** --- **Marie:** *(muttering to herself, adjusting her camera)* "C'est étrange... je n'arrive pas à croire que cela se passe ici..." **Hunter:** *(approaching, clearing throat)* "Excuse me, miss. I’m Detective Hunter. Mind if I ask you a few questions about what happened last night?" **Marie:** *(startled, switching to rapid French)* "Quoi? Je... je ne comprends pas. Vous parlez français?" *(her hands tremble slightly as she clutches her camera)* **Hunter:** *(frowning, shaking his head)* "No, I don’t. Listen, I just need to know if you saw anything unusual near the old mill. There’s been another disappearance." **Marie:** *(eyes widening, speaking faster in French)* "Le moulin? Mon Dieu... j'ai vu des ombres, des bruits bizarres. Mais je ne sais pas... je ne sais pas ce que c'était!" *(she gestures wildly, clearly distressed)* **Hunter:** *(rubbing his temples, frustrated)* "Slow down, lady. I don’t speak... whatever that is. Point to things, maybe? Did you see anyone suspicious?" **Marie:** *(tearing up, pointing toward the mill in the distance)* "Là-bas! J'ai entendu des cris... mais il faisait trop sombre pour voir!" *(she mimics a shadowy figure with her hands, then sighs in frustration when Hunter just stares blankly)* **Hunter:** *(pulling out a notepad, scribbling aimlessly)* "Cries, got it. Look, I’m gonna need you to—" *(his phone rings, cutting him off. He checks the caller ID and groans)* "I gotta take this. Stay here." *(he steps away, answering)* "Hunter here. Yeah, I’m at the café... what? Another one? Damn it." **Marie:** *(to herself, watching Hunter pace as he talks on the phone)* "Qu'est-ce qui se passe dans cette ville..." *(she hugs her camera closer, looking uneasy)* **Hunter:** *(returning, already walking backward toward the door)* "Listen, uh... *Muh-ree* or whatever, I gotta run. If you remember anything else, find someone who speaks... French, I guess. And stay out of trouble." *(he tips an imaginary hat and jogs off)* **Marie:** *(calling after him in French, exasperated)* "Attendez! Vous ne pouvez pas juste—" *(she slumps in her seat, defeated, as Hunter disappears around the corner)* --- **End Scene.**
created_at
"2026-10-07T09:30:54.053Z"
10/7/2026, 9:30:54 AM
model
"mistralai/mistral-medium-3.5-20260430"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
293
moderation_latency
(null)
generation_time
5713
tokens_prompt
303
tokens_completion
569
native_tokens_prompt
281
native_tokens_completion
556
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
"default"
usage
0.0045915
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1791365454-xtXxWep8x9ObHztnVNg0"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1791365454-CsTaXR8YQ9T98VQzQrZb"
upstream_id
"97e3a02238e44c718e98743f84f47006"
provider_responses
0
endpoint_id
"d21d316f-d540-4718-b36e-3beff85d0cf9"
id
"97e3a02238e44c718e98743f84f47006"
is_byok
false
latency
293
model_permaslug
"mistralai/mistral-medium-3.5-20260430"
provider_name
"Mistral"
status
200
total_cost
0.0045915
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Mistral"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
100.00%
Parse dialogue
n/a
dialogue
0
name
"Marie"
dialogue
"C'est étrange... je n'arrive pas à croire que cela se passe ici..."
detectedLang
"fr"
heavyLang
"fr"
scores
fr
0.8226950354609929
pt
0.5919243986254296
ca
0.5673952641165756
da
0.5005257623554153
nl
0.485373781148429
no
0.47687224669603523
yo
0.4508670520231214
it
0.43113772455089816
de
0.4193154034229829
sq
0.4025157232704403
sv
0.39567430025445294
es
0.39490445859872614
sl
0.391025641025641
hr
0.3902439024390244
cs
0.37335092348284965
en
0.36412315930388217
et
0.25196850393700787
ms
0.23878205128205127
sk
0.23387096774193547
ro
0.20168067226890754
fi
0.17677642980935876
lt
0.1607773851590106
pl
0.1607773851590106
tl
0.13479052823315119
is
0.12037037037037036
reliable
true
passes
true
1
name
"Hunter"
dialogue
"Excuse me, miss. I’m Detective Hunter. Mind if I ask you a few questions about what happened last night?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8116997238262617
tl
0.6364517692680562
fr
0.5440729483282675
it
0.511400651465798
ca
0.46619217081850534
pt
0.45848375451263534
ro
0.4186046511627907
no
0.41770186335403725
sq
0.4028662420382166
es
0.39418416801292405
nl
0.38825448613376834
da
0.3755203996669442
sv
0.3686868686868687
cs
0.3403693931398417
et
0.3397887323943662
hr
0.29775280898876405
de
0.2944496707431797
hu
0.293119698397738
sl
0.28842504743833014
yo
0.27184466019417475
pl
0.23547400611620795
ms
0.21548117154811713
tr
0.21548117154811713
sk
0.21218487394957983
lt
0.16201117318435754
fi
0.15540540540540537
is
0.15540540540540537
az
0.1506228765571914
lv
0.1506228765571914
vi
0.1506228765571914
be
0.08536585365853659
eu
0.08536585365853659
uk
0.07749077490774908
reliable
true
passes
true
2
name
"Marie"
dialogue
"Quoi? Je... je ne comprends pas. Vous parlez français?"
detectedLang
"fr"
heavyLang
"fr"
scores
fr
0.806432400238237
ca
0.6621621621621622
it
0.5811855670103093
nl
0.5784695201037613
sl
0.574607329842932
hr
0.5660881174899867
sq
0.5337159253945482
cs
0.5269286754002911
ro
0.5213549337260678
lt
0.5192307692307693
en
0.5170876671619613
pt
0.5134730538922155
es
0.5098039215686274
de
0.47833065810593905
sk
0.468954248366013
yo
0.42781690140845074
tl
0.4196428571428571
pl
0.4122965641952984
lv
0.40476190476190477
hu
0.4025735294117647
tr
0.3992606284658041
ms
0.3879472693032015
no
0.2919389978213508
az
0.2903930131004367
da
0.2793791574279379
sv
0.2793791574279379
fi
0.21307506053268765
eu
0.19753086419753088
et
0.16237113402061853
is
0.15364583333333331
reliable
true
passes
true
3
name
"Hunter"
dialogue
"No, I don’t. Listen, I just need to know if you saw anything unusual near the old mill. There’s been another disappearance."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8103816070158806
tl
0.5798319327731093
no
0.4605529332434255
da
0.4421199442119944
sv
0.4215473608098337
hr
0.3798449612403101
nl
0.3665874901029295
cs
0.35691318327974275
es
0.3548387096774194
sq
0.35170178282009723
ms
0.35012185215272135
sk
0.34047815333882936
et
0.33829611248966085
pl
0.3349958437240233
lv
0.33444259567387685
it
0.3333333333333333
yo
0.3277310924369748
ca
0.30434782608695654
de
0.30374238468233244
pt
0.2963940193491645
fr
0.2837958818263205
sl
0.23298178331735378
tr
0.21951219512195122
fi
0.1902834008097166
lt
0.17269906928645296
ro
0.16054564533053514
hu
0.15522703273495247
is
0.14255091103965703
eu
0.12758996728462377
be
0.08045977011494253
az
0.07300115874855156
uk
0.07300115874855156
vi
0.07300115874855156
reliable
true
passes
true
4
name
"Marie"
dialogue
"Le moulin? Mon Dieu... j'ai vu des ombres, des bruits bizarres. Mais je ne sais pas... je ne sais pas ce que c'était!"
detectedLang
"fr"
heavyLang
"fr"
scores
fr
0.7985820174025137
ca
0.5745405037440435
es
0.4292237442922375
pt
0.40191387559808617
sl
0.40076701821668265
ro
0.3635437881873727
sq
0.3543388429752066
nl
0.3400211193241816
it
0.33226495726495725
yo
0.3131868131868132
hr
0.3124312431243124
cs
0.2681498829039813
de
0.26035502958579887
lt
0.24425634824667475
hu
0.22360248447204967
eu
0.20584498094027956
sk
0.1883116883116883
tl
0.14383561643835618
lv
0.14148351648351648
tr
0.13073713490959665
pl
0.1270949720670391
fi
0.12342215988779803
ms
0.11847672778561354
da
0.11095305832147938
en
0.11095305832147938
hi
0.11095305832147938
reliable
true
passes
true
5
name
"Hunter"
dialogue
"Slow down, lady. I don’t speak... whatever that is. Point to things, maybe? Did you see anyone suspicious?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8120805369127517
tl
0.6615087040618954
da
0.4444444444444444
nl
0.3799822852081488
no
0.37163375224416517
pl
0.33523266856600187
fr
0.3320610687022901
yo
0.32950191570881227
cs
0.30966469428007887
hu
0.30624380574826565
sv
0.2985971943887776
hr
0.2670157068062827
is
0.2576882290562036
et
0.2497320471596999
ca
0.23076923076923078
sk
0.22566371681415928
lv
0.20903954802259886
ro
0.20273348519362186
lt
0.19261822376009227
pt
0.18604651162790697
sq
0.1606714628297362
sl
0.14738124238733252
it
0.1411042944785276
de
0.12060301507537688
es
0.09326424870466321
ms
0.09326424870466321
be
0.09090909090909091
tr
0.09090909090909091
az
0.08256880733944955
uk
0.08256880733944955
vi
0.08256880733944955
reliable
true
passes
true
6
name
"Marie"
dialogue
"Là-bas! J'ai entendu des cris... mais il faisait trop sombre pour voir!"
detectedLang
"fr"
heavyLang
"fr"
scores
fr
0.816260909508498
ca
0.5
it
0.41002949852507375
pt
0.3893129770992366
az
0.34959349593495936
es
0.3288590604026846
tl
0.28825622775800713
vi
0.28186714542190305
tr
0.2779783393501805
cs
0.2687385740402194
de
0.25925925925925924
eu
0.2125984251968504
sk
0.2125984251968504
ms
0.2
ro
0.18533604887983707
yo
0.18032786885245902
en
0.17355371900826447
da
0.14893617021276595
no
0.14893617021276595
reliable
true
passes
true
7
name
"Hunter"
dialogue
"Hunter here. Yeah, I’m at the café... what? Another one? Damn it."
detectedLang
"en"
heavyLang
"en"
scores
en
0.7961264016309888
tl
0.6674979218620116
da
0.5079950799507995
nl
0.464524765729585
no
0.4497936726272352
sq
0.4467496542185339
pt
0.39668174962292607
yo
0.313893653516295
fr
0.2727272727272727
sv
0.27007299270072993
ms
0.25512104283054005
es
0.2
de
0.18032786885245902
hr
0.17864476386036962
pl
0.17864476386036962
lv
0.17695473251028807
it
0.13606911447084233
ca
0.12854030501089325
ro
0.12854030501089325
sl
0.12854030501089325
tr
0.12854030501089325
reliable
true
passes
true
8
name
"Marie"
dialogue
"Qu'est-ce qui se passe dans cette ville..."
detectedLang
"fr"
heavyLang
"fr"
scores
fr
0.8397435897435898
da
0.6945010183299388
it
0.6753246753246753
no
0.6445497630331753
ca
0.5978552278820375
sv
0.5732574679943101
et
0.5184590690208668
de
0.5161290322580645
pt
0.5057660626029654
fi
0.494949494949495
ro
0.46524064171123
en
0.42857142857142855
nl
0.42748091603053434
es
0.39999999999999997
sq
0.37888198757763975
hu
0.3775933609958506
tl
0.33774834437086093
cs
0.3119266055045872
hr
0.3071593533487298
sl
0.3055555555555556
is
0.29906542056074764
yo
0.2628992628992629
tr
0.21465968586387435
ms
0.1780821917808219
reliable
true
passes
true
9
name
"Hunter"
dialogue
"Listen, uh... Muh-ree or whatever, I gotta run. If you remember anything else, find someone who speaks... French, I guess. And stay out of trouble."
detectedLang
"en"
heavyLang
"en"
scores
en
0.7870909905871807
tl
0.5962600934976625
sv
0.43045563549160676
no
0.41610325752919486
da
0.4110353378797272
nl
0.38471502590673573
yo
0.38191281717631753
fr
0.35020519835841313
it
0.3209435310936383
hu
0.31259044862518093
de
0.3090909090909091
is
0.2835595776772248
pt
0.24363057324840762
fi
0.24000000000000002
sq
0.23817161186848435
et
0.22764227642276424
sk
0.2142266335814723
ms
0.208992506244796
cs
0.205685618729097
es
0.20100925147182505
hr
0.18384879725085912
pl
0.16885389326334208
sl
0.16446789797713282
ro
0.1387126019945603
lv
0.13557779799818015
ca
0.12683823529411764
tr
0.12603495860165592
eu
0.10965323336457358
be
0.06862745098039216
az
0.06219151036525173
lt
0.06219151036525173
uk
0.06219151036525173
vi
0.06219151036525173
reliable
true
passes
true
10
name
"Marie"
dialogue
"Attendez! Vous ne pouvez pas juste—"
detectedLang
"fr"
heavyLang
"fr"
scores
fr
0.8135719612229679
ca
0.6044303797468354
it
0.5192307692307693
et
0.503968253968254
es
0.4939271255060729
en
0.4929006085192698
pt
0.4908350305498982
sq
0.4877049180327869
nl
0.4791666666666667
lt
0.4469026548672566
no
0.4469026548672566
lv
0.4172494172494172
ro
0.4033412887828162
tr
0.38875305623471884
de
0.3765586034912718
ms
0.3765586034912718
tl
0.3654822335025381
da
0.36386768447837153
sl
0.33862433862433866
sv
0.33510638297872336
hr
0.3112947658402204
fi
0.26035502958579887
cs
0.24698795180722888
hu
0.24698795180722888
eu
0.22118380062305293
reliable
true
passes
true