NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-02-20-01KHXPQV2TRE4ERJ6204E3AAF0
Run Details
Model:
Mistral Large 3
Test:
Language Writing
Scenario:
Character dialogue (French) in a story
Duration:
19.9s
Cost:
$0.001582
Provider:
Mistral
Evaluation summary
Score
Evaluator
Details Link
92.31%
Parse dialogue
(details)
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Marie"> Marie is a 30-year old college student on a study abroad program. Born in France, she is fluent in French and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of French, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Marie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in French, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Marie and Hunter as a voice sheet: Marie: "..." Hunter: "..."
Model response
Messages
Meta
AI
**Voice Sheet: Café Encounter in Alborn, MN** *(Marie sits at a small wrought-iron table outside the café, her camera resting in her lap. She flips through the photos she’s taken, her brow furrowed. The morning light catches the lens as she adjusts it absently. Hunter approaches, his boots scuffing against the sidewalk. He’s in plain clothes—dark jeans, a flannel shirt rolled to the elbows—but his posture is all business.)* **Hunter:** *(clears throat, standing just outside her personal space)* Excuse me, miss. You’re Marie, right? The French student? **Marie:** *(startled, looks up, clutching her camera tighter)* Oui…? *(Her voice is soft, but her grip on the camera betrays her nerves. She glances around, as if expecting someone else.)* **Hunter:** *(nods, pulling out a small notepad—old habit)* I’m Detective Hunter Cole. I was hoping to ask you a few questions about the other night. At the apple orchard? **Marie:** *(eyes widen, her breath hitches. She shakes her head quickly, words tumbling out in rapid French)* Je ne sais pas ce que vous voulez dire! Je n’ai rien vu, je le jure! *(She presses a hand to her chest, as if to steady herself.)* C’était horrible… les cris… et puis plus rien. *(Her voice cracks, and she looks away, blinking fast.)* **Hunter:** *(frowns, holding up a hand like he can physically slow her down)* Whoa, whoa—hold on. I don’t… *(scratches his jaw, frustrated)* Look, I don’t speak French. At all. Can we do this in English? **Marie:** *(shakes her head, switching to heavily accented, broken English)* I—I no understand. *(She gestures helplessly at her mouth, then at him.)* Parlez-vous… no. *(She exhales sharply, then tries again, slower.)* I was taking pictures. Of the trees. The sunset. *(She flips her camera screen toward him, showing a photo of the orchard bathed in golden light.)* Then… *(she swallows hard, points vaguely toward the edge of town)* …the noise. Like an animal. But not. **Hunter:** *(leans in slightly, studying the photo. His voice drops, serious.)* You heard something? Saw something? **Marie:** *(nods, then shakes her head, frustrated with the language barrier. She mimes something large moving quickly, then covers her mouth, eyes darting around like she’s reliving it.)* Vite! Très vite! *(She grabs his wrist, then freezes, realizing what she’s done. She lets go quickly, murmuring an apology.)* Désolée… **Hunter:** *(doesn’t react to the touch, but his expression softens slightly. He pulls a pen from his pocket and scribbles on a napkin.)* Here. Write it down. In French. I’ll get it translated. **Marie:** *(takes the pen with shaky hands, scribbling a few sentences. She pushes the napkin back toward him, then adds, in careful English)* The man… he was running. But not like a person. Like… *(she searches for the word, then mimics a limp, dragging one leg.)* Like this. **Hunter:** *(stares at the napkin, then at her. His phone buzzes in his pocket. He ignores it at first, then sighs, pulling it out. His jaw tightens as he reads the screen.)* Damn it. *(He pockets the phone, then the napkin, meeting her eyes.)* Listen, I gotta go. But I’ll be back. Don’t—*(he hesitates, then points at her camera)*—don’t delete those photos, okay? And stay where people can see you. **Marie:** *(nods quickly, then blurts out in French)* Attendez! *(She grabs a fresh napkin and writes down her number, sliding it toward him.)* S’il vous plaît… soyez prudent. **Hunter:** *(takes the napkin, tucking it into his pocket without looking at it. He gives her a curt nod.)* Lock your doors tonight. *(He turns and strides away, his long legs eating up the sidewalk. Marie watches him go, then looks down at her camera, her thumb hovering over the delete button. After a long moment, she exhales and flips to the next photo instead.)*
created_at
"2026-02-20T14:19:56.391Z"
2/20/2026, 2:19:56 PM
model
"mistralai/mistral-large-2512"
1/1/2512, 12:00:00 AM
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
393
moderation_latency
(null)
generation_time
19831
tokens_prompt
316
tokens_completion
1009
native_tokens_prompt
269
native_tokens_completion
965
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.001582
router
(null)
provider_responses
0
endpoint_id
"fa718841-07ea-4b7e-b8a3-6069545c7e6a"
id
"f01ada674e40485c8b9e0297d9d88ea8"
is_byok
false
latency
393
model_permaslug
"mistralai/mistral-large-2512"
1/1/2512, 12:00:00 AM
provider_name
"Mistral"
status
200
api_type
"completions"
id
"gen-1771597196-Vpwxw12kFqadigHmEJxZ"
upstream_id
"f01ada674e40485c8b9e0297d9d88ea8"
total_cost
0.001582
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Mistral"
Evaluation details
Result
Evaluator
Details
Meta Data
92.31%
Parse dialogue
n/a
dialogue
0
name
"Hunter"
dialogue
"Excuse me, miss. You’re Marie, right? The French student?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.7780244173140954
tl
0.63996399639964
no
0.576271186440678
fr
0.5694294940796556
sq
0.5169082125603864
da
0.5121951219512195
it
0.4936708860759494
nl
0.48119325551232167
sv
0.46879150066401065
ro
0.44367176634214184
de
0.40298507462686567
es
0.4002998500749625
pt
0.3874425727411945
yo
0.37888198757763975
et
0.3630573248407643
ms
0.36
sl
0.35379644588045234
pl
0.33774834437086093
cs
0.33444259567387685
sk
0.32432432432432434
ca
0.2753623188405797
hr
0.2753623188405797
lt
0.25512104283054005
fi
0.250936329588015
lv
0.2438563327032136
az
0.15789473684210525
eu
0.13606911447084233
hu
0.12854030501089325
reliable
true
passes
true
1
name
"Marie"
dialogue
"Oui…?"
detectedLang
"fr"
heavyLang
"fr"
scores
fr
0.8076923076923077
reliable
false
passes
true
2
name
"Hunter"
dialogue
"I’m Detective Hunter Cole. I was hoping to ask you a few questions about the other night. At the apple orchard?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.81015662078785
tl
0.6762444354512344
fr
0.5987963891675026
da
0.5444191343963554
no
0.5428571428571428
it
0.49622166246851385
nl
0.4845360824742268
de
0.4516792323509253
ca
0.45017182130584193
pt
0.4354269583627382
yo
0.43302622253720763
sv
0.4152046783625731
ro
0.40298507462686567
es
0.4020926756352765
cs
0.3930197268588771
sq
0.35275080906148865
hr
0.35170178282009723
pl
0.313893653516295
sl
0.2963940193491645
sk
0.2945326278659612
ms
0.25788497217068646
lv
0.24170616113744076
lt
0.23736892278360344
hu
0.2179863147605083
tr
0.2047713717693837
et
0.19678714859437751
is
0.14712153518123666
az
0.14255091103965703
vi
0.14255091103965703
be
0.08045977011494253
eu
0.08045977011494253
fi
0.07300115874855156
uk
0.07300115874855156
reliable
true
passes
true
3
name
"Marie"
dialogue
"Je ne sais pas ce que vous voulez dire! Je n’ai rien vu, je le jure! C’était horrible… les cris… et puis plus rien."
detectedLang
"fr"
heavyLang
"fr"
scores
fr
0.8109773172780734
ca
0.5354439091534756
it
0.4516653127538586
es
0.4279661016949152
ro
0.3967828418230563
sl
0.38243366880146384
yo
0.296875
hr
0.2961418143899896
sq
0.2606790799561884
cs
0.25331858407079644
no
0.2524916943521595
da
0.24916573971078973
nl
0.24327354260089684
lt
0.2303306727480046
eu
0.2114485981308411
hu
0.21052631578947367
pt
0.20306965761511217
tl
0.19547079856972585
et
0.18870192307692307
sk
0.17682926829268292
en
0.13903061224489796
lv
0.13239074550128535
tr
0.1222366710013004
pl
0.11879895561357702
fi
0.11533420707732633
ms
0.11067193675889328
de
0.10596026490066225
sv
0.10239361702127658
reliable
true
passes
true
4
name
"Hunter"
dialogue
"Whoa, whoa—hold on. I don’t… Look, I don’t speak French. At all. Can we do this in English?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8228834573149132
tl
0.6563573883161512
pl
0.5192307692307693
da
0.49899799599198397
no
0.4807892004153686
hr
0.45593035908596297
it
0.451152579582876
sv
0.4375703037120359
yo
0.3961352657004831
sq
0.3924665856622114
ca
0.3857493857493857
cs
0.3849938499384994
et
0.37888198757763975
ro
0.37810945273631835
de
0.3678887484197219
nl
0.36386768447837153
sk
0.3581514762516046
sl
0.3540051679586563
pt
0.33244325767690247
az
0.3093922651933701
vi
0.258160237388724
fi
0.23076923076923078
ms
0.22720247295208654
tr
0.22720247295208654
fr
0.17898193760262726
es
0.1638795986622074
hi
0.14383561643835618
be
0.12280701754385964
hu
0.11816578483245149
is
0.11190053285968028
lt
0.11190053285968028
lv
0.11190053285968028
uk
0.11190053285968028
reliable
true
passes
true
5
name
"Marie"
dialogue
"I—I no understand. Parlez-vous… no. I was taking pictures. Of the trees. The sunset. Then… …the noise. Like an animal. But not."
detectedLang
"en"
heavyLang
"fr"
scores
en
0.7801031240521686
no
0.6174142480211082
fr
0.5847651775486827
tl
0.5816503173687247
de
0.5289148797920727
da
0.5121130551816959
nl
0.511455525606469
ca
0.49229691876750703
sv
0.46454948301329396
ro
0.4331508991399531
yo
0.40230832646331405
pl
0.38402718776550554
tr
0.38402718776550554
pt
0.3712055507372073
et
0.35267857142857145
sk
0.35152057245080504
hr
0.3403093721565059
it
0.3217960710944809
sq
0.32052483598875353
lv
0.3166823751178134
is
0.29060665362035226
es
0.2757242757242757
cs
0.2579324462640737
ms
0.23361522198731502
az
0.22376873661670238
vi
0.19175027870680048
hu
0.1559953434225844
sl
0.1559953434225844
lt
0.14806110458284372
eu
0.12545235223160436
fi
0.09937888198757763
be
0.0880503144654088
uk
0.0799492385786802
reliable
true
passes
true
6
name
"Hunter"
dialogue
"You heard something? Saw something?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8217922606924645
tl
0.6187363834422658
ms
0.5042492917847025
cs
0.308300395256917
es
0.308300395256917
pt
0.308300395256917
reliable
true
passes
true
7
name
"Marie"
dialogue
"Vite! Très vite! Désolée…"
detectedLang
"fr"
heavyLang
"fr"
scores
fr
0.815043156596794
ca
0.42748091603053434
sq
0.3697478991596639
no
0.34210526315789475
reliable
true
passes
true
8
name
"Hunter"
dialogue
"Here. Write it down. In French. I’ll get it translated."
detectedLang
"en"
heavyLang
"en"
scores
en
0.825436408977556
tl
0.5524296675191815
it
0.5063469675599436
ro
0.4720965309200603
sl
0.44881889763779526
sq
0.42434210526315785
et
0.3955094991364421
nl
0.3848857644991213
de
0.3794326241134752
es
0.3333333333333333
pt
0.33078393881453155
sv
0.3217054263565891
yo
0.31906614785992216
pl
0.3055555555555556
lv
0.30417495029821073
fr
0.3027888446215139
sk
0.29292929292929293
az
0.29006085192697767
lt
0.2842535787321063
ms
0.2768595041322314
hi
0.2273730684326711
is
0.2222222222222222
vi
0.2009132420091324
ca
0.1764705882352941
eu
0.1606714628297362
da
0.15254237288135594
hr
0.15254237288135594
no
0.15254237288135594
tr
0.15254237288135594
cs
0.14425427872860636
reliable
true
passes
true
9
name
"Marie"
dialogue
"The man… he was running. But not like a person. Like… Like this."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8379052369077307
tl
0.7430830039525692
no
0.6713852376137512
nl
0.6384872080088987
sv
0.6372767857142857
da
0.6323529411764706
de
0.5795601552393272
yo
0.5608108108108109
fr
0.5303468208092486
is
0.4953416149068323
ca
0.49376947040498437
es
0.4833068362480127
sq
0.47833065810593905
pt
0.4610281923714759
lv
0.43771626297577854
lt
0.4328097731239092
ms
0.4133574007220217
ro
0.40693430656934304
tr
0.4058500914076782
hu
0.4025735294117647
it
0.3959107806691449
cs
0.3701550387596899
sk
0.367704280155642
hr
0.344758064516129
pl
0.33537832310838445
fi
0.32150313152400833
az
0.28414096916299564
et
0.27293064876957496
sl
0.21686746987951808
eu
0.17721518987341772
vi
0.17721518987341772
reliable
true
passes
false
10
name
"Hunter"
dialogue
"Damn it. Listen, I gotta go. But I’ll be back. Don’t——don’t delete those photos, okay? And stay where people can see you."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8027487910409773
tl
0.6049949031600408
sq
0.4052187260168841
no
0.3834526650755768
hu
0.3704305442729488
yo
0.36683006535947715
sv
0.3657937806873977
fr
0.3647540983606557
it
0.3616144975288303
da
0.32784041630529054
ca
0.31294326241134746
de
0.30180180180180183
et
0.28439519852262235
lv
0.28307123034227566
pl
0.27973977695167285
fi
0.27906976744186046
ro
0.2757009345794392
tr
0.2716165413533835
lt
0.2475728155339806
nl
0.24684159378036927
cs
0.24094025465230165
pt
0.22344689378757512
hr
0.21638018200202225
es
0.2131979695431472
az
0.15300546448087432
sl
0.1474147414741474
is
0.14647577092511013
sk
0.1445916114790287
eu
0.13116591928251123
hi
0.0903755868544601
be
0.08284023668639054
uk
0.07517899761336516
vi
0.07517899761336516
reliable
true
passes
true
11
name
"Marie"
dialogue
"Attendez! S’il vous plaît… soyez prudent."
detectedLang
"fr"
heavyLang
"fr"
scores
fr
0.7572815533980582
ca
0.6192893401015229
en
0.46619217081850534
no
0.4094488188976378
it
0.3775933609958506
es
0.3603411513859275
de
0.33774834437086093
nl
0.33035714285714285
tl
0.3288590604026846
da
0.3258426966292135
sq
0.3135011441647597
et
0.3103448275862069
sv
0.29906542056074764
pt
0.22077922077922074
lv
0.20212765957446807
az
0.2
pl
0.1891891891891892
ro
0.1891891891891892
sk
0.1891891891891892
cs
0.18256130790190736
tr
0.1780821917808219
hu
0.16434540389972147
reliable
true
passes
true
12
name
"Hunter"
dialogue
"Lock your doors tonight."
detectedLang
"en"
heavyLang
"en"
scores
en
0.7483221476510067
tl
0.6543778801843317
nl
0.469964664310954
ms
0.34210526315789475
da
0.33035714285714285
de
0.33035714285714285
fr
0.33035714285714285
no
0.33035714285714285
yo
0.33035714285714285
reliable
true
passes
true