NC Bench
Overview
About
Tests
Models
Vendors
Run: 2026-02-20-01KHXPQV2TRE4ERJ6204E3AAF0
Run Details
Model:
Mistral Large 3
Test:
Language Writing
Scenario:
Character dialogue (French) in a story
Duration:
19.9s
Cost:
$0.001582
Provider:
Mistral
Evaluation summary
Score
Evaluator
Details Link
92.31%
Parse dialogue
(details)
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Marie"> Marie is a 30-year old college student on a study abroad program. Born in France, she is fluent in French and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of French, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Marie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in French, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Marie and Hunter as a voice sheet: Marie: "..." Hunter: "..."
Model response
Messages
Meta
AI
**Voice Sheet: Café Encounter in Alborn, MN** *(Marie sits at a small wrought-iron table outside the café, her camera resting in her lap. She flips through the photos she’s taken, her brow furrowed. The morning light catches the lens as she adjusts it absently. Hunter approaches, his boots scuffing against the sidewalk. He’s in plain clothes—dark jeans, a flannel shirt rolled to the elbows—but his posture is all business.)* **Hunter:** *(clears throat, standing just outside her personal space)* Excuse me, miss. You’re Marie, right? The French student? **Marie:** *(startled, looks up, clutching her camera tighter)* Oui…? *(Her voice is soft, but her grip on the camera betrays her nerves. She glances around, as if expecting someone else.)* **Hunter:** *(nods, pulling out a small notepad—old habit)* I’m Detective Hunter Cole. I was hoping to ask you a few questions about the other night. At the apple orchard? **Marie:** *(eyes widen, her breath hitches. She shakes her head quickly, words tumbling out in rapid French)* Je ne sais pas ce que vous voulez dire! Je n’ai rien vu, je le jure! *(She presses a hand to her chest, as if to steady herself.)* C’était horrible… les cris… et puis plus rien. *(Her voice cracks, and she looks away, blinking fast.)* **Hunter:** *(frowns, holding up a hand like he can physically slow her down)* Whoa, whoa—hold on. I don’t… *(scratches his jaw, frustrated)* Look, I don’t speak French. At all. Can we do this in English? **Marie:** *(shakes her head, switching to heavily accented, broken English)* I—I no understand. *(She gestures helplessly at her mouth, then at him.)* Parlez-vous… no. *(She exhales sharply, then tries again, slower.)* I was taking pictures. Of the trees. The sunset. *(She flips her camera screen toward him, showing a photo of the orchard bathed in golden light.)* Then… *(she swallows hard, points vaguely toward the edge of town)* …the noise. Like an animal. But not. **Hunter:** *(leans in slightly, studying the photo. His voice drops, serious.)* You heard something? Saw something? **Marie:** *(nods, then shakes her head, frustrated with the language barrier. She mimes something large moving quickly, then covers her mouth, eyes darting around like she’s reliving it.)* Vite! Très vite! *(She grabs his wrist, then freezes, realizing what she’s done. She lets go quickly, murmuring an apology.)* Désolée… **Hunter:** *(doesn’t react to the touch, but his expression softens slightly. He pulls a pen from his pocket and scribbles on a napkin.)* Here. Write it down. In French. I’ll get it translated. **Marie:** *(takes the pen with shaky hands, scribbling a few sentences. She pushes the napkin back toward him, then adds, in careful English)* The man… he was running. But not like a person. Like… *(she searches for the word, then mimics a limp, dragging one leg.)* Like this. **Hunter:** *(stares at the napkin, then at her. His phone buzzes in his pocket. He ignores it at first, then sighs, pulling it out. His jaw tightens as he reads the screen.)* Damn it. *(He pockets the phone, then the napkin, meeting her eyes.)* Listen, I gotta go. But I’ll be back. Don’t—*(he hesitates, then points at her camera)*—don’t delete those photos, okay? And stay where people can see you. **Marie:** *(nods quickly, then blurts out in French)* Attendez! *(She grabs a fresh napkin and writes down her number, sliding it toward him.)* S’il vous plaît… soyez prudent. **Hunter:** *(takes the napkin, tucking it into his pocket without looking at it. He gives her a curt nod.)* Lock your doors tonight. *(He turns and strides away, his long legs eating up the sidewalk. Marie watches him go, then looks down at her camera, her thumb hovering over the delete button. After a long moment, she exhales and flips to the next photo instead.)*
created_at
"2026-02-20T14:19:56.391Z"
2/20/2026, 2:19:56 PM
model
"mistralai/mistral-large-2512"
1/1/2512, 12:00:00 AM
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
393
moderation_latency
(null)
generation_time
19831
tokens_prompt
316
tokens_completion
1009
native_tokens_prompt
269
native_tokens_completion
965
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.001582
router
(null)
provider_responses
0
endpoint_id
"fa718841-07ea-4b7e-b8a3-6069545c7e6a"
id
"f01ada674e40485c8b9e0297d9d88ea8"
is_byok
false
latency
393
model_permaslug
"mistralai/mistral-large-2512"
1/1/2512, 12:00:00 AM
provider_name
"Mistral"
status
200
api_type
"completions"
id
"gen-1771597196-Vpwxw12kFqadigHmEJxZ"
upstream_id
"f01ada674e40485c8b9e0297d9d88ea8"
total_cost
0.001582
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Mistral"
Evaluation details
Result
Evaluator
Details
Meta Data
92.31%
Parse dialogue
n/a
dialogue
0
name
"Hunter"
dialogue
"** Excuse me, miss. You’re Marie, right? The French student?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.7780244173140954
tl
0.63996399639964
no
0.576271186440678
fr
0.5694294940796556
sq
0.5169082125603864
da
0.5121951219512195
it
0.4936708860759494
nl
0.48119325551232167
sv
0.46879150066401065
ro
0.44367176634214184
de
0.40298507462686567
es
0.4002998500749625
pt
0.3874425727411945
yo
0.37888198757763975
et
0.3630573248407643
ms
0.36
sl
0.35379644588045234
pl
0.33774834437086093
cs
0.33444259567387685
sk
0.32432432432432434
ca
0.2753623188405797
hr
0.2753623188405797
lt
0.25512104283054005
fi
0.250936329588015
lv
0.2438563327032136
az
0.15789473684210525
eu
0.13606911447084233
hu
0.12854030501089325
reliable
true
passes
true
1
name
"Marie"
dialogue
"**"
detectedLang
""
heavyLang
""
scores
reliable
false
passes
true
2
name
"Hunter"
dialogue
"** I’m Detective Hunter Cole. I was hoping to ask you a few questions about the other night. At the apple orchard?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.81015662078785
tl
0.6762444354512344
fr
0.5987963891675026
da
0.5444191343963554
no
0.5428571428571428
it
0.49622166246851385
nl
0.4845360824742268
de
0.4516792323509253
ca
0.45017182130584193
pt
0.4354269583627382
yo
0.43302622253720763
sv
0.4152046783625731
ro
0.40298507462686567
es
0.4020926756352765
cs
0.3930197268588771
sq
0.35275080906148865
hr
0.35170178282009723
pl
0.313893653516295
sl
0.2963940193491645
sk
0.2945326278659612
ms
0.25788497217068646
lv
0.24170616113744076
lt
0.23736892278360344
hu
0.2179863147605083
tr
0.2047713717693837
et
0.19678714859437751
is
0.14712153518123666
az
0.14255091103965703
vi
0.14255091103965703
be
0.08045977011494253
eu
0.08045977011494253
fi
0.07300115874855156
uk
0.07300115874855156
reliable
true
passes
true
3
name
"Marie"
dialogue
"**"
detectedLang
""
heavyLang
""
scores
reliable
false
passes
true
4
name
"Hunter"
dialogue
"** Look, I don’t speak French. At all. Can we do this in English?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8308794269797056
tl
0.6720679012345679
no
0.5213963963963963
pl
0.5175936435868331
it
0.49162679425837325
sv
0.47788697788697787
da
0.47595561035758327
hr
0.4378306878306878
sq
0.4318181818181818
ro
0.4170096021947874
de
0.4064245810055866
nl
0.4022503516174402
sl
0.39198855507868385
yo
0.37315634218289084
pt
0.3694362017804154
cs
0.358974358974359
az
0.34514637904468415
ca
0.3359375
sk
0.32432432432432434
vi
0.2904841402337229
et
0.2621527777777778
ms
0.256993006993007
tr
0.256993006993007
es
0.18738049713193117
be
0.1414141414141414
hu
0.1361788617886179
is
0.1290983606557377
lt
0.1290983606557377
lv
0.1290983606557377
uk
0.1290983606557377
reliable
true
passes
true
5
name
"Marie"
dialogue
"** …the noise. Like an animal. But not."
detectedLang
"en"
heavyLang
"en"
scores
en
0.7971145175834085
fr
0.6975806451612904
tl
0.5953237410071942
no
0.4943820224719101
de
0.4755244755244755
yo
0.471830985915493
ro
0.42748091603053434
ms
0.412532637075718
pt
0.4094488188976378
tr
0.39839572192513373
vi
0.3263473053892215
eu
0.3161094224924012
nl
0.27184466019417475
ca
0.26229508196721313
es
0.26229508196721313
da
0.25742574257425743
sq
0.25742574257425743
sv
0.25742574257425743
az
0.2524916943521595
hr
0.2398648648648649
it
0.2398648648648649
reliable
true
passes
false
6
name
"Hunter"
dialogue
"** You heard something? Saw something?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8217922606924645
tl
0.6187363834422658
ms
0.5042492917847025
cs
0.308300395256917
es
0.308300395256917
pt
0.308300395256917
reliable
true
passes
true
7
name
"Marie"
dialogue
"** Désolée…"
detectedLang
"fr"
heavyLang
"fr"
scores
fr
0.7819767441860466
reliable
true
passes
true
8
name
"Hunter"
dialogue
"** Here. Write it down. In French. I’ll get it translated."
detectedLang
"en"
heavyLang
"en"
scores
en
0.825436408977556
tl
0.5524296675191815
it
0.5063469675599436
ro
0.4720965309200603
sl
0.44881889763779526
sq
0.42434210526315785
et
0.3955094991364421
nl
0.3848857644991213
de
0.3794326241134752
es
0.3333333333333333
pt
0.33078393881453155
sv
0.3217054263565891
yo
0.31906614785992216
pl
0.3055555555555556
lv
0.30417495029821073
fr
0.3027888446215139
sk
0.29292929292929293
az
0.29006085192697767
lt
0.2842535787321063
ms
0.2768595041322314
hi
0.2273730684326711
is
0.2222222222222222
vi
0.2009132420091324
ca
0.1764705882352941
eu
0.1606714628297362
da
0.15254237288135594
hr
0.15254237288135594
no
0.15254237288135594
tr
0.15254237288135594
cs
0.14425427872860636
reliable
true
passes
true
9
name
"Marie"
dialogue
"** Like this."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8644986449864499
no
0.7142857142857143
tl
0.6666666666666666
reliable
false
passes
true
10
name
"Hunter"
dialogue
"**—don’t delete those photos, okay? And stay where people can see you."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8243559718969555
tl
0.5802238805970149
fr
0.3951612903225807
et
0.35251798561151076
sq
0.35251798561151076
ca
0.32330827067669177
pt
0.26229508196721313
no
0.26108374384236455
tr
0.2524916943521595
de
0.24874791318864775
es
0.24623115577889448
ro
0.2398648648648649
nl
0.23469387755102045
yo
0.18032786885245902
hu
0.15730337078651685
lt
0.15094339622641512
cs
0.14772727272727273
az
0.14611005692599618
hi
0.14611005692599618
sl
0.14285714285714285
lv
0.1362763915547025
da
0.12959381044487428
it
0.12959381044487428
sv
0.12959381044487428
reliable
true
passes
true
11
name
"Marie"
dialogue
"** S’il vous plaît… soyez prudent."
detectedLang
"fr"
heavyLang
"fr"
scores
fr
0.7535596933187294
ca
0.5989304812834225
sq
0.3784530386740331
en
0.26229508196721313
az
0.25
et
0.23728813559322032
nl
0.23728813559322032
pl
0.23728813559322032
ro
0.23728813559322032
sk
0.23728813559322032
tl
0.23728813559322032
cs
0.22945205479452058
no
0.22945205479452058
da
0.21875
de
0.21875
sv
0.21875
hu
0.2077464788732394
reliable
true
passes
true
12
name
"Hunter"
dialogue
"** Lock your doors tonight."
detectedLang
"en"
heavyLang
"en"
scores
en
0.7483221476510067
tl
0.6543778801843317
nl
0.469964664310954
ms
0.34210526315789475
da
0.33035714285714285
de
0.33035714285714285
fr
0.33035714285714285
no
0.33035714285714285
yo
0.33035714285714285
reliable
true
passes
true