NC Bench
Overview
About
Tests
Models
Vendors
Run: 2026-02-20-01KHXQGRWYR3NZDV6Y801MM066
Run Details
Model:
Mistral Large 3
Test:
Language Writing
Scenario:
Character dialogue (French) in a story
Duration:
18.5s
Cost:
$0.001519
Provider:
Mistral
Evaluation summary
Score
Evaluator
Details Link
78.95%
Parse dialogue
(details)
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Marie"> Marie is a 30-year old college student on a study abroad program. Born in France, she is fluent in French and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of French, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Marie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in French, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Marie and Hunter as a voice sheet: Marie: "..." Hunter: "..."
Model response
Messages
Meta
AI
**Voice Sheet: Café Encounter in Alborn, MN** *(Marie sits at a small wrought-iron table outside the café, her camera resting in her lap. She flips through the photos she’s taken, her brow furrowed. The late afternoon sun casts long shadows across the quiet street. Hunter approaches, his boots scuffing lightly against the pavement. He hesitates before pulling out the chair across from her.)* **Hunter:** *(clears throat, polite but firm)* Excuse me, miss. Mind if I sit for a minute? **Marie:** *(startled, looks up, then relaxes slightly when she sees his badge clipped to his belt. She nods, gesturing to the chair, then says in rapid French)* Oh—oui, bien sûr. Vous êtes de la police? **Hunter:** *(blinks, then shakes his head slightly, as if clearing it)* Uh. Yeah, I’m Detective Hunter. With the Alborn PD. *(leans forward, elbows on the table)* I was hoping you might be able to help me with something. **Marie:** *(frowns, tilting her head. She switches to French, her words tumbling out nervously)* Aider? Avec quoi? Je ne comprends pas ce qui se passe ici. Tout le monde disparaît, et personne ne dit rien— **Hunter:** *(holds up a hand, grimacing)* Whoa, whoa—hold on. I don’t—uh. *(scrubs a hand over his jaw, frustrated)* Look, I don’t speak French. At all. Can you—maybe try English? **Marie:** *(blinks, then exhales sharply, switching to heavily accented but careful English)* Oh. I am sorry. I… forget. *(taps her camera)* I take pictures. Of the town. But—*(gestures vaguely toward the street)*—the people. They are gone. **Hunter:** *(nods, relieved she’s trying)* Right. That’s what I wanted to ask you about. You’ve been taking photos around town, yeah? Seen anything… unusual? **Marie:** *(bites her lip, then flips her camera around, showing him a photo of the empty town square from earlier that week)* Regardez. *(points)* There. The festival. It is always busy. But now—*(shakes her head)*—nothing. And the man at the orchard. He is gone too. **Hunter:** *(studies the photo, then looks back at her, voice low)* The orchard? You mean Old Man Calloway? **Marie:** *(nods quickly)* Oui. Calloway. He is not there. His truck is, but—*(mimes vanishing with her hands)*—poof. **Hunter:** *(grunts, pulling out a small notebook and jotting something down)* When did you notice he was gone? **Marie:** *(thinks, counting on her fingers)* Three days. Maybe four. I go to take pictures of the apples, and—*(shrugs, helpless)*—no one. **Hunter:** *(nods, then pauses, studying her face)* You’ve been asking around about this? **Marie:** *(hesitates, then nods)* Oui. But no one… *(makes a zipping motion over her lips)* They do not talk to me. I am new. A stranger. **Hunter:** *(grunts, sympathetic)* Yeah, small towns can be like that. *(leans back, then checks his phone as it buzzes. His expression tightens.)* Look, I gotta take this. But—*(pulls out a business card, slides it across the table)*—if you see anything else, or remember anything, call me. Even if it’s just a feeling. **Marie:** *(takes the card, turning it over in her fingers. She looks up at him, her voice quiet)* You will find them? **Hunter:** *(stands, tucking his notebook away)* That’s the plan. *(pauses, then adds gruffly)* And hey—if you need anything, or get spooked, you call me. Alright? **Marie:** *(nods, clutching the card)* Merci, Detective. **Hunter:** *(tips an imaginary hat, then strides off, phone already at his ear. Marie watches him go, then looks down at her camera, her thumb brushing over the shutter button.)*
created_at
"2026-02-20T14:33:33.353Z"
2/20/2026, 2:33:33 PM
model
"mistralai/mistral-large-2512"
1/1/2512, 12:00:00 AM
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
491
moderation_latency
(null)
generation_time
18410
tokens_prompt
316
tokens_completion
943
native_tokens_prompt
269
native_tokens_completion
923
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.001519
router
(null)
provider_responses
0
endpoint_id
"fa718841-07ea-4b7e-b8a3-6069545c7e6a"
id
"4d7dda97bd2a46839d84f8675a403452"
is_byok
false
latency
491
model_permaslug
"mistralai/mistral-large-2512"
1/1/2512, 12:00:00 AM
provider_name
"Mistral"
status
200
api_type
"completions"
id
"gen-1771598013-Jsq2hxP3KahIdGQ5GCNr"
upstream_id
"4d7dda97bd2a46839d84f8675a403452"
total_cost
0.001519
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Mistral"
Evaluation details
Result
Evaluator
Details
Meta Data
78.95%
Parse dialogue
n/a
dialogue
0
name
"Hunter"
dialogue
"** Excuse me, miss. Mind if I sit for a minute?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.75825946817083
no
0.6777658431793769
da
0.6539792387543253
it
0.6057818659658344
et
0.6
sq
0.5815899581589958
tl
0.5756718528995757
hr
0.5664739884393063
ro
0.563953488372093
pt
0.5568685376661743
sv
0.5529061102831594
ca
0.5356037151702787
sl
0.5192307692307693
cs
0.5098039215686274
hu
0.5090016366612111
es
0.5008319467554077
pl
0.494949494949495
sk
0.4800693240901213
fr
0.4746059544658494
nl
0.41972920696324956
fi
0.4117647058823529
de
0.4094488188976378
lt
0.4094488188976378
ms
0.40711462450592883
yo
0.40711462450592883
tr
0.3288590604026846
is
0.3150684931506849
az
0.3071593533487298
lv
0.3071593533487298
vi
0.3071593533487298
be
0.1891891891891892
eu
0.1891891891891892
uk
0.17355371900826447
reliable
true
passes
true
1
name
"Marie"
dialogue
"** Oh—oui, bien sûr. Vous êtes de la police?"
detectedLang
"fr"
heavyLang
"fr"
scores
fr
0.8162992651970608
es
0.6604938271604939
ro
0.6376811594202898
ca
0.5901639344262295
it
0.5870870870870871
nl
0.5696400625978091
tl
0.5416666666666666
no
0.5062836624775583
en
0.461839530332681
sq
0.44779116465863456
pt
0.4433198380566802
da
0.4318181818181818
sv
0.4246861924686192
yo
0.40347071583514105
cs
0.3982494529540482
hu
0.38478747203579416
tr
0.3820224719101124
hr
0.3792325056433409
eu
0.3735763097949886
sl
0.3707093821510297
sk
0.36342592592592593
de
0.3483412322274882
ms
0.34523809523809523
az
0.3341404358353511
et
0.2445054945054945
lv
0.2445054945054945
pl
0.24242424242424243
lt
0.2403314917127072
fi
0.233983286908078
vi
0.233983286908078
reliable
true
passes
true
2
name
"Hunter"
dialogue
"** I was hoping you might be able to help me with something."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8238661382650815
tl
0.6011964107676969
yo
0.553072625698324
no
0.5500562429696289
da
0.49174078780177893
ms
0.4428969359331476
cs
0.43977591036414565
nl
0.4186046511627907
sq
0.41348973607038125
lt
0.4108983799705449
pl
0.394856278366112
hr
0.3893129770992366
pt
0.3710691823899371
fr
0.3700787401574803
et
0.3630573248407643
sv
0.35064935064935066
sl
0.34318555008210183
sk
0.33774834437086093
it
0.3277310924369748
de
0.3254637436762226
lv
0.3162393162393162
hu
0.3150684931506849
es
0.3103448275862069
ca
0.25650557620817843
ro
0.1836734693877551
fi
0.15789473684210525
be
0.14893617021276595
tr
0.14893617021276595
az
0.13606911447084233
is
0.13606911447084233
uk
0.13606911447084233
vi
0.13606911447084233
reliable
true
passes
true
3
name
"Marie"
dialogue
"** Aider? Avec quoi? Je ne comprends pas ce qui se passe ici. Tout le monde disparaît, et personne ne dit rien—"
detectedLang
"fr"
heavyLang
"fr"
scores
fr
0.8255953812845802
it
0.665590405904059
ca
0.6221990620114642
ro
0.5823732718894009
nl
0.5530209617755857
es
0.5361484325015995
pt
0.5111260957518543
en
0.4850852272727273
da
0.4757772957339118
de
0.4649446494464945
sl
0.4313725490196078
sv
0.4304791830322074
no
0.4204636290967226
sq
0.40622440622440625
cs
0.40476190476190477
hr
0.39633638634471274
tl
0.3829787234042553
yo
0.35094001790510293
et
0.34150772025431425
lt
0.3317972350230415
hu
0.33118081180811804
sk
0.27354709418837675
ms
0.2463617463617464
tr
0.24083769633507857
fi
0.20765027322404372
lv
0.19712070874861573
pl
0.17142857142857143
az
0.15005861664712777
is
0.15005861664712777
reliable
true
passes
true
4
name
"Hunter"
dialogue
"** Look, I don’t speak French. At all. Can you—maybe try English?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.82195224130708
tl
0.6401354784081287
no
0.5213963963963963
da
0.47595561035758327
sv
0.3988684582743989
it
0.38316400580551524
ca
0.3359375
hr
0.33176100628930816
sq
0.3264659270998415
cs
0.30098684210526316
ro
0.27597955706984667
et
0.2621527777777778
tr
0.256993006993007
de
0.2530755711775044
az
0.247787610619469
pl
0.22867513611615245
nl
0.1904761904761905
es
0.18738049713193117
pt
0.17953667953667954
yo
0.169921875
ms
0.1448692152917505
sk
0.1448692152917505
be
0.1414141414141414
hu
0.1361788617886179
is
0.1290983606557377
lt
0.1290983606557377
lv
0.1290983606557377
uk
0.1290983606557377
vi
0.1290983606557377
reliable
true
passes
true
5
name
"Marie"
dialogue
"**—the people. They are gone."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8622589531680441
tl
0.576271186440678
ro
0.49664429530201337
yo
0.4163424124513619
no
0.3877551020408163
nl
0.358974358974359
da
0.34210526315789475
fr
0.34210526315789475
ms
0.34210526315789475
sq
0.34210526315789475
sv
0.34210526315789475
reliable
true
passes
false
6
name
"Hunter"
dialogue
"** Right. That’s what I wanted to ask you about. You’ve been taking photos around town, yeah? Seen anything… unusual?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8176430362434466
tl
0.5618838992332968
no
0.34102141680395387
sq
0.3360995850622407
pl
0.3144815766923736
fr
0.290150842945874
da
0.2837958818263205
cs
0.28186714542190305
yo
0.27140255009107467
sk
0.2558139534883721
nl
0.2537313432835821
lv
0.24242424242424243
hr
0.24170616113744076
lt
0.23591212989493793
et
0.2300288739172281
pt
0.22178988326848248
de
0.21951219512195122
it
0.21182266009852216
ca
0.20713577799801783
sv
0.20713577799801783
sl
0.1935483870967742
es
0.16405433646812956
tr
0.16317991631799164
ms
0.16230366492146597
is
0.14346895074946467
ro
0.10112359550561797
fi
0.09090909090909091
hi
0.08779931584948689
be
0.08045977011494253
hu
0.07727797001153403
az
0.07300115874855156
uk
0.07300115874855156
vi
0.07300115874855156
reliable
true
passes
true
7
name
"Marie"
dialogue
"**—nothing. And the man at the orchard. He is gone too."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8271889400921658
tl
0.7131931166347993
yo
0.5879120879120879
nl
0.5821727019498607
no
0.5821727019498607
da
0.560117302052786
sv
0.40594059405940597
de
0.3890020366598778
ms
0.34210526315789475
hu
0.33920704845814975
fr
0.33774834437086093
lv
0.2647058823529412
lt
0.23857868020304565
is
0.23469387755102045
ca
0.23273657289002556
fi
0.23273657289002556
es
0.21875
sq
0.20634920634920634
reliable
true
passes
false
8
name
"Hunter"
dialogue
"** The orchard? You mean Old Man Calloway?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.7656982193064668
tl
0.654696132596685
de
0.5183044315992292
no
0.5136186770428015
nl
0.5088408644400786
da
0.4529540481400437
sv
0.45054945054945056
fr
0.3796526054590571
lv
0.30167597765363136
yo
0.299719887955182
es
0.2732558139534884
lt
0.2732558139534884
cs
0.2378048780487805
ms
0.2378048780487805
sq
0.2378048780487805
reliable
true
passes
true
9
name
"Marie"
dialogue
"**—poof."
detectedLang
""
heavyLang
"et"
scores
reliable
false
passes
true
10
name
"Hunter"
dialogue
"** When did you notice he was gone?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8317914213624895
tl
0.5423340961098398
yo
0.48586118251928023
es
0.46380697050938335
cs
0.44751381215469616
fr
0.441340782122905
nl
0.40119760479041916
de
0.3730407523510972
lv
0.3730407523510972
ro
0.3311036789297659
ca
0.3127147766323024
fi
0.3127147766323024
it
0.3079584775086505
hr
0.29577464788732394
pt
0.27007299270072993
sk
0.27007299270072993
reliable
true
passes
true
11
name
"Marie"
dialogue
"**—no one."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8220640569395018
hr
0.7899159663865546
tl
0.7695852534562212
pl
0.7641509433962265
pt
0.7340425531914894
es
0.732620320855615
ca
0.7297297297297297
lv
0.7237569060773481
no
0.6598639455782312
sk
0.6453900709219859
tr
0.6376811594202898
it
0.6153846153846154
reliable
false
passes
true
12
name
"Hunter"
dialogue
"** You’ve been asking around about this?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8245054243777921
tl
0.5499181669394435
nl
0.27055702917771884
no
0.23822714681440443
de
0.22535211267605632
fr
0.20520231213872833
is
0.20520231213872833
pt
0.20520231213872833
sv
0.20520231213872833
reliable
true
passes
true
13
name
"Marie"
dialogue
"** They do not talk to me. I am new. A stranger."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8138602520045818
no
0.7034671532846716
da
0.6673490276356192
cs
0.6642561983471075
hr
0.6614583333333334
sk
0.6535181236673774
sq
0.6444201312910285
pl
0.643640350877193
sl
0.6352413019079686
tl
0.6220930232558138
de
0.6203271028037384
sv
0.6112440191387559
fr
0.6046228710462287
ro
0.6031746031746031
yo
0.5982694684796045
nl
0.5927318295739349
it
0.5870393900889453
pt
0.5416078984485191
lv
0.5
lt
0.49297971918876754
tr
0.4663382594417077
et
0.4628099173553719
ca
0.4574290484140233
ms
0.45286195286195285
vi
0.42882249560632685
es
0.4186046511627907
hu
0.40693430656934304
is
0.38679245283018865
az
0.37137330754352027
fi
0.29805615550755943
hi
0.2111650485436893
be
0.17721518987341772
eu
0.17721518987341772
uk
0.16237113402061853
reliable
true
passes
false
14
name
"Hunter"
dialogue
"**—if you see anything else, or remember anything, call me. Even if it’s just a feeling."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8260869565217391
tl
0.6438746438746439
nl
0.5748299319727891
sv
0.5069033530571991
et
0.503968253968254
ms
0.49849548645937813
no
0.46977730646871685
fr
0.43566591422121903
da
0.40688018979833923
hu
0.3997599039615846
sq
0.3902439024390244
yo
0.3811881188118812
sl
0.3796526054590571
de
0.37888198757763975
sk
0.3403693931398417
es
0.31880108991825606
is
0.31412894375857336
pt
0.3131868131868132
ca
0.29873772791023845
cs
0.29577464788732394
it
0.2907801418439716
ro
0.21752738654147105
fi
0.2163009404388715
hr
0.1830065359477124
pl
0.17355371900826447
lt
0.14089347079037798
tr
0.1334488734835355
az
0.12280701754385964
eu
0.12280701754385964
lv
0.12280701754385964
vi
0.12280701754385964
reliable
true
passes
true
15
name
"Marie"
dialogue
"** You will find them?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8444790046656299
tl
0.609375
de
0.5145631067961165
da
0.5
cs
0.43820224719101125
reliable
true
passes
false
16
name
"Hunter"
dialogue
"** And hey—if you need anything, or get spooked, you call me. Alright?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8045920859794822
tl
0.5412844036697247
sq
0.38271604938271603
fr
0.37791601866251945
et
0.36908517350157727
nl
0.32088285229202035
yo
0.3019197207678883
no
0.2920353982300885
ms
0.28825622775800713
es
0.20318725099601595
is
0.2
sv
0.2
pt
0.18032786885245902
sl
0.18032786885245902
it
0.16666666666666666
cs
0.16317991631799164
fi
0.15789473684210525
da
0.15611814345991562
de
0.15611814345991562
reliable
true
passes
true
17
name
"Marie"
dialogue
"** Merci, Detective."
detectedLang
"en"
heavyLang
"fr"
scores
en
0.748995983935743
fr
0.7406639004149378
it
0.7329059829059829
tl
0.7037914691943127
es
0.6794871794871795
ca
0.6770025839793281
pt
0.6727748691099475
ro
0.6684350132625994
de
0.5503597122302158
cs
0.5437956204379563
sl
0.5210727969348659
sq
0.42660550458715596
pl
0.410377358490566
da
0.40191387559808617
nl
0.3961352657004831
no
0.3902439024390244
ms
0.3556701030927836
tr
0.3556701030927836
hr
0.34895833333333337
sv
0.34895833333333337
reliable
true
passes
true
18
name
"Hunter"
dialogue
"**"
detectedLang
""
heavyLang
""
scores
reliable
false
passes
true