NC Bench
Overview
About
Tests
Models
Vendors
Run: 2026-02-20-01KHXQ6B585TBG2K3YJJRZ84ZY
Run Details
Model:
Mistral Large 3
Test:
Language Writing
Scenario:
Character dialogue (French) in a story
Duration:
18.2s
Cost:
$0.001515
Provider:
Mistral
Evaluation summary
Score
Evaluator
Details Link
76.47%
Parse dialogue
(details)
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Marie"> Marie is a 30-year old college student on a study abroad program. Born in France, she is fluent in French and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of French, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Marie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in French, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Marie and Hunter as a voice sheet: Marie: "..." Hunter: "..."
Model response
Messages
Meta
AI
**Voice Sheet: Café Encounter in Alborn, MN** *(Marie sits at a small wrought-iron table outside the café, her fingers tracing the edges of her camera. The late afternoon sun casts long shadows across the cobblestone street. She glances up as Hunter approaches, his expression serious, his posture rigid with purpose.)* **Hunter:** *(clears throat, adjusting his jacket)* "Excuse me, miss. Mind if I sit for a moment?" **Marie:** *(startled, clutching her camera tighter)* "Oh—oui, bien sûr. *(nods, gesturing to the empty chair across from her)* Euh… vous parlez français?" **Hunter:** *(blinks, then shakes his head slowly)* "No, ma’am. English only, I’m afraid." **Marie:** *(frowns, then sighs, switching to heavily accented English)* "Ah. Okay. You… sit?" *(points to the chair again, her voice hesitant)* **Hunter:** *(pulls out the chair, sitting down)* "Thank you. I’m Detective Hunter. I’m looking into some… unusual activity around town. You’re new here, right?" **Marie:** *(nods quickly, then shakes her head, her words tumbling out in French)* "Oui, je suis ici pour étudier, mais—*(shakes her head, eyes wide)*—c’est terrible, ce qui se passe! J’ai vu quelque chose près de la vieille grange, près des bois. *(leans forward, gripping the table)* Il y avait des lumières, et puis—*(mimes something vanishing with her hands)*—plus rien! Comme si… comme si la terre l’avait avalé!" **Hunter:** *(leans in slightly, brow furrowed)* "Ma’am, I’m not following. You saw *lights*? Near the old barn by the woods?" **Marie:** *(nods frantically, then switches back to broken English)* "Yes! Lights. Blue. Like… *(mimes flickering with her fingers)* electricity. And then—*(makes a swallowing motion)*—gone. No sound. No people. Just… gone." **Hunter:** *(pulls out a small notepad, scribbling)* "When was this?" **Marie:** *(counts on her fingers, then holds up three)* "Trois nuits. Three nights ago. I take photos—*(taps her camera)*—of the trees, the sky. But then… *(shudders)* I see this. And now, I hear the town talk. People missing. *(whispers)* C’est vrai?" **Hunter:** *(nods grimly)* "Yeah. It’s true. That’s why I’m asking around." *(pauses, studying her)* "You said you’re here to study? What’s your name?" **Marie:** *(hesitates, then offers a small smile)* "Marie. Marie Laurent. From Lyon." **Hunter:** *(extends a hand, which she shakes cautiously)* "Nice to meet you, Marie. You’ve got a good eye—*(gestures to her camera)*—if you saw something, even if it doesn’t make sense to you, it might help. You remember *exactly* where this was?" **Marie:** *(nods, then points vaguely toward the edge of town)* "Oui. Near the big red barn. The one with… *(mimes a broken fence)* the broken fence. There is a path into the trees." **Hunter:** *(jots it down, then stands abruptly as his phone buzzes)* "That’s my partner. I gotta run, but—*(pulls out a business card, sets it on the table)*—if you remember anything else, call me. Even if it’s just… blue lights in the woods." **Marie:** *(takes the card, turning it over in her hands)* "Merci, Detective. *(looks up, voice quiet)* Soyez prudent. *(then, realizing he doesn’t understand, switches to English)* Be… careful." **Hunter:** *(gives her a tight nod, already turning away)* "Always am. Stay safe, Marie." *(He strides off, phone to his ear, leaving Marie staring after him, her camera forgotten in her lap. She exhales shakily, then glances at the card before tucking it into her pocket.)*
created_at
"2026-02-20T14:27:51.602Z"
2/20/2026, 2:27:51 PM
model
"mistralai/mistral-large-2512"
1/1/2512, 12:00:00 AM
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
378
moderation_latency
(null)
generation_time
18132
tokens_prompt
316
tokens_completion
939
native_tokens_prompt
269
native_tokens_completion
920
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.0015145
router
(null)
provider_responses
0
endpoint_id
"fa718841-07ea-4b7e-b8a3-6069545c7e6a"
id
"4ff4808a968b4a11a02902cbf16290f3"
is_byok
false
latency
378
model_permaslug
"mistralai/mistral-large-2512"
1/1/2512, 12:00:00 AM
provider_name
"Mistral"
status
200
api_type
"completions"
id
"gen-1771597671-YpNSpMMhvOTGp9GdN51q"
upstream_id
"4ff4808a968b4a11a02902cbf16290f3"
total_cost
0.0015145
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Mistral"
Evaluation details
Result
Evaluator
Details
Meta Data
76.47%
Parse dialogue
n/a
dialogue
0
name
"Hunter"
dialogue
"Excuse me, miss. Mind if I sit for a moment?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.7647058823529411
no
0.6777658431793769
da
0.6539792387543253
sq
0.6216897856242118
ca
0.6163682864450128
tl
0.5896032831737346
fr
0.5786516853932584
it
0.574468085106383
pt
0.5708154506437768
ro
0.5708154506437768
hu
0.5548961424332344
pl
0.5522388059701493
cs
0.5488721804511278
sv
0.5481927710843374
sk
0.5290423861852434
es
0.5176848874598071
nl
0.512987012987013
hr
0.511400651465798
et
0.5073891625615764
yo
0.4727592267135325
de
0.40828402366863903
az
0.3951612903225807
sl
0.3723849372384937
ms
0.3288590604026846
tr
0.3288590604026846
lt
0.3258426966292135
fi
0.3150684931506849
is
0.3150684931506849
lv
0.3071593533487298
vi
0.3071593533487298
be
0.1891891891891892
eu
0.1891891891891892
uk
0.17355371900826447
reliable
true
passes
true
1
name
"Marie"
dialogue
"Oh—oui, bien sûr. ** Euh… vous parlez français?"
detectedLang
"fr"
heavyLang
"fr"
scores
fr
0.7734761120263591
ca
0.49725776965265084
es
0.4897959183673469
nl
0.4888475836431227
pt
0.4455645161290322
it
0.3648960739030023
sk
0.3405275779376499
de
0.33894230769230765
hr
0.3373493975903614
ro
0.3373493975903614
sl
0.3341404358353511
hu
0.3325242718446602
pl
0.3325242718446602
no
0.3276283618581907
sq
0.3276283618581907
az
0.32598039215686275
cs
0.32598039215686275
en
0.32098765432098764
da
0.314214463840399
sv
0.314214463840399
ms
0.30730478589420657
tr
0.30730478589420657
lv
0.3002544529262086
eu
0.22535211267605632
yo
0.22535211267605632
tl
0.19590643274853803
et
0.1863905325443787
lt
0.1863905325443787
is
0.17664670658682635
reliable
true
passes
true
2
name
"Hunter"
dialogue
"No, ma’am. English only, I’m afraid."
detectedLang
"en"
heavyLang
"en"
scores
en
0.7365648050579557
tl
0.5283018867924528
no
0.4172494172494172
hr
0.40898345153664306
pt
0.3556701030927836
es
0.3540051679586563
ca
0.35064935064935066
lv
0.3438320209973753
sk
0.2668621700879765
tr
0.26035502958579887
it
0.24242424242424243
pl
0.23076923076923078
da
0.22360248447204967
de
0.22360248447204967
ms
0.22360248447204967
ro
0.22360248447204967
sv
0.22360248447204967
reliable
true
passes
true
3
name
"Marie"
dialogue
"Ah. Okay. You… sit?"
detectedLang
"tl"
heavyLang
"en"
scores
tl
0.6466431095406361
en
0.576271186440678
da
0.5652173913043478
no
0.5
cs
0.43820224719101125
reliable
true
passes
false
4
name
"Hunter"
dialogue
"Thank you. I’m Detective Hunter. I’m looking into some… unusual activity around town. You’re new here, right?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8145305704783832
tl
0.6122994652406418
fr
0.46691176470588236
ro
0.4277821625887924
pt
0.3897306397306397
nl
0.38870151770657674
de
0.3798118049615056
no
0.3776824034334764
ca
0.35669920141969835
sq
0.3403093721565059
da
0.3330266789328427
it
0.33056325023084027
es
0.3262081784386617
cs
0.323062558356676
sv
0.31279620853080564
ms
0.2691532258064516
sk
0.21281216069489683
sl
0.2032967032967033
et
0.1844769403824522
vi
0.16666666666666666
yo
0.15893271461716937
hr
0.14806110458284372
tr
0.13997627520759193
is
0.08919597989949749
fi
0.0845959595959596
lv
0.0799492385786802
reliable
true
passes
true
5
name
"Marie"
dialogue
"Oui, je suis ici pour étudier, mais—**—plus rien! Comme si… comme si la terre l’avait avalé!"
detectedLang
"fr"
heavyLang
"fr"
scores
fr
0.8077595246417336
it
0.556809024979855
ca
0.5491803278688524
no
0.4751908396946565
es
0.43298969072164945
da
0.4300518134715026
ro
0.41050375133976424
cs
0.4073275862068965
yo
0.4073275862068965
sk
0.4008714596949891
nl
0.39692982456140347
pt
0.3799323562570462
tl
0.3742889647326508
sl
0.3405275779376499
sq
0.3325242718446602
et
0.3184634448574969
sv
0.28292046936114734
en
0.2637215528781794
hr
0.23717059639389734
pl
0.21428571428571427
hu
0.20863309352517986
de
0.20634920634920634
vi
0.13249211356466878
lt
0.11575562700964631
az
0.10277324632952692
fi
0.09688013136288999
reliable
true
passes
true
6
name
"Hunter"
dialogue
"Ma’am, I’m not following. You saw ? Near the old barn by the woods?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8030583873957368
tl
0.6632329635499208
da
0.371301775147929
cs
0.32965299684542587
no
0.30668841761827076
sv
0.2975206611570248
ms
0.2951907131011609
nl
0.27597955706984667
sk
0.24242424242424243
pl
0.21731123388581952
yo
0.20112781954887218
fr
0.1550695825049702
it
0.1550695825049702
sq
0.1550695825049702
tr
0.1550695825049702
is
0.1533864541832669
reliable
true
passes
true
7
name
"Marie"
dialogue
"Yes! Lights. Blue. Like… **—gone. No sound. No people. Just… gone."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8311761395610581
tl
0.6685082872928177
no
0.42528735632183906
ca
0.4140625
pt
0.3150684931506849
es
0.3135011441647597
lv
0.30394431554524365
et
0.2537313432835821
sv
0.2537313432835821
hr
0.2518703241895262
be
0.25
sk
0.23273657289002556
tr
0.22680412371134018
it
0.21052631578947367
pl
0.2
reliable
true
passes
false
8
name
"Hunter"
dialogue
"When was this?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8648648648648649
nl
0.6411483253588517
de
0.6134020618556701
tl
0.5714285714285714
yo
0.5370370370370371
reliable
true
passes
true
9
name
"Marie"
dialogue
"Trois nuits. Three nights ago. I take photos—** C’est vrai?"
detectedLang
"en"
heavyLang
"fr"
scores
en
0.7289972899728997
fr
0.6990218209179835
tl
0.6116504854368932
ca
0.4177583697234352
it
0.375
no
0.26605504587155965
lt
0.26335174953959484
da
0.25788497217068646
hr
0.25788497217068646
sv
0.25650557620817843
lv
0.250936329588015
sq
0.250936329588015
pl
0.23954372623574144
cs
0.2079207920792079
ro
0.1836734693877551
yo
0.17864476386036962
es
0.16666666666666666
pt
0.16666666666666666
sl
0.16317991631799164
hi
0.16142557651991615
sk
0.15254237288135594
de
0.15074309978768577
nl
0.15074309978768577
be
0.14893617021276595
tr
0.14893617021276595
hu
0.14346895074946467
az
0.13606911447084233
et
0.13606911447084233
is
0.13606911447084233
uk
0.13606911447084233
vi
0.13606911447084233
reliable
true
passes
true
10
name
"Hunter"
dialogue
"You said you’re here to study? What’s your name?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8308361527307879
tl
0.538866930171278
cs
0.4479495268138801
nl
0.41373534338358464
pl
0.36594202898550726
hr
0.3554327808471455
lv
0.35424354243542433
sk
0.35304990757855825
no
0.3408662900188324
sl
0.33962264150943394
sq
0.33962264150943394
lt
0.3320610687022901
it
0.3269230769230769
da
0.3230174081237911
de
0.29718875502008035
yo
0.2813141683778234
et
0.24242424242424243
ms
0.1822429906542056
ro
0.16666666666666666
sv
0.16666666666666666
fr
0.14425427872860636
reliable
true
passes
true
11
name
"Marie"
dialogue
"Marie. Marie Laurent. From Lyon."
detectedLang
"fr"
heavyLang
"en"
scores
fr
0.7382198952879581
en
0.6975806451612904
ro
0.6900826446280992
no
0.6666666666666666
it
0.609375
da
0.5867768595041323
tl
0.5412844036697247
ca
0.5176848874598071
sv
0.4863013698630137
lt
0.4791666666666667
nl
0.4791666666666667
et
0.471830985915493
fi
0.46428571428571425
lv
0.46428571428571425
hr
0.3333333333333333
pt
0.32432432432432434
sl
0.32432432432432434
es
0.3087557603686636
pl
0.3087557603686636
de
0.29577464788732394
eu
0.29577464788732394
ms
0.29577464788732394
sk
0.29577464788732394
sq
0.29577464788732394
yo
0.29577464788732394
cs
0.2822966507177033
reliable
true
passes
true
12
name
"Hunter"
dialogue
"Nice to meet you, Marie. You’ve got a good eye—*exactly* where this was?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8155339805825242
yo
0.5254745254745254
tl
0.5202020202020201
cs
0.4571428571428572
ro
0.4546498277841562
de
0.4077306733167082
sk
0.40624999999999994
no
0.40550688360450565
da
0.4010088272383354
pl
0.39258312020460356
hr
0.38946015424164526
it
0.37745740498034075
sl
0.37335092348284965
es
0.3683510638297872
nl
0.35983827493261455
fr
0.35549525101763907
lt
0.3475274725274725
lv
0.3457300275482094
sq
0.309593023255814
pt
0.30858806404657935
ca
0.302496328928047
sv
0.3014705882352941
hu
0.24722662440570525
eu
0.21875
et
0.2096505823627288
ms
0.2096505823627288
fi
0.20435510887772196
tr
0.1394927536231884
is
0.13636363636363635
az
0.12844036697247707
vi
0.12844036697247707
reliable
true
passes
true
13
name
"Marie"
dialogue
"Oui. Near the big red barn. The one with… ** the broken fence. There is a path into the trees."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8085024894676368
tl
0.5503597122302158
nl
0.4887525562372188
yo
0.452354874041621
fr
0.451152579582876
no
0.44567627494456763
sv
0.3902439024390244
da
0.3842364532019704
hu
0.38271604938271603
sq
0.3710691823899371
hr
0.3540051679586563
de
0.3288590604026846
is
0.32795698924731176
sl
0.32432432432432434
ca
0.3206521739130435
ms
0.3045897079276773
cs
0.30167597765363136
es
0.30167597765363136
pt
0.29278642149929274
pl
0.2774566473988439
et
0.24585218702865763
tr
0.22360248447204967
ro
0.21752738654147105
lv
0.21507064364207218
sk
0.20634920634920634
it
0.2
lt
0.14089347079037798
az
0.12280701754385964
eu
0.12280701754385964
vi
0.12280701754385964
fi
0.11190053285968028
reliable
true
passes
false
14
name
"Hunter"
dialogue
"That’s my partner. I gotta run, but—**—if you remember anything else, call me. Even if it’s just… blue lights in the woods."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8146431881371641
tl
0.6630160067396799
sv
0.5291347851677457
nl
0.5232419547079857
it
0.5040297582145071
no
0.44713199723566
sq
0.441340782122905
yo
0.44016794961511546
ms
0.4108983799705449
da
0.3957703927492447
de
0.37057435090479934
fr
0.3620414673046252
sl
0.3532740501212611
hu
0.34156378600823045
et
0.33774834437086093
pl
0.3174061433447099
sk
0.30374238468233244
cs
0.29328621908127206
ro
0.290150842945874
ca
0.2779783393501805
az
0.22103213242453748
is
0.21337266470009833
hr
0.2047713717693837
es
0.1991991991991992
fi
0.1894630192502533
pt
0.18781725888324874
lt
0.14712153518123666
tr
0.14621131270010673
lv
0.1443850267379679
eu
0.09090909090909091
be
0.08045977011494253
uk
0.07300115874855156
vi
0.07300115874855156
reliable
true
passes
true
15
name
"Marie"
dialogue
"Merci, Detective. ** Be… careful."
detectedLang
"en"
heavyLang
"en"
scores
en
0.7816593886462883
ro
0.6875
fr
0.684044233807267
tl
0.6569468267581475
it
0.6316758747697975
es
0.6303142329020333
ca
0.5670995670995671
pt
0.562363238512035
de
0.43342776203966005
cs
0.4269340974212034
sl
0.40476190476190477
hu
0.36908517350157727
lt
0.358974358974359
yo
0.3548387096774194
sq
0.3174061433447099
pl
0.30313588850174217
da
0.29577464788732394
nl
0.2907801418439716
no
0.2857142857142857
ms
0.25650557620817843
tr
0.25650557620817843
hr
0.250936329588015
sv
0.250936329588015
reliable
true
passes
false
16
name
"Hunter"
dialogue
"Always am. Stay safe, Marie."
detectedLang
"en"
heavyLang
"en"
scores
en
0.7820672478206725
ro
0.6391752577319588
de
0.5257452574525745
it
0.48224852071005914
fr
0.453125
no
0.453125
da
0.4479495268138801
sv
0.4479495268138801
hi
0.3320610687022901
tl
0.3055555555555556
hr
0.3
pt
0.29149797570850206
sl
0.29149797570850206
ca
0.2857142857142857
es
0.2768595041322314
lt
0.2768595041322314
pl
0.2768595041322314
et
0.2647058823529412
eu
0.2647058823529412
ms
0.2647058823529412
nl
0.2647058823529412
sk
0.2647058823529412
sq
0.2647058823529412
yo
0.2647058823529412
cs
0.25213675213675213
fi
0.25213675213675213
lv
0.25213675213675213
reliable
true
passes
true