NC Bench
Overview
About
Tests
Models
Vendors
Run: 2026-02-20-01KHXQC1HYQ53NXXKCJ2TSY85S
Run Details
Model:
Mistral Large 3
Test:
Language Writing
Scenario:
Character dialogue (French) in a story
Duration:
19.5s
Cost:
$0.001635
Provider:
Mistral
Evaluation summary
Score
Evaluator
Details Link
81.82%
Parse dialogue
(details)
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Marie"> Marie is a 30-year old college student on a study abroad program. Born in France, she is fluent in French and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of French, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Marie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in French, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Marie and Hunter as a voice sheet: Marie: "..." Hunter: "..."
Model response
Messages
Meta
AI
**Voice Sheet: Café Conversation in Alborn, MN** *(Marie sits at a small wrought-iron table outside the café, her fingers tracing the edges of her camera. The late afternoon sun casts long shadows across the cobblestone street. Hunter approaches, his boots scuffing lightly against the pavement. He adjusts his jacket, his expression serious but not unkind.)* **Hunter:** *(clears throat, speaking slowly and clearly, as if volume alone might bridge the language gap)* Excuse me, miss. I’m Detective Hunter. I was wondering if I could ask you a few questions about the… recent events in town. **Marie:** *(looks up sharply, her dark eyes wide. She clutches her camera tighter, her knuckles whitening. Her voice is soft but urgent, the words tumbling out in rapid French)* Oh, mon Dieu… Vous êtes de la police ? Je… je ne sais pas quoi dire. J’ai vu quelque chose, mais je ne comprends pas. Les gens disparaissent, n’est-ce pas ? *(She shakes her head, her breath hitching.)* C’est comme un cauchemar. Hier soir, près de la vieille grange—j’y étais pour prendre des photos du coucher de soleil. Et puis… *(she swallows hard, her voice dropping to a whisper)* j’ai entendu des bruits. Comme des pas, mais trop lourds. Et puis plus rien. Juste… le silence. **Hunter:** *(frowns, rubbing the back of his neck. He catches the words "police" and "disparaissent," but the rest is lost on him. He tries again, gesturing vaguely toward the street.)* Uh… you saw something? Near the old barn? *(He points in the general direction of the outskirts of town.)* Can you… show me? On a map, maybe? **Marie:** *(shakes her head, frustrated. She flips open her camera and scrolls through the photos, then turns the screen toward him. The images are beautiful—golden fields, a crimson sunset, the skeletal frame of the old barn. But then she stops on one: a dark shape in the distance, barely more than a smudge against the trees. She points at it, her finger trembling.)* Là. Je ne sais pas ce que c’est. Mais après ça, j’ai couru. *(She mimes running, then hugs herself, her shoulders tense.)* Je ne veux pas y retourner. **Hunter:** *(studies the photo, his jaw tightening. He doesn’t understand her words, but the fear in her voice is unmistakable. He pulls out his notepad and sketches a quick map of the area, pointing to the barn and then to her.)* You were here? *(He taps the barn on the map.)* And you saw… *(he gestures at the photo, then shrugs helplessly, miming confusion.)* Something? **Marie:** *(nods vigorously, then sighs, switching to halting, heavily accented English—her first attempt at the language.)* Oui. Yes. I… see… *(she struggles for the word, then points at the photo again)* shadow. Big. Not… personne. *(She shakes her head, frustrated with herself.)* Not person. **Hunter:** *(blinks, surprised by the English. He leans in slightly, as if proximity might help.)* A shadow? Like… a person? Or— *(His phone rings abruptly, cutting him off. He glances at the screen, his expression darkening. He holds up a finger to Marie.)* Sorry, I gotta take this. *(He steps away, answering the call in a low voice.)* Hunter. **Marie:** *(watches him go, her fingers tightening around her camera again. She exhales shakily, murmuring to herself in French.)* Qu’est-ce qui se passe dans cette ville ? *(Hunter ends the call and turns back to her, his expression grim. He pockets his phone and gives her an apologetic nod.)* **Hunter:** I’ve gotta go. But… *(he hesitates, then pulls a business card from his wallet and hands it to her. He points to the number, then to her.)* If you remember anything else—anything at all—call me. *(He mimes holding a phone to his ear.)* Okay? **Marie:** *(takes the card, studying it. She nods, then offers a small, uncertain smile.)* Merci. Thank you. **Hunter:** *(gives her a curt nod, then turns to leave, his stride quickening as he heads toward his car. Marie watches him go, then looks down at the photo on her camera again, her brow furrowed.)* *(Fade out.)*
created_at
"2026-02-20T14:30:58.379Z"
2/20/2026, 2:30:58 PM
model
"mistralai/mistral-large-2512"
1/1/2512, 12:00:00 AM
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
396
moderation_latency
(null)
generation_time
19452
tokens_prompt
316
tokens_completion
1055
native_tokens_prompt
269
native_tokens_completion
1000
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.0016345
router
(null)
provider_responses
0
endpoint_id
"fa718841-07ea-4b7e-b8a3-6069545c7e6a"
id
"75c5d190b28544e1a3eaca2235dbb0b5"
is_byok
false
latency
396
model_permaslug
"mistralai/mistral-large-2512"
1/1/2512, 12:00:00 AM
provider_name
"Mistral"
status
200
api_type
"completions"
id
"gen-1771597858-ii60e3Ok4ZrQOTpIuuHZ"
upstream_id
"75c5d190b28544e1a3eaca2235dbb0b5"
total_cost
0.0016345
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Mistral"
Evaluation details
Result
Evaluator
Details
Meta Data
81.82%
Parse dialogue
n/a
dialogue
0
name
"Hunter"
dialogue
"** Excuse me, miss. I’m Detective Hunter. I was wondering if I could ask you a few questions about the… recent events in town."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8177083333333334
tl
0.626228107646305
nl
0.6033544877606528
fr
0.5949074074074074
it
0.5533435426237876
sv
0.5267712276906436
ca
0.5144284128745839
ro
0.5092540661805945
da
0.4868035190615836
no
0.4852941176470589
pt
0.48377581120943947
de
0.42847811887655124
es
0.41783100465735196
sq
0.4002741603838246
cs
0.37810945273631835
sl
0.3732091690544413
yo
0.35803374908290536
ms
0.3401206636500754
pl
0.30500397140587765
hr
0.303343949044586
sk
0.28687856560717195
lv
0.2081447963800905
hu
0.20309653916211293
et
0.20164233576642335
az
0.19871794871794873
lt
0.19205909510618652
tr
0.19056429232192415
fi
0.1362290227048371
is
0.1362290227048371
vi
0.13194444444444445
be
0.07407407407407407
eu
0.07407407407407407
uk
0.06716417910447761
reliable
true
passes
true
1
name
"Marie"
dialogue
"** j’ai entendu des bruits. Comme des pas, mais trop lourds. Et puis plus rien. Juste… le silence."
detectedLang
"fr"
heavyLang
"fr"
scores
fr
0.8094764744864149
ca
0.5135363790186125
pt
0.5013009540329575
en
0.44764649375600385
da
0.4471153846153846
no
0.42557442557442554
et
0.42384769539078154
nl
0.4226907630522089
es
0.37837837837837834
it
0.36743674367436746
tl
0.36252771618625274
ro
0.3179122182680902
cs
0.2866004962779156
de
0.25902061855670105
sl
0.25032594524119944
sq
0.2493472584856397
yo
0.24738219895287958
eu
0.2374005305039788
ms
0.20798898071625344
sv
0.1935483870967742
tr
0.19241573033707865
sk
0.1581259150805271
hu
0.14561664190193166
lt
0.13663663663663664
lv
0.1043613707165109
reliable
true
passes
true
2
name
"Hunter"
dialogue
"** Can you… show me? On a map, maybe?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8207171314741035
tl
0.5989304812834225
fr
0.584870848708487
ca
0.5810055865921787
et
0.5810055865921787
pt
0.5754716981132075
fi
0.5614035087719298
cs
0.5588235294117647
es
0.5098039215686274
nl
0.506578947368421
sq
0.4943820224719101
it
0.47674418604651164
sk
0.47674418604651164
hr
0.47058823529411764
yo
0.4630071599045346
pl
0.45652173913043476
sl
0.44168734491315137
no
0.41709844559585496
hu
0.4094488188976378
tr
0.4063324538258575
az
0.3951612903225807
ms
0.3951612903225807
ro
0.3818681318681319
hi
0.27184466019417475
lt
0.267100977198697
is
0.25
da
0.24242424242424243
eu
0.23728813559322032
lv
0.23728813559322032
vi
0.23728813559322032
de
0.22945205479452058
sv
0.21875
reliable
true
passes
true
3
name
"Marie"
dialogue
"** Je ne veux pas y retourner."
detectedLang
"fr"
heavyLang
"fr"
scores
fr
0.8114985862393967
sl
0.6007984031936128
hr
0.5867768595041323
es
0.5565410199556541
ca
0.5454545454545454
sq
0.54337899543379
cs
0.5337995337995338
nl
0.5203836930455635
lt
0.5024875621890548
pl
0.494949494949495
yo
0.4490358126721763
de
0.43820224719101125
sk
0.42028985507246375
lv
0.33993399339933994
ro
0.33774834437086093
vi
0.3288590604026846
tr
0.3197278911564626
fi
0.3055555555555556
it
0.3055555555555556
pt
0.30313588850174217
ms
0.29577464788732394
hu
0.2907801418439716
da
0.2753623188405797
en
0.2753623188405797
no
0.2753623188405797
reliable
true
passes
true
4
name
"Hunter"
dialogue
"** Something?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.821852731591449
tl
0.5562130177514794
es
0.5098039215686274
ms
0.5098039215686274
pt
0.5098039215686274
reliable
true
passes
true
5
name
"Marie"
dialogue
"** Not person."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8010610079575596
tl
0.7422680412371134
sv
0.6900826446280992
no
0.6781115879828327
da
0.663677130044843
sq
0.663677130044843
de
0.660633484162896
tr
0.6590909090909091
pt
0.647887323943662
is
0.6411483253588517
ca
0.5454545454545454
es
0.5398773006134969
it
0.5398773006134969
ms
0.5398773006134969
fr
0.5283018867924528
ro
0.5283018867924528
lv
0.5
nl
0.5
lt
0.4897959183673469
hu
0.45652173913043476
az
0.44029850746268656
cs
0.44029850746268656
et
0.44029850746268656
hr
0.44029850746268656
pl
0.44029850746268656
sk
0.44029850746268656
reliable
true
passes
false
6
name
"Hunter"
dialogue
"** A shadow? Like… a person? Or—"
detectedLang
"en"
heavyLang
"en"
scores
en
0.766977363515313
no
0.6685606060606061
tl
0.6300211416490487
fr
0.6145374449339206
pt
0.6136865342163355
sv
0.5679012345679012
ca
0.5635910224438903
ro
0.5603015075376884
da
0.5569620253164557
es
0.5569620253164557
sq
0.5569620253164557
hu
0.5558375634517766
de
0.5489690721649484
it
0.5489690721649484
is
0.5442708333333333
cs
0.5218579234972678
sk
0.5192307692307693
hr
0.4942196531791907
pl
0.48377581120943947
lt
0.46808510638297873
ms
0.4631901840490798
lv
0.453125
nl
0.453125
tr
0.4514106583072101
az
0.42434210526315785
et
0.41077441077441074
yo
0.40476190476190477
sl
0.33962264150943394
eu
0.2857142857142857
vi
0.2857142857142857
fi
0.2647058823529412
reliable
true
passes
true
7
name
"Marie"
dialogue
"** Qu’est-ce qui se passe dans cette ville ?"
detectedLang
"fr"
heavyLang
"fr"
scores
fr
0.8266666666666667
da
0.6772591857000994
it
0.6575342465753424
no
0.6260069044879172
ca
0.5784695201037613
sv
0.5535714285714286
et
0.4984567901234568
de
0.496124031007752
pt
0.4857594936708861
fi
0.4749596122778676
ro
0.44539249146757676
en
0.40909090909090906
nl
0.4080145719489982
es
0.38095238095238093
sq
0.3602362204724409
hu
0.358974358974359
tl
0.3200836820083682
cs
0.29501084598698485
hr
0.2903930131004367
sl
0.28884026258205686
is
0.282560706401766
yo
0.2476851851851852
tr
0.20147420147420148
ms
0.16666666666666666
reliable
true
passes
true
8
name
"Hunter"
dialogue
"I’ve gotta go. But… ** Okay?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.7278382581648523
tl
0.6728971962616822
it
0.5308310991957105
fi
0.3902439024390244
hu
0.38162544169611307
pl
0.38162544169611307
fr
0.3346007604562738
sv
0.3055555555555556
yo
0.3055555555555556
reliable
true
passes
true
9
name
"Marie"
dialogue
"** Merci. Thank you."
detectedLang
"en"
heavyLang
"en"
scores
en
0.7714808043875686
it
0.576271186440678
fr
0.5674740484429065
cs
0.5535714285714286
tl
0.5404411764705882
vi
0.5370370370370371
es
0.410377358490566
pl
0.410377358490566
pt
0.410377358490566
ca
0.3961352657004831
de
0.3556701030927836
ms
0.3556701030927836
sl
0.3556701030927836
tr
0.3556701030927836
reliable
true
passes
false
10
name
"Hunter"
dialogue
"**"
detectedLang
""
heavyLang
""
scores
reliable
false
passes
true