NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-02-20-01KHXQ3BPZXFYXD6FG7TH9D9GC
Run Details
Model:
Mistral Large 3
Test:
Language Writing
Scenario:
Character dialogue (German) in a story
Duration:
18.1s
Cost:
$0.001431
Provider:
Mistral
Evaluation summary
Score
Evaluator
Details Link
100.00%
Parse dialogue
(details)
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Melanie"> Melanie is a 30-year old college student on a study abroad program. Born in Germany, she is fluent in German and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of German, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Melanie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in German, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Melanie and Hunter as a voice sheet: Melanie: "..." Hunter: "..."
Model response
Messages
Meta
AI
**Voice Sheet: Café Conversation** *(Melanie sits at a small outdoor table, her camera resting in her lap. She flips through the photos on the display, her brow furrowed. Hunter approaches, his expression serious but not unkind.)* **Hunter:** *(clears throat, standing a respectful distance away)* Excuse me, miss? Do you mind if I ask you a few questions? **Melanie:** *(startled, looks up, then relaxes slightly when she sees his badge)* Oh—ja? Äh… *you*… sprechen…? *(shakes head, frustrated)* Nein, nein, ich verstehe nicht. *(gestures to her camera, then to the street, voice trembling)* Ich war hier… fotografieren. Aber dann… *(trails off, hugs herself, eyes darting around nervously)* **Hunter:** *(frowns, rubbing the back of his neck)* Uh… okay. I’m sorry, I don’t—*(mimes taking a photo)* You were taking pictures? Near the festival grounds? **Melanie:** *(nods rapidly, then points toward the edge of town)* Ja! Die Äpfel… schön. Aber dann… *(shudders, lowers her voice)* Ich habe *etwas* gesehen. *(makes a vague, sweeping gesture with her hands, then clutches her camera tighter)* Die Schatten… sie haben *genommen*… *(whispers)* Die Frau. **Hunter:** *(leans in slightly, brow furrowed)* Taken? Someone was taken? *(mimes grabbing something, then points at her)* You saw this? **Melanie:** *(nods, eyes wide, then shakes her head violently)* Nein, nein—nicht *ich*! Ich habe *nur*… *(taps her camera)* Die Bilder. Aber sie ist *weg*. *(mimes something vanishing, then hugs herself again)* Und die Polizei… sie *glauben* mir nicht. **Hunter:** *(pulls out a small notepad, flips it open, then hesitates, realizing the language barrier)* Look, I *want* to help, but—*(sighs, then points to her camera)* Can I see the pictures? **Melanie:** *(hesitates, then nods, handing over the camera. She watches anxiously as he scrolls through the images, her fingers twisting together.)* Da… da ist sie. *(points to a blurry figure in the background of a photo)* Und dann… *(scrolls to the next one, where the figure is gone)* *Weg*. **Hunter:** *(studies the photos, then looks up at her, voice low)* This was near the old orchard, right? By the train tracks? **Melanie:** *(nods, relieved he understands, then her face falls)* Aber… *(points to her ears, then shakes her head)* Ich kann nicht… *sprechen*… mit Ihnen. **Hunter:** *(grits his teeth, then pulls out his phone, opening a translation app. He types slowly, then shows her the screen: "I will find out what happened. Stay safe.")* **Melanie:** *(reads it, then looks up at him, eyes glistening. She nods, then whispers)* Danke… *bitte*. *(points to the camera)* Ich… ich zeige Ihnen mehr. Morgen? **Hunter:** *(nods, then his phone rings. He glances at the screen, then back at her, holding up a finger)* One second. *(answers the call, listens, then sighs, pinching the bridge of his nose)* Yeah, I’m on my way. *(hangs up, then turns back to her, pointing to himself, then in the direction of the station)* I have to go. But I’ll be back. *(mimes writing, then points to her)* Stay here. I’ll send someone who speaks German. **Melanie:** *(nods, then watches as he hurries off, her grip tightening on her camera. She whispers to herself in German)* *Bitte lass es gut enden…*
created_at
"2026-02-20T14:26:13.866Z"
2/20/2026, 2:26:13 PM
model
"mistralai/mistral-large-2512"
1/1/2512, 12:00:00 AM
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
408
moderation_latency
(null)
generation_time
17997
tokens_prompt
319
tokens_completion
862
native_tokens_prompt
273
native_tokens_completion
863
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.001431
router
(null)
provider_responses
0
endpoint_id
"fa718841-07ea-4b7e-b8a3-6069545c7e6a"
id
"6571d663b38d4097af1eb590a11b71b6"
is_byok
false
latency
408
model_permaslug
"mistralai/mistral-large-2512"
1/1/2512, 12:00:00 AM
provider_name
"Mistral"
status
200
api_type
"completions"
id
"gen-1771597573-1v5eijZuBXg30LgT17TG"
upstream_id
"6571d663b38d4097af1eb590a11b71b6"
total_cost
0.001431
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Mistral"
Evaluation details
Result
Evaluator
Details
Meta Data
100.00%
Parse dialogue
n/a
dialogue
0
name
"Hunter"
dialogue
"Excuse me, miss? Do you mind if I ask you a few questions?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.7949699289229087
pt
0.5980707395498392
fr
0.5972073039742213
it
0.5941558441558442
sq
0.5567375886524822
cs
0.5443499392466585
tl
0.5341614906832298
ca
0.5259165613147914
pl
0.4993324432576769
hr
0.4973190348525469
sk
0.4710860366713681
hu
0.4533527696793003
es
0.45255474452554745
et
0.4517543859649123
no
0.44933920704845814
sv
0.44526627218934917
sl
0.4427934621099554
yo
0.43095599393019723
nl
0.4038155802861685
vi
0.39418416801292405
ro
0.37913907284768217
da
0.36006825938566556
ms
0.2816091954022989
tr
0.2816091954022989
lt
0.27884615384615385
fi
0.2690058479532163
is
0.2690058479532163
az
0.2618110236220473
lv
0.2618110236220473
be
0.15730337078651685
eu
0.15730337078651685
de
0.1515837104072398
uk
0.14383561643835618
reliable
true
passes
true
1
name
"Melanie"
dialogue
"Oh—ja? Äh… you… sprechen…? Nein, nein, ich verstehe nicht. Ich war hier… fotografieren. Aber dann…"
detectedLang
"de"
heavyLang
"de"
scores
de
0.8020158387329014
nl
0.5904690990320178
ca
0.46341463414634143
da
0.4532803180914513
en
0.448345035105316
sk
0.42528735632183906
no
0.4073275862068965
sv
0.394273127753304
sl
0.37286202964652226
pl
0.36562860438292966
cs
0.36194895591647336
lt
0.3475682087781732
et
0.3341404358353511
sq
0.32844932844932845
it
0.3268053855569155
es
0.3251533742331288
ro
0.32182490752157833
lv
0.301143583227446
tr
0.2857142857142857
hr
0.2801047120418848
fr
0.2763157894736842
pt
0.25170068027210885
fi
0.21763869132290184
is
0.19825072886297376
az
0.17664670658682635
eu
0.16158536585365854
tl
0.12420382165605094
yo
0.12
hu
0.11575562700964631
ms
0.09688013136288999
reliable
true
passes
true
2
name
"Hunter"
dialogue
"Uh… okay. I’m sorry, I don’t— You were taking pictures? Near the festival grounds?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.7900693683826214
tl
0.7231584015406837
fr
0.5224252491694352
no
0.5043103448275862
sv
0.4911504424778761
ca
0.47199265381083566
da
0.4529019980970504
nl
0.4351669941060904
it
0.4180161943319838
sq
0.4180161943319838
pt
0.3928194297782471
cs
0.39153439153439157
ro
0.3850267379679145
et
0.38105489773950485
hr
0.37158469945355194
pl
0.339080459770115
sk
0.31220095693779903
sl
0.3097238895558223
ms
0.3088942307692307
de
0.27854454203262236
lv
0.26658163265306123
yo
0.25227568270481143
lt
0.24738219895287958
es
0.2414248021108179
az
0.23941798941798942
tr
0.213406292749658
fi
0.1991643454038997
hu
0.18899858956276447
is
0.18899858956276447
be
0.10852713178294573
uk
0.0987460815047022
vi
0.0987460815047022
reliable
true
passes
true
3
name
"Melanie"
dialogue
"Ja! Die Äpfel… schön. Aber dann… Ich habe etwas gesehen. Die Schatten… sie haben genommen… Die Frau."
detectedLang
"de"
heavyLang
"de"
scores
de
0.8316498316498316
nl
0.5260663507109005
sv
0.4800693240901213
da
0.470432480141218
no
0.3890020366598778
fi
0.36642027455121434
sk
0.33920704845814975
pl
0.33847850055126794
ca
0.2376111817026684
es
0.2277992277992278
tr
0.21671018276762402
yo
0.21363040629095675
it
0.21052631578947367
en
0.20844327176781002
et
0.20424403183023873
eu
0.16083916083916083
lv
0.16083916083916083
sl
0.11764705882352942
sq
0.1111111111111111
reliable
true
passes
true
4
name
"Hunter"
dialogue
"Taken? Someone was taken? You saw this?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8283261802575107
nl
0.562363238512035
tl
0.4708994708994709
de
0.3730407523510972
ms
0.3333333333333333
no
0.3288590604026846
sv
0.30313588850174217
yo
0.30313588850174217
cs
0.2805755395683453
es
0.2805755395683453
pt
0.2805755395683453
sk
0.2805755395683453
sl
0.2805755395683453
reliable
true
passes
true
5
name
"Melanie"
dialogue
"Nein, nein—nicht ich! Ich habe nur… Die Bilder. Aber sie ist weg. Und die Polizei… sie glauben mir nicht."
detectedLang
"de"
heavyLang
"de"
scores
de
0.848629700446144
nl
0.5569029850746269
pl
0.39873417721518983
no
0.37335092348284965
sv
0.35983827493261455
tr
0.35983827493261455
sk
0.3065693430656934
da
0.3014705882352941
az
0.2931547619047619
eu
0.2931547619047619
cs
0.28678678678678676
ro
0.2857142857142857
hr
0.2835595776772248
ms
0.2770167427701674
en
0.2647058823529412
hi
0.18244406196213425
sl
0.1607773851590106
et
0.15780141843971632
lv
0.15780141843971632
yo
0.15630550621669628
lt
0.15480427046263345
it
0.1532976827094474
fi
0.15026833631484796
fr
0.14721723518850988
sq
0.14721723518850988
es
0.13636363636363635
hu
0.13636363636363635
tl
0.13636363636363635
ru
0.13479052823315119
ca
0.1316270566727605
pt
0.12844036697247707
reliable
true
passes
true
6
name
"Hunter"
dialogue
"Look, I want to help, but— Can I see the pictures?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8331479421579534
tl
0.6235884567126726
no
0.5839112343966713
da
0.5670995670995671
ca
0.5620437956204379
fr
0.5440729483282675
et
0.5245641838351823
yo
0.5245641838351823
sv
0.4897959183673469
nl
0.48805460750853247
lv
0.471830985915493
pl
0.46524064171123
hr
0.4594594594594595
ro
0.44649446494464945
cs
0.44029850746268656
sq
0.4140625
sk
0.40476190476190477
lt
0.3576017130620985
tr
0.3288590604026846
az
0.3181818181818182
sl
0.28741092636579574
it
0.27710843373493976
ms
0.20634920634920634
de
0.1935483870967742
be
0.1891891891891892
hu
0.18256130790190736
is
0.17355371900826447
uk
0.17355371900826447
vi
0.17355371900826447
reliable
true
passes
true
7
name
"Melanie"
dialogue
"Da… da ist sie. Und dann… Weg."
detectedLang
"de"
heavyLang
"de"
scores
de
0.8564593301435407
tr
0.5652173913043478
pl
0.5384615384615384
nl
0.46428571428571425
pt
0.45652173913043476
eu
0.45255474452554745
sl
0.45054945054945056
hr
0.44029850746268656
it
0.4186046511627907
az
0.4140625
hi
0.4140625
da
0.375
no
0.3723849372384937
yo
0.3333333333333333
ro
0.3087557603686636
es
0.29577464788732394
tl
0.29577464788732394
vi
0.29577464788732394
reliable
true
passes
true
8
name
"Hunter"
dialogue
"This was near the old orchard, right? By the train tracks?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8222447943118334
tl
0.6615087040618954
fr
0.5867768595041323
nl
0.5231607629427792
de
0.5063469675599436
yo
0.4336569579288026
no
0.41077441077441074
da
0.40476190476190477
sk
0.279835390946502
cs
0.2723492723492723
eu
0.2584745762711864
pl
0.25213675213675213
ca
0.23076923076923078
ro
0.20634920634920634
ms
0.1822429906542056
sq
0.1822429906542056
sv
0.1822429906542056
it
0.18032786885245902
reliable
true
passes
true
9
name
"Melanie"
dialogue
"Aber… Ich kann nicht… sprechen… mit Ihnen."
detectedLang
"de"
heavyLang
"de"
scores
de
0.8532550693703308
da
0.4670542635658915
nl
0.44668008048289737
sk
0.4123931623931624
no
0.36046511627906974
is
0.3483412322274882
pl
0.2948717948717949
sl
0.2857142857142857
sv
0.27821522309711283
cs
0.26666666666666666
lt
0.24657534246575344
hu
0.24242424242424243
hr
0.21875
en
0.2005813953488372
it
0.2005813953488372
reliable
true
passes
true
10
name
"Melanie"
dialogue
"Danke… bitte. Ich… ich zeige Ihnen mehr. Morgen?"
detectedLang
"de"
heavyLang
"de"
scores
de
0.8216409036860879
nl
0.5305164319248826
no
0.5253164556962026
da
0.5245641838351823
sk
0.4791666666666667
sv
0.4371482176360225
pl
0.27710843373493976
et
0.2736077481840194
is
0.24050632911392408
hr
0.23857868020304565
sl
0.23857868020304565
es
0.2
it
0.2
reliable
true
passes
true
11
name
"Hunter"
dialogue
"One second. Yeah, I’m on my way. I have to go. But I’ll be back. Stay here. I’ll send someone who speaks German."
detectedLang
"en"
heavyLang
"en"
scores
en
0.820335373968592
tl
0.6564885496183207
pl
0.4835501147666412
yo
0.4186046511627907
hr
0.3891402714932127
cs
0.3703358208955224
da
0.36619718309859156
fr
0.3515850144092219
sk
0.3509615384615385
et
0.3452958292919496
ro
0.32567432567432564
ca
0.32228915662650603
it
0.31749241658240646
sq
0.3105209397344229
lt
0.29245283018867924
no
0.27341227125941875
sv
0.23556058890147225
lv
0.21511627906976746
hu
0.21420256111757857
nl
0.1847826086956522
fi
0.1818181818181818
es
0.17982989064398544
tr
0.17177914110429449
az
0.1646039603960396
sl
0.1520100502512563
hi
0.11067193675889328
pt
0.10358565737051792
de
0.09999999999999999
be
0.09395973154362416
ms
0.09395973154362416
is
0.08536585365853659
uk
0.08536585365853659
vi
0.08536585365853659
reliable
true
passes
true
12
name
"Melanie"
dialogue
"Bitte lass es gut enden…"
detectedLang
"de"
heavyLang
"de"
scores
de
0.8042505592841164
da
0.622844827586207
no
0.5882352941176471
es
0.5646766169154229
ca
0.5591939546599496
nl
0.5466321243523317
hu
0.5406824146981627
tr
0.40878378378378377
lv
0.4067796610169492
et
0.39236111111111116
sv
0.36823104693140796
lt
0.34210526315789475
sq
0.3137254901960784
en
0.3
it
0.3
pt
0.3
reliable
true
passes
true