NC Bench
Overview
About
Tests
Models
Vendors
Run: 2026-02-20-01KHXQ3BPZXFYXD6FG7TH9D9GC
Run Details
Model:
Mistral Large 3
Test:
Language Writing
Scenario:
Character dialogue (German) in a story
Duration:
18.1s
Cost:
$0.001431
Provider:
Mistral
Evaluation summary
Score
Evaluator
Details Link
100.00%
Parse dialogue
(details)
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Melanie"> Melanie is a 30-year old college student on a study abroad program. Born in Germany, she is fluent in German and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of German, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Melanie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in German, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Melanie and Hunter as a voice sheet: Melanie: "..." Hunter: "..."
Model response
Messages
Meta
AI
**Voice Sheet: Café Conversation** *(Melanie sits at a small outdoor table, her camera resting in her lap. She flips through the photos on the display, her brow furrowed. Hunter approaches, his expression serious but not unkind.)* **Hunter:** *(clears throat, standing a respectful distance away)* Excuse me, miss? Do you mind if I ask you a few questions? **Melanie:** *(startled, looks up, then relaxes slightly when she sees his badge)* Oh—ja? Äh… *you*… sprechen…? *(shakes head, frustrated)* Nein, nein, ich verstehe nicht. *(gestures to her camera, then to the street, voice trembling)* Ich war hier… fotografieren. Aber dann… *(trails off, hugs herself, eyes darting around nervously)* **Hunter:** *(frowns, rubbing the back of his neck)* Uh… okay. I’m sorry, I don’t—*(mimes taking a photo)* You were taking pictures? Near the festival grounds? **Melanie:** *(nods rapidly, then points toward the edge of town)* Ja! Die Äpfel… schön. Aber dann… *(shudders, lowers her voice)* Ich habe *etwas* gesehen. *(makes a vague, sweeping gesture with her hands, then clutches her camera tighter)* Die Schatten… sie haben *genommen*… *(whispers)* Die Frau. **Hunter:** *(leans in slightly, brow furrowed)* Taken? Someone was taken? *(mimes grabbing something, then points at her)* You saw this? **Melanie:** *(nods, eyes wide, then shakes her head violently)* Nein, nein—nicht *ich*! Ich habe *nur*… *(taps her camera)* Die Bilder. Aber sie ist *weg*. *(mimes something vanishing, then hugs herself again)* Und die Polizei… sie *glauben* mir nicht. **Hunter:** *(pulls out a small notepad, flips it open, then hesitates, realizing the language barrier)* Look, I *want* to help, but—*(sighs, then points to her camera)* Can I see the pictures? **Melanie:** *(hesitates, then nods, handing over the camera. She watches anxiously as he scrolls through the images, her fingers twisting together.)* Da… da ist sie. *(points to a blurry figure in the background of a photo)* Und dann… *(scrolls to the next one, where the figure is gone)* *Weg*. **Hunter:** *(studies the photos, then looks up at her, voice low)* This was near the old orchard, right? By the train tracks? **Melanie:** *(nods, relieved he understands, then her face falls)* Aber… *(points to her ears, then shakes her head)* Ich kann nicht… *sprechen*… mit Ihnen. **Hunter:** *(grits his teeth, then pulls out his phone, opening a translation app. He types slowly, then shows her the screen: "I will find out what happened. Stay safe.")* **Melanie:** *(reads it, then looks up at him, eyes glistening. She nods, then whispers)* Danke… *bitte*. *(points to the camera)* Ich… ich zeige Ihnen mehr. Morgen? **Hunter:** *(nods, then his phone rings. He glances at the screen, then back at her, holding up a finger)* One second. *(answers the call, listens, then sighs, pinching the bridge of his nose)* Yeah, I’m on my way. *(hangs up, then turns back to her, pointing to himself, then in the direction of the station)* I have to go. But I’ll be back. *(mimes writing, then points to her)* Stay here. I’ll send someone who speaks German. **Melanie:** *(nods, then watches as he hurries off, her grip tightening on her camera. She whispers to herself in German)* *Bitte lass es gut enden…*
created_at
"2026-02-20T14:26:13.866Z"
2/20/2026, 2:26:13 PM
model
"mistralai/mistral-large-2512"
1/1/2512, 12:00:00 AM
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
408
moderation_latency
(null)
generation_time
17997
tokens_prompt
319
tokens_completion
862
native_tokens_prompt
273
native_tokens_completion
863
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.001431
router
(null)
provider_responses
0
endpoint_id
"fa718841-07ea-4b7e-b8a3-6069545c7e6a"
id
"6571d663b38d4097af1eb590a11b71b6"
is_byok
false
latency
408
model_permaslug
"mistralai/mistral-large-2512"
1/1/2512, 12:00:00 AM
provider_name
"Mistral"
status
200
api_type
"completions"
id
"gen-1771597573-1v5eijZuBXg30LgT17TG"
upstream_id
"6571d663b38d4097af1eb590a11b71b6"
total_cost
0.001431
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Mistral"
Evaluation details
Result
Evaluator
Details
Meta Data
100.00%
Parse dialogue
n/a
dialogue
0
name
"Hunter"
dialogue
"** Excuse me, miss? Do you mind if I ask you a few questions?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.7949699289229087
pt
0.5980707395498392
fr
0.5972073039742213
it
0.5941558441558442
sq
0.5567375886524822
cs
0.5443499392466585
tl
0.5341614906832298
ca
0.5259165613147914
pl
0.4993324432576769
hr
0.4973190348525469
sk
0.4710860366713681
hu
0.4533527696793003
es
0.45255474452554745
et
0.4517543859649123
no
0.44933920704845814
sv
0.44526627218934917
sl
0.4427934621099554
yo
0.43095599393019723
nl
0.4038155802861685
vi
0.39418416801292405
ro
0.37913907284768217
da
0.36006825938566556
ms
0.2816091954022989
tr
0.2816091954022989
lt
0.27884615384615385
fi
0.2690058479532163
is
0.2690058479532163
az
0.2618110236220473
lv
0.2618110236220473
be
0.15730337078651685
eu
0.15730337078651685
de
0.1515837104072398
uk
0.14383561643835618
reliable
true
passes
true
1
name
"Melanie"
dialogue
"*you*"
detectedLang
"en"
heavyLang
"en"
scores
en
0.84472049689441
cs
0.7572815533980582
tl
0.7572815533980582
reliable
false
passes
true
2
name
"Hunter"
dialogue
"** You were taking pictures? Near the festival grounds?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8071625344352616
tl
0.7133497133497133
fr
0.6424923391215526
nl
0.5586380832282472
no
0.5569620253164557
sv
0.5436766623207301
ca
0.5179063360881543
da
0.4905385735080059
et
0.453978159126365
sq
0.44356120826709056
pt
0.4372990353697749
ro
0.43548387096774194
cs
0.4308943089430894
sl
0.42434210526315785
ms
0.4233937397034596
de
0.38811188811188807
hr
0.36479128856624315
it
0.3613138686131387
sk
0.35064935064935066
es
0.3433395872420263
pl
0.325626204238921
lv
0.29435483870967744
fi
0.29006085192697767
lt
0.2647058823529412
az
0.25213675213675213
yo
0.23413566739606126
tr
0.19724770642201836
is
0.16864608076009502
hu
0.1606714628297362
reliable
true
passes
true
3
name
"Melanie"
dialogue
"*etwasgenommen* Die Frau."
detectedLang
"de"
heavyLang
"de"
scores
de
0.7928176795580111
nl
0.6993987975951904
da
0.4318181818181818
no
0.42528735632183906
yo
0.3697478991596639
sv
0.3644067796610169
reliable
true
passes
true
4
name
"Hunter"
dialogue
"** You saw this?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8459958932238193
tl
0.7035573122529644
ms
0.5714285714285714
cs
0.5098039215686274
reliable
true
passes
true
5
name
"Melanie"
dialogue
"*ichnurwegglauben* mir nicht."
detectedLang
"de"
heavyLang
"de"
scores
de
0.7518610421836228
nl
0.42028985507246375
cs
0.3333333333333333
hr
0.3333333333333333
reliable
true
passes
true
6
name
"Hunter"
dialogue
"*want* Can I see the pictures?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8260869565217391
ca
0.6581196581196581
et
0.623352165725047
tl
0.623352165725047
no
0.609375
da
0.591002044989775
sv
0.5901639344262295
nl
0.588477366255144
fr
0.574468085106383
ro
0.5475113122171946
sq
0.5145631067961165
yo
0.49238578680203043
tr
0.42363112391930835
lv
0.42196531791907516
az
0.4117647058823529
hr
0.41002949852507375
pl
0.38650306748466257
it
0.36507936507936506
cs
0.3442622950819672
ms
0.2805755395683453
de
0.2647058823529412
sk
0.2647058823529412
be
0.25925925925925924
hu
0.250936329588015
is
0.23954372623574144
lt
0.23954372623574144
uk
0.23954372623574144
vi
0.23954372623574144
reliable
true
passes
true
7
name
"Melanie"
dialogue
"*Weg*."
detectedLang
"nl"
heavyLang
"nl"
scores
nl
0.8387096774193549
de
0.8275862068965517
reliable
false
passes
true
8
name
"Hunter"
dialogue
"** This was near the old orchard, right? By the train tracks?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8222447943118334
tl
0.6615087040618954
fr
0.5867768595041323
nl
0.5231607629427792
de
0.5063469675599436
yo
0.4336569579288026
no
0.41077441077441074
da
0.40476190476190477
sk
0.279835390946502
cs
0.2723492723492723
eu
0.2584745762711864
pl
0.25213675213675213
ca
0.23076923076923078
ro
0.20634920634920634
ms
0.1822429906542056
sq
0.1822429906542056
sv
0.1822429906542056
it
0.18032786885245902
reliable
true
passes
true
9
name
"Melanie"
dialogue
"*sprechen*… mit Ihnen."
detectedLang
"de"
heavyLang
"de"
scores
de
0.8432601880877743
da
0.6163682864450128
sl
0.4230769230769231
sv
0.4140625
lt
0.375
hu
0.3697478991596639
hr
0.33920704845814975
nl
0.33920704845814975
no
0.33920704845814975
en
0.3150684931506849
is
0.3150684931506849
it
0.3150684931506849
sk
0.3150684931506849
reliable
true
passes
true
10
name
"Hunter"
dialogue
"**"
detectedLang
""
heavyLang
""
scores
reliable
false
passes
true
11
name
"Melanie"
dialogue
"*bitte* Ich… ich zeige Ihnen mehr. Morgen?"
detectedLang
"de"
heavyLang
"de"
scores
de
0.831081081081081
nl
0.5107632093933464
no
0.5078740157480316
da
0.5069033530571991
sv
0.38875305623471884
sk
0.3315508021390375
pl
0.3150684931506849
et
0.3112947658402204
is
0.2753623188405797
es
0.23076923076923078
it
0.23076923076923078
reliable
true
passes
true
12
name
"Hunter"
dialogue
"** Stay here. I’ll send someone who speaks German."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8148148148148148
tl
0.5405819295558958
sq
0.3617021276595745
ro
0.3492407809110629
es
0.33035714285714285
et
0.31662870159453305
ca
0.21875
it
0.21875
nl
0.20634920634920634
pt
0.20634920634920634
de
0.2
az
0.1891891891891892
ms
0.1891891891891892
sv
0.1891891891891892
tr
0.1891891891891892
reliable
true
passes
true
13
name
"Melanie"
dialogue
"*Bitte lass es gut enden…*"
detectedLang
"de"
heavyLang
"de"
scores
de
0.8042505592841164
da
0.622844827586207
no
0.5882352941176471
es
0.5646766169154229
ca
0.5591939546599496
nl
0.5466321243523317
hu
0.5406824146981627
tr
0.40878378378378377
lv
0.4067796610169492
et
0.39236111111111116
sv
0.36823104693140796
lt
0.34210526315789475
sq
0.3137254901960784
en
0.3
it
0.3
pt
0.3
reliable
true
passes
true