NC Bench
Overview
About
Tests
Models
Vendors
Run: 2026-02-20-01KHXPCC6JZ1YJN30PJVDH0EJH
Run Details
Model:
Mistral Large 3
Test:
Language Writing
Scenario:
Character dialogue (German) in a story
Duration:
16.3s
Cost:
$0.001357
Provider:
Mistral
Evaluation summary
Score
Evaluator
Details Link
100.00%
Parse dialogue
(details)
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Melanie"> Melanie is a 30-year old college student on a study abroad program. Born in Germany, she is fluent in German and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of German, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Melanie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in German, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Melanie and Hunter as a voice sheet: Melanie: "..." Hunter: "..."
Model response
Messages
Meta
AI
**Voice Sheet: Café Conversation** *(Melanie sits at a small outdoor table, her camera resting in her lap. She flips through the photos on the display, her expression troubled. Hunter approaches, his detective badge clipped to his belt, his posture rigid but not unkind.)* **Hunter:** *(clears throat, speaks slowly)* Excuse me. Mind if I sit for a minute? **Melanie:** *(startled, looks up, then nods hesitantly)* Ja… natürlich. *(Yes… of course.)* **Hunter:** *(pulls out the chair across from her, sits)* Thanks. I’m Detective Hunter. I’m looking into the recent… well, the things that’ve been happening around town. *(pauses, watching her reaction)* You’ve been around the festival grounds a lot, right? Taking photos? **Melanie:** *(frowns, shakes her head slightly, then speaks rapidly in German)* Ich verstehe nicht. Was meinen Sie? Ich war nur beim Festival, um Fotos zu machen—die Äpfel, die Leute, die Landschaft. Aber dann… *(I don’t understand. What do you mean? I was only at the festival to take photos—the apples, the people, the scenery. But then…)* *(she trails off, her fingers tightening around her camera)* **Hunter:** *(leans forward slightly, trying to parse her tone if not her words)* Ma’am, I’m not sure what you’re saying. But you look… upset. Did you see something? Near the orchard, maybe? **Melanie:** *(shakes her head again, voice rising slightly)* Ich habe *etwas* gesehen. Etwas Seltsames. Ein Mann—nein, zwei Männer—die sich im Wald gestritten haben. Und dann… *(I saw *something*. Something strange. A man—no, two men—arguing in the woods. And then…)* *(she swallows hard, her eyes darting toward the tree line beyond the café)* Der eine ist einfach… verschwunden. *(One just… disappeared.)* **Hunter:** *(frowns, rubbing his temple)* Okay, I’m gonna need you to slow down. You’re saying you saw a fight? And someone vanished? **Melanie:** *(nods vigorously, then switches to broken English, stumbling over the words)* Ja. Fight. In woods. One man… gone. *(mimes a poof with her hands)* Weg. *(Gone.)* **Hunter:** *(eyes narrow slightly, processing)* You got photos of this? **Melanie:** *(hesitates, then nods, flipping through her camera. She turns the display toward him, pointing at a blurry shot of two figures near the trees)* Hier. *(Here.)* **Hunter:** *(studies the photo, then looks back at her)* This is… not much to go on. But it’s something. *(pulls out a notepad and pen, holds the pen out to her)* Can you write down what you saw? In German is fine—I’ll get it translated. **Melanie:** *(takes the pen, scribbles quickly on the notepad, then hands it back. Her hand trembles slightly.)* Bitte. Seien Sie vorsichtig. *(Please. Be careful.)* **Hunter:** *(tucks the notepad into his pocket, then stands as his phone buzzes. He glances at the screen, then back at her)* I gotta take this. But I’ll be in touch. *(pauses, then points at her camera)* Don’t delete those photos, okay? **Melanie:** *(nods, clutching her camera to her chest)* Ja. Danke. *(Hunter gives her a curt nod, then strides away, already answering his phone. Melanie watches him go, her expression still troubled, before turning back to her camera and flipping through the photos again.)*
created_at
"2026-02-20T14:13:40.702Z"
2/20/2026, 2:13:40 PM
model
"mistralai/mistral-large-2512"
1/1/2512, 12:00:00 AM
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
432
moderation_latency
(null)
generation_time
16197
tokens_prompt
319
tokens_completion
858
native_tokens_prompt
273
native_tokens_completion
814
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.0013575
router
(null)
provider_responses
0
endpoint_id
"fa718841-07ea-4b7e-b8a3-6069545c7e6a"
id
"14373c05d65e4f34b83bc8b54e479335"
is_byok
false
latency
432
model_permaslug
"mistralai/mistral-large-2512"
1/1/2512, 12:00:00 AM
provider_name
"Mistral"
status
200
api_type
"completions"
id
"gen-1771596820-z8HJ3SEydfMICqkioC0r"
upstream_id
"14373c05d65e4f34b83bc8b54e479335"
total_cost
0.0013575
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Mistral"
Evaluation details
Result
Evaluator
Details
Meta Data
100.00%
Parse dialogue
n/a
dialogue
0
name
"Hunter"
dialogue
"** Excuse me. Mind if I sit for a minute?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.753584229390681
no
0.6964679911699779
da
0.6733966745843231
it
0.626358695652174
et
0.6206896551724138
sq
0.6026011560693642
hr
0.5877061469265367
ro
0.5852187028657617
pt
0.5782208588957055
sv
0.5743034055727554
ca
0.5571658615136876
sl
0.5409015025041736
cs
0.5315161839863715
hu
0.5307167235494881
tl
0.5274914089347079
es
0.5225694444444445
pl
0.5166959578207382
sk
0.5018115942028986
fr
0.4963369963369963
nl
0.4410569105691057
fi
0.43298969072164945
de
0.43064182194616984
lt
0.43064182194616984
ms
0.42827442827442824
yo
0.42827442827442824
tr
0.3483412322274882
is
0.3341404358353511
az
0.32598039215686275
lv
0.32598039215686275
vi
0.32598039215686275
be
0.20289855072463767
eu
0.20289855072463767
uk
0.1863905325443787
reliable
true
passes
true
1
name
"Melanie"
dialogue
"**"
detectedLang
""
heavyLang
""
scores
reliable
false
passes
true
2
name
"Hunter"
dialogue
"** You’ve been around the festival grounds a lot, right? Taking photos?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.810102544625902
tl
0.6905940594059405
fr
0.6183206106870229
nl
0.5059288537549407
no
0.5059288537549407
pt
0.4959677419354839
ca
0.452354874041621
da
0.451152579582876
sv
0.44933920704845814
es
0.441340782122905
de
0.419953596287703
sq
0.41245593419506466
sl
0.410377358490566
it
0.3924665856622114
ms
0.3902439024390244
cs
0.38949938949938945
sk
0.38949938949938945
hr
0.3849938499384994
yo
0.375
lt
0.3654822335025381
pl
0.3540051679586563
ro
0.3394980184940555
et
0.33862433862433866
hu
0.3084370677731674
fi
0.2917847025495751
lv
0.28977272727272724
az
0.2732558139534884
tr
0.24585218702865763
is
0.2260061919504644
hi
0.1334488734835355
eu
0.12280701754385964
vi
0.12280701754385964
reliable
true
passes
true
3
name
"Melanie"
dialogue
"**"
detectedLang
""
heavyLang
""
scores
reliable
false
passes
true
4
name
"Hunter"
dialogue
"** Ma’am, I’m not sure what you’re saying. But you look… upset. Did you see something? Near the orchard, maybe?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8002853067047075
tl
0.5697602950215119
fr
0.25611052072263546
tr
0.20273348519362186
et
0.19540229885057472
no
0.19540229885057472
nl
0.1850989522700815
ms
0.1822429906542056
yo
0.1325898389095415
fi
0.13043478260869565
cs
0.10025706940874037
da
0.10025706940874037
es
0.10025706940874037
pt
0.10025706940874037
sq
0.10025706940874037
sv
0.10025706940874037
de
0.0967741935483871
reliable
true
passes
true
5
name
"Melanie"
dialogue
"*etwas*"
detectedLang
"de"
heavyLang
"de"
scores
de
0.84375
reliable
false
passes
true
6
name
"Hunter"
dialogue
"** Okay, I’m gonna need you to slow down. You’re saying you saw a fight? And someone vanished?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.7998719180275377
tl
0.6044303797468354
yo
0.40702087286527516
da
0.358974358974359
cs
0.3530020703933748
et
0.3400211193241816
sk
0.29537767756482525
no
0.28815489749430523
pl
0.2774566473988439
hr
0.2672919109026964
it
0.259478672985782
pt
0.2586002372479241
sl
0.25239234449760767
es
0.251497005988024
lv
0.2350061199510404
fr
0.23406862745098037
lt
0.22934648581997535
fi
0.22166874221668745
tr
0.2206982543640898
ms
0.20685279187817257
hu
0.1997439180537772
de
0.18407310704960833
ro
0.1819371727748691
ca
0.17871222076215507
is
0.10714285714285714
sq
0.10329985652797705
az
0.10071942446043164
eu
0.10071942446043164
nl
0.10071942446043164
vi
0.10071942446043164
sv
0.09156976744186046
reliable
true
passes
true
7
name
"Melanie"
dialogue
"**"
detectedLang
""
heavyLang
""
scores
reliable
false
passes
true
8
name
"Hunter"
dialogue
"** You got photos of this?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8378378378378378
tl
0.7131931166347993
nl
0.5677233429394812
fr
0.5481927710843374
de
0.506578947368421
yo
0.4296577946768061
no
0.38524590163934425
is
0.3723849372384937
es
0.34782608695652173
lt
0.34782608695652173
pt
0.34782608695652173
cs
0.34210526315789475
hi
0.33920704845814975
ca
0.3212669683257918
lv
0.3212669683257918
reliable
true
passes
true
9
name
"Melanie"
dialogue
"**"
detectedLang
""
heavyLang
""
scores
reliable
false
passes
true
10
name
"Hunter"
dialogue
"** Can you write down what you saw? In German is fine—I’ll get it translated."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8259435690729204
tl
0.5423892100192678
ro
0.4994731296101159
it
0.496288441145281
nl
0.4897959183673469
ms
0.3902439024390244
az
0.3790849673202614
de
0.3782722513089006
sl
0.375
yo
0.3741765480895916
ca
0.3319268635724332
sv
0.3319268635724332
et
0.3252840909090909
sq
0.32432432432432434
tr
0.3065693430656934
is
0.28785607196401797
hu
0.2448330683624801
pl
0.2448330683624801
lv
0.24363057324840762
fr
0.24242424242424243
es
0.23633440514469453
sk
0.23387096774193547
da
0.22764227642276424
no
0.22764227642276424
lt
0.2263843648208469
cs
0.2238562091503268
hi
0.1782006920415225
vi
0.15630550621669628
pt
0.14414414414414414
eu
0.12361623616236161
hr
0.1171003717472119
reliable
true
passes
true
11
name
"Melanie"
dialogue
"**"
detectedLang
""
heavyLang
""
scores
reliable
false
passes
true
12
name
"Hunter"
dialogue
"** Don’t delete those photos, okay?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.7912801484230055
tl
0.5967741935483871
fr
0.5664739884393063
sq
0.4260204081632653
pt
0.4155844155844156
no
0.4140625
es
0.3951612903225807
ro
0.3869209809264305
ca
0.38016528925619836
nl
0.38016528925619836
hu
0.27184466019417475
lt
0.26229508196721313
hi
0.2549668874172185
et
0.25
sl
0.25
tr
0.25
de
0.2398648648648649
lv
0.2398648648648649
da
0.22945205479452058
it
0.22945205479452058
sv
0.22945205479452058
reliable
true
passes
true
13
name
"Melanie"
dialogue
"** Ja. Danke."
detectedLang
"de"
heavyLang
"rn"
scores
de
0.7619047619047619
sk
0.7588424437299035
sl
0.6987951807228916
da
0.6724890829694322
et
0.6724890829694322
fi
0.6710526315789473
sv
0.6651785714285715
lv
0.6052631578947368
ca
0.592391304347826
hr
0.5562130177514794
pl
0.5161290322580645
nl
0.5098039215686274
sq
0.5
yo
0.5
no
0.49664429530201337
reliable
true
passes
true