NC Bench
Overview
About
Tests
Models
Vendors
Run: 2026-02-20-01KHXQCSNK18QXYEYG48J27VCH
Run Details
Model:
Mistral Large 3
Test:
Language Writing
Scenario:
Character dialogue (German) in a story
Duration:
15.5s
Cost:
$0.001257
Provider:
Mistral
Evaluation summary
Score
Evaluator
Details Link
100.00%
Parse dialogue
(details)
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Melanie"> Melanie is a 30-year old college student on a study abroad program. Born in Germany, she is fluent in German and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of German, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Melanie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in German, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Melanie and Hunter as a voice sheet: Melanie: "..." Hunter: "..."
Model response
Messages
Meta
AI
**Voice Sheet: Café Conversation** *(Melanie sits at a small outdoor table, her camera resting in her lap. She flips through the photos on the display, her brow furrowed. Hunter approaches, his expression serious but not unkind.)* **Hunter:** *(clears throat, standing a respectful distance away)* Excuse me, miss? Do you mind if I ask you a few questions? **Melanie:** *(startled, looks up, then relaxes slightly when she sees his badge)* Oh—ja? Äh… *you*… sprechen…? *(shakes head, frustrated)* Nein, nein, ich verstehe nicht. *(gestures to her camera, then to the street, voice trembling)* Ich war hier… fotografieren. Aber dann… *(trails off, hugs herself, eyes darting around nervously)* **Hunter:** *(frowns, rubbing the back of his neck)* Uh… okay. I’m sorry, I don’t—*(mimes taking a photo)* You were taking pictures? Near the festival grounds? **Melanie:** *(nods rapidly, then points toward the edge of town)* Ja! Die Äpfel… schön. Aber dann… *(shudders, whispers)* Die Frau. Sie ist… *gone*. Einfach… weg. **Hunter:** *(leans in slightly, tone gentle but firm)* A woman? You saw a woman disappear? **Melanie:** *(nods again, voice rising in distress)* Ja! Sie hat geschrien—nein, nicht geschrien. Sie hat… *(mimes a hand over her mouth, eyes wide)* Dann *whoosh*. Wie der Wind. *(shakes her head, muttering in German)* Das ist nicht möglich. Das ist nicht möglich. **Hunter:** *(pulls out a notepad, flips it open, then hesitates, pen hovering)* Ma’am, I really wish I spoke German. But if you saw something—anything—it could help. *(points to her camera)* Did you get a picture? **Melanie:** *(clutches her camera tighter, then reluctantly turns the display toward him, scrolling through photos. She stops on a blurry shot of the festival, then zooms in on a dark figure near the trees. Her finger trembles as she taps the screen.)* Hier. Das… das ist nicht normal. **Hunter:** *(squints at the photo, then at her, jaw tightening)* That’s… *(trails off, then sighs, pulling out a business card)* Look, I gotta take this. *(phone rings; he answers with a sharp “Detective Cole.” Pauses, then swears under his breath.)* Yeah, I’m on my way. *(hangs up, hands her the card)* If you remember anything else—anything at all—call me. Ask for an interpreter if you need to. **Melanie:** *(takes the card, staring at the English words, then up at him, voice small)* Sie… Sie glauben mir? **Hunter:** *(nods once, already turning to leave)* I believe you saw *something*. And I’m gonna find out what. *(pauses, then adds gruffly)* Stay safe, okay? *(Melanie watches him go, then looks back at her camera, her hands shaking. She whispers to herself in German, too low for anyone to hear.)* **Melanie:** *(softly, to herself)* Das ist kein Zufall. Und ich… ich bin die Einzige, die es gesehen hat. *(End scene.)*
created_at
"2026-02-20T14:31:23.07Z"
2/20/2026, 2:31:23 PM
model
"mistralai/mistral-large-2512"
1/1/2512, 12:00:00 AM
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
518
moderation_latency
(null)
generation_time
15436
tokens_prompt
319
tokens_completion
757
native_tokens_prompt
273
native_tokens_completion
747
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.001257
router
(null)
provider_responses
0
endpoint_id
"fa718841-07ea-4b7e-b8a3-6069545c7e6a"
id
"59b9eba496c9442fbe3281dc884035d3"
is_byok
false
latency
516
model_permaslug
"mistralai/mistral-large-2512"
1/1/2512, 12:00:00 AM
provider_name
"Mistral"
status
200
api_type
"completions"
id
"gen-1771597883-BIfmILFeZcqPAHteetp7"
upstream_id
"59b9eba496c9442fbe3281dc884035d3"
total_cost
0.001257
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Mistral"
Evaluation details
Result
Evaluator
Details
Meta Data
100.00%
Parse dialogue
n/a
dialogue
0
name
"Hunter"
dialogue
"** Excuse me, miss? Do you mind if I ask you a few questions?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.7949699289229087
pt
0.5980707395498392
fr
0.5972073039742213
it
0.5941558441558442
sq
0.5567375886524822
cs
0.5443499392466585
tl
0.5341614906832298
ca
0.5259165613147914
pl
0.4993324432576769
hr
0.4973190348525469
sk
0.4710860366713681
hu
0.4533527696793003
es
0.45255474452554745
et
0.4517543859649123
no
0.44933920704845814
sv
0.44526627218934917
sl
0.4427934621099554
yo
0.43095599393019723
nl
0.4038155802861685
vi
0.39418416801292405
ro
0.37913907284768217
da
0.36006825938566556
ms
0.2816091954022989
tr
0.2816091954022989
lt
0.27884615384615385
fi
0.2690058479532163
is
0.2690058479532163
az
0.2618110236220473
lv
0.2618110236220473
be
0.15730337078651685
eu
0.15730337078651685
de
0.1515837104072398
uk
0.14383561643835618
reliable
true
passes
true
1
name
"Melanie"
dialogue
"*you*"
detectedLang
"en"
heavyLang
"en"
scores
en
0.84472049689441
cs
0.7572815533980582
tl
0.7572815533980582
reliable
false
passes
true
2
name
"Hunter"
dialogue
"** You were taking pictures? Near the festival grounds?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8071625344352616
tl
0.7133497133497133
fr
0.6424923391215526
nl
0.5586380832282472
no
0.5569620253164557
sv
0.5436766623207301
ca
0.5179063360881543
da
0.4905385735080059
et
0.453978159126365
sq
0.44356120826709056
pt
0.4372990353697749
ro
0.43548387096774194
cs
0.4308943089430894
sl
0.42434210526315785
ms
0.4233937397034596
de
0.38811188811188807
hr
0.36479128856624315
it
0.3613138686131387
sk
0.35064935064935066
es
0.3433395872420263
pl
0.325626204238921
lv
0.29435483870967744
fi
0.29006085192697767
lt
0.2647058823529412
az
0.25213675213675213
yo
0.23413566739606126
tr
0.19724770642201836
is
0.16864608076009502
hu
0.1606714628297362
reliable
true
passes
true
3
name
"Melanie"
dialogue
"*gone*. Einfach… weg."
detectedLang
"de"
heavyLang
"de"
scores
de
0.7995991983967936
nl
0.5652173913043478
is
0.5454545454545454
en
0.5121951219512195
reliable
true
passes
true
4
name
"Hunter"
dialogue
"** A woman? You saw a woman disappear?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.7901364113326338
cs
0.5841995841995842
ms
0.5661605206073753
nl
0.5515695067264574
tl
0.5249406175771971
ro
0.522673031026253
it
0.5145631067961165
fr
0.49238578680203043
hr
0.47780678851174935
hu
0.43820224719101125
fi
0.41690962099125367
sq
0.41690962099125367
no
0.41348973607038125
pt
0.4117647058823529
ca
0.40476190476190477
es
0.39759036144578314
sk
0.3939393939393939
yo
0.3730407523510972
pl
0.3442622950819672
sl
0.3103448275862069
lt
0.2907801418439716
tr
0.2779783393501805
is
0.2727272727272727
da
0.2647058823529412
az
0.25925925925925924
eu
0.25925925925925924
lv
0.25925925925925924
vi
0.25925925925925924
de
0.250936329588015
et
0.23954372623574144
sv
0.23954372623574144
reliable
true
passes
true
5
name
"Melanie"
dialogue
"*whoosh* Das ist nicht möglich. Das ist nicht möglich."
detectedLang
"de"
heavyLang
"de"
scores
de
0.8349229640498899
pt
0.42455242966751916
nl
0.39189189189189183
hi
0.3202416918429003
cs
0.30769230769230765
is
0.29467084639498436
tr
0.29467084639498436
hu
0.25742574257425743
reliable
true
passes
true
6
name
"Hunter"
dialogue
"** Did you get a picture?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8305084745762712
tl
0.6724890829694322
fr
0.604221635883905
ro
0.5912806539509536
it
0.5844875346260388
cs
0.5833333333333334
hr
0.5689655172413793
yo
0.5588235294117647
is
0.5384615384615384
sl
0.53125
hu
0.5098039215686274
sq
0.48805460750853247
pt
0.4827586206896552
de
0.4791666666666667
ca
0.4755244755244755
es
0.46808510638297873
sk
0.46428571428571425
pl
0.4117647058823529
lt
0.35344827586206895
tr
0.33920704845814975
da
0.32432432432432434
az
0.3181818181818182
eu
0.3181818181818182
lv
0.3181818181818182
nl
0.3181818181818182
no
0.3181818181818182
vi
0.3181818181818182
et
0.29577464788732394
fi
0.29577464788732394
ms
0.29577464788732394
sv
0.29577464788732394
reliable
true
passes
true
7
name
"Melanie"
dialogue
"** Hier. Das… das ist nicht normal."
detectedLang
"de"
heavyLang
"de"
scores
de
0.844306049822064
nl
0.6369294605809128
pt
0.630801687763713
tr
0.573170731707317
cs
0.4760479041916168
fr
0.4631901840490798
en
0.44620253164556967
ro
0.43910256410256415
az
0.4318181818181818
ca
0.4318181818181818
es
0.4318181818181818
ms
0.42434210526315785
tl
0.42434210526315785
hi
0.37722419928825623
eu
0.2768595041322314
lv
0.2768595041322314
da
0.2647058823529412
fi
0.2647058823529412
it
0.2647058823529412
lt
0.2647058823529412
no
0.2647058823529412
sq
0.2647058823529412
et
0.25213675213675213
hr
0.25213675213675213
pl
0.25213675213675213
sk
0.25213675213675213
sl
0.25213675213675213
sv
0.25213675213675213
reliable
true
passes
true
8
name
"Hunter"
dialogue
"** If you remember anything else—anything at all—call me. Ask for an interpreter if you need to."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8150638870208473
no
0.6311200536552649
tl
0.6002906976744186
da
0.5814307458143074
de
0.5528455284552846
ms
0.5013599274705349
sq
0.492619926199262
et
0.4912118408880666
sv
0.4731800766283525
fr
0.47267497603068076
sl
0.4649805447470817
nl
0.4433198380566802
yo
0.43298969072164945
es
0.42528735632183906
pt
0.42287513116474296
sk
0.4222689075630252
hu
0.377123442808607
it
0.3670886075949367
cs
0.34210526315789475
tr
0.3373493975903614
ro
0.32598039215686275
ca
0.3125
pl
0.28292046936114734
lv
0.2744063324538259
hr
0.26568758344459276
eu
0.25271739130434784
lt
0.24760601915184677
vi
0.23822714681440443
is
0.21875
fi
0.12
az
0.1085899513776337
reliable
true
passes
true
9
name
"Melanie"
dialogue
"** Sie… Sie glauben mir?"
detectedLang
"de"
heavyLang
"de"
scores
de
0.84375
pl
0.5283018867924528
hr
0.5
reliable
true
passes
true
10
name
"Hunter"
dialogue
"*something* Stay safe, okay?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.7875354107648725
tl
0.5702005730659025
es
0.34210526315789475
ms
0.34210526315789475
pt
0.34210526315789475
reliable
true
passes
true
11
name
"Melanie"
dialogue
"** Das ist kein Zufall. Und ich… ich bin die Einzige, die es gesehen hat."
detectedLang
"de"
heavyLang
"de"
scores
de
0.840561224489796
tr
0.4094488188976378
hu
0.336283185840708
pt
0.30683918669131244
nl
0.28842504743833014
ca
0.2816091954022989
es
0.2816091954022989
sk
0.24849699398797598
lv
0.24242424242424243
eu
0.23469387755102045
pl
0.23469387755102045
hi
0.2203742203742204
lt
0.19527896995708155
fi
0.19006479481641467
ms
0.19006479481641467
yo
0.19006479481641467
is
0.17035398230088497
no
0.17035398230088497
sv
0.17035398230088497
reliable
true
passes
true