NC Bench
Overview
About
Tests
Models
Vendors
Run: 2026-02-20-01KHXPC6JK8JF5V91G06JHYFKQ
Run Details
Model:
Mistral Large 3
Test:
Language Writing
Scenario:
Character dialogue (German) in a story
Duration:
17.1s
Cost:
$0.001363
Provider:
Mistral
Evaluation summary
Score
Evaluator
Details Link
93.75%
Parse dialogue
(details)
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Melanie"> Melanie is a 30-year old college student on a study abroad program. Born in Germany, she is fluent in German and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of German, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Melanie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in German, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Melanie and Hunter as a voice sheet: Melanie: "..." Hunter: "..."
Model response
Messages
Meta
AI
**Voice Sheet: Café Conversation** *(Melanie sits at a small outdoor table, her camera resting in her lap. She flips through the photos on the display, her brow furrowed. Hunter approaches, his expression serious but not unkind.)* **Hunter:** *(clears throat, standing a respectful distance away)* Excuse me, miss? Do you mind if I ask you a few questions? **Melanie:** *(startled, looks up, then relaxes slightly when she sees his badge)* Oh—ja? Äh… *you*… sprechen…? *(shakes head, frustrated)* Nein, nein, ich verstehe nicht. *(points to her camera, then gestures vaguely toward the town)* Ich war nur… fotografieren. **Hunter:** *(frowns, rubbing the back of his neck)* Uh… right. Okay. *(tries again, slower)* I’m Detective Hunter. There was an… incident near the orchard last night. Did you see anything unusual? **Melanie:** *(eyes widen, voice trembling)* Der Obstgarten? *(shakes head vehemently)* Nein, nein, ich war nicht dort! Ich war am See—der See! *(mimes waves with her hands, then points to her camera)* Nur Fotos. Aber… *(voice drops, uneasy)* Ich habe etwas gehört. Ein Schrei. *(shudders)* So… so weit weg. Und dann… *(trails off, hugs herself)* **Hunter:** *(leans in slightly, tone gentle despite the language barrier)* A scream? You heard a scream? **Melanie:** *(nods rapidly)* Ja! Ein Schrei. Und dann… *(mimes something vanishing with her hands)* Weg. Alles still. **Hunter:** *(pulls out a small notepad, flips to a blank page, and sketches a rough map of the town, pointing to the lake and the orchard)* Here? And here? **Melanie:** *(studies the map, then points to the lake)* Hier. Ich war hier. Aber der Schrei… *(points toward the orchard, then makes a questioning gesture)* Vielleicht… dort? **Hunter:** *(nods, jotting notes)* Okay. That helps. *(pauses, then tries a different approach)* Do you… have photos? From the lake? **Melanie:** *(brightens slightly, flips through her camera, then turns the display toward him)* Ja! Hier. *(points to a photo of the lake at dusk, then scrolls to another)* Und hier… *(zooms in on a dark shape near the tree line, barely visible)* **Hunter:** *(squints at the photo, then looks up sharply)* That wasn’t there before. *(points to the shape)* What is that? **Melanie:** *(shakes her head, confused)* Ich weiß nicht. Vielleicht ein Tier? Oder… *(trails off, uneasy again)* Oder nein. *(Hunter’s phone rings abruptly. He answers, listening intently, his expression darkening.)* **Hunter:** *(into phone)* Yeah, I’m on my way. *(hangs up, then turns back to Melanie, switching to a more urgent tone)* Miss, I have to go. But… *(hesitates, then pulls out a business card and hands it to her)* If you remember anything else—anything at all—call me. *(points to the card, then to his ear, miming a phone call)* **Melanie:** *(takes the card, nods)* Ja. Ich… ich rufe an. **Hunter:** *(gives her a tight nod, then turns to leave, but pauses)* And… *(points to her camera)* Be careful, okay? **Melanie:** *(clutches her camera, whispering)* Danke. *(Hunter strides away, leaving Melanie staring after him, her fingers tightening around her camera.)*
created_at
"2026-02-20T14:13:34.94Z"
2/20/2026, 2:13:34 PM
model
"mistralai/mistral-large-2512"
1/1/2512, 12:00:00 AM
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
430
moderation_latency
(null)
generation_time
17077
tokens_prompt
319
tokens_completion
835
native_tokens_prompt
273
native_tokens_completion
818
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.0013635
router
(null)
provider_responses
0
endpoint_id
"fa718841-07ea-4b7e-b8a3-6069545c7e6a"
id
"ee231d29a70a4b089ab775a6e87b137b"
is_byok
false
latency
430
model_permaslug
"mistralai/mistral-large-2512"
1/1/2512, 12:00:00 AM
provider_name
"Mistral"
status
200
api_type
"completions"
id
"gen-1771596814-wraa4vK2LNM1NNf87BEs"
upstream_id
"ee231d29a70a4b089ab775a6e87b137b"
total_cost
0.0013635
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Mistral"
Evaluation details
Result
Evaluator
Details
Meta Data
93.75%
Parse dialogue
n/a
dialogue
0
name
"Hunter"
dialogue
"** Excuse me, miss? Do you mind if I ask you a few questions?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.7949699289229087
pt
0.5980707395498392
fr
0.5972073039742213
it
0.5941558441558442
sq
0.5567375886524822
cs
0.5443499392466585
tl
0.5341614906832298
ca
0.5259165613147914
pl
0.4993324432576769
hr
0.4973190348525469
sk
0.4710860366713681
hu
0.4533527696793003
es
0.45255474452554745
et
0.4517543859649123
no
0.44933920704845814
sv
0.44526627218934917
sl
0.4427934621099554
yo
0.43095599393019723
nl
0.4038155802861685
vi
0.39418416801292405
ro
0.37913907284768217
da
0.36006825938566556
ms
0.2816091954022989
tr
0.2816091954022989
lt
0.27884615384615385
fi
0.2690058479532163
is
0.2690058479532163
az
0.2618110236220473
lv
0.2618110236220473
be
0.15730337078651685
eu
0.15730337078651685
de
0.1515837104072398
uk
0.14383561643835618
reliable
true
passes
true
1
name
"Melanie"
dialogue
"*you* Ich war nur… fotografieren."
detectedLang
"de"
heavyLang
"de"
scores
de
0.7794928335170893
en
0.6116504854368932
ca
0.6055226824457594
nl
0.5614035087719298
sk
0.5594713656387665
no
0.54337899543379
pl
0.5423340961098398
da
0.5337995337995338
tr
0.5238095238095238
cs
0.5145631067961165
es
0.5024875621890548
ro
0.5024875621890548
ms
0.4428969359331476
hr
0.4065281899109792
sl
0.4065281899109792
sq
0.40298507462686567
it
0.38650306748466257
lt
0.38650306748466257
et
0.37888198757763975
lv
0.37888198757763975
pt
0.37888198757763975
sv
0.3710691823899371
eu
0.3464052287581699
tl
0.2805755395683453
az
0.2277992277992278
fr
0.2277992277992278
reliable
true
passes
true
2
name
"Hunter"
dialogue
"** I’m Detective Hunter. There was an… incident near the orchard last night. Did you see anything unusual?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8078452160084814
tl
0.6417984189723319
de
0.5448838669177652
fr
0.5205026455026455
nl
0.4961779013203613
ro
0.465339233038348
no
0.42138866719872303
sq
0.4204636290967226
et
0.39883913764510776
ca
0.3850720949957591
da
0.3776824034334764
pt
0.377147766323024
es
0.35267857142857145
it
0.3444846292947558
ms
0.33910665451230626
yo
0.3330266789328427
sv
0.27716849451645065
cs
0.2757242757242757
sl
0.2602040816326531
az
0.16666666666666666
tr
0.15204678362573099
sk
0.15105386416861827
hr
0.14806110458284372
vi
0.13069544364508393
eu
0.12545235223160436
pl
0.0880503144654088
hu
0.07525510204081631
lt
0.07525510204081631
reliable
true
passes
true
3
name
"Melanie"
dialogue
"**"
detectedLang
""
heavyLang
""
scores
reliable
false
passes
true
4
name
"Hunter"
dialogue
"** A scream? You heard a scream?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8235294117647058
tl
0.70703125
cs
0.5833333333333334
hu
0.5098039215686274
pt
0.4827586206896552
ro
0.4809688581314879
ca
0.4755244755244755
es
0.46808510638297873
sk
0.46428571428571425
it
0.4545454545454546
yo
0.44237918215613387
fr
0.43820224719101125
hr
0.42748091603053434
pl
0.4117647058823529
sl
0.375
lt
0.35344827586206895
tr
0.33920704845814975
is
0.3333333333333333
da
0.32432432432432434
sq
0.32432432432432434
az
0.3181818181818182
eu
0.3181818181818182
lv
0.3181818181818182
nl
0.3181818181818182
no
0.3181818181818182
vi
0.3181818181818182
de
0.3087557603686636
et
0.29577464788732394
fi
0.29577464788732394
ms
0.29577464788732394
sv
0.29577464788732394
reliable
true
passes
true
5
name
"Melanie"
dialogue
"** Weg. Alles still."
detectedLang
"nl"
heavyLang
"nl"
scores
nl
0.7641509433962265
de
0.7619047619047619
da
0.6851385390428211
no
0.6778350515463918
en
0.6761658031088082
it
0.6448863636363635
fr
0.6301775147928995
et
0.6006389776357828
is
0.5370370370370371
sv
0.5370370370370371
ca
0.4369369369369369
es
0.3902439024390244
sq
0.375
fi
0.358974358974359
tl
0.358974358974359
hr
0.34895833333333337
lt
0.34895833333333337
lv
0.34895833333333337
reliable
true
passes
false
6
name
"Hunter"
dialogue
"** Here? And here?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8607242339832869
tl
0.6894409937888198
sq
0.6666666666666666
yo
0.6644295302013423
reliable
false
passes
true
7
name
"Melanie"
dialogue
"** Vielleicht… dort?"
detectedLang
"de"
heavyLang
"de"
scores
de
0.8518518518518519
fi
0.7084548104956269
nl
0.5918367346938775
reliable
true
passes
true
8
name
"Hunter"
dialogue
"** Do you… have photos? From the lake?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8380566801619433
tl
0.6422182468694096
fr
0.5652173913043478
pt
0.5412844036697247
da
0.5294117647058824
cs
0.51338199513382
sq
0.4936708860759494
yo
0.4805194805194805
nl
0.43661971830985913
pl
0.41690962099125367
sk
0.39759036144578314
hr
0.375
sl
0.375
vi
0.35691318327974275
no
0.3220338983050847
es
0.2857142857142857
lt
0.2857142857142857
ms
0.2805755395683453
sv
0.2805755395683453
hi
0.2779783393501805
ca
0.26199261992619927
de
0.26199261992619927
lv
0.26199261992619927
reliable
true
passes
true
9
name
"Melanie"
dialogue
"**"
detectedLang
""
heavyLang
""
scores
reliable
false
passes
true
10
name
"Hunter"
dialogue
"** What is that?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8686514886164624
nl
0.6794871794871795
hu
0.6724890829694322
yo
0.6153846153846154
tl
0.5714285714285714
is
0.5508982035928144
reliable
true
passes
true
11
name
"Melanie"
dialogue
"** Oder nein."
detectedLang
"de"
heavyLang
"de"
scores
de
0.84472049689441
reliable
false
passes
true
12
name
"Hunter"
dialogue
"**"
detectedLang
""
heavyLang
""
scores
reliable
false
passes
true
13
name
"Melanie"
dialogue
"** Ja. Ich… ich rufe an."
detectedLang
"de"
heavyLang
"de"
scores
de
0.7811816192560175
sk
0.6753246753246753
pl
0.6610169491525424
yo
0.6282527881040892
et
0.6062992125984252
fi
0.6047430830039525
en
0.5633187772925764
lv
0.5348837209302325
ca
0.5215311004784688
vi
0.5215311004784688
eu
0.5098039215686274
ro
0.49238578680203043
da
0.4444444444444444
fr
0.4444444444444444
ms
0.4444444444444444
sl
0.4444444444444444
sq
0.42857142857142855
sv
0.42857142857142855
tr
0.4152046783625731
reliable
true
passes
true
14
name
"Hunter"
dialogue
"** Be careful, okay?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.7742663656884876
tl
0.6563573883161512
ro
0.6527777777777778
hu
0.5391705069124424
lt
0.5283018867924528
yo
0.5238095238095238
es
0.4318181818181818
fr
0.4318181818181818
reliable
true
passes
true
15
name
"Melanie"
dialogue
"** Danke."
detectedLang
"de"
heavyLang
"rn"
scores
de
0.7524752475247525
sk
0.7524752475247525
hr
0.6527777777777778
sl
0.6527777777777778
nl
0.609375
da
0.5967741935483871
no
0.5967741935483871
sv
0.5967741935483871
reliable
false
passes
true