NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-10-07-01M4ATYC33S8B6QMP7AZF34VWN
Run Details
Model:
Mistral Medium 3.5
Test:
Language Writing
Scenario:
Character dialogue (German) in a story
Duration:
3.9s
Cost:
$0.003795
Provider:
Mistral
Evaluation summary
Score
Evaluator
Details Link
88.89%
Parse dialogue
(details)
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Melanie"> Melanie is a 30-year old college student on a study abroad program. Born in Germany, she is fluent in German and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of German, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Melanie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in German, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Melanie and Hunter as a voice sheet: Melanie: "..." Hunter: "..."
Model response
Messages
Meta
AI
**Voice Sheet: Café Encounter** --- **Melanie:** *(muttering to herself, adjusting her camera)* "Das Licht hier ist perfekt... aber diese Schatten..." *(The light here is perfect... but these shadows...)* **Hunter:** *(approaches, clearing his throat)* "Excuse me, miss. I’m Detective Hunter. Mind if I ask you a few questions about what happened at the festival last night?" **Melanie:** *(startled, looks up, responds in rapid German)* "Äh—ja, ich war dort, aber... es war so seltsam! Die Leute... sie sind einfach verschwunden!" *(Uh—yes, I was there, but... it was so strange! The people... they just disappeared!)* **Hunter:** *(frowns, rubbing his temple)* "Uh... slow down. I didn’t catch any of that." **Melanie:** *(realizing, flustered, switches to broken English with a heavy accent)* "I—I no speak English good. But... people gone. Poof!" *(makes a vanishing gesture with her hands)* **Hunter:** *(sighs, pulling out a notepad)* "Okay, let’s try this. You were at the festival. Did you see anything *unusual*? Like... I don’t know, a suspicious person? A van? Anything?" **Melanie:** *(shakes her head, then pauses, eyes widening)* "Der Mann... mit dem... *schwarzen Mantel*." *(The man... with the... black coat.)* *(points vaguely toward the town square)* **Hunter:** *(perks up, leaning in)* "Black coat? Tall? Short? Did he have a—" *(his phone rings, cutting him off. He checks the caller ID and groans)* "I’ve gotta take this. *(to Melanie)* Stay here. I’ll find someone who speaks... whatever you’re speaking." *(answers phone)* "Hunter." **Melanie:** *(watches him walk away, murmuring in German)* "Das war... sehr verwirrend." *(That was... very confusing.)* --- **End Scene**
created_at
"2026-10-07T09:26:05.163Z"
10/7/2026, 9:26:05 AM
model
"mistralai/mistral-medium-3.5-20260430"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
392
moderation_latency
(null)
generation_time
3905
tokens_prompt
306
tokens_completion
442
native_tokens_prompt
285
native_tokens_completion
449
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
"default"
usage
0.003795
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1791365165-AeUC2IZY8eGNaY6IQe41"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1791365165-qERx82K3XEbDJdCCpllM"
upstream_id
"f1a157e633e145499b603b480a97e4f5"
provider_responses
0
endpoint_id
"d21d316f-d540-4718-b36e-3beff85d0cf9"
id
"f1a157e633e145499b603b480a97e4f5"
is_byok
false
latency
392
model_permaslug
"mistralai/mistral-medium-3.5-20260430"
provider_name
"Mistral"
status
200
total_cost
0.003795
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Mistral"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
88.89%
Parse dialogue
n/a
dialogue
0
name
"Melanie"
dialogue
"Das Licht hier ist perfekt... aber diese Schatten..."
detectedLang
"de"
heavyLang
"de"
scores
de
0.8362720403022671
nl
0.711111111111111
da
0.5142002989536621
sv
0.5068285280728376
no
0.45561139028475717
pt
0.4206773618538324
it
0.41546762589928055
tr
0.4133574007220217
en
0.3380855397148676
fr
0.3271221532091097
ro
0.3128964059196617
es
0.3114406779661017
fi
0.2459396751740139
hi
0.2459396751740139
ca
0.17721518987341772
sq
0.17721518987341772
tl
0.16237113402061853
reliable
true
passes
true
1
name
"Hunter"
dialogue
"Excuse me, miss. I’m Detective Hunter. Mind if I ask you a few questions about what happened at the festival last night?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8105650573717254
tl
0.6686861037485801
fr
0.568327577701036
it
0.5290635091496232
no
0.5267712276906436
da
0.5045300113250283
ca
0.4959677419354839
pt
0.4886031560490941
nl
0.45987654320987653
sq
0.44933920704845814
es
0.43402328589909445
ro
0.4292237442922375
sv
0.4201457919151756
cs
0.3961352657004831
hr
0.37230989956958394
et
0.3673174258857556
sl
0.35944363103953153
ms
0.3460388639760837
yo
0.30665610142630745
de
0.3044515103338633
hu
0.30167597765363136
sk
0.2677824267782427
pl
0.251497005988024
lt
0.23647469458987785
az
0.22291296625222026
tr
0.19056429232192415
fi
0.18680297397769516
lv
0.1830065359477124
is
0.1362290227048371
vi
0.13194444444444445
be
0.07407407407407407
eu
0.07407407407407407
uk
0.06716417910447761
reliable
true
passes
true
2
name
"Melanie"
dialogue
"Äh—ja, ich war dort, aber... es war so seltsam! Die Leute... sie sind einfach verschwunden!"
detectedLang
"de"
heavyLang
"de"
scores
de
0.8225751943224062
et
0.4728915662650602
ca
0.4414893617021277
nl
0.41077441077441074
sk
0.37425506555423127
pl
0.3689903846153846
en
0.36053593179049936
es
0.3558282208588957
yo
0.35503685503685506
hu
0.3462017434620174
no
0.3155149934810952
sv
0.3101182654402102
lv
0.30921052631578944
sl
0.3055555555555556
sq
0.2895805142083897
da
0.27884615384615385
is
0.26264044943820225
lt
0.24242424242424243
fi
0.22566371681415928
tr
0.1873065015479876
vi
0.15865384615384615
tl
0.1435562805872757
it
0.12060301507537688
fr
0.10714285714285714
pt
0.10714285714285714
az
0.10102739726027396
ro
0.10102739726027396
reliable
true
passes
true
3
name
"Hunter"
dialogue
"Uh... slow down. I didn’t catch any of that."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8129675810473814
tl
0.6336996336996337
ca
0.4746059544658494
no
0.4434137291280148
sv
0.43289224952741023
yo
0.39999999999999997
it
0.3877551020408163
tr
0.3617021276595745
de
0.34497816593886466
is
0.336283185840708
da
0.31662870159453305
hr
0.31662870159453305
sq
0.3087557603686636
nl
0.29577464788732394
pl
0.29577464788732394
cs
0.25925925925925924
fr
0.23273657289002556
ro
0.23076923076923078
sk
0.1935483870967742
be
0.1891891891891892
hu
0.18256130790190736
az
0.17355371900826447
et
0.17355371900826447
lt
0.17355371900826447
lv
0.17355371900826447
uk
0.17355371900826447
vi
0.17355371900826447
reliable
true
passes
true
4
name
"Melanie"
dialogue
"I—I no speak English good. But... people gone. Poof!"
detectedLang
"en"
heavyLang
"en"
scores
en
0.813200498132005
tl
0.6398559423769509
no
0.5192307692307693
hr
0.5098039215686274
ca
0.47643979057591623
da
0.4129158512720157
sv
0.4117647058823529
pl
0.40119760479041916
it
0.3939393939393939
lv
0.39271255060728744
sk
0.35205183585313177
ro
0.35064935064935066
tr
0.34497816593886466
pt
0.3150684931506849
es
0.3135011441647597
sq
0.3087557603686636
cs
0.25925925925925924
fr
0.22680412371134018
yo
0.2248062015503876
de
0.1935483870967742
ms
0.1935483870967742
be
0.1891891891891892
hu
0.18256130790190736
az
0.17355371900826447
et
0.17355371900826447
is
0.17355371900826447
lt
0.17355371900826447
uk
0.17355371900826447
vi
0.17355371900826447
reliable
true
passes
false
5
name
"Hunter"
dialogue
"Okay, let’s try this. You were at the festival. Did you see anything unusual? Like... I don’t know, a suspicious person? A van? Anything?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.7966413014956705
tl
0.6675246675246675
no
0.5465184318314804
da
0.5076238881829733
nl
0.5051085568326947
ca
0.5
sq
0.46068197633959634
pt
0.45384073291050037
es
0.45190947666195197
ms
0.450354609929078
et
0.4288872512896094
hu
0.4216417910447761
sv
0.421209858103062
cs
0.4199101796407186
fr
0.40613026819923376
it
0.404304381245196
ro
0.40108191653786707
hr
0.3973561430793157
sk
0.32842287694974004
pl
0.31294326241134746
lt
0.3067978533094812
yo
0.2876838235294118
az
0.2857142857142857
de
0.2674858223062382
sl
0.2633079847908745
is
0.2597898758357211
lv
0.2590822179732314
tr
0.21638018200202225
vi
0.14647577092511013
fi
0.13984461709211987
be
0.08284023668639054
eu
0.08284023668639054
uk
0.07517899761336516
reliable
true
passes
true
6
name
"Melanie"
dialogue
"Der Mann... mit dem... schwarzen Mantel."
detectedLang
"de"
heavyLang
"de"
scores
de
0.8068669527896994
da
0.6218487394957983
no
0.5825602968460111
sv
0.4803695150115473
ca
0.4693396226415094
nl
0.46808510638297873
pl
0.30769230769230765
tl
0.30769230769230765
es
0.3055555555555556
pt
0.296875
hu
0.281150159744409
it
0.27184466019417475
lv
0.27184466019417475
is
0.25742574257425743
tr
0.25
reliable
true
passes
true
7
name
"Hunter"
dialogue
"Hunter."
detectedLang
"en"
heavyLang
"de"
scores
en
0.7797356828193832
de
0.6376811594202898
da
0.6212121212121212
no
0.609375
fr
0.5901639344262295
sv
0.5833333333333334
tl
0.5726495726495726
it
0.5575221238938053
nl
0.5575221238938053
pt
0.5575221238938053
ca
0.5412844036697247
ms
0.5412844036697247
ro
0.5412844036697247
sl
0.5412844036697247
sq
0.5412844036697247
tr
0.5412844036697247
reliable
false
passes
true
8
name
"Melanie"
dialogue
"Das war... sehr verwirrend."
detectedLang
"de"
heavyLang
"de"
scores
de
0.8279816513761469
nl
0.5978552278820375
pt
0.5253164556962026
en
0.4444444444444444
fr
0.3775933609958506
fa
0.3333333333333333
hr
0.3333333333333333
sk
0.3333333333333333
reliable
true
passes
true