NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-10-07-01M4AVHR9B7FQNYK6SFRCFD11N
Run Details
Model:
Mistral Medium 3.5
Test:
Language Writing
Scenario:
Character dialogue (German) in a story
Duration:
3.5s
Cost:
$0.003705
Provider:
Mistral
Evaluation summary
Score
Evaluator
Details Link
100.00%
Parse dialogue
(details)
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Melanie"> Melanie is a 30-year old college student on a study abroad program. Born in Germany, she is fluent in German and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of German, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Melanie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in German, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Melanie and Hunter as a voice sheet: Melanie: "..." Hunter: "..."
Model response
Messages
Meta
AI
**Voice Sheet:** --- **Melanie:** *(muttering to herself, adjusting her camera)* "Das ist seltsam... ich habe so etwas noch nie gesehen." *(This is strange... I've never seen anything like this.)* *(Hunter approaches, clearing his throat.)* **Hunter:** "Excuse me, miss. I’m Detective Hunter. I noticed you were here during the commotion earlier. Did you see anything unusual?" **Melanie:** *(startled, switching to rapid German)* "Ja, ich... ich habe etwas gesehen! Aber ich verstehe nicht, was los ist. Es war so... unheimlich." *(Yes, I... I saw something! But I don’t understand what’s going on. It was so... eerie.)* **Hunter:** *(frowning, shaking his head slightly)* "I’m sorry, I don’t speak German. Could you... maybe point or show me?" **Melanie:** *(frustrated, gesturing wildly with her hands)* "Nein, nein— Sie verstehen nicht! Da war ein Mann, aber dann... dann war er einfach weg!" *(No, no—you don’t understand! There was a man, but then... then he was just gone!)* **Hunter:** *(sighing, rubbing his temple)* "Okay, okay. Slow down. You saw a man disappear?" **Melanie:** *(nodding vigorously)* "Ja! Genau wie die anderen!" *(Yes! Just like the others!)* *(Hunter’s phone rings. He checks the caller ID and curses under his breath.)* **Hunter:** "I’ve gotta take this. *(into phone)* Hunter here." *(pauses, listening)* "Yeah, I’ll be right there." *(to Melanie, apologetic)* "Look, I’ve gotta run, but... maybe find someone who speaks both languages? This is important." **Melanie:** *(disappointed, but nodding)* "Ich werde es versuchen." *(I’ll try.)* *(Hunter leaves quickly, and Melanie stares after him, still clutching her camera.)* --- **End Scene.**
created_at
"2026-10-07T09:36:40.242Z"
10/7/2026, 9:36:40 AM
model
"mistralai/mistral-medium-3.5-20260430"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
303
moderation_latency
(null)
generation_time
3444
tokens_prompt
306
tokens_completion
440
native_tokens_prompt
285
native_tokens_completion
437
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
"default"
usage
0.003705
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1791365800-l41XL4VY1d9ePQ8Pfp9X"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1791365800-fDtBLg2KHREId2LNfTs4"
upstream_id
"6476429c794449579ebe202d9d9854cb"
provider_responses
0
endpoint_id
"d21d316f-d540-4718-b36e-3beff85d0cf9"
id
"6476429c794449579ebe202d9d9854cb"
is_byok
false
latency
303
model_permaslug
"mistralai/mistral-medium-3.5-20260430"
provider_name
"Mistral"
status
200
total_cost
0.003705
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Mistral"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
100.00%
Parse dialogue
n/a
dialogue
0
name
"Melanie"
dialogue
"Das ist seltsam... ich habe so etwas noch nie gesehen."
detectedLang
"de"
heavyLang
"de"
scores
de
0.8343527013251785
sk
0.5227606461086637
pl
0.4574290484140233
et
0.4003690036900369
pt
0.3380855397148676
sl
0.3172268907563025
yo
0.2793791574279379
eu
0.26136363636363635
en
0.25799086757990863
hi
0.2459396751740139
vi
0.23349056603773585
tr
0.2243436754176611
fi
0.21307506053268765
no
0.21307506053268765
tl
0.21307506053268765
reliable
true
passes
true
1
name
"Hunter"
dialogue
"Excuse me, miss. I’m Detective Hunter. I noticed you were here during the commotion earlier. Did you see anything unusual?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8069032102341298
tl
0.6148290804044295
fr
0.5543175487465181
no
0.4875080076873799
sq
0.4708994708994709
da
0.46308724832214765
nl
0.4594594594594595
it
0.44095038434661077
sv
0.41733430444282593
ro
0.3730407523510972
pt
0.3710691823899371
ms
0.36908517350157727
es
0.3579454253611557
et
0.35117599351175993
ca
0.32030586236193714
de
0.31682322801024765
yo
0.2640294388224471
cs
0.24170616113744076
sl
0.21104536489151873
hr
0.2047713717693837
lv
0.18533604887983707
lt
0.16926272066458983
fi
0.16405433646812956
sk
0.1543340380549683
tr
0.13885898815931108
pl
0.13606911447084233
zh
0.08779931584948689
be
0.08045977011494253
hu
0.07727797001153403
az
0.07300115874855156
is
0.07300115874855156
uk
0.07300115874855156
vi
0.07300115874855156
reliable
true
passes
true
2
name
"Melanie"
dialogue
"Ja, ich... ich habe etwas gesehen! Aber ich verstehe nicht, was los ist. Es war so... unheimlich."
detectedLang
"de"
heavyLang
"de"
scores
de
0.8308212857582283
en
0.44779116465863456
ca
0.42287513116474296
es
0.4073275862068965
nl
0.39956331877729256
sk
0.36342592592592593
yo
0.3436754176610978
fi
0.30467762326169406
lv
0.29936305732484075
sl
0.29577464788732394
pl
0.26174496644295303
hu
0.2403314917127072
lt
0.233983286908078
et
0.21875
no
0.21540656205420827
sq
0.19590643274853803
sv
0.19590643274853803
eu
0.1729323308270677
hi
0.16158536585365854
cs
0.15384615384615385
vi
0.15254237288135594
tr
0.14596273291925466
tl
0.13793103448275862
da
0.12698412698412698
it
0.11575562700964631
is
0.1085899513776337
fr
0.10277324632952692
pt
0.10277324632952692
az
0.09688013136288999
ro
0.09688013136288999
reliable
true
passes
true
3
name
"Hunter"
dialogue
"I’m sorry, I don’t speak German. Could you... maybe point or show me?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8120973514674303
tl
0.7015349630471859
fr
0.4801980198019802
it
0.4192477876106194
sq
0.40136830102622584
da
0.3574051407588739
pt
0.3354430379746835
ro
0.3234536082474227
nl
0.31282722513089006
no
0.3101182654402102
ca
0.29718875502008035
pl
0.29340511440107675
sv
0.2837653478854025
cs
0.2584745762711864
es
0.2467718794835007
et
0.23133235724743775
ms
0.22680412371134018
tr
0.21052631578947367
hr
0.20933734939759033
az
0.20212765957446807
sl
0.1435562805872757
yo
0.14215686274509806
de
0.125
fi
0.125
sk
0.12060301507537688
be
0.11764705882352942
hu
0.11317567567567569
is
0.10714285714285714
lt
0.10714285714285714
lv
0.10714285714285714
uk
0.10714285714285714
vi
0.10714285714285714
reliable
true
passes
true
4
name
"Melanie"
dialogue
"Nein, nein— Sie verstehen nicht! Da war ein Mann, aber dann... dann war er einfach weg!"
detectedLang
"de"
heavyLang
"de"
scores
de
0.8450036469730123
no
0.5649948822927329
is
0.5502645502645502
nl
0.542518837459634
da
0.380466472303207
eu
0.35993975903614456
pt
0.3078175895765472
en
0.30098684210526316
it
0.2975206611570248
pl
0.2916666666666667
az
0.2796610169491525
es
0.22867513611615245
ro
0.22867513611615245
sl
0.22445255474452555
hr
0.21731123388581952
tr
0.1920152091254753
cs
0.1904761904761905
fi
0.17153996101364524
lt
0.1533864541832669
yo
0.15
hu
0.1448692152917505
fr
0.1290983606557377
tl
0.1290983606557377
vi
0.1290983606557377
ca
0.121900826446281
sq
0.121900826446281
sv
0.121900826446281
reliable
true
passes
true
5
name
"Hunter"
dialogue
"Okay, okay. Slow down. You saw a man disappear?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.7584541062801933
tl
0.584717607973422
nl
0.5238095238095238
ms
0.5107632093933464
it
0.4588744588744588
cs
0.45652173913043476
da
0.44567627494456763
fr
0.4369369369369369
sv
0.4318181818181818
de
0.42263279445727486
lv
0.41588785046728977
lt
0.4131455399061033
no
0.3961352657004831
hu
0.3842364532019704
pt
0.358974358974359
ro
0.3573264781491003
ca
0.35233160621761656
es
0.34554973821989526
sk
0.34210526315789475
yo
0.32249322493224936
hr
0.3093922651933701
pl
0.29577464788732394
sl
0.2647058823529412
tr
0.23547400611620795
is
0.23076923076923078
sq
0.22360248447204967
az
0.21875
eu
0.21875
vi
0.21875
et
0.20127795527156547
fi
0.20127795527156547
reliable
true
passes
true
6
name
"Melanie"
dialogue
"Ja! Genau wie die anderen!"
detectedLang
"de"
heavyLang
"de"
scores
de
0.8372093023255814
nl
0.7456395348837209
da
0.6450304259634888
no
0.5430809399477807
ca
0.5192307692307693
sv
0.5056497175141244
yo
0.48224852071005914
pl
0.47447447447447455
et
0.46808510638297873
fi
0.4664634146341463
lv
0.396551724137931
eu
0.37722419928825623
tr
0.34210526315789475
sk
0.32432432432432434
es
0.3137254901960784
ro
0.3137254901960784
sl
0.3137254901960784
sq
0.3
reliable
true
passes
true
7
name
"Hunter"
dialogue
"Look, I’ve gotta run, but... maybe find someone who speaks both languages? This is important."
detectedLang
"en"
heavyLang
"en"
scores
en
0.809825673534073
tl
0.5568685376661743
fr
0.48320413436692505
ro
0.4759825327510917
da
0.40476190476190477
it
0.3957703927492447
nl
0.39455095862764883
ca
0.38271604938271603
yo
0.3197278911564626
es
0.3142857142857143
pt
0.3142857142857143
hu
0.30394431554524365
no
0.27710843373493976
et
0.26560587515299877
is
0.22680412371134018
de
0.21156373193166886
sv
0.1935483870967742
lt
0.18256130790190736
fi
0.15730337078651685
ms
0.12663755458515283
tr
0.11764705882352942
eu
0.11504424778761062
sq
0.10044977511244377
reliable
true
passes
true
8
name
"Melanie"
dialogue
"Ich werde es versuchen."
detectedLang
"de"
heavyLang
"de"
scores
de
0.8390064397424103
nl
0.6548323471400395
es
0.6162280701754387
ca
0.5406824146981627
hu
0.49856733524355296
lt
0.4897959183673469
sv
0.4852941176470589
da
0.45987654320987653
it
0.4496855345911949
pt
0.4496855345911949
no
0.4336569579288026
ro
0.42622950819672134
sk
0.41471571906354515
lv
0.4067796610169492
pl
0.396551724137931
tr
0.39236111111111116
is
0.2768595041322314
en
0.2647058823529412
fr
0.2647058823529412
az
0.25213675213675213
sq
0.25213675213675213
reliable
true
passes
true