NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-10-07-01M4AVJ92WTRFYMZA46D529XQ1
Run Details
Model:
Mistral Medium 3.5
Test:
Language Writing
Scenario:
Character dialogue (German) in a story
Duration:
5.0s
Cost:
$0.005190
Provider:
Mistral
Evaluation summary
Score
Evaluator
Details Link
100.00%
Parse dialogue
(details)
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Melanie"> Melanie is a 30-year old college student on a study abroad program. Born in Germany, she is fluent in German and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of German, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Melanie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in German, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Melanie and Hunter as a voice sheet: Melanie: "..." Hunter: "..."
Model response
Messages
Meta
AI
**Voice Sheet: Café Encounter** --- **Melanie:** *(muttering to herself, adjusting camera settings)* "Das Licht hier ist perfekt... aber diese Schatten..." *(The light here is perfect... but these shadows...)* **Hunter:** *(approaches, clears throat)* "Excuse me, miss. I’m Detective Hunter. Mind if I ask you a few questions about what happened at the festival last night?" **Melanie:** *(startled, looks up, responds in rapid German)* "Äh—ja, also, ich war dort, aber ich habe nichts gesehen! Es war so... seltsam. Die Leute sind einfach verschwunden!" *(Uh—yes, well, I was there, but I didn’t see anything! It was so... strange. People just disappeared!)* **Hunter:** *(frowns, leans in slightly)* "I’m gonna need you to slow down. You’re gonna have to speak English, ma’am. I don’t understand a word you’re sayin’." **Melanie:** *(flustered, gestures helplessly with her camera)* "Ich—ich spreche kein Englisch! Bitte, ich will helfen, aber..." *(I—I don’t speak English! Please, I want to help, but...)* **Hunter:** *(sighs, rubs his temple)* "Alright. Let’s try this." *(pulls out a notepad, writes slowly in block letters:)* **"DID YOU SEE ANYTHING SUSPICIOUS?"** **Melanie:** *(reads, then shakes her head vigorously, pointing at her camera)* "Nein, nein! Nur... nur Fotos. Aber die Bilder—" *(No, no! Just... just photos. But the pictures—)* *(she flips through her camera, then freezes, her face paling)* **Hunter:** *(notices her reaction, sharpens his tone)* "What? What is it?" **Melanie:** *(whispers in German, voice trembling)* "In den Fotos... da ist jemand. Immer im Hintergrund." *(In the photos... there’s someone. Always in the background.)* **Hunter:** *(leans in, urgent)* "Who? Who’s in the background?" **Melanie:** *(shakes her head, near tears)* "Ich weiß es nicht! Aber... es ist immer dieselbe Person. Und sie... sie lächelt." *(I don’t know! But... it’s always the same person. And they... they’re smiling.)* *(Hunter’s phone rings. He glances at it, curses under his breath.)* **Hunter:** "I gotta take this. *(to Melanie, frustrated)* Look, find someone who speaks German, alright? We *need* to talk." *(answers phone)* "Hunter here." **Melanie:** *(nods, clutching her camera tighter, murmuring to herself as Hunter walks away)* "Das kann nicht sein... das kann nicht sein..." *(This can’t be... this can’t be...)* --- **End Scene**
created_at
"2026-10-07T09:36:57.443Z"
10/7/2026, 9:36:57 AM
model
"mistralai/mistral-medium-3.5-20260430"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
298
moderation_latency
(null)
generation_time
4939
tokens_prompt
306
tokens_completion
624
native_tokens_prompt
285
native_tokens_completion
635
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
"default"
usage
0.00519
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1791365817-bMEb9gV6Uad2zUv8PFZ6"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1791365817-yxzdQhOQ2ZTWxvOKFOBl"
upstream_id
"4ba661349c894759931d6bbf9ff026be"
provider_responses
0
endpoint_id
"d21d316f-d540-4718-b36e-3beff85d0cf9"
id
"4ba661349c894759931d6bbf9ff026be"
is_byok
false
latency
298
model_permaslug
"mistralai/mistral-medium-3.5-20260430"
provider_name
"Mistral"
status
200
total_cost
0.00519
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Mistral"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
100.00%
Parse dialogue
n/a
dialogue
0
name
"Melanie"
dialogue
"Das Licht hier ist perfekt... aber diese Schatten..."
detectedLang
"de"
heavyLang
"de"
scores
de
0.8362720403022671
nl
0.711111111111111
da
0.5142002989536621
sv
0.5068285280728376
no
0.45561139028475717
pt
0.4206773618538324
it
0.41546762589928055
tr
0.4133574007220217
en
0.3380855397148676
fr
0.3271221532091097
ro
0.3128964059196617
es
0.3114406779661017
fi
0.2459396751740139
hi
0.2459396751740139
ca
0.17721518987341772
sq
0.17721518987341772
tl
0.16237113402061853
reliable
true
passes
true
1
name
"Hunter"
dialogue
"Excuse me, miss. I’m Detective Hunter. Mind if I ask you a few questions about what happened at the festival last night?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8105650573717254
tl
0.6686861037485801
fr
0.568327577701036
it
0.5290635091496232
no
0.5267712276906436
da
0.5045300113250283
ca
0.4959677419354839
pt
0.4886031560490941
nl
0.45987654320987653
sq
0.44933920704845814
es
0.43402328589909445
ro
0.4292237442922375
sv
0.4201457919151756
cs
0.3961352657004831
hr
0.37230989956958394
et
0.3673174258857556
sl
0.35944363103953153
ms
0.3460388639760837
yo
0.30665610142630745
de
0.3044515103338633
hu
0.30167597765363136
sk
0.2677824267782427
pl
0.251497005988024
lt
0.23647469458987785
az
0.22291296625222026
tr
0.19056429232192415
fi
0.18680297397769516
lv
0.1830065359477124
is
0.1362290227048371
vi
0.13194444444444445
be
0.07407407407407407
eu
0.07407407407407407
uk
0.06716417910447761
reliable
true
passes
true
2
name
"Melanie"
dialogue
"Äh—ja, also, ich war dort, aber ich habe nichts gesehen! Es war so... seltsam. Die Leute sind einfach verschwunden!"
detectedLang
"de"
heavyLang
"de"
scores
de
0.8270816706570896
nl
0.42781690140845074
et
0.42016057091882253
en
0.4122965641952984
ca
0.38967136150234744
sk
0.3257261410788381
es
0.30851063829787234
yo
0.3077742279020234
hu
0.2995689655172413
no
0.2713004484304933
fi
0.27048260381593714
sv
0.26636568848758463
lv
0.2655367231638418
sl
0.26220204313280365
sq
0.2476851851851852
da
0.23798358733880423
pl
0.23076923076923078
is
0.22341696535244923
lt
0.20537897310513448
tr
0.15693904020752272
eu
0.15032679738562094
cs
0.13333333333333333
vi
0.1321762349799733
tl
0.11924119241192413
it
0.09972299168975068
fr
0.08835904628330996
pt
0.08835904628330996
az
0.08321579689703808
ro
0.08321579689703808
reliable
true
passes
true
3
name
"Hunter"
dialogue
"I’m gonna need you to slow down. You’re gonna have to speak English, ma’am. I don’t understand a word you’re sayin’."
detectedLang
"en"
heavyLang
"en"
scores
en
0.7905834777585211
tl
0.566128067025733
da
0.5352564102564102
no
0.49229691876750703
cs
0.4223107569721115
sv
0.4003308519437552
pl
0.3798118049615056
hr
0.377147766323024
sk
0.36846689895470386
et
0.34684684684684686
ro
0.34090909090909094
tr
0.32369402985074625
yo
0.32116104868913853
it
0.3153918791312559
de
0.3140964995269631
ca
0.27427427427427425
lv
0.2602040816326531
lt
0.25564681724846
nl
0.25488180883864336
hu
0.2352320675105485
is
0.22625400213447172
sl
0.22542735042735043
sq
0.22126745435016112
fi
0.19712070874861573
pt
0.16184971098265896
ms
0.1569767441860465
az
0.15501165501165504
vi
0.15501165501165504
es
0.15402567094515754
fr
0.13895486935866982
be
0.0880503144654088
eu
0.0880503144654088
uk
0.0799492385786802
reliable
true
passes
true
4
name
"Melanie"
dialogue
"Ich—ich spreche kein Englisch! Bitte, ich will helfen, aber..."
detectedLang
"de"
heavyLang
"de"
scores
de
0.8120300751879699
nl
0.6126340882002383
en
0.4749596122778676
no
0.4186046511627907
da
0.3992606284658041
sk
0.3725868725868726
ro
0.35258964143426297
hr
0.3143459915611814
it
0.30703624733475476
pl
0.26136363636363635
et
0.25799086757990863
sl
0.25287356321839083
lt
0.21686746987951808
tl
0.1935483870967742
ms
0.181360201511335
sv
0.181360201511335
is
0.1751269035532995
reliable
true
passes
true
5
name
"Hunter"
dialogue
"DID YOU SEE ANYTHING SUSPICIOUS?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8046875
tl
0.612736660929432
et
0.43037974683544306
ms
0.39999999999999997
sq
0.30769230769230765
hu
0.281150159744409
pt
0.281150159744409
ro
0.281150159744409
cs
0.25742574257425743
ca
0.24242424242424243
es
0.24242424242424243
fr
0.24242424242424243
reliable
true
passes
true
6
name
"Melanie"
dialogue
"Nein, nein! Nur... nur Fotos. Aber die Bilder—"
detectedLang
"de"
heavyLang
"de"
scores
de
0.8236331569664903
nl
0.6491228070175439
no
0.5584988962472406
sv
0.5423340961098398
az
0.47506561679790027
da
0.46524064171123
tr
0.4609164420485175
en
0.43661971830985913
es
0.41690962099125367
lt
0.41690962099125367
pt
0.41690962099125367
ca
0.40119760479041916
lv
0.40119760479041916
eu
0.33993399339933994
ms
0.3333333333333333
yo
0.3055555555555556
fr
0.2857142857142857
ru
0.27007299270072993
cs
0.250936329588015
hr
0.250936329588015
sk
0.250936329588015
sl
0.250936329588015
et
0.23954372623574144
it
0.23954372623574144
sq
0.23954372623574144
pl
0.2277992277992278
ro
0.2277992277992278
reliable
true
passes
true
7
name
"Hunter"
dialogue
"What? What is it?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8592870544090057
yo
0.7232472324723247
nl
0.6794871794871795
hu
0.6724890829694322
is
0.5508982035928144
lv
0.5341614906832298
sq
0.5341614906832298
tl
0.5033112582781457
reliable
true
passes
true
8
name
"Melanie"
dialogue
"In den Fotos... da ist jemand. Immer im Hintergrund."
detectedLang
"de"
heavyLang
"de"
scores
de
0.8107971745711403
da
0.6772805507745266
nl
0.6615523465703971
sv
0.6200607902735562
no
0.5709382151029748
en
0.5603751465416178
it
0.51171875
sl
0.47844228094575797
ro
0.4777158774373259
pl
0.4477172312223858
hr
0.4335347432024169
pt
0.41770186335403725
tr
0.4140625
yo
0.4009584664536741
az
0.39903846153846156
eu
0.3980738362760835
fr
0.38016528925619836
ca
0.3578767123287671
es
0.35456110154905335
sk
0.31066176470588236
ms
0.3029739776951673
cs
0.30037313432835816
tl
0.2937853107344633
lt
0.27606177606177607
lv
0.2632612966601179
fi
0.2299794661190965
hi
0.2203742203742204
et
0.14383561643835618
sq
0.14383561643835618
vi
0.14383561643835618
reliable
true
passes
true
9
name
"Hunter"
dialogue
"Who? Who’s in the background?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8334721065778518
tl
0.6815286624203821
nl
0.6289424860853432
sv
0.5975855130784709
yo
0.4936708860759494
sl
0.4350282485875706
ms
0.43342776203966005
de
0.42363112391930835
it
0.42363112391930835
ro
0.4152046783625731
no
0.3220338983050847
az
0.29577464788732394
pl
0.29577464788732394
da
0.2805755395683453
fr
0.2805755395683453
sq
0.2805755395683453
reliable
true
passes
true
10
name
"Melanie"
dialogue
"Ich weiß es nicht! Aber... es ist immer dieselbe Person. Und sie... sie lächelt."
detectedLang
"de"
heavyLang
"de"
scores
de
0.8248686514886164
sv
0.44382647385984425
nl
0.43566591422121903
en
0.3983152827918171
ca
0.3842364532019704
pl
0.36386768447837153
no
0.3540051679586563
da
0.35233160621761656
es
0.3197278911564626
lv
0.2805755395683453
sk
0.26793557833089315
hu
0.24812030075187969
et
0.24698795180722888
it
0.24585218702865763
lt
0.24585218702865763
tr
0.24357034795764
cs
0.24127465857359634
fr
0.24127465857359634
sq
0.22839506172839508
pt
0.2163009404388715
tl
0.2163009404388715
is
0.21135646687697163
hi
0.1749174917491749
ms
0.14965986394557826
ro
0.14383561643835618
az
0.10554561717352416
hr
0.10554561717352416
reliable
true
passes
true
11
name
"Hunter"
dialogue
"Hunter here."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8036649214659686
sq
0.6794871794871795
de
0.5398773006134969
da
0.5222929936305732
no
0.5098039215686274
fr
0.4897959183673469
sv
0.4827586206896552
tl
0.471830985915493
it
0.45652173913043476
nl
0.45652173913043476
pt
0.45652173913043476
ca
0.44029850746268656
ms
0.44029850746268656
ro
0.44029850746268656
sl
0.44029850746268656
tr
0.44029850746268656
reliable
true
passes
true
12
name
"Melanie"
dialogue
"Das kann nicht sein... das kann nicht sein..."
detectedLang
"de"
heavyLang
"de"
scores
de
0.8678646934460887
pt
0.570446735395189
nl
0.5370370370370371
fr
0.47257383966244726
cs
0.4444444444444444
is
0.3842364532019704
no
0.3842364532019704
reliable
true
passes
true