NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-09-25-01M3CKEEXCNSDB555R4GW9HPH2
Run Details
Model:
Mistral Medium 3.5 (Reasoning)
Test:
Language Writing
Scenario:
Character dialogue (German) in a story
Duration:
4.9s
Cost:
$0.003735
Provider:
Mistral
Evaluation summary
Score
Evaluator
Details Link
100.00%
Parse dialogue
(details)
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Melanie"> Melanie is a 30-year old college student on a study abroad program. Born in Germany, she is fluent in German and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of German, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Melanie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in German, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Melanie and Hunter as a voice sheet: Melanie: "..." Hunter: "..."
Model response
Messages
Meta
AI
**Voice Sheet: Café Encounter** --- **Melanie:** *(muttering to herself in German, adjusting her camera)* "Das ist seltsam... ich habe so etwas noch nie gesehen." *(This is strange... I’ve never seen anything like this.)* **Hunter:** *(approaches, clearing his throat)* "Excuse me, miss. I’m Detective Hunter. Mind if I ask you a few questions about what happened at the festival last night?" **Melanie:** *(startled, responds in rapid German, hands trembling slightly)* "Ich—ich war nur dort, um Fotos zu machen! Ich habe nichts gesehen, ich schwöre!" *(I—I was only there to take photos! I didn’t see anything, I swear!)* **Hunter:** *(frowning, rubbing his temple)* "Uh… lady, I don’t speak German. You’re gonna have to slow down and—" *(pauses, realizing she doesn’t understand)* "—never mind. Look, did you see anything *unusual*? Pointing, gestures, anything?" **Melanie:** *(shakes her head vigorously, still speaking German)* "Nein, nein, ich war allein! Die Leute… sie sind einfach verschwunden!" *(No, no, I was alone! The people… they just disappeared!)* **Hunter:** *(sighs, pulling out a notepad and scribbling something)* "Okay, this isn’t working. *(leans in slightly)* Listen, if you saw something, *anything*, find someone who speaks English, got it? Or come to the station. We’ve got translators." *(his phone rings—he checks it, then curses under his breath)* "I’ve gotta take this. *(to Melanie, pointing at her camera)* And hey—if you’ve got pictures, *keep ‘em safe*." *(turns away, answering the call)* "Hunter here." **Melanie:** *(watches him leave, whispering in German)* "Was zum…?" *(What the…?) *(clutches her camera tighter, looking around nervously)* --- **End Scene**
created_at
"2026-09-25T15:37:50.77Z"
9/25/2026, 3:37:50 PM
model
"mistralai/mistral-medium-3.5-20260430"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
416
moderation_latency
(null)
generation_time
4837
tokens_prompt
306
tokens_completion
450
native_tokens_prompt
285
native_tokens_completion
441
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
"default"
usage
0.003735
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1790350670-N8tr9528TWqQsNdziumT"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1790350670-KdMpMhlDskNjJ52WIxLv"
upstream_id
"126e36dc84ec4607b77d7b2e5b54ae59"
provider_responses
0
endpoint_id
"d21d316f-d540-4718-b36e-3beff85d0cf9"
id
"126e36dc84ec4607b77d7b2e5b54ae59"
is_byok
false
latency
415
model_permaslug
"mistralai/mistral-medium-3.5-20260430"
provider_name
"Mistral"
status
200
total_cost
0.003735
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Mistral"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
100.00%
Parse dialogue
n/a
dialogue
0
name
"Melanie"
dialogue
"Das ist seltsam... ich habe so etwas noch nie gesehen."
detectedLang
"de"
heavyLang
"de"
scores
de
0.8343527013251785
sk
0.5227606461086637
pl
0.4574290484140233
et
0.4003690036900369
pt
0.3380855397148676
sl
0.3172268907563025
yo
0.2793791574279379
eu
0.26136363636363635
en
0.25799086757990863
hi
0.2459396751740139
vi
0.23349056603773585
tr
0.2243436754176611
fi
0.21307506053268765
no
0.21307506053268765
tl
0.21307506053268765
reliable
true
passes
true
1
name
"Hunter"
dialogue
"Excuse me, miss. I’m Detective Hunter. Mind if I ask you a few questions about what happened at the festival last night?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8105650573717254
tl
0.6686861037485801
fr
0.568327577701036
it
0.5290635091496232
no
0.5267712276906436
da
0.5045300113250283
ca
0.4959677419354839
pt
0.4886031560490941
nl
0.45987654320987653
sq
0.44933920704845814
es
0.43402328589909445
ro
0.4292237442922375
sv
0.4201457919151756
cs
0.3961352657004831
hr
0.37230989956958394
et
0.3673174258857556
sl
0.35944363103953153
ms
0.3460388639760837
yo
0.30665610142630745
de
0.3044515103338633
hu
0.30167597765363136
sk
0.2677824267782427
pl
0.251497005988024
lt
0.23647469458987785
az
0.22291296625222026
tr
0.19056429232192415
fi
0.18680297397769516
lv
0.1830065359477124
is
0.1362290227048371
vi
0.13194444444444445
be
0.07407407407407407
eu
0.07407407407407407
uk
0.06716417910447761
reliable
true
passes
true
2
name
"Melanie"
dialogue
"Ich—ich war nur dort, um Fotos zu machen! Ich habe nichts gesehen, ich schwöre!"
detectedLang
"de"
heavyLang
"de"
scores
de
0.8296744890234671
sv
0.46428571428571425
pt
0.45255474452554745
nl
0.4289340101522843
en
0.37931034482758624
tr
0.32330827067669177
sk
0.29797191887675506
pl
0.27884615384615385
cs
0.2706645056726094
fr
0.267100977198697
is
0.25742574257425743
es
0.24114671163575044
lt
0.24114671163575044
da
0.23339011925042585
ca
0.22945205479452058
lv
0.22945205479452058
eu
0.20353982300884957
ms
0.1818181818181818
fi
0.16356877323420074
tl
0.14285714285714285
hr
0.12959381044487428
sl
0.12959381044487428
et
0.12280701754385964
it
0.12280701754385964
sq
0.12280701754385964
az
0.11591355599214145
no
0.11591355599214145
ro
0.11591355599214145
reliable
true
passes
true
3
name
"Hunter"
dialogue
"—never mind. Look, did you see anything unusual? Pointing, gestures, anything?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.7945205479452054
tl
0.5782567947516402
et
0.5060373216245884
fr
0.5
nl
0.44168734491315137
pt
0.40554821664464996
ro
0.3902439024390244
ca
0.3626062322946175
de
0.3562231759656652
ms
0.35344827586206895
no
0.3515850144092219
da
0.34782608695652173
sv
0.34782608695652173
it
0.337260677466863
hu
0.2890995260663507
lt
0.26350245499181674
lv
0.2598684210526316
es
0.25864909390444807
is
0.256198347107438
sq
0.1818181818181818
pl
0.16974169741697415
sk
0.16820702402957485
cs
0.14772727272727273
sl
0.14285714285714285
hr
0.12959381044487428
reliable
true
passes
true
4
name
"Melanie"
dialogue
"Nein, nein, ich war allein! Die Leute… sie sind einfach verschwunden!"
detectedLang
"de"
heavyLang
"de"
scores
de
0.8329156223893066
nl
0.5893223819301848
en
0.3874425727411945
no
0.37791601866251945
fr
0.36808846761453395
pl
0.3620414673046252
da
0.355877616747182
is
0.3185689948892675
et
0.3150684931506849
hu
0.3055555555555556
it
0.28698752228163993
sv
0.28698752228163993
ca
0.2844364937388193
es
0.26335174953959484
sq
0.25788497217068646
sk
0.2366412213740458
tr
0.23224568138195778
yo
0.18032786885245902
lt
0.16142557651991615
fi
0.14893617021276595
tl
0.14893617021276595
pt
0.13606911447084233
az
0.12854030501089325
ro
0.12854030501089325
reliable
true
passes
true
5
name
"Hunter"
dialogue
"Hunter here."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8036649214659686
sq
0.6794871794871795
de
0.5398773006134969
da
0.5222929936305732
no
0.5098039215686274
fr
0.4897959183673469
sv
0.4827586206896552
tl
0.471830985915493
it
0.45652173913043476
nl
0.45652173913043476
pt
0.45652173913043476
ca
0.44029850746268656
ms
0.44029850746268656
ro
0.44029850746268656
sl
0.44029850746268656
tr
0.44029850746268656
reliable
true
passes
true
6
name
"Melanie"
dialogue
"Was zum…?"
detectedLang
"de"
heavyLang
"de"
scores
de
0.8493975903614458
en
0.75
nl
0.7282608695652174
yo
0.635036496350365
reliable
false
passes
true