NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-09-25-01M3CKC2HE5XHBZTVAA4NRFQDQ
Run Details
Model:
Mistral Medium 3.5 (Reasoning)
Test:
Language Writing
Scenario:
Character dialogue (Italian) in a story
Duration:
7.2s
Cost:
$0.006156
Provider:
Mistral
Evaluation summary
Score
Evaluator
Details Link
100.00%
Parse dialogue
(details)
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Isabella"> Isabella is a 30-year old college student on a study abroad program. Born in Italy, she is fluent in Italian and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Italian, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Isabella is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Italian, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Isabella and Hunter as a voice sheet: Isabella: "..." Hunter: "..."
Model response
Messages
Meta
AI
**Voice Sheet:** --- **Isabella:** *(softly, to herself, in Italian)* "Non riesco a credere che sia successo qui... è così tranquillo questo posto." *(She sighs, looking down at her camera, her fingers tracing the edges as if searching for answers in its lens.)* *(Hunter approaches, pulling out a small notepad and pen. He clears his throat, his expression serious but not unkind.)* **Hunter:** "Ma'am, I’m Detective Hunter. Mind if I ask you a few questions about what happened at the festival last night?" *(Isabella looks up, startled. Her eyes widen slightly, and she clutches her camera a little tighter. She responds in rapid, shaken Italian.)* **Isabella:** "Io... io non so nulla! Non ho visto nulla! È stato orribile, non riesco ancora a..." *(She trails off, her voice trembling as she shakes her head, as if trying to rid herself of the memory.)* *(Hunter blinks, clearly confused. He leans in slightly, as if that might help him understand her words.)* **Hunter:** "Ma'am, I... I don’t speak Italian. You’re gonna have to help me out here." *(Isabella looks at him, her brow furrowing in frustration. She gestures wildly with her hands, her words spilling out in a mix of urgency and fear.)* **Isabella:** "Non capisce? Ma come? È importante! C’era un uomo, vicino al chiosco delle mele, e poi... poi è sparito!" *(She mimics a vanishing motion with her hands, her voice rising in pitch.)* *(Hunter scratches his head, his no-nonsense demeanor faltering slightly as he realizes the language barrier is thicker than he anticipated.)* **Hunter:** "Okay, okay. Slow down. You’re saying there was a man near the apple stand? And then he... disappeared?" *(He makes a vague gesture, mimicking her earlier motion, hoping it’s universal enough.)* *(Isabella nods vigorously, relieved that he seems to be catching on, even if just barely. She points toward the town square, her words still rapid but slightly calmer.)* **Isabella:** "Sì, sì! Lì! E non era solo lui. Ho sentito le voci, le urla. Ma quando sono arrivata la polizia, non c’era più nessuno!" *(Hunter jots down a few notes, his brow furrowed in concentration. He looks up at her, his tone firm but not unkind.)* **Hunter:** "Alright, listen. I’m gonna need you to come down to the station later. We’ll get someone who can translate, okay? For now, just... stay in town." *(Isabella nods, though her expression is still uneasy. She clutches her camera to her chest, as if it’s the only thing keeping her grounded.)* **Isabella:** *(quietly, in Italian)* "Va bene. Ma... per favore, trovatelo. Prima che sia troppo tardi." *(Hunter gives her a small, reassuring nod, even if he doesn’t understand the words. Just as he’s about to say something else, his phone rings. He pulls it out, glances at the screen, and sighs.)* **Hunter:** "I’ve gotta take this. Stay here for a minute." *(He steps away, answering the call with a brisk,)* "Hunter here." *(Isabella watches him, her fingers tightening around her camera as the weight of the situation settles back over her.)* ---
created_at
"2026-09-25T15:36:32.575Z"
9/25/2026, 3:36:32 PM
model
"mistralai/mistral-medium-3.5-20260430"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
411
moderation_latency
(null)
generation_time
7117
tokens_prompt
308
tokens_completion
789
native_tokens_prompt
289
native_tokens_completion
763
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
"default"
usage
0.006156
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1790350592-Aq8VZa4vx2AteOO9CU88"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1790350592-HYSKyWBW0SmVVVbGDgnY"
upstream_id
"8b193ae992e64d259de9a1225e5c3397"
provider_responses
0
endpoint_id
"d21d316f-d540-4718-b36e-3beff85d0cf9"
id
"8b193ae992e64d259de9a1225e5c3397"
is_byok
false
latency
397
model_permaslug
"mistralai/mistral-medium-3.5-20260430"
provider_name
"Mistral"
status
200
total_cost
0.006156
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Mistral"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
100.00%
Parse dialogue
n/a
dialogue
0
name
"Isabella"
dialogue
"Non riesco a credere che sia successo qui... è così tranquillo questo posto."
detectedLang
"it"
heavyLang
"it"
scores
it
0.8257839721254355
pt
0.6335776149233845
fr
0.6143057503506312
ca
0.5820668693009119
en
0.5739736638264911
es
0.5638382236320381
ro
0.5145631067961165
hr
0.461839530332681
da
0.4554455445544555
tl
0.4410569105691057
cs
0.4358974358974359
sl
0.43064182194616984
nl
0.4155154091392136
lt
0.40860215053763443
de
0.40476190476190477
sk
0.40347071583514105
sv
0.37286202964652226
no
0.34523809523809523
tr
0.3349455864570738
lv
0.3184634448574969
yo
0.3184634448574969
pl
0.314214463840399
eu
0.289405684754522
ms
0.28756476683937826
et
0.2724867724867725
sq
0.2695883134130146
az
0.25474254742547425
vi
0.2231638418079096
hu
0.22096317280453256
fi
0.18154761904761904
is
0.12
reliable
true
passes
true
1
name
"Hunter"
dialogue
"Ma'am, I’m Detective Hunter. Mind if I ask you a few questions about what happened at the festival last night?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8116868294909838
tl
0.6688077077478924
fr
0.5625662778366914
it
0.5225694444444445
da
0.5192307692307693
no
0.5169789227166276
ca
0.5106761565836299
pt
0.4755244755244755
nl
0.4448183041722746
ro
0.4436952124072825
sv
0.43454420836189167
cs
0.41029306647605435
es
0.4081779053084649
sq
0.406901509705248
hr
0.3861607142857143
et
0.3336025848142165
sl
0.32817589576547235
yo
0.3193069306930693
de
0.3170529801324503
ms
0.31478405315614616
hu
0.314214463840399
sk
0.27947598253275113
pl
0.26273458445040215
lt
0.24726277372262775
az
0.23327137546468402
tr
0.19980601357904945
lv
0.19196865817825662
is
0.14330218068535827
vi
0.13883089770354906
fi
0.13249211356466878
be
0.0782122905027933
eu
0.0782122905027933
uk
0.07094594594594594
reliable
true
passes
true
2
name
"Isabella"
dialogue
"Io... io non so nulla! Non ho visto nulla! È stato orribile, non riesco ancora a..."
detectedLang
"it"
heavyLang
"it"
scores
it
0.8129184718393068
en
0.5153061224489796
ca
0.5077720207253886
es
0.5020964360587002
sk
0.5015739769150053
pt
0.5010504201680672
sl
0.4952178533475027
yo
0.48425624321389793
fr
0.47687224669603523
no
0.4757174392935982
de
0.46509009009009006
ro
0.45961319681456203
tl
0.4418331374853114
lt
0.41212871287128716
cs
0.38788659793814434
fi
0.3572395128552098
hr
0.34392265193370164
da
0.3155619596541787
sq
0.31059506531204645
sv
0.309593023255814
az
0.30453879941434847
et
0.302496328928047
lv
0.3014705882352941
vi
0.26242236024844723
pl
0.26127527216174184
eu
0.24841772151898736
hu
0.24722662440570525
is
0.23633440514469453
nl
0.22764227642276424
tr
0.22258592471358432
ms
0.20435510887772196
reliable
true
passes
true
3
name
"Hunter"
dialogue
"Ma'am, I... I don’t speak Italian. You’re gonna have to help me out here."
detectedLang
"en"
heavyLang
"en"
scores
en
0.7917534360683048
tl
0.5446265938069217
sq
0.5140913508260446
da
0.4731296101159114
no
0.44933920704845814
it
0.42857142857142855
fi
0.39320388349514557
hr
0.3857493857493857
cs
0.3710691823899371
yo
0.37027707808564225
sl
0.3581514762516046
et
0.3573264781491003
pl
0.3429697766097241
ro
0.32523616734143057
ms
0.31880108991825606
lt
0.3150684931506849
sk
0.28977272727272724
sv
0.2826398852223816
lv
0.27007299270072993
es
0.24812030075187969
fr
0.23547400611620795
nl
0.22720247295208654
pt
0.22720247295208654
ca
0.2163009404388715
tr
0.20508744038155804
az
0.19614147909967844
be
0.12280701754385964
hu
0.11816578483245149
de
0.11190053285968028
is
0.11190053285968028
uk
0.11190053285968028
vi
0.11190053285968028
reliable
true
passes
true
4
name
"Isabella"
dialogue
"Non capisce? Ma come? È importante! C’era un uomo, vicino al chiosco delle mele, e poi... poi è sparito!"
detectedLang
"it"
heavyLang
"it"
scores
it
0.8243395165823496
fr
0.624173180998196
es
0.6066708621774701
ro
0.5882740447957839
tl
0.5139968895800934
ca
0.5082612116443744
pt
0.5063191153238547
en
0.5
yo
0.410933081998115
da
0.3854473942969518
no
0.378727634194831
sq
0.37374749498997994
de
0.3441762854144806
et
0.3124312431243124
lt
0.3078626799557032
lv
0.2690058479532163
sv
0.24969987995198079
pl
0.23218673218673216
nl
0.22839506172839508
eu
0.2264851485148515
fi
0.2255266418835192
ms
0.20483460559796438
hu
0.2028061224489796
tr
0.1935483870967742
is
0.1883116883116883
sk
0.11598302687411598
vi
0.11095305832147938
cs
0.10071942446043164
sl
0.09682080924855492
az
0.09156976744186046
hr
0.09156976744186046
reliable
true
passes
true
5
name
"Hunter"
dialogue
"Okay, okay. Slow down. You’re saying there was a man near the apple stand? And then he... disappeared?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8072360616844604
de
0.5517241379310345
nl
0.5293265749456916
tl
0.526584122359796
yo
0.4415807560137457
fr
0.4337979094076655
da
0.4074749316317229
no
0.38967136150234744
sv
0.3838862559241706
es
0.36149312377210213
it
0.35960591133004927
ms
0.3143459915611814
sq
0.3062966915688367
ro
0.29805615550755943
tr
0.27293064876957496
lt
0.2655367231638418
ca
0.2588369441277081
is
0.2494226327944573
eu
0.24330616996507565
cs
0.2415402567094516
sk
0.23708920187793428
hr
0.22985781990521328
pl
0.2243436754176611
lv
0.214975845410628
sl
0.20245398773006135
hu
0.1935483870967742
fi
0.19154228855721395
pt
0.17721518987341772
az
0.1698595146871009
vi
0.09722222222222222
et
0.08835904628330996
reliable
true
passes
true
6
name
"Isabella"
dialogue
"Sì, sì! Lì! E non era solo lui. Ho sentito le voci, le urla. Ma quando sono arrivata la polizia, non c’era più nessuno!"
detectedLang
"it"
heavyLang
"it"
scores
it
0.8188405797101449
fr
0.6274614156466205
ro
0.5853080568720379
es
0.5795795795795796
pt
0.5244565217391305
ca
0.5192307692307693
en
0.46564885496183206
yo
0.45054945054945056
eu
0.4336569579288026
sq
0.40728196443691783
tl
0.396551724137931
no
0.381078691423519
sl
0.33396764985727884
hu
0.3217054263565891
et
0.3184031158714703
hr
0.3143976493633692
ms
0.3006993006993007
fi
0.2893401015228426
sk
0.2849846782431052
pl
0.2835209825997953
cs
0.2805755395683453
vi
0.27159209157127995
sv
0.24487594390507011
lt
0.23830250272034822
tr
0.2265193370165746
az
0.22308546059933407
da
0.17936694021101993
lv
0.1784037558685446
de
0.1764705882352941
nl
0.17550058892815076
is
0.08735332464146023
reliable
true
passes
true
7
name
"Hunter"
dialogue
"Alright, listen. I’m gonna need you to come down to the station later. We’ll get someone who can translate, okay? For now, just... stay in town."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8062873588665043
tl
0.6019108280254777
no
0.5333333333333334
da
0.515235457063712
de
0.4834710743801653
sv
0.470659407138536
nl
0.4696969696969697
it
0.4455006337135614
fr
0.3977976600137646
yo
0.39109255393180237
pl
0.3613138686131387
et
0.3537666174298375
sl
0.3425995492111195
ro
0.33912386706948644
cs
0.31048069345941687
hr
0.3093922651933701
fi
0.3055555555555556
pt
0.30167597765363136
lv
0.27864798021434456
sk
0.26346801346801346
az
0.24438687392055264
sq
0.24242424242424243
ms
0.23647469458987785
tr
0.2331288343558282
lt
0.21944692239072258
ca
0.20742753623188404
es
0.19945105215004574
eu
0.17374881964117092
is
0.16267942583732056
vi
0.09138110072689512
hu
0.08376963350785341
zh
0.08088235294117647
hi
0.07991587802313353
reliable
true
passes
true
8
name
"Isabella"
dialogue
"Va bene. Ma... per favore, trovatelo. Prima che sia troppo tardi."
detectedLang
"it"
heavyLang
"it"
scores
it
0.8043278084714549
ca
0.5711402623612513
ro
0.5350109409190372
es
0.5029239766081871
sq
0.4572158365261813
hr
0.4501940491591203
pt
0.4501940491591203
fr
0.44948186528497414
et
0.4429882044560944
sk
0.42953020134228187
de
0.4064245810055866
ms
0.39372325249643364
lt
0.36661698956780925
nl
0.35213414634146345
sl
0.34715821812596004
en
0.34615384615384615
tl
0.3431221020092735
no
0.3410852713178295
cs
0.2796610169491525
sv
0.2685025817555938
da
0.22586520947176683
lv
0.22018348623853207
pl
0.20112781954887218
hu
0.16173570019723865
vi
0.1550695825049702
yo
0.1550695825049702
tr
0.121900826446281
reliable
true
passes
true
9
name
"Hunter"
dialogue
"Hunter here."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8036649214659686
sq
0.6794871794871795
de
0.5398773006134969
da
0.5222929936305732
no
0.5098039215686274
fr
0.4897959183673469
sv
0.4827586206896552
tl
0.471830985915493
it
0.45652173913043476
nl
0.45652173913043476
pt
0.45652173913043476
ca
0.44029850746268656
ms
0.44029850746268656
ro
0.44029850746268656
sl
0.44029850746268656
tr
0.44029850746268656
reliable
true
passes
true