NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-09-25-01M3CKFQ8Z2QMQXCR1RD8E86YF
Run Details
Model:
Mistral Medium 3.5 (Reasoning)
Test:
Language Writing
Scenario:
Character dialogue (Italian) in a story
Duration:
5.5s
Cost:
$0.005143
Provider:
Mistral
Evaluation summary
Score
Evaluator
Details Link
100.00%
Parse dialogue
(details)
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Isabella"> Isabella is a 30-year old college student on a study abroad program. Born in Italy, she is fluent in Italian and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Italian, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Isabella is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Italian, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Isabella and Hunter as a voice sheet: Isabella: "..." Hunter: "..."
Model response
Messages
Meta
AI
**Voice Sheet:** --- **Isabella:** *(looking up from her camera, startled)* "Sì? Mi scusi, può aiutarla?" *(Yes? Excuse me, can I help you?)* **Hunter:** *(leaning slightly forward, hands on the table)* "Ma'am, I’m Detective Hunter. I need to ask you a few questions about what happened at the festival last night. You were there, right?" **Isabella:** *(frowning, shaking her head slightly)* "Non capisco... Parla italiano?" *(I don’t understand... Do you speak Italian?)* **Hunter:** *(straightening up, confused)* "Italian? No, I don’t. Listen, did you see anything unusual? A disturbance, maybe someone acting strange?" **Isabella:** *(growing more agitated, gesturing with her hands)* "Non so di cosa sta parlando! Io... io ho visto solo la folla, le luci... e poi..." *(I don’t know what you’re talking about! I... I only saw the crowd, the lights... and then...)* *(her voice trails off, her hands trembling slightly as she clutches her camera)* **Hunter:** *(squinting, realizing the language barrier)* "Hold on—you don’t speak English at all, do you?" **Isabella:** *(shaking her head, frustrated)* "No, no inglese. Solo italiano." *(No, no English. Only Italian.)* **Hunter:** *(rubbing his temple, sighing)* "Okay, this isn’t working. *(pauses, then points to her camera)* You take pictures, right? Did you... did you photograph anything last night? Maybe something that could help?" **Isabella:** *(nodding slowly, then flipping through her camera)* "Sì, sì, ho scattato molte foto. Ma... non so se..." *(Yes, yes, I took many photos. But... I don’t know if...)* *(she hesitates, then shows him a blurry image on the screen—something in the background looks out of place)* **Hunter:** *(leaning in, studying the photo)* "That—right there. That’s... *(his phone rings loudly, cutting him off)* Damn it. *(he pulls out his phone, glancing at the screen)* I’ve gotta take this. *(to Isabella, stern but not unkind)* Stay here. Don’t go anywhere." **Isabella:** *(nodding, but looking uneasy)* "Aspetta, dove va? Io non..." *(Wait, where are you going? I don’t...)* **Hunter:** *(already stepping away, phone to his ear)* "Yeah, I’m on it." *(to Isabella, over his shoulder)* "I’ll be back. Just... sit tight." **Isabella:** *(muttering to herself, watching him leave)* "Che sta succedendo qui..." *(What is happening here...)* --- **End Scene.**
created_at
"2026-09-25T15:38:32.102Z"
9/25/2026, 3:38:32 PM
model
"mistralai/mistral-medium-3.5-20260430"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
319
moderation_latency
(null)
generation_time
5439
tokens_prompt
308
tokens_completion
615
native_tokens_prompt
289
native_tokens_completion
628
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
256
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
"default"
usage
0.0051435
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1790350712-8k7ggeyEytDpFD3sDrze"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1790350712-3Ge9wiW8S8hzv8b6okZi"
upstream_id
"72a9c4f725d8474a81e463ec01c0a9c8"
provider_responses
0
endpoint_id
"38ef23a9-5cb3-46fa-85ec-7aed174f04eb"
id
"72a9c4f725d8474a81e463ec01c0a9c8"
is_byok
false
latency
319
model_permaslug
"mistralai/mistral-medium-3.5-20260430"
provider_name
"Mistral"
status
200
total_cost
0.0051435
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Mistral"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
100.00%
Parse dialogue
n/a
dialogue
0
name
"Isabella"
dialogue
"Sì? Mi scusi, può aiutarla?"
detectedLang
"it"
heavyLang
"it"
scores
it
0.7892518440463646
yo
0.5614035087719298
tr
0.5575221238938053
es
0.5535714285714286
cs
0.4350282485875706
ca
0.4065281899109792
az
0.33774834437086093
sl
0.3150684931506849
hu
0.2982456140350877
ro
0.2982456140350877
is
0.2907801418439716
sk
0.2907801418439716
hr
0.2805755395683453
pl
0.2805755395683453
tl
0.2647058823529412
fr
0.24528301886792453
reliable
true
passes
true
1
name
"Hunter"
dialogue
"Ma'am, I’m Detective Hunter. I need to ask you a few questions about what happened at the festival last night. You were there, right?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8201089070400622
tl
0.6671464555595539
fr
0.5342396777442094
da
0.5182291666666667
no
0.5174752217005738
it
0.4939824945295405
ca
0.48208286674132134
pt
0.44710101613867304
cs
0.4325153374233129
nl
0.4167717528373266
ro
0.4156664560960202
sq
0.4104525175270874
hr
0.40705128205128205
es
0.3808567603748327
de
0.3775235531628533
sv
0.3660041124057573
sl
0.3616287094547964
yo
0.3616287094547964
et
0.33405327573794097
sk
0.32824981844589685
pl
0.3168389955686854
ms
0.29064417177914115
lt
0.28846153846153844
lv
0.25583266291230894
hu
0.23868312757201646
az
0.21343537414965988
tr
0.18213969938107868
is
0.12982126058325494
vi
0.12570888468809074
fi
0.11988582302568983
be
0.07035175879396985
eu
0.07035175879396985
uk
0.06376518218623482
reliable
true
passes
true
2
name
"Isabella"
dialogue
"Non capisco... Parla italiano?"
detectedLang
"it"
heavyLang
"it"
scores
it
0.8023715415019763
es
0.7333333333333333
pt
0.7014925373134329
fr
0.623352165725047
ca
0.6070726915520629
en
0.6007984031936128
tl
0.5959595959595959
az
0.5359628770301624
ro
0.5337995337995338
tr
0.5238095238095238
sq
0.5215311004784688
cs
0.49238578680203043
yo
0.42196531791907516
pl
0.4152046783625731
sl
0.3993993993993994
de
0.38650306748466257
lt
0.38650306748466257
nl
0.38650306748466257
hr
0.37888198757763975
ms
0.37888198757763975
no
0.37888198757763975
da
0.3710691823899371
sv
0.3710691823899371
eu
0.30313588850174217
is
0.2907801418439716
sk
0.25925925925925924
hu
0.250936329588015
et
0.23954372623574144
fi
0.2277992277992278
lv
0.2277992277992278
reliable
true
passes
true
3
name
"Hunter"
dialogue
"Italian? No, I don’t. Listen, did you see anything unusual? A disturbance, maybe someone acting strange?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.7850578120367625
tl
0.6176160337552743
no
0.5732783990582696
pt
0.5399746192893401
es
0.52365308804205
fr
0.5153743315508021
ro
0.5153743315508021
hr
0.5144005358338916
it
0.5124411566913248
de
0.5017182130584192
da
0.4915848527349229
sq
0.4915848527349229
nl
0.4810307802433787
sv
0.4704163623082542
cs
0.4474085365853659
ca
0.44656488549618323
ms
0.4186046511627907
sk
0.4076797385620915
et
0.38818565400843885
pl
0.3835034013605442
lv
0.36681222707423583
tr
0.36681222707423583
fi
0.34684684684684686
sl
0.3378995433789954
is
0.3255813953488372
yo
0.3160377358490566
hu
0.29474708171206226
lt
0.275
az
0.257172131147541
eu
0.2050438596491228
vi
0.15501165501165504
be
0.0880503144654088
uk
0.0799492385786802
reliable
true
passes
true
4
name
"Isabella"
dialogue
"Non so di cosa sta parlando! Io... io ho visto solo la folla, le luci... e poi..."
detectedLang
"it"
heavyLang
"it"
scores
it
0.809233117130866
es
0.6668887408394404
tl
0.5670995670995671
fr
0.5652173913043478
ca
0.5579133510167993
sl
0.5487364620938628
yo
0.5395948434622468
ro
0.5327102803738317
no
0.5238095238095238
pt
0.5078740157480316
en
0.50199203187251
sq
0.4617868675995694
sk
0.41792782305005816
de
0.3857493857493857
hu
0.37888198757763975
vi
0.358974358974359
az
0.35064935064935066
fi
0.34810951760104303
sv
0.34725848563968675
et
0.3412384716732542
da
0.3394980184940555
is
0.31224209078404397
ms
0.31224209078404397
lt
0.30362116991643456
tr
0.284692417739628
nl
0.2816091954022989
lv
0.2795389048991354
cs
0.25261584454409564
pl
0.2295839753466872
hr
0.20127795527156547
eu
0.1482112436115843
reliable
true
passes
true
5
name
"Hunter"
dialogue
"Hold on—you don’t speak English at all, do you?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8274870615296146
tl
0.689119170984456
da
0.5447647951441578
no
0.5145631067961165
cs
0.48805460750853247
hr
0.4827586206896552
et
0.44649446494464945
pl
0.4307400379506641
sk
0.40828402366863903
sq
0.38650306748466257
pt
0.34210526315789475
yo
0.33774834437086093
fi
0.3333333333333333
de
0.32432432432432434
sv
0.32432432432432434
sl
0.2857142857142857
vi
0.27007299270072993
fr
0.2665036674816626
ca
0.24812030075187969
hi
0.21875
it
0.1935483870967742
ms
0.1935483870967742
ro
0.1935483870967742
reliable
true
passes
true
6
name
"Isabella"
dialogue
"No, no inglese. Solo italiano."
detectedLang
"it"
heavyLang
"it"
scores
it
0.8053392658509454
es
0.7666666666666666
pt
0.7163695299837927
ca
0.5454545454545454
yo
0.5205479452054795
en
0.4883040935672514
hr
0.47761194029850745
no
0.47761194029850745
sq
0.4760479041916168
tl
0.4696969696969697
pl
0.4615384615384615
tr
0.45652173913043476
lv
0.4281045751633987
sk
0.34210526315789475
et
0.3055555555555556
sl
0.2857142857142857
ro
0.2768595041322314
de
0.2647058823529412
fr
0.2647058823529412
lt
0.2647058823529412
nl
0.2647058823529412
az
0.25213675213675213
cs
0.25213675213675213
da
0.25213675213675213
fi
0.25213675213675213
ms
0.25213675213675213
sv
0.25213675213675213
reliable
true
passes
true
7
name
"Hunter"
dialogue
"Okay, this isn’t working. You take pictures, right? Did you... did you photograph anything last night? Maybe something that could help?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.824150058616647
tl
0.6733449477351916
fr
0.4646680942184154
nl
0.25074925074925075
no
0.23625254582484725
de
0.23155737704918034
et
0.1891891891891892
ca
0.1847826086956522
ro
0.16851441241685144
pt
0.1657397107897664
da
0.16294642857142855
sv
0.1601343784994401
sq
0.11764705882352942
lv
0.09963985594237695
cs
0.09420289855072464
es
0.09420289855072464
ms
0.09420289855072464
sl
0.09420289855072464
hi
0.09310761789600969
yo
0.08980582524271845
is
0.08647990255785627
reliable
true
passes
true
8
name
"Isabella"
dialogue
"Sì, sì, ho scattato molte foto. Ma... non so se..."
detectedLang
"it"
heavyLang
"it"
scores
it
0.8135487880671225
yo
0.6148908857509628
ca
0.5810055865921787
sk
0.5548961424332344
sl
0.5454545454545454
no
0.5426829268292682
cs
0.5008319467554077
fr
0.49324324324324326
ro
0.46524064171123
pt
0.460431654676259
en
0.40711462450592883
hr
0.3902439024390244
es
0.38650306748466257
de
0.3814432989690722
sq
0.3710691823899371
vi
0.3710691823899371
tl
0.3697478991596639
pl
0.3617021276595745
da
0.35064935064935066
et
0.3464052287581699
lt
0.33774834437086093
fi
0.2537313432835821
eu
0.2248062015503876
sv
0.2227979274611399
hu
0.21465968586387435
ms
0.1780821917808219
lv
0.17355371900826447
nl
0.17355371900826447
reliable
true
passes
true
9
name
"Hunter"
dialogue
"That—right there. That’s... Damn it. I’ve gotta take this. Stay here. Don’t go anywhere."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8125203782197588
tl
0.6544471153846153
sq
0.3876464323748669
it
0.3413516609392898
de
0.3047158403869408
yo
0.2830423940149626
fi
0.16302765647743814
hu
0.1581259150805271
pl
0.1581259150805271
nl
0.14688427299703263
lv
0.13010590015128592
sl
0.11944869831546708
sv
0.11809815950920245
da
0.11402157164869028
fr
0.11402157164869028
no
0.11402157164869028
reliable
true
passes
true
10
name
"Isabella"
dialogue
"Aspetta, dove va? Io non..."
detectedLang
"it"
heavyLang
"it"
scores
it
0.8271889400921658
fr
0.6511627906976745
ca
0.601063829787234
ro
0.5810055865921787
es
0.5327102803738317
en
0.5222929936305732
is
0.471830985915493
fi
0.4186046511627907
sv
0.4186046511627907
eu
0.3670886075949367
ms
0.34782608695652173
pt
0.3212669683257918
sq
0.3212669683257918
reliable
true
passes
true
11
name
"Hunter"
dialogue
"I’ll be back. Just... sit tight."
detectedLang
"en"
heavyLang
"en"
scores
en
0.7858672376873662
tl
0.6007984031936128
da
0.504950495049505
yo
0.4791666666666667
no
0.46524064171123
hu
0.36908517350157727
lt
0.358974358974359
et
0.33774834437086093
sv
0.33774834437086093
ca
0.2779783393501805
de
0.27007299270072993
fr
0.27007299270072993
reliable
true
passes
true
12
name
"Isabella"
dialogue
"Che sta succedendo qui..."
detectedLang
"it"
heavyLang
"it"
scores
it
0.823943661971831
ca
0.6277915632754343
ro
0.6153846153846154
fr
0.6062992125984252
pt
0.5714285714285714
es
0.5652173913043478
sl
0.4485294117647059
ms
0.39999999999999997
en
0.38016528925619836
da
0.35344827586206895
nl
0.35344827586206895
tl
0.33920704845814975
tr
0.3333333333333333
sv
0.32432432432432434
reliable
true
passes
true