NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-10-07-01M4ASKC6ZY1NQ5FBVPJQP7Z7Z
Run Details
Model:
Mistral Medium 3.5
Test:
Language Writing
Scenario:
Character dialogue (Italian) in a story
Duration:
4.5s
Cost:
$0.004416
Provider:
Mistral
Evaluation summary
Score
Evaluator
Details Link
100.00%
Parse dialogue
(details)
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Isabella"> Isabella is a 30-year old college student on a study abroad program. Born in Italy, she is fluent in Italian and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Italian, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Isabella is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Italian, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Isabella and Hunter as a voice sheet: Isabella: "..." Hunter: "..."
Model response
Messages
Meta
AI
**Voice Sheet:** --- **Isabella:** *(softly, in Italian, examining her camera)* "Questa foto... non ha senso. Non dovrebbe essere qui." *(This photo... it doesn’t make sense. It shouldn’t be here.)* **Hunter:** *(approaching, firm but polite)* "Ma’am, I’m Detective Hunter. Mind if I ask you a few questions about what happened at the festival last night?" **Isabella:** *(startled, switching to rapid Italian, hands trembling slightly)* "Io... io non so nulla! Non parlo inglese! Per favore, mi lasci in pace!" *(I... I don’t know anything! I don’t speak English! Please, leave me alone!)* **Hunter:** *(frowning, rubbing his temple)* "Okay, okay. Slow down. You’re Italian, right? You were at the festival?" **Isabella:** *(shaking her head, still in Italian, voice wavering)* "Non capisco! Non so cosa è successo! Ho solo scattato delle foto..." *(I don’t understand! I don’t know what happened! I only took some photos...)* **Hunter:** *(sighs, pulling out his phone to show a translated phrase)* "Look, I just need to know if you saw anything... unusual. *Ehm.*" *(points at her camera)* "Did you... take pictures of the crowd?" **Isabella:** *(hesitant, clutching her camera tighter, in Italian)* "Sì, ma... c’era un uomo. Strano. Mi ha guardato come se..." *(Yes, but... there was a man. Strange. He looked at me like...)* *(trails off, visibly upset)* **Hunter:** *(leaning in slightly, frustrated but trying to stay calm)* "Like what? *Come?* Damn it, I need details." **Isabella:** *(whispers in Italian, near tears)* "Come se sapesse che ho visto qualcosa." *(Like he knew I saw something.)* **Hunter:** *(phone rings—he checks it, then curses under his breath)* "I’ve gotta take this. *Stay here.*" *(answers call)* "Hunter here. Yeah, I’m on it." *(to Isabella, sternly)* "Don’t go anywhere. We’re not done." **Isabella:** *(muttering in Italian as he walks away, relieved but anxious)* "Dio mio, che situazione..." *(My God, what a situation...)* --- **End Scene.**
created_at
"2026-10-07T09:02:36.266Z"
10/7/2026, 9:02:36 AM
model
"mistralai/mistral-medium-3.5-20260430"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
323
moderation_latency
(null)
generation_time
4491
tokens_prompt
308
tokens_completion
517
native_tokens_prompt
289
native_tokens_completion
531
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
"default"
usage
0.004416
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1791363756-9BVNuGx9tsnegYG1Mk2N"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1791363756-EduxvdmfmQzK7YuYPPw9"
upstream_id
"7a6063c57c2a4f80af838895b4362e76"
provider_responses
0
endpoint_id
"d21d316f-d540-4718-b36e-3beff85d0cf9"
id
"7a6063c57c2a4f80af838895b4362e76"
is_byok
false
latency
323
model_permaslug
"mistralai/mistral-medium-3.5-20260430"
provider_name
"Mistral"
status
200
total_cost
0.004416
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Mistral"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
100.00%
Parse dialogue
n/a
dialogue
0
name
"Isabella"
dialogue
"Questa foto... non ha senso. Non dovrebbe essere qui."
detectedLang
"it"
heavyLang
"it"
scores
it
0.8270356572645023
ca
0.6486486486486486
fr
0.6103117505995204
pt
0.602203182374541
es
0.570673712021136
de
0.5460893854748603
no
0.5192307692307693
en
0.5185185185185186
hr
0.4217081850533808
ro
0.3981481481481482
sv
0.36893203883495146
da
0.32432432432432434
sl
0.3186582809224318
sk
0.3157894736842105
lv
0.2919389978213508
pl
0.2903930131004367
ms
0.2872807017543859
hu
0.27293064876957496
yo
0.268018018018018
fi
0.24065420560747666
eu
0.2111650485436893
is
0.1875
nl
0.16237113402061853
tl
0.15803108808290156
cs
0.15364583333333331
et
0.15364583333333331
reliable
true
passes
true
1
name
"Hunter"
dialogue
"Ma’am, I’m Detective Hunter. Mind if I ask you a few questions about what happened at the festival last night?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8116868294909838
tl
0.6688077077478924
fr
0.5625662778366914
it
0.5225694444444445
da
0.5192307692307693
no
0.5169789227166276
ca
0.5106761565836299
pt
0.4755244755244755
nl
0.4448183041722746
ro
0.4436952124072825
sv
0.43454420836189167
cs
0.41029306647605435
es
0.4081779053084649
sq
0.406901509705248
hr
0.3861607142857143
et
0.3336025848142165
sl
0.32817589576547235
yo
0.3193069306930693
de
0.3170529801324503
ms
0.31478405315614616
hu
0.314214463840399
sk
0.27947598253275113
pl
0.26273458445040215
lt
0.24726277372262775
az
0.23327137546468402
tr
0.19980601357904945
lv
0.19196865817825662
is
0.14330218068535827
vi
0.13883089770354906
fi
0.13249211356466878
be
0.0782122905027933
eu
0.0782122905027933
uk
0.07094594594594594
reliable
true
passes
true
2
name
"Isabella"
dialogue
"Io... io non so nulla! Non parlo inglese! Per favore, mi lasci in pace!"
detectedLang
"it"
heavyLang
"it"
scores
it
0.7989593188268685
sl
0.5861733203505356
en
0.5779543197616683
es
0.4982290436835891
yo
0.4982290436835891
de
0.49223416965352446
sv
0.48296836982968366
nl
0.46874999999999994
ca
0.46741854636591484
ro
0.46473551637279603
sk
0.44078947368421056
fr
0.4272237196765499
sq
0.40807799442896936
no
0.4072524407252441
az
0.3501529051987768
pl
0.3501529051987768
hr
0.3491577335375191
et
0.34514637904468415
pt
0.3328100470957614
lt
0.29867986798679863
tl
0.29867986798679863
hu
0.26343154246100525
cs
0.25438596491228066
ms
0.24511545293072823
tr
0.23561151079136694
da
0.22586520947176683
fi
0.2100371747211896
vi
0.18893129770992365
eu
0.169921875
lv
0.121900826446281
reliable
true
passes
true
3
name
"Hunter"
dialogue
"Okay, okay. Slow down. You’re Italian, right? You were at the festival?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.7996228194247996
tl
0.6842496285289746
da
0.5741482965931863
no
0.5741482965931863
ms
0.48918269230769235
fr
0.4810744810744811
sq
0.4551282051282051
nl
0.4385733157199472
cs
0.4325767690253671
it
0.40056417489421725
ro
0.3876080691642651
hr
0.3795620437956204
pt
0.3795620437956204
sl
0.37683284457478006
sv
0.375
yo
0.371301775147929
es
0.36661698956780925
de
0.3275316455696203
ca
0.3264659270998415
fi
0.3167202572347267
lt
0.3078175895765472
az
0.29401993355481726
et
0.22303473491773307
sk
0.21731123388581952
hu
0.1361788617886179
lv
0.1290983606557377
pl
0.1290983606557377
tr
0.121900826446281
reliable
true
passes
true
4
name
"Isabella"
dialogue
"Non capisco! Non so cosa è successo! Ho solo scattato delle foto..."
detectedLang
"it"
heavyLang
"it"
scores
it
0.8235049833887044
ca
0.5841487279843445
pt
0.569838056680162
fr
0.5420258620689655
en
0.5272525027808677
es
0.5114942528735632
no
0.47400990099009904
yo
0.4444444444444444
da
0.43559096945551123
tl
0.4325767690253671
de
0.40807799442896936
sk
0.4072524407252441
ro
0.36377245508982037
sl
0.3491577335375191
et
0.2975206611570248
cs
0.2796610169491525
sv
0.25569176882662
nl
0.25438596491228066
fi
0.21875
vi
0.18893129770992365
lt
0.17153996101364524
eu
0.169921875
lv
0.1290983606557377
pl
0.1290983606557377
hr
0.121900826446281
reliable
true
passes
true
5
name
"Hunter"
dialogue
"Did you... take pictures of the crowd?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8291182501708817
tl
0.7159090909090909
nl
0.5300751879699248
fr
0.5192307692307693
no
0.5107632093933464
yo
0.46808510638297873
ca
0.40476190476190477
de
0.38271604938271603
ro
0.37810945273631835
da
0.375
sv
0.375
et
0.2816091954022989
is
0.2625368731563422
lv
0.2492492492492493
cs
0.2378048780487805
ms
0.2378048780487805
sl
0.2378048780487805
sq
0.2378048780487805
reliable
true
passes
true
6
name
"Isabella"
dialogue
"Sì, ma... c’era un uomo. Strano. Mi ha guardato come se..."
detectedLang
"it"
heavyLang
"it"
scores
it
0.8111782477341389
es
0.6704745166959578
ro
0.6189024390243903
fr
0.6113989637305699
yo
0.5932754880694143
ca
0.5906113537117904
sl
0.5155038759689923
hr
0.5078740157480316
tl
0.4517543859649123
cs
0.44526627218934917
pt
0.44113263785394935
hu
0.43524096385542166
sv
0.4248466257668711
en
0.423963133640553
no
0.41222570532915365
pl
0.41222570532915365
sk
0.40191387559808617
lv
0.3872549019607844
sq
0.3862520458265139
da
0.30167597765363136
et
0.29775280898876405
lt
0.26035502958579887
tr
0.258893280632411
ms
0.25447316103379725
fi
0.21383647798742136
vi
0.17218543046357618
de
0.17035398230088497
nl
0.17035398230088497
is
0.1515837104072398
az
0.1359447004608295
reliable
true
passes
true
7
name
"Hunter"
dialogue
"Like what? Come? Damn it, I need details."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8085106382978724
no
0.5953237410071942
sq
0.5553359683794467
it
0.5517928286852589
tl
0.4851258581235698
et
0.4730679156908665
da
0.47058823529411764
hr
0.47058823529411764
ca
0.4693396226415094
sv
0.4693396226415094
yo
0.4201030927835051
ro
0.4015957446808511
lv
0.39839572192513373
de
0.38016528925619836
nl
0.38016528925619836
tr
0.3679775280898876
pl
0.358974358974359
lt
0.3553008595988539
cs
0.3181818181818182
fr
0.2549668874172185
sk
0.24242424242424243
be
0.23728813559322032
es
0.22945205479452058
hu
0.22945205479452058
az
0.21875
is
0.21875
uk
0.21875
vi
0.21875
pt
0.21328671328671328
reliable
true
passes
true
8
name
"Isabella"
dialogue
"Come se sapesse che ho visto qualcosa."
detectedLang
"it"
heavyLang
"it"
scores
it
0.8283395755305869
pt
0.645618556701031
ca
0.5955882352941176
no
0.5703125
fr
0.5266781411359724
es
0.5217391304347826
da
0.4811320754716981
cs
0.46808510638297873
sl
0.4444444444444444
en
0.434156378600823
fi
0.40860215053763443
sk
0.39956331877729256
de
0.39293598233995586
sv
0.36342592592592593
hr
0.32598039215686275
ro
0.3037974683544304
sq
0.289405684754522
et
0.2819843342036553
yo
0.2801047120418848
ms
0.26666666666666666
lt
0.24242424242424243
is
0.207492795389049
lv
0.207492795389049
tl
0.207492795389049
nl
0.20520231213872833
reliable
true
passes
true
9
name
"Hunter"
dialogue
"Don’t go anywhere. We’re not done."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8141263940520446
tl
0.6189024390243903
pl
0.30167597765363136
de
0.2378048780487805
sq
0.2378048780487805
tr
0.2378048780487805
yo
0.23547400611620795
reliable
true
passes
true
10
name
"Isabella"
dialogue
"Dio mio, che situazione..."
detectedLang
"it"
heavyLang
"it"
scores
it
0.8305084745762712
hr
0.5238095238095238
da
0.5192307692307693
ms
0.5145631067961165
es
0.511400651465798
sq
0.504950495049505
de
0.47735191637630664
eu
0.42748091603053434
pl
0.38524590163934425
ca
0.33920704845814975
lv
0.3333333333333333
ro
0.3333333333333333
pt
0.32432432432432434
fr
0.3181818181818182
sk
0.3181818181818182
cs
0.3087557603686636
lt
0.3087557603686636
en
0.29577464788732394
nl
0.29577464788732394
no
0.29577464788732394
sv
0.29577464788732394
sl
0.2822966507177033
reliable
true
passes
true