NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-10-07-01M4AT83JB7VRMHBRGE7TYRRCM
Run Details
Model:
Mistral Medium 3.5
Test:
Language Writing
Scenario:
Character dialogue (Italian) in a story
Duration:
4.9s
Cost:
$0.004453
Provider:
Mistral
Evaluation summary
Score
Evaluator
Details Link
100.00%
Parse dialogue
(details)
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Isabella"> Isabella is a 30-year old college student on a study abroad program. Born in Italy, she is fluent in Italian and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Italian, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Isabella is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Italian, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Isabella and Hunter as a voice sheet: Isabella: "..." Hunter: "..."
Model response
Messages
Meta
AI
**Voice Sheet:** --- **Isabella:** *(softly, in Italian, to herself)* "Che strano... non ho mai visto nulla di simile prima..." *(What a strange thing... I’ve never seen anything like this before...)* *(She looks up as Hunter approaches, her expression troubled. She clutches her camera tightly.)* **Hunter:** *(firm but polite)* "Ma’am, I’m Detective Hunter. I need to ask you a few questions about what happened at the festival last night. You were there, right?" **Isabella:** *(shaken, in rapid Italian)* "Io... io non so nulla! Non ho visto nulla! Solo... solo le ombre. E poi... lui è sparito." *(I... I don’t know anything! I didn’t see anything! Just... just the shadows. And then... he disappeared.)* *(She gestures wildly with her hands, her voice rising in distress. Hunter’s brow furrows in confusion.)* **Hunter:** *(leaning in slightly, raising his voice as if volume will help)* "Look, I need you to slow down. Did you see someone suspicious? A man in a dark coat? Anything at all?" **Isabella:** *(frustrated, still in Italian)* "Non capisco! Perché non mi capisce?!" *(I don’t understand! Why don’t you understand me?!)* *(She throws her hands up, then points at her camera, tapping it urgently as if willing him to look.)* **Hunter:** *(sighs, rubbing his temple)* "Okay, okay. Maybe we can—" *(His phone rings. He pulls it out, glances at the screen, and curses under his breath.)* "I’ve gotta take this. *(into phone)* Hunter here." *(He listens for a moment, then looks back at Isabella, conflicted.)* **Hunter:** *(to Isabella, apologetic but firm)* "I’m sorry, but I’ve gotta go. *(He pulls out a notepad, scribbles something, and hands it to her.)* Here’s my number. If you remember *anything*—or if you can find someone to translate—call me." *(He hesitates, then points at her camera.)* "And... keep that safe. Might be important." *(He turns and strides away, already barking into the phone as he leaves.)* **Isabella:** *(muttering to herself in Italian, watching him go)* "Dio mio... che disastro." *(My God... what a mess.)* ---
created_at
"2026-10-07T09:13:55.542Z"
10/7/2026, 9:13:55 AM
model
"mistralai/mistral-medium-3.5-20260430"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
365
moderation_latency
(null)
generation_time
4803
tokens_prompt
308
tokens_completion
539
native_tokens_prompt
289
native_tokens_completion
536
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
"default"
usage
0.0044535
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1791364435-IW9bdXgDpCVFKU7qw3MI"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1791364435-D6y7n3uZ1VEmf7EpzaFg"
upstream_id
"f6aa938ec3a14872a852e96641486c00"
provider_responses
0
endpoint_id
"d21d316f-d540-4718-b36e-3beff85d0cf9"
id
"f6aa938ec3a14872a852e96641486c00"
is_byok
false
latency
365
model_permaslug
"mistralai/mistral-medium-3.5-20260430"
provider_name
"Mistral"
status
200
total_cost
0.0044535
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Mistral"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
100.00%
Parse dialogue
n/a
dialogue
0
name
"Isabella"
dialogue
"Che strano... non ho mai visto nulla di simile prima..."
detectedLang
"it"
heavyLang
"it"
scores
it
0.8230297310051912
ro
0.5733788395904437
ca
0.5503597122302158
ms
0.5387453874538745
es
0.5300751879699248
hr
0.4897959183673469
no
0.48700410396716826
sl
0.4806094182825485
sk
0.4710860366713681
et
0.4658119658119659
en
0.4588744588744588
tl
0.44113263785394935
pt
0.4094488188976378
fr
0.40570522979397783
cs
0.40191387559808617
lt
0.3676222596964587
da
0.34895833333333337
fi
0.34895833333333337
sq
0.3397887323943662
vi
0.3339253996447602
nl
0.28842504743833014
sv
0.2816091954022989
lv
0.27466150870406186
is
0.2704280155642024
de
0.2661448140900196
az
0.2632612966601179
yo
0.26035502958579887
tr
0.23935091277890466
eu
0.1883116883116883
pl
0.17218543046357618
reliable
true
passes
true
1
name
"Hunter"
dialogue
"Ma’am, I’m Detective Hunter. I need to ask you a few questions about what happened at the festival last night. You were there, right?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8201089070400622
tl
0.6671464555595539
fr
0.5342396777442094
da
0.5182291666666667
no
0.5174752217005738
it
0.4939824945295405
ca
0.48208286674132134
pt
0.44710101613867304
cs
0.4325153374233129
nl
0.4167717528373266
ro
0.4156664560960202
sq
0.4104525175270874
hr
0.40705128205128205
es
0.3808567603748327
de
0.3775235531628533
sv
0.3660041124057573
sl
0.3616287094547964
yo
0.3616287094547964
et
0.33405327573794097
sk
0.32824981844589685
pl
0.3168389955686854
ms
0.29064417177914115
lt
0.28846153846153844
lv
0.25583266291230894
hu
0.23868312757201646
az
0.21343537414965988
tr
0.18213969938107868
is
0.12982126058325494
vi
0.12570888468809074
fi
0.11988582302568983
be
0.07035175879396985
eu
0.07035175879396985
uk
0.06376518218623482
reliable
true
passes
true
2
name
"Isabella"
dialogue
"Io... io non so nulla! Non ho visto nulla! Solo... solo le ombre. E poi... lui è sparito."
detectedLang
"it"
heavyLang
"it"
scores
it
0.8110831234256928
es
0.60801393728223
fr
0.5635305528612997
yo
0.5263157894736842
sl
0.4845360824742268
no
0.48394495412844035
pt
0.47613504074505236
ro
0.4724501758499414
tl
0.4712103407755582
ca
0.4636471990464839
en
0.43467336683417085
lt
0.4007989347536618
sk
0.3910690121786198
fi
0.3697478991596639
de
0.3679775280898876
sq
0.3333333333333333
is
0.3253373313343328
sv
0.32432432432432434
da
0.3212669683257918
cs
0.281150159744409
hu
0.27999999999999997
et
0.24623115577889448
az
0.23469387755102045
lv
0.23076923076923078
vi
0.18032786885245902
eu
0.16201117318435754
pl
0.15413533834586465
tr
0.1346153846153846
hr
0.12280701754385964
nl
0.12280701754385964
reliable
true
passes
true
3
name
"Hunter"
dialogue
"Look, I need you to slow down. Did you see someone suspicious? A man in a dark coat? Anything at all?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8084902649218001
tl
0.6325780771586038
no
0.5215311004784688
da
0.5077932731747333
et
0.4657168299198575
sv
0.45799457994579945
it
0.43342776203966005
ro
0.43342776203966005
pl
0.42857142857142855
cs
0.4263862332695985
yo
0.4180407371483996
de
0.40119760479041916
sq
0.38650306748466257
hr
0.3795243019648397
sl
0.37823834196891193
lv
0.37694704049844235
ca
0.36575052854122625
lt
0.3637327677624602
sk
0.3576017130620985
nl
0.35205183585313177
hu
0.3413830954994512
pt
0.33774834437086093
ms
0.32432432432432434
es
0.3197278911564626
az
0.26560587515299877
fr
0.23954372623574144
tr
0.19678714859437751
is
0.18699186991869918
vi
0.18144611186903137
be
0.1044776119402985
eu
0.1044776119402985
fi
0.09502262443438914
uk
0.09502262443438914
reliable
true
passes
true
4
name
"Isabella"
dialogue
"Non capisco! Perché non mi capisce?!"
detectedLang
"it"
heavyLang
"it"
scores
it
0.8178980228928201
fr
0.7121710526315789
es
0.6568627450980391
pt
0.6040723981900453
en
0.5949074074074074
ro
0.5843230403800476
ca
0.5524296675191815
sk
0.5070422535211268
hu
0.4883040935672514
yo
0.48377581120943947
cs
0.47761194029850745
tl
0.4582043343653251
sl
0.3445692883895131
eu
0.3320610687022901
ms
0.3320610687022901
hr
0.308300395256917
pl
0.308300395256917
tr
0.29149797570850206
sq
0.2827868852459016
reliable
true
passes
true
5
name
"Hunter"
dialogue
"I’ve gotta take this. Hunter here."
detectedLang
"en"
heavyLang
"en"
scores
en
0.7859181731684111
tl
0.6052631578947368
it
0.5370370370370371
sq
0.4140625
sv
0.3951612903225807
sl
0.3784530386740331
fi
0.33234421364985167
hu
0.32432432432432434
de
0.281150159744409
da
0.267100977198697
no
0.25742574257425743
fr
0.24242424242424243
nl
0.21875
pt
0.21875
ca
0.2077464788732394
ms
0.2077464788732394
ro
0.2077464788732394
tr
0.2077464788732394
reliable
true
passes
true
6
name
"Hunter"
dialogue
"I’m sorry, but I’ve gotta go. Here’s my number. If you remember anything—or if you can find someone to translate—call me."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8035246487258871
tl
0.6191135734072023
it
0.38478747203579416
no
0.3820224719101124
nl
0.3806306306306307
da
0.3782969103240392
sk
0.374051593323217
fr
0.3462757527733756
cs
0.34210526315789475
pl
0.32926829268292684
yo
0.32817589576547235
sl
0.32432432432432434
ms
0.3232157506152584
sv
0.3187448389760529
pt
0.2954739538855679
es
0.28694900605012963
sq
0.27947598253275113
et
0.27312775330396477
hu
0.25675675675675674
hr
0.23540315106580167
de
0.21278625954198474
lv
0.1863905325443787
fi
0.1847826086956522
lt
0.1716867469879518
ro
0.16834677419354838
is
0.15730337078651685
ca
0.15557830092118732
tr
0.14507772020725387
az
0.14151925078043703
vi
0.09638554216867469
eu
0.07511210762331838
reliable
true
passes
true
7
name
"Isabella"
dialogue
"Dio mio... che disastro."
detectedLang
"it"
heavyLang
"it"
scores
it
0.8081841432225064
es
0.6359223300970874
ms
0.5689655172413793
hr
0.5398773006134969
pt
0.5207667731629393
fr
0.49324324324324326
sl
0.48805460750853247
eu
0.42748091603053434
da
0.39759036144578314
en
0.38271604938271603
tl
0.3562231759656652
de
0.34210526315789475
lt
0.33035714285714285
cs
0.3150684931506849
pl
0.3150684931506849
ro
0.3150684931506849
sk
0.3150684931506849
sq
0.3150684931506849
sv
0.3150684931506849
reliable
true
passes
true