NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-09-25-01M3CKJT69674ZH23HZWNJK1C4
Run Details
Model:
Mistral Medium 3.5 (Reasoning)
Test:
Language Writing
Scenario:
Character dialogue (Italian) in a story
Duration:
6.7s
Cost:
$0.005436
Provider:
Mistral
Evaluation summary
Score
Evaluator
Details Link
100.00%
Parse dialogue
(details)
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Isabella"> Isabella is a 30-year old college student on a study abroad program. Born in Italy, she is fluent in Italian and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Italian, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Isabella is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Italian, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Isabella and Hunter as a voice sheet: Isabella: "..." Hunter: "..."
Model response
Messages
Meta
AI
**Voice Sheet:** --- **Isabella:** *(softly, in Italian, examining her camera)* "Questa foto... non ha senso. Non dovrebbe essere possibile..." **Hunter:** *(approaching, stern but polite)* "Ma'am, I’m Detective Hunter. Mind if I ask you a few questions about what happened at the festival last night?" **Isabella:** *(startled, switching to rapid Italian, hands trembling slightly)* "Io... io non so nulla! Non ho visto nulla! Solo... solo rumori strani, e poi... lui è sparito!" *(She clutches her camera tighter, her voice shaking.)* **Hunter:** *(frowning, leaning in slightly)* "I’m sorry, I don’t understand. You’re going to have to speak English, ma’am." **Isabella:** *(frustrated, gesturing wildly with her free hand)* "Inglese? No, no parlo inglese! Non capisco!" *(She takes a deep breath, trying to calm herself, then points at her camera and mimics taking a photo, then shakes her head.)* **Hunter:** *(sighing, rubbing his temple)* "Okay, okay. Let’s try this—" *(He pulls out his phone, opens a translation app, and types slowly.)* "Did. You. See. Anything. Unusual. Last. Night?" **Isabella:** *(reading the translated Italian on his phone, her expression darkening)* "Sì... sì, ho visto. Ombre. Nel bosco. E poi... un grido." *(She shudders, her voice dropping to a whisper.)* "Poi silenzio." **Hunter:** *(typing again, his jaw tightening as he reads the translation)* "Shadows in the woods. And then a scream?" *(He looks up at her, his tone urgent.)* "Can you show me where?" **Isabella:** *(nodding rapidly, standing up and grabbing her camera bag)* "Sì, sì! Vi port—" *(She stops, realizing he won’t understand, and instead grabs his arm, pulling him toward the door while pointing toward the edge of town.)* **Hunter:** *(resisting slightly, confused)* "Whoa, whoa—ma’am, I can’t just—" *(His phone rings loudly. He pulls it out, glances at the screen, and curses under his breath.)* "I’ve gotta take this." *(He answers, his voice sharp.)* "Hunter." *(A pause. His expression hardens.)* "Yeah, I’ll be right there." *(He hangs up and looks back at Isabella, conflicted.)* "I’ve gotta go. But we *are* talking later, okay? Don’t leave town." **Isabella:** *(disappointed, but nodding)* "Va bene. Ma... attento." *(She mimics a shadow creeping up behind him, her eyes wide with warning.)* **Hunter:** *(not understanding but sensing the gravity, he gives her a curt nod)* "Yeah. You too." *(He turns and strides away, already barking orders into his phone as he goes.)* --- **End Scene.**
created_at
"2026-09-25T15:40:13.421Z"
9/25/2026, 3:40:13 PM
model
"mistralai/mistral-medium-3.5-20260430"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
367
moderation_latency
(null)
generation_time
6606
tokens_prompt
308
tokens_completion
654
native_tokens_prompt
289
native_tokens_completion
667
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
"default"
usage
0.005436
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1790350813-LZ3nyL7kbvQxtdMvleRx"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1790350813-Z3UyYbQg4MLPfQJnGFcN"
upstream_id
"f6ee6cfb64294aa49298236ca1befce0"
provider_responses
0
endpoint_id
"38ef23a9-5cb3-46fa-85ec-7aed174f04eb"
id
"f6ee6cfb64294aa49298236ca1befce0"
is_byok
false
latency
364
model_permaslug
"mistralai/mistral-medium-3.5-20260430"
provider_name
"Mistral"
status
200
total_cost
0.005436
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Mistral"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
100.00%
Parse dialogue
n/a
dialogue
0
name
"Isabella"
dialogue
"Questa foto... non ha senso. Non dovrebbe essere possibile..."
detectedLang
"it"
heavyLang
"it"
scores
it
0.8271889400921658
pt
0.647887323943662
ca
0.6438746438746439
fr
0.622356495468278
en
0.6185147507629705
de
0.5535714285714286
es
0.5353159851301116
no
0.4834710743801653
hr
0.4533527696793003
ro
0.4517543859649123
sl
0.3760399334442596
sv
0.336283185840708
da
0.2937853107344633
sk
0.2857142857142857
tl
0.2661448140900196
lv
0.2632612966601179
pl
0.2618110236220473
ms
0.258893280632411
hu
0.2454728370221328
yo
0.24089068825910928
fi
0.21548117154811713
eu
0.1883116883116883
is
0.16666666666666666
nl
0.14383561643835618
cs
0.1359447004608295
et
0.1359447004608295
reliable
true
passes
true
1
name
"Hunter"
dialogue
"Ma'am, I’m Detective Hunter. Mind if I ask you a few questions about what happened at the festival last night?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8116868294909838
tl
0.6688077077478924
fr
0.5625662778366914
it
0.5225694444444445
da
0.5192307692307693
no
0.5169789227166276
ca
0.5106761565836299
pt
0.4755244755244755
nl
0.4448183041722746
ro
0.4436952124072825
sv
0.43454420836189167
cs
0.41029306647605435
es
0.4081779053084649
sq
0.406901509705248
hr
0.3861607142857143
et
0.3336025848142165
sl
0.32817589576547235
yo
0.3193069306930693
de
0.3170529801324503
ms
0.31478405315614616
hu
0.314214463840399
sk
0.27947598253275113
pl
0.26273458445040215
lt
0.24726277372262775
az
0.23327137546468402
tr
0.19980601357904945
lv
0.19196865817825662
is
0.14330218068535827
vi
0.13883089770354906
fi
0.13249211356466878
be
0.0782122905027933
eu
0.0782122905027933
uk
0.07094594594594594
reliable
true
passes
true
2
name
"Isabella"
dialogue
"Io... io non so nulla! Non ho visto nulla! Solo... solo rumori strani, e poi... lui è sparito!"
detectedLang
"it"
heavyLang
"it"
scores
it
0.7944612721765469
sl
0.5123203285420944
no
0.5098039215686274
es
0.49252136752136755
en
0.46808510638297873
pt
0.4626696832579186
yo
0.4431418522860493
sk
0.4424882629107981
lt
0.43653618030842234
tl
0.43653618030842234
fr
0.4351961950059453
ro
0.433849821215733
sq
0.43045563549160676
ca
0.42771084337349397
de
0.4164619164619165
sv
0.37745740498034075
is
0.3741765480895916
da
0.37335092348284965
fi
0.3572395128552098
cs
0.3528610354223433
hr
0.3484224965706447
et
0.302496328928047
lv
0.3014705882352941
az
0.2931547619047619
pl
0.25196850393700787
nl
0.22764227642276424
ms
0.22512234910277326
tr
0.21357615894039736
vi
0.17247386759581881
eu
0.15480427046263345
hu
0.1394927536231884
reliable
true
passes
true
3
name
"Hunter"
dialogue
"I’m sorry, I don’t understand. You’re going to have to speak English, ma’am."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8039549948857825
tl
0.5768947755702722
da
0.570254110612855
no
0.5240066225165563
sv
0.4226907630522089
pl
0.37089715536105033
hr
0.36252771618625274
cs
0.3575418994413408
sk
0.33755760368663595
de
0.3154761904761905
ro
0.2909987669543773
yo
0.28035043804755944
it
0.2721518987341772
lv
0.24342105263157895
nl
0.23638778220451526
lt
0.22506738544474394
ca
0.1935483870967742
is
0.19241573033707865
sq
0.18899858956276447
sl
0.1738505747126437
pt
0.14814814814814814
ms
0.11128284389489954
be
0.10852713178294573
tr
0.10852713178294573
hu
0.1043613707165109
az
0.0987460815047022
et
0.0987460815047022
uk
0.0987460815047022
vi
0.0987460815047022
reliable
true
passes
true
4
name
"Isabella"
dialogue
"Inglese? No, no parlo inglese! Non capisco!"
detectedLang
"it"
heavyLang
"it"
scores
it
0.7973657548125633
es
0.7405966277561609
pt
0.6960486322188449
en
0.6309963099630996
ca
0.5975855130784709
fr
0.5726495726495726
tl
0.5327102803738317
yo
0.494949494949495
lv
0.48717948717948717
hr
0.45054945054945056
ro
0.44751381215469616
sk
0.44598337950138506
no
0.43820224719101125
tr
0.42363112391930835
pl
0.4152046783625731
et
0.4117647058823529
eu
0.30313588850174217
az
0.25925925925925924
hu
0.250936329588015
cs
0.23954372623574144
de
0.23954372623574144
lt
0.23954372623574144
ms
0.23954372623574144
nl
0.23954372623574144
sl
0.23954372623574144
da
0.2277992277992278
sq
0.2277992277992278
sv
0.2277992277992278
reliable
true
passes
true
5
name
"Hunter"
dialogue
"Did. You. See. Anything. Unusual. Last. Night?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8094248094248094
tl
0.6258503401360545
et
0.5614035087719298
ms
0.36046511627906974
sq
0.26666666666666666
cs
0.22096317280453256
es
0.21875
nl
0.21875
pt
0.21875
da
0.21203438395415475
de
0.21203438395415475
fr
0.21203438395415475
no
0.21203438395415475
yo
0.21203438395415475
reliable
true
passes
true
6
name
"Isabella"
dialogue
"Poi silenzio."
detectedLang
"it"
heavyLang
"it"
scores
it
0.8134328358208955
ca
0.43820224719101125
es
0.43820224719101125
de
0.4350282485875706
hr
0.4350282485875706
sl
0.4350282485875706
reliable
true
passes
true
7
name
"Hunter"
dialogue
"Can you show me where?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8281786941580757
sq
0.601063829787234
tl
0.5454545454545454
pt
0.5238095238095238
nl
0.5176848874598071
es
0.40476190476190477
et
0.3877551020408163
fr
0.3775933609958506
no
0.3775933609958506
sl
0.3697478991596639
ms
0.358974358974359
it
0.34782608695652173
cs
0.34210526315789475
de
0.34210526315789475
az
0.33920704845814975
ca
0.33920704845814975
tr
0.33920704845814975
fi
0.3333333333333333
reliable
true
passes
true
8
name
"Isabella"
dialogue
"Sì, sì! Vi port—"
detectedLang
"it"
heavyLang
"it"
scores
it
0.7311827956989247
yo
0.691358024691358
da
0.6543778801843317
sv
0.6495327102803737
no
0.6268656716417911
vi
0.5714285714285714
ca
0.5098039215686274
en
0.5098039215686274
fr
0.5098039215686274
reliable
true
passes
true
9
name
"Hunter"
dialogue
"I’ve gotta go. But we are talking later, okay? Don’t leave town."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8024582967515365
tl
0.6062992125984252
nl
0.494949494949495
pl
0.3894165535956581
de
0.3440233236151603
sv
0.34210526315789475
fr
0.3382352941176471
it
0.3055555555555556
no
0.2822966507177033
ro
0.2474916387959866
pt
0.2398648648648649
fi
0.199288256227758
hu
0.1935483870967742
da
0.17279411764705882
yo
0.14611005692599618
hi
0.14448669201520914
is
0.1362763915547025
reliable
true
passes
true
10
name
"Isabella"
dialogue
"Va bene. Ma... attento."
detectedLang
"it"
heavyLang
"it"
scores
it
0.824438202247191
fr
0.6973365617433415
es
0.6518105849582173
ro
0.6323529411764706
tl
0.6081504702194357
sk
0.5967741935483871
lt
0.5659722222222222
ca
0.5535714285714286
pt
0.5335820895522388
pl
0.46120689655172414
en
0.4444444444444444
et
0.4444444444444444
cs
0.4292237442922375
hu
0.3961352657004831
vi
0.3842364532019704
yo
0.3842364532019704
lv
0.37810945273631835
no
0.37810945273631835
ms
0.34210526315789475
sq
0.34210526315789475
reliable
true
passes
true
11
name
"Hunter"
dialogue
"Yeah. You too."
detectedLang
"en"
heavyLang
"en"
scores
en
0.7807017543859649
cs
0.5098039215686274
tl
0.5098039215686274
reliable
true
passes
true