NC Bench
Overview
About
Tests
Models
Vendors
Run: 2026-02-20-01KHXPG8TEEETPR5K80HXDBDXB
Run Details
Model:
Mistral Large 3
Test:
Language Writing
Scenario:
Character dialogue (Italian) in a story
Duration:
15.8s
Cost:
$0.001318
Provider:
Mistral
Evaluation summary
Score
Evaluator
Details Link
100.00%
Parse dialogue
(details)
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Isabella"> Isabella is a 30-year old college student on a study abroad program. Born in Italy, she is fluent in Italian and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Italian, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Isabella is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Italian, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Isabella and Hunter as a voice sheet: Isabella: "..." Hunter: "..."
Model response
Messages
Meta
AI
**Voice Sheet: Café Encounter in Alborn, MN** *(Isabella sits at a small wrought-iron table outside the café, her fingers tracing the edges of her camera. The late afternoon sun casts long shadows across the cobblestone street. Hunter approaches, his boots scuffing lightly against the pavement. He hesitates before pulling out the chair across from her.)* **Hunter:** *(clears throat, adjusting his jacket)* "Excuse me, miss. Mind if I sit for a minute?" **Isabella:** *(looks up, startled, then relaxes slightly when she sees his badge clipped to his belt. She nods, gesturing to the chair. In Italian, soft but urgent)* "Sì, certo. Ma… lei è della polizia? È successo qualcosa?" **Hunter:** *(sits, frowning slightly at her words)* "Uh. Yeah, I’m Detective Hunter. I was hoping to ask you a few questions about—" *(pauses, realizing she doesn’t understand)* "You… speak English?" **Isabella:** *(shakes her head, gripping her camera tighter. In Italian, her voice trembling)* "No, mi dispiace. Non parlo inglese. Ma… perché mi chiede? Ho fatto qualcosa di male?" **Hunter:** *(rubs his temple, frustrated)* "Okay, uh. *Parla…* no, never mind." *(leans forward, pointing at her camera)* "Photos. You take pictures, right? Of the town?" **Isabella:** *(nods eagerly, holding up her camera. In Italian, relieved he’s trying to communicate)* "Sì! Fotografo i paesaggi. Alborn è bellissima, ma…" *(hesitates, her expression darkening)* "Ma ho visto qualcosa di strano ieri sera. Vicino al vecchio frutteto." **Hunter:** *(perks up, though he only catches a few words)* "Frutteto? You mean the orchard? What’d you see?" **Isabella:** *(mimes taking a photo, then shakes her head. In Italian, her words tumbling out)* "Non lo so! Era buio, ma ho sentito dei rumori. Come… come passi. E poi una luce. Ho scattato una foto, ma non si vede bene." *(flips through her camera, showing him a grainy image of shadows and a faint, flickering light in the distance)* **Hunter:** *(squints at the photo, then at her. Points to the image, then to himself)* "You’ll… show me? Later?" **Isabella:** *(nods, then pauses, biting her lip. In Italian, worried)* "Ma lei non capisce. E se è pericoloso? Ho sentito storie… persone che scompaiono." **Hunter:** *(stiffens, recognizing the word "spariscono." His phone buzzes in his pocket. He pulls it out, glancing at the screen, then stands abruptly.)* "Look, I gotta go. But—" *(points to her, then to the photo, then to himself again)* "Meet me. Tomorrow. *Domani.* At the orchard. *Frutteto.* Noon. *Mezzogiorno.*" **Isabella:** *(blinks, then nods slowly. In Italian, hopeful)* "Domani. Mezzogiorno. Va bene." **Hunter:** *(gives her a tight nod, already turning away as he answers his phone)* "Yeah, I’m coming. What’ve you got?" *(He strides off, leaving Isabella staring after him, her fingers tightening around her camera. She glances down at the photo again, her brow furrowed.)*
created_at
"2026-02-20T14:15:48.314Z"
2/20/2026, 2:15:48 PM
model
"mistralai/mistral-large-2512"
1/1/2512, 12:00:00 AM
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
430
moderation_latency
(null)
generation_time
15758
tokens_prompt
321
tokens_completion
775
native_tokens_prompt
277
native_tokens_completion
786
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.0013175
router
(null)
provider_responses
0
endpoint_id
"fa718841-07ea-4b7e-b8a3-6069545c7e6a"
id
"93a8b8b95a4942abb2079cc11da0f05b"
is_byok
false
latency
429
model_permaslug
"mistralai/mistral-large-2512"
1/1/2512, 12:00:00 AM
provider_name
"Mistral"
status
200
api_type
"completions"
id
"gen-1771596948-faRzPnSju41hp4VfQyW6"
upstream_id
"93a8b8b95a4942abb2079cc11da0f05b"
total_cost
0.0013175
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Mistral"
Evaluation details
Result
Evaluator
Details
Meta Data
100.00%
Parse dialogue
n/a
dialogue
0
name
"Hunter"
dialogue
"Excuse me, miss. Mind if I sit for a minute?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.75825946817083
no
0.6777658431793769
da
0.6539792387543253
it
0.6057818659658344
et
0.6
sq
0.5815899581589958
tl
0.5756718528995757
hr
0.5664739884393063
ro
0.563953488372093
pt
0.5568685376661743
sv
0.5529061102831594
ca
0.5356037151702787
sl
0.5192307692307693
cs
0.5098039215686274
hu
0.5090016366612111
es
0.5008319467554077
pl
0.494949494949495
sk
0.4800693240901213
fr
0.4746059544658494
nl
0.41972920696324956
fi
0.4117647058823529
de
0.4094488188976378
lt
0.4094488188976378
ms
0.40711462450592883
yo
0.40711462450592883
tr
0.3288590604026846
is
0.3150684931506849
az
0.3071593533487298
lv
0.3071593533487298
vi
0.3071593533487298
be
0.1891891891891892
eu
0.1891891891891892
uk
0.17355371900826447
reliable
true
passes
true
1
name
"Isabella"
dialogue
"Sì, certo. Ma… lei è della polizia? È successo qualcosa?"
detectedLang
"it"
heavyLang
"it"
scores
it
0.8294970161977835
pt
0.6412556053811659
ca
0.6289424860853432
fr
0.5740149094781682
ro
0.5721925133689839
en
0.5305164319248826
yo
0.4897959183673469
es
0.45652173913043476
sv
0.45652173913043476
tl
0.43741209563994377
et
0.40476190476190477
da
0.38080495356037153
sq
0.36507936507936506
fi
0.34959349593495936
pl
0.3277310924369748
eu
0.3197278911564626
nl
0.29577464788732394
sk
0.29577464788732394
de
0.2907801418439716
hu
0.28186714542190305
lt
0.2753623188405797
ms
0.2687385740402194
cs
0.18533604887983707
sl
0.18533604887983707
lv
0.18200408997955012
no
0.18200408997955012
hr
0.18032786885245902
vi
0.16317991631799164
az
0.15789473684210525
tr
0.15254237288135594
reliable
true
passes
true
2
name
"Hunter"
dialogue
"You… speak English?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8191027496382056
tl
0.5874587458745875
no
0.3961352657004831
cs
0.3842364532019704
da
0.3654822335025381
de
0.3654822335025381
hr
0.3654822335025381
ms
0.3654822335025381
ro
0.3654822335025381
sv
0.3654822335025381
reliable
true
passes
true
3
name
"Isabella"
dialogue
"No, mi dispiace. Non parlo inglese. Ma… perché mi chiede? Ho fatto qualcosa di male?"
detectedLang
"it"
heavyLang
"it"
scores
it
0.8108552631578948
fr
0.5718540580789278
sk
0.5500782472613459
en
0.5381526104417671
ca
0.5366639806607574
es
0.5290745290745291
pt
0.4995648389904264
yo
0.4209466263846928
cs
0.40904419321685515
ro
0.40904419321685515
ms
0.39727463312368977
tl
0.3895966029723991
no
0.37431991294885747
pl
0.36252771618625274
hr
0.3575418994413408
hu
0.3546576879910213
sq
0.31302270011947436
et
0.29447852760736193
tr
0.2758186397984887
de
0.2730720606826802
lv
0.2483660130718954
vi
0.23333333333333334
sl
0.21232876712328766
sv
0.20249653259361997
da
0.19127988748241914
lt
0.18207681365576103
eu
0.1314199395770393
az
0.10852713178294573
nl
0.0987460815047022
reliable
true
passes
true
4
name
"Hunter"
dialogue
"Photos. You take pictures, right? Of the town?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8247663551401868
tl
0.7292418772563177
fr
0.6368038740920097
nl
0.5405819295558958
no
0.5275590551181102
de
0.5
yo
0.494949494949495
ca
0.44547134935304994
da
0.42748091603053434
lv
0.33920704845814975
ro
0.336283185840708
sv
0.3333333333333333
et
0.24623115577889448
is
0.22879177377892032
es
0.21052631578947367
lt
0.21052631578947367
pt
0.21052631578947367
cs
0.20634920634920634
ms
0.20634920634920634
sl
0.20634920634920634
sq
0.20634920634920634
hi
0.20424403183023873
reliable
true
passes
true
5
name
"Isabella"
dialogue
"Ma ho visto qualcosa di strano ieri sera. Vicino al vecchio frutteto."
detectedLang
"it"
heavyLang
"it"
scores
it
0.808282208588957
es
0.5340167753960857
ca
0.4753410283315845
ro
0.44751381215469616
ms
0.4369369369369369
fr
0.43117178612059154
sl
0.4206257242178447
pt
0.419953596287703
sk
0.41383352872215706
lt
0.39903846153846156
tl
0.3939393939393939
no
0.3464052287581699
da
0.3093922651933701
yo
0.29577464788732394
sq
0.2867332382310985
nl
0.284692417739628
cs
0.274310595065312
pl
0.27007299270072993
hr
0.26035502958579887
vi
0.25925925925925924
en
0.24585218702865763
de
0.24357034795764
et
0.24127465857359634
lv
0.22118380062305293
is
0.21752738654147105
eu
0.1610738255033557
fi
0.14965986394557826
hu
0.14089347079037798
sv
0.12587412587412586
az
0.10554561717352416
tr
0.10554561717352416
reliable
true
passes
true
6
name
"Hunter"
dialogue
"Frutteto? You mean the orchard? What’d you see?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.765625
tl
0.4800693240901213
it
0.3710691823899371
et
0.3617021276595745
no
0.3617021276595745
nl
0.3464052287581699
sq
0.34065934065934067
fr
0.33774834437086093
lt
0.27184466019417475
yo
0.2628992628992629
sl
0.25
cs
0.20634920634920634
da
0.20634920634920634
ms
0.20634920634920634
sv
0.20634920634920634
es
0.20424403183023873
pt
0.20424403183023873
de
0.2
reliable
true
passes
true
7
name
"Isabella"
dialogue
"Non lo so! Era buio, ma ho sentito dei rumori. Come… come passi. E poi una luce. Ho scattato una foto, ma non si vede bene."
detectedLang
"it"
heavyLang
"it"
scores
it
0.8060280513279618
ca
0.5619946091644205
no
0.5376955903271692
es
0.5224099926524615
ro
0.5217071376011773
pt
0.4969040247678019
en
0.48535233570863023
yo
0.4706840390879479
tl
0.45286195286195285
fr
0.4477485131690739
sk
0.4333042720139495
sl
0.38446969696969696
et
0.37319189971070393
cs
0.35770750988142297
sq
0.3440968718466196
de
0.34343434343434337
lt
0.30997876857749473
ms
0.30406852248394006
vi
0.2919389978213508
eu
0.28492849284928495
pl
0.2793791574279379
da
0.24855491329479767
nl
0.23349056603773585
hu
0.1965389369592089
sv
0.17825537294563845
tr
0.1698595146871009
is
0.16879795396419436
az
0.16237113402061853
fi
0.16237113402061853
lv
0.16237113402061853
hr
0.15803108808290156
reliable
true
passes
true
8
name
"Hunter"
dialogue
"You’ll… show me? Later?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.7767857142857143
nl
0.6788990825688073
pt
0.5742092457420924
no
0.5098039215686274
tl
0.4971264367816092
fr
0.4807121661721069
de
0.4712990936555891
sq
0.4582043343653251
tr
0.375
es
0.36823104693140796
et
0.35185185185185186
da
0.34944237918215615
sl
0.3346007604562738
sv
0.32950191570881227
ms
0.32432432432432434
it
0.3137254901960784
hi
0.3027888446215139
pl
0.3027888446215139
fi
0.3
reliable
true
passes
true
9
name
"Isabella"
dialogue
"Ma lei non capisce. E se è pericoloso? Ho sentito storie… persone che scompaiono."
detectedLang
"it"
heavyLang
"it"
scores
it
0.812222601570502
ro
0.6258503401360545
fr
0.5804729214340199
no
0.555735056542811
pt
0.5412844036697247
ca
0.5319148936170213
en
0.5009074410163339
es
0.4940202391904324
da
0.47115384615384615
tl
0.4675701839303001
sq
0.466537342386033
yo
0.4427558257345492
ms
0.43123061013443637
sv
0.4294605809128631
cs
0.41050375133976424
nl
0.38478747203579416
lt
0.38271604938271603
pl
0.3792325056433409
sk
0.3699885452462772
hr
0.36342592592592593
fi
0.3514150943396226
sl
0.34988179669030733
et
0.3381468110709988
tr
0.32014833127317677
hu
0.28756476683937826
de
0.28292046936114734
lv
0.2637215528781794
az
0.25170068027210885
eu
0.23717059639389734
is
0.19117647058823528
vi
0.12420382165605094
reliable
true
passes
true
10
name
"Hunter"
dialogue
"Meet me. Tomorrow. At the orchard. Noon."
detectedLang
"en"
heavyLang
"en"
scores
en
0.7365648050579557
tl
0.6684350132625994
no
0.6240601503759399
da
0.5029821073558649
fr
0.4939271255060729
nl
0.4929006085192698
sq
0.4747899159663866
ms
0.39320388349514557
yo
0.299719887955182
es
0.28977272727272724
et
0.2753623188405797
pt
0.26035502958579887
sl
0.26035502958579887
it
0.24242424242424243
sv
0.2378048780487805
de
0.23076923076923078
fi
0.23076923076923078
reliable
true
passes
true
11
name
"Isabella"
dialogue
"Domani. Mezzogiorno. Va bene."
detectedLang
"it"
heavyLang
"it"
scores
it
0.7916666666666666
fr
0.5841995841995842
ro
0.5283018867924528
es
0.47780678851174935
hr
0.45652173913043476
sl
0.45652173913043476
ca
0.43661971830985913
de
0.3197278911564626
sq
0.30313588850174217
yo
0.30313588850174217
en
0.27007299270072993
lv
0.27007299270072993
pt
0.27007299270072993
sv
0.27007299270072993
reliable
true
passes
true
12
name
"Hunter"
dialogue
"Yeah, I’m coming. What’ve you got?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8059006211180123
tl
0.6124031007751938
it
0.4369369369369369
fr
0.39903846153846156
es
0.2877492877492877
ro
0.2816091954022989
ca
0.2732558139534884
nl
0.2732558139534884
pt
0.2732558139534884
da
0.2492492492492493
cs
0.2378048780487805
de
0.22839506172839508
no
0.22839506172839508
reliable
true
passes
true