NC Bench
Overview
About
Tests
Models
Vendors
Run: 2026-02-20-01KHXPW18M6SBCW0N41QE84QEB
Run Details
Model:
Mistral Large 3
Test:
Language Writing
Scenario:
Character dialogue (Italian) in a story
Duration:
14.2s
Cost:
$0.001193
Provider:
Mistral
Evaluation summary
Score
Evaluator
Details Link
100.00%
Parse dialogue
(details)
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Isabella"> Isabella is a 30-year old college student on a study abroad program. Born in Italy, she is fluent in Italian and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Italian, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Isabella is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Italian, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Isabella and Hunter as a voice sheet: Isabella: "..." Hunter: "..."
Model response
Messages
Meta
AI
**Voice Sheet: Café Encounter in Alborn, MN** *(Isabella sits at a small wrought-iron table outside the café, her fingers tracing the edges of her camera. The late afternoon sun casts long shadows across the cobblestone street. Hunter approaches, his boots scuffing lightly against the pavement. He hesitates before pulling out the chair across from her.)* **Hunter:** *(clears throat, adjusting his jacket)* "Excuse me, miss. Mind if I sit for a minute?" **Isabella:** *(looks up, startled, then relaxes slightly when she sees his badge clipped to his belt. She nods, gesturing to the chair. In Italian, soft but urgent)* "Sì, certo. Ma… lei è della polizia? È successo qualcosa?" **Hunter:** *(sits, frowning slightly at the rapid Italian)* "Uh. I’m sorry, I don’t—do you speak English?" **Isabella:** *(shakes her head, gripping her camera tighter. Her voice wavers as she switches to halting, heavily accented English)* "No… no English. Solo italiano. Mi dispiace." **Hunter:** *(leans forward, speaking slowly)* "Okay. Okay, that’s fine. I’m Detective Hunter. I’m looking into… some things happening around town. You been here long?" **Isabella:** *(nods, then switches back to Italian, her words tumbling out)* "Sono arrivata due settimane fa. Per il programma di scambio. Ma… ho visto delle cose strane. Persone che spariscono. E poi…" *(she trails off, her eyes darting toward the alleyway beside the café)* **Hunter:** *(follows her gaze, then looks back at her, frustrated)* "I don’t—look, I don’t understand. But you’re saying you’ve seen something? People disappearing?" **Isabella:** *(nods vigorously, then switches to English again, struggling)* "Sì. Sì, disappearing. Due notti fa. Un uomo… vicino al lago. Io—io ho foto." *(she fumbles with her camera, pulling up a grainy image of a shadowy figure near the water’s edge)* **Hunter:** *(takes the camera, squinting at the screen. His expression darkens)* "This is… yeah, that’s near where we found the last one. You didn’t think to report this?" **Isabella:** *(throws her hands up in exasperation, Italian spilling out again)* "Come potevo? Non parlo inglese! E poi, chi mi avrebbe creduto? Sono solo una studentessa straniera!" **Hunter:** *(rubs his temple, sighing)* "Alright, alright. Look, I need you to—" *(his phone rings. He glances at the screen, then stands abruptly)* "I gotta take this. Stay here. Don’t go anywhere, okay?" **Isabella:** *(nods, but her voice is small, worried)* "Va bene. Ma… per favore, torni." **Hunter:** *(already walking away, phone to his ear)* "I will. Just—stay put." *(Isabella watches him go, her fingers tightening around her camera once more. The café’s chime rings softly as the door swings shut behind him.)*
created_at
"2026-02-20T14:22:13.789Z"
2/20/2026, 2:22:13 PM
model
"mistralai/mistral-large-2512"
1/1/2512, 12:00:00 AM
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
385
moderation_latency
(null)
generation_time
14128
tokens_prompt
321
tokens_completion
734
native_tokens_prompt
277
native_tokens_completion
703
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.001193
router
(null)
provider_responses
0
endpoint_id
"fa718841-07ea-4b7e-b8a3-6069545c7e6a"
id
"3ba11381669e4c7d88d38729a9329d44"
is_byok
false
latency
385
model_permaslug
"mistralai/mistral-large-2512"
1/1/2512, 12:00:00 AM
provider_name
"Mistral"
status
200
api_type
"completions"
id
"gen-1771597333-lEjmBBsMLklzoiZiOmsI"
upstream_id
"3ba11381669e4c7d88d38729a9329d44"
total_cost
0.001193
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Mistral"
Evaluation details
Result
Evaluator
Details
Meta Data
100.00%
Parse dialogue
n/a
dialogue
0
name
"Hunter"
dialogue
"Excuse me, miss. Mind if I sit for a minute?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.75825946817083
no
0.6777658431793769
da
0.6539792387543253
it
0.6057818659658344
et
0.6
sq
0.5815899581589958
tl
0.5756718528995757
hr
0.5664739884393063
ro
0.563953488372093
pt
0.5568685376661743
sv
0.5529061102831594
ca
0.5356037151702787
sl
0.5192307692307693
cs
0.5098039215686274
hu
0.5090016366612111
es
0.5008319467554077
pl
0.494949494949495
sk
0.4800693240901213
fr
0.4746059544658494
nl
0.41972920696324956
fi
0.4117647058823529
de
0.4094488188976378
lt
0.4094488188976378
ms
0.40711462450592883
yo
0.40711462450592883
tr
0.3288590604026846
is
0.3150684931506849
az
0.3071593533487298
lv
0.3071593533487298
vi
0.3071593533487298
be
0.1891891891891892
eu
0.1891891891891892
uk
0.17355371900826447
reliable
true
passes
true
1
name
"Isabella"
dialogue
"Sì, certo. Ma… lei è della polizia? È successo qualcosa?"
detectedLang
"it"
heavyLang
"it"
scores
it
0.8294970161977835
pt
0.6412556053811659
ca
0.6289424860853432
fr
0.5740149094781682
ro
0.5721925133689839
en
0.5305164319248826
yo
0.4897959183673469
es
0.45652173913043476
sv
0.45652173913043476
tl
0.43741209563994377
et
0.40476190476190477
da
0.38080495356037153
sq
0.36507936507936506
fi
0.34959349593495936
pl
0.3277310924369748
eu
0.3197278911564626
nl
0.29577464788732394
sk
0.29577464788732394
de
0.2907801418439716
hu
0.28186714542190305
lt
0.2753623188405797
ms
0.2687385740402194
cs
0.18533604887983707
sl
0.18533604887983707
lv
0.18200408997955012
no
0.18200408997955012
hr
0.18032786885245902
vi
0.16317991631799164
az
0.15789473684210525
tr
0.15254237288135594
reliable
true
passes
true
2
name
"Hunter"
dialogue
"Uh. I’m sorry, I don’t—do you speak English?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.7966298663567694
tl
0.6679316888045541
hr
0.48604992657856094
cs
0.47447447447447455
pl
0.4345718901453958
pt
0.42244224422442245
sq
0.4176372712146422
no
0.3934142114384749
it
0.3805309734513274
da
0.3761140819964349
sv
0.375
sk
0.36823104693140796
vi
0.3320610687022901
yo
0.32038834951456313
ro
0.31640625
ca
0.2827868852459016
sl
0.25531914893617025
de
0.17061611374407584
ms
0.17061611374407584
be
0.16666666666666666
tr
0.16666666666666666
hu
0.1606714628297362
az
0.15254237288135594
et
0.15254237288135594
is
0.15254237288135594
lt
0.15254237288135594
lv
0.15254237288135594
uk
0.15254237288135594
reliable
true
passes
true
3
name
"Isabella"
dialogue
"No… no English. Solo italiano. Mi dispiace."
detectedLang
"it"
heavyLang
"it"
scores
it
0.7526978417266187
es
0.7126436781609196
pt
0.6283783783783783
en
0.6268656716417911
ca
0.5703125
sk
0.5542949756888168
ro
0.5378151260504201
hr
0.5299145299145299
no
0.46808510638297873
pl
0.4532803180914513
sq
0.4532803180914513
fr
0.4510978043912176
tr
0.4433198380566802
cs
0.43298969072164945
de
0.4258872651356994
sl
0.3707093821510297
yo
0.3648960739030023
tl
0.36046511627906974
da
0.3226600985221675
lv
0.3226600985221675
ms
0.3226600985221675
sv
0.3226600985221675
hu
0.23611111111111113
lt
0.1863905325443787
nl
0.1863905325443787
az
0.17664670658682635
fi
0.17664670658682635
reliable
true
passes
true
4
name
"Hunter"
dialogue
"Okay. Okay, that’s fine. I’m Detective Hunter. I’m looking into… some things happening around town. You been here long?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8235442399798335
tl
0.6510468594217349
nl
0.47722180731889474
no
0.42386831275720166
da
0.38971229293809934
it
0.3848857644991213
fr
0.37722419928825623
sv
0.37275985663082434
sq
0.3346007604562738
de
0.3320610687022901
ro
0.3076162215628091
pt
0.3027888446215139
is
0.2776057791537668
ca
0.2545260915867945
es
0.20273348519362186
cs
0.1764705882352941
sl
0.15254237288135594
sk
0.125
vi
0.12390488110137672
hr
0.08735332464146023
ms
0.077733860342556
tr
0.077733860342556
reliable
true
passes
true
5
name
"Isabella"
dialogue
"Sono arrivata due settimane fa. Per il programma di scambio. Ma… ho visto delle cose strane. Persone che spariscono. E poi…"
detectedLang
"it"
heavyLang
"it"
scores
it
0.8194178882515403
no
0.5728643216080402
ca
0.5148401826484018
fr
0.5095210617426428
en
0.5092378752886837
sq
0.502050380785003
et
0.49584816132858833
ro
0.48233861144945184
tl
0.46808510638297873
es
0.46675031367628605
de
0.45686900958466453
sv
0.4544287548138639
lt
0.44948186528497414
sk
0.4325767690253671
hr
0.42876344086021506
pt
0.4197952218430034
da
0.41054091539528437
lv
0.40308988764044945
ms
0.3963068181818182
sl
0.38672438672438675
nl
0.38450398262128893
cs
0.38271604938271603
is
0.37454010301692425
pl
0.35361216730038025
tr
0.3415956622773044
yo
0.3359375
fi
0.33070866141732286
hu
0.2981007431874484
az
0.2582897033158813
vi
0.17073170731707318
eu
0.15169660678642716
reliable
true
passes
true
6
name
"Hunter"
dialogue
"I don’t—look, I don’t understand. But you’re saying you’ve seen something? People disappearing?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8059006211180123
tl
0.5532523230879199
no
0.4734625105307498
da
0.47301854974704893
sv
0.42555147058823534
nl
0.3908382066276803
de
0.3055555555555556
ms
0.30011198208286677
pl
0.2460796139927624
it
0.24425634824667475
cs
0.23218673218673216
tr
0.21383647798742136
fr
0.20886075949367086
ro
0.20785804816223066
sk
0.20483460559796438
hr
0.1819371727748691
ca
0.18086500655307994
is
0.17979002624671916
sq
0.17654808959156787
yo
0.12219101123595505
es
0.11095305832147938
pt
0.11095305832147938
be
0.10071942446043164
hu
0.09682080924855492
az
0.09156976744186046
et
0.09156976744186046
lt
0.09156976744186046
lv
0.09156976744186046
uk
0.09156976744186046
vi
0.09156976744186046
reliable
true
passes
true
7
name
"Isabella"
dialogue
"Sì. Sì, disappearing. Due notti fa. Un uomo… vicino al lago. Io—io ho foto."
detectedLang
"it"
heavyLang
"it"
scores
it
0.7972972972972973
ca
0.5697896749521989
es
0.5005549389567148
nl
0.4755244755244755
yo
0.4578313253012048
en
0.4296577946768061
ro
0.42748091603053434
no
0.4102228047182176
ms
0.3885869565217392
da
0.3775933609958506
lv
0.3382352941176471
fr
0.336283185840708
sk
0.29245283018867924
cs
0.2682926829268293
de
0.24369747899159663
sv
0.20212765957446807
tl
0.1906474820143885
fi
0.1818181818181818
eu
0.1758241758241758
sl
0.14611005692599618
pl
0.12280701754385964
et
0.11591355599214145
hr
0.11591355599214145
pt
0.11591355599214145
reliable
true
passes
true
8
name
"Hunter"
dialogue
"This is… yeah, that’s near where we found the last one. You didn’t think to report this?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8374424275264156
tl
0.663677130044843
nl
0.5451099317664898
pl
0.3951612903225807
yo
0.3775933609958506
cs
0.3617021276595745
sq
0.3442622950819672
no
0.3079584775086505
hr
0.30394431554524365
da
0.28994082840236685
fr
0.281437125748503
hu
0.269183922046285
sv
0.26560587515299877
sk
0.24146649810366622
sl
0.23076923076923078
it
0.22077922077922074
de
0.19463087248322147
ro
0.19137466307277629
ms
0.1902834008097166
et
0.1847826086956522
lv
0.16897506925207756
lt
0.14772727272727273
tr
0.14285714285714285
is
0.13294797687861273
es
0.12023460410557184
ca
0.1111111111111111
pt
0.10714285714285714
reliable
true
passes
true
9
name
"Isabella"
dialogue
"Come potevo? Non parlo inglese! E poi, chi mi avrebbe creduto? Sono solo una studentessa straniera!"
detectedLang
"it"
heavyLang
"it"
scores
it
0.8091603053435115
es
0.5849297573435505
ro
0.5748855461085677
en
0.525893508388038
pt
0.5086923658352229
pl
0.48697711128650356
sk
0.468954248366013
fr
0.4672131147540984
sq
0.45240101095197977
ca
0.43965517241379315
hr
0.4328097731239092
sv
0.4263018534863195
no
0.41546762589928055
lv
0.4138863841298467
sl
0.4106980961015413
cs
0.39759036144578314
de
0.3821292775665399
nl
0.37799043062200954
da
0.364613880742913
et
0.3608652900688299
lt
0.3394308943089431
yo
0.33127572016460904
tl
0.2995689655172413
tr
0.2857142857142857
az
0.2785793562708102
is
0.2696629213483146
hu
0.2605233219567691
fi
0.23258559622195982
ms
0.2215568862275449
eu
0.21020656136087487
vi
0.1698595146871009
reliable
true
passes
true
10
name
"Hunter"
dialogue
"I gotta take this. Stay here. Don’t go anywhere, okay?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.7763578274760383
tl
0.6621621621621622
it
0.4720965309200603
sq
0.4712990936555891
pl
0.4006849315068493
sv
0.3805309734513274
hu
0.3333333333333333
yo
0.31906614785992216
no
0.29292929292929293
da
0.2842535787321063
hr
0.2842535787321063
ca
0.2827868852459016
fi
0.24242424242424243
cs
0.23076923076923078
ro
0.20454545454545453
de
0.1822429906542056
sl
0.1822429906542056
sk
0.17061611374407584
be
0.16666666666666666
tr
0.16666666666666666
az
0.15254237288135594
et
0.15254237288135594
is
0.15254237288135594
lt
0.15254237288135594
lv
0.15254237288135594
uk
0.15254237288135594
vi
0.15254237288135594
reliable
true
passes
true
11
name
"Isabella"
dialogue
"Va bene. Ma… per favore, torni."
detectedLang
"it"
heavyLang
"it"
scores
it
0.812206572769953
ca
0.7097242380261248
ro
0.5893223819301848
es
0.5689655172413793
fr
0.5594713656387665
sl
0.5348837209302325
sq
0.5283018867924528
lt
0.47780678851174935
pt
0.45799457994579945
hr
0.4520547945205479
tl
0.45054945054945056
sk
0.4428969359331476
en
0.441340782122905
nl
0.43820224719101125
sv
0.43820224719101125
no
0.42028985507246375
pl
0.3485342019543974
et
0.3333333333333333
hu
0.2907801418439716
de
0.2857142857142857
vi
0.2805755395683453
yo
0.2805755395683453
da
0.24528301886792453
ms
0.24528301886792453
reliable
true
passes
true
12
name
"Hunter"
dialogue
"I will. Just—stay put."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8214285714285714
hr
0.6786632390745501
sv
0.6575342465753424
ca
0.6323529411764706
et
0.5689655172413793
tl
0.5503597122302158
no
0.5370370370370371
da
0.5265151515151516
sq
0.5173745173745175
pl
0.50199203187251
it
0.4791666666666667
de
0.4588744588744588
cs
0.45652173913043476
ro
0.4186046511627907
yo
0.410377358490566
sk
0.3654822335025381
be
0.358974358974359
tr
0.358974358974359
hu
0.34895833333333337
az
0.33510638297872336
is
0.33510638297872336
lt
0.33510638297872336
lv
0.33510638297872336
uk
0.33510638297872336
vi
0.33510638297872336
reliable
true
passes
true