NC Bench
Overview
About
Tests
Models
Vendors
Run: 2026-02-20-01KHXPBN0QYVB736YZMCFBZYV3
Run Details
Model:
Mistral Large 3
Test:
Language Writing
Scenario:
Character dialogue (Spanish) in a story
Duration:
21.0s
Cost:
$0.001685
Provider:
Mistral
Evaluation summary
Score
Evaluator
Details Link
90.00%
Parse dialogue
(details)
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Maria"> Maria is a 30-year old college student on a study abroad program. Born in Spain, she is fluent in Spanish and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Spanish, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Maria is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Spanish, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Maria and Hunter as a voice sheet: Maria: "..." Hunter: "..."
Model response
Messages
Meta
AI
**Voice Sheet: Café Conversation in Alborn, MN** *(Maria sits at a small wrought-iron table outside the café, her fingers tracing the edges of her camera. The late afternoon sun casts long shadows across the cobblestone street. She glances up as Hunter approaches, his expression serious but not unkind. He pulls out the chair across from her and sits without waiting for an invitation.)* **Hunter:** *(leaning forward slightly, hands clasped on the table)* "Excuse me, miss. I’m Detective Hunter Cole. I was hoping I could ask you a few questions about the other night—during the festival." **Maria:** *(startled, gripping her camera tighter; in rapid, anxious Spanish)* "¿El festival? ¡Dios mío, no quiero recordar! Vi algo… algo que no debería haber visto. La gente desaparece, ¿sabe? Como si la tierra se los tragara. Y ahora tengo miedo de que me encuentren a mí también." *(She shakes her head, eyes darting toward the street as if expecting someone.)* "No debí haber tomado esas fotos. Pero no podía parar. Es mi trabajo, ¿no? Capturar la belleza… pero esto no era belleza. Era…" *(She trails off, swallowing hard.)* **Hunter:** *(frowning, leaning back slightly)* "Whoa, whoa—hold on. I don’t… uh, I don’t speak Spanish. At all." *(He rubs his temple, clearly frustrated with himself.)* "Look, can you slow down? Maybe try English? Or…" *(He gestures vaguely, as if miming writing.)* "Write it down?" **Maria:** *(shaking her head, switching to broken but urgent English)* "No, no English. Lo siento. Pero…" *(She flips her camera around, scrolling through photos until she lands on one. She turns the screen toward him—a blurry shot of the festival at dusk, but in the corner, a dark figure dragging someone into the shadows near the old mill.)* "This. This is bad. Very bad. Yo vi… I saw…" *(She shudders, pulling the camera back to her chest.)* **Hunter:** *(eyes narrowing as he studies the photo, then looking back at her)* "You saw *what*? Who was that?" *(He pulls out a small notepad, clicking his pen.)* "And when was this taken?" **Maria:** *(in Spanish, then realizing he doesn’t understand, she points at the timestamp on the photo)* "Anoche. La última noche del festival. Después de la fogata. Todos estaban…" *(She makes a sweeping gesture with her hand, then mimes people dancing.)* "Felices. Pero luego…" *(She mimes someone being grabbed, her face twisting in fear.)* "No sé quién era. Pero llevaban algo. Como…" *(She gestures to her own face, then mimes a mask or hood.)* **Hunter:** *(grunting, scribbling notes)* "Okay, okay. So you saw someone—*something*—taking a person near the mill. You got a photo. That’s… that’s actually really helpful." *(He looks up at her, his tone softening.)* "You’re not in trouble, alright? But I need you to stay somewhere safe. Do you have a place to stay? Somewhere with people who can—" *(His phone rings sharply, cutting him off. He glances at the screen, his jaw tightening.)* **Hunter:** *(answering, standing abruptly)* "Cole." *(A pause. His expression darkens.)* "Yeah. Yeah, I’m on my way." *(He hangs up, looking back at Maria, who’s watching him with wide, frightened eyes.)* "Look, I gotta go. But *do not* go back to that mill. And don’t go anywhere alone, you hear me?" *(He hesitates, then pulls a business card from his wallet, sliding it across the table. He points at it, then at her.)* "If you see anything else—*anything*—you call me. Got it?" **Maria:** *(nodding quickly, taking the card with trembling fingers)* "Sí. Sí, lo haré. Pero…" *(She looks up at him, her voice barely above a whisper.)* "Tenga cuidado, Detective. No es solo una persona. Son… muchos." **Hunter:** *(pausing, clearly not understanding but reading the fear in her eyes)* "Yeah. Yeah, I’ll be careful." *(He gives her a curt nod, then turns and strides away, his coat flaring behind him as he disappears around the corner.)* *(Maria exhales shakily, clutching the business card to her chest. She glances down at her camera, then quickly tucks it into her bag, as if afraid someone might see it.)*
created_at
"2026-02-20T14:13:16.962Z"
2/20/2026, 2:13:16 PM
model
"mistralai/mistral-large-2512"
1/1/2512, 12:00:00 AM
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
565
moderation_latency
(null)
generation_time
20961
tokens_prompt
317
tokens_completion
1076
native_tokens_prompt
269
native_tokens_completion
1034
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.0016855
router
(null)
provider_responses
0
endpoint_id
"fa718841-07ea-4b7e-b8a3-6069545c7e6a"
id
"be2078a4d8dd44eb8da63c8127b949ed"
is_byok
false
latency
559
model_permaslug
"mistralai/mistral-large-2512"
1/1/2512, 12:00:00 AM
provider_name
"Mistral"
status
200
api_type
"completions"
id
"gen-1771596796-Jj3X6QF3D9R46aCV0TV5"
upstream_id
"be2078a4d8dd44eb8da63c8127b949ed"
total_cost
0.0016855
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Mistral"
Evaluation details
Result
Evaluator
Details
Meta Data
90.00%
Parse dialogue
n/a
dialogue
0
name
"Hunter"
dialogue
"Excuse me, miss. I’m Detective Hunter Cole. I was hoping I could ask you a few questions about the other night—during the festival."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8074521232306411
tl
0.648021308980213
fr
0.5905267817618416
no
0.5219638242894057
nl
0.5169712793733682
da
0.5157068062827225
it
0.5151991614255765
pt
0.4948115783724741
ca
0.48208286674132134
sv
0.43973349485160507
sq
0.4356314826113484
es
0.4204260651629073
ro
0.4156664560960202
ms
0.40629011553273425
de
0.38701126573889993
cs
0.3829219479653102
hr
0.35941828254847646
sl
0.3467514124293785
yo
0.33881343817012155
et
0.30866965620328846
lt
0.2862654320987654
sk
0.25702811244979923
pl
0.24118129614438064
hu
0.23868312757201646
az
0.21343537414965988
tr
0.18213969938107868
fi
0.17850799289520428
lv
0.17484388938447815
is
0.12982126058325494
vi
0.12570888468809074
be
0.07035175879396985
eu
0.07035175879396985
uk
0.06376518218623482
reliable
true
passes
true
1
name
"Maria"
dialogue
"No debí haber tomado esas fotos. Pero no podía parar. Es mi trabajo, ¿no? Capturar la belleza… pero esto no era belleza. Era…"
detectedLang
"es"
heavyLang
"es"
scores
es
0.801878485471089
ca
0.6630054917623563
pt
0.6547314578005115
tr
0.5283018867924528
it
0.5253164556962026
tl
0.4955156950672646
ro
0.44897959183673475
fr
0.4485294117647059
de
0.44306930693069313
no
0.4140625
en
0.40423654015887023
lv
0.40371024734982336
pl
0.3522072936660269
yo
0.34146341463414637
cs
0.3336623889437315
lt
0.31402439024390244
hr
0.3112244897959183
sq
0.30769230769230765
sk
0.30698151950718683
sv
0.29540709812108557
nl
0.2841993637327678
eu
0.2741935483870968
sl
0.24412094064949608
da
0.2398648648648649
hu
0.21693735498839908
et
0.16974169741697415
ms
0.16666666666666666
az
0.14880201765447668
is
0.11649214659685864
vi
0.11067193675889328
fi
0.09638554216867469
reliable
true
passes
true
2
name
"Hunter"
dialogue
"Write it down?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8307952622673435
et
0.4791666666666667
ro
0.46808510638297873
lv
0.46236559139784944
sq
0.46236559139784944
sk
0.45054945054945056
tl
0.4318181818181818
yo
0.4318181818181818
fr
0.4186046511627907
it
0.4186046511627907
lt
0.4186046511627907
sl
0.4186046511627907
reliable
true
passes
true
3
name
"Maria"
dialogue
"This. This is bad. Very bad. Yo vi… I saw…"
detectedLang
"en"
heavyLang
"en"
scores
en
0.7948717948717948
tl
0.6383363471971067
yo
0.6007984031936128
da
0.5841995841995842
sv
0.5807127882599581
no
0.5753715498938429
hu
0.5249406175771971
it
0.5085995085995086
vi
0.4490358126721763
nl
0.4428969359331476
is
0.43661971830985913
hr
0.41002949852507375
ca
0.40828402366863903
sq
0.40119760479041916
pl
0.38650306748466257
cs
0.3442622950819672
es
0.33993399339933994
de
0.3333333333333333
ms
0.3333333333333333
ro
0.3103448275862069
sk
0.2647058823529412
be
0.25925925925925924
tr
0.25925925925925924
az
0.23954372623574144
et
0.23954372623574144
lt
0.23954372623574144
lv
0.23954372623574144
uk
0.23954372623574144
reliable
true
passes
false
4
name
"Hunter"
dialogue
"And when was this taken?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8501498501498501
nl
0.6314496314496314
tl
0.5844875346260388
yo
0.5535714285714286
de
0.44237918215613387
no
0.3951612903225807
sv
0.3670886075949367
sk
0.34210526315789475
sl
0.34210526315789475
reliable
true
passes
true
5
name
"Maria"
dialogue
"No sé quién era. Pero llevaban algo. Como…"
detectedLang
"es"
heavyLang
"es"
scores
es
0.8197903014416775
pt
0.6386333771353482
tl
0.5676100628930818
it
0.5542949756888168
ca
0.5338983050847458
lv
0.4421906693711968
en
0.3902439024390244
ms
0.3514150943396226
is
0.30904522613065327
ro
0.27055702917771884
hr
0.26861702127659576
no
0.260752688172043
sk
0.2486338797814208
eu
0.24242424242424243
tr
0.24242424242424243
yo
0.23822714681440443
pl
0.21428571428571427
reliable
true
passes
true
6
name
"Hunter"
dialogue
"You’re not in trouble, alright? But I need you to stay somewhere safe. Do you have a place to stay? Somewhere with people who can—"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8275862068965517
tl
0.5947456679709335
cs
0.4996549344375431
fr
0.4817726947819872
pl
0.4802867383512545
da
0.45814648729446933
yo
0.4457186544342508
ro
0.41579371474617244
hr
0.4018151815181518
sl
0.40082644628099173
sk
0.39126784214945426
pt
0.37928082191780826
ca
0.36681222707423583
sq
0.3561278863232682
no
0.3544078361531611
it
0.34802158273381295
sv
0.34210526315789475
de
0.3354720439963337
nl
0.29543245869776485
tr
0.29406037000973706
az
0.28851815505397443
es
0.2778884462151395
et
0.2676767676767676
lv
0.2602040816326531
lt
0.25564681724846
vi
0.2518059855521156
hu
0.2352320675105485
ms
0.22954303931987244
is
0.15990730011587484
be
0.0880503144654088
eu
0.0880503144654088
fi
0.0799492385786802
uk
0.0799492385786802
reliable
true
passes
true
7
name
"Hunter"
dialogue
"If you see anything else——you call me. Got it?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8303516347933374
sq
0.548440065681445
et
0.4907407407407407
tl
0.47418738049713194
ms
0.3707093821510297
es
0.27055702917771884
sv
0.26666666666666666
fr
0.2486338797814208
no
0.2486338797814208
pt
0.24242424242424243
sl
0.24242424242424243
lv
0.23822714681440443
nl
0.233983286908078
it
0.22535211267605632
cs
0.22096317280453256
yo
0.21652421652421652
fi
0.21428571428571427
reliable
true
passes
true
8
name
"Maria"
dialogue
"Tenga cuidado, Detective. No es solo una persona. Son… muchos."
detectedLang
"es"
heavyLang
"es"
scores
es
0.8119417019275975
it
0.6663886572143453
ca
0.6658312447786132
pt
0.6386630532971996
en
0.5480225988700564
tl
0.5412844036697247
ro
0.5198079231692677
fr
0.5079950799507995
lv
0.5006242197253433
no
0.4542974079126876
de
0.4301994301994302
tr
0.39668174962292607
sq
0.3798449612403101
hu
0.37694704049844235
hr
0.3620414673046252
ms
0.3220338983050847
is
0.3019197207678883
az
0.29701230228471004
lt
0.2895204262877442
da
0.28698752228163993
nl
0.28186714542190305
sv
0.2779783393501805
sk
0.2727272727272727
pl
0.250936329588015
cs
0.24670433145009416
eu
0.18533604887983707
sl
0.14346895074946467
et
0.12854030501089325
reliable
true
passes
true
9
name
"Hunter"
dialogue
"Yeah. Yeah, I’ll be careful."
detectedLang
"en"
heavyLang
"en"
scores
en
0.7910863509749304
ro
0.5562130177514794
tl
0.5535714285714286
hu
0.43820224719101125
lt
0.42748091603053434
yo
0.4230769230769231
es
0.336283185840708
fr
0.336283185840708
reliable
true
passes
true