NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-03-18-01KM0AEXMFQW0S9PZ742PQB9XX
Run Details
Model:
Mistral Small 4
Test:
Language Writing
Scenario:
Character dialogue (Spanish) in a story
Duration:
7.6s
Cost:
$0.000461
Provider:
Mistral
Evaluation summary
Score
Evaluator
Details Link
63.64%
Parse dialogue
(details)
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Maria"> Maria is a 30-year old college student on a study abroad program. Born in Spain, she is fluent in Spanish and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Spanish, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Maria is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Spanish, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Maria and Hunter as a voice sheet: Maria: "..." Hunter: "..."
Model response
Messages
Meta
AI
**Voice Sheet: A Chance Encounter** *Setting: A quiet afternoon at "The Golden Apple Café" in Alborn, MN. Sunlight filters through the large windows, casting a warm glow over the wooden tables. Maria, camera in hand, sits alone, her expression troubled as she flips through the photos on its display screen. The hum of the café—chatter, the clinking of cups—is a distant murmur in the background.* --- **Hunter** *(approaches Maria’s table, hands tucked into the pockets of his leather jacket. He clears his throat politely.)* Hunter: "Excuse me. Mind if I sit?" *Maria looks up, her dark eyes widening slightly. She shakes her head and gestures to the empty chair across from her—a silent invitation.* **Hunter** *(pulls out the chair and sits, his voice direct but not unkind.)* Hunter: "You’re the Spanish student, right? The one from the college in the city? I saw you around campus." *Maria nods, her fingers tightening around her camera strap. She replies softly in Spanish, her voice laced with unease.* **Maria** *(hesitant, in Spanish)* Maria: "Sí... I mean, yes. I’m Maria. Photographs are my way of understanding this town, but lately..." *She trails off, shaking her head.* **Hunter** *(blinks, then frowns slightly. He doesn’t understand.)* Hunter: "Sorry, I don’t speak Spanish. Could you—" *Maria realizes her mistake and switches to broken English, her words halting.* **Maria** Maria: "Sorry. My English... is not good. I try, but..." *She gestures vaguely.* "These photos... they make me sad. Too many shadows now." **Hunter** *(leans forward slightly, his tone measured.)* Hunter: "Shadows?" *Maria nods, flipping the camera around to show him a recent photo—a misty street in what looks like the older part of town, the lampposts casting long, eerie shapes.* **Maria** Maria: "Here. This street. Before, it was bright. Now, no one walks. Only... disappearances." *She shivers, wrapping her arms around herself.* **Hunter** *(his jaw tightens, but he keeps his voice even.)* Hunter: "Disappearances?" *Maria looks up at him, her eyes reflecting genuine fear.* **Maria** Maria: "Four people. Gone. Last month, last week... the mayor’s daughter too. The police say ‘accidents.’ But this town—" *She gestures toward the window, where the quiet streets of Alborn are visible.* "—it hides things in the dark." *Hunter’s phone rings loudly, startling Maria. He pulls it out, checks the caller ID, and sighs.* **Hunter** *(to Maria, apologetic)* Hunter: "I’ve got to take this. But I’d like to talk more later. Maybe you can show me those photos?" *Maria nods, but before she can respond, Hunter stands, already answering the call.* **Hunter** *(into phone)* Hunter: "Yeah, I’m on my way." *With a last glance at Maria—who watches him with wide eyes—Hunter strides out of the café, leaving her alone with her camera and the weight of unspoken questions.*
created_at
"2026-03-18T11:14:28.122Z"
3/18/2026, 11:14:28 AM
model
"mistralai/mistral-small-2603"
1/1/2603, 12:00:00 AM
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
366
moderation_latency
(null)
generation_time
7548
tokens_prompt
317
tokens_completion
792
native_tokens_prompt
281
native_tokens_completion
702
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
16
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.00046119
router
(null)
provider_responses
0
endpoint_id
"f5ed6283-4e17-457d-98cd-2ec0c318171d"
id
"6b739a32edc64f428813a9dcbc1cbd0f"
is_byok
false
latency
366
model_permaslug
"mistralai/mistral-small-2603"
1/1/2603, 12:00:00 AM
provider_name
"Mistral"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.14.0; linux; x64))"
http_referer
(null)
api_type
"completions"
id
"gen-1773832468-uaVraFdSrNSnOZijm0KM"
upstream_id
"6b739a32edc64f428813a9dcbc1cbd0f"
total_cost
0.00046119
cache_discount
0.00000216
upstream_inference_cost
0
provider_name
"Mistral"
Evaluation details
Result
Evaluator
Details
Meta Data
63.64%
Parse dialogue
n/a
dialogue
0
name
"Hunter"
dialogue
"Excuse me. Mind if I sit?"
detectedLang
"en"
heavyLang
"la"
scores
en
0.702886247877759
no
0.6575342465753424
sq
0.6170678336980306
da
0.6058558558558559
et
0.5843230403800476
sv
0.576271186440678
it
0.527027027027027
hu
0.4696969696969697
hr
0.44267515923566875
ca
0.44089456869009586
pl
0.4186046511627907
cs
0.375
es
0.36823104693140796
fr
0.34210526315789475
ro
0.33962264150943394
pt
0.3346007604562738
sl
0.3346007604562738
yo
0.3320610687022901
ms
0.32432432432432434
nl
0.32432432432432434
fi
0.3
tl
0.3
sk
0.29149797570850206
be
0.2857142857142857
tr
0.2857142857142857
az
0.2647058823529412
is
0.2647058823529412
lt
0.2647058823529412
lv
0.2647058823529412
uk
0.2647058823529412
vi
0.2647058823529412
reliable
true
passes
true
1
name
"Hunter"
dialogue
"You’re the Spanish student, right? The one from the college in the city? I saw you around campus."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8237277743715511
tl
0.6967299578059071
no
0.5967741935483871
nl
0.5715350223546944
ro
0.5576923076923077
sv
0.5151770657672851
it
0.4838420107719928
de
0.4724770642201835
da
0.45907808090310437
fr
0.44764649375600385
pl
0.4301288404360753
sq
0.42842942345924456
yo
0.4267198404785643
ms
0.40843621399176955
ca
0.3991640543364681
cs
0.3611111111111111
hr
0.3451025056947608
az
0.27854454203262236
sl
0.2703045685279188
sk
0.25902061855670105
hu
0.2551813471502591
et
0.18785310734463279
lt
0.18785310734463279
lv
0.18785310734463279
pt
0.15066469719350073
es
0.14561664190193166
be
0.10852713178294573
tr
0.10852713178294573
is
0.0987460815047022
uk
0.0987460815047022
vi
0.0987460815047022
reliable
true
passes
true
2
name
"Maria"
dialogue
"Sí... I mean, yes. I’m Maria. Photographs are my way of understanding this town, but lately..."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8055382700684506
tl
0.6232670283303194
no
0.5397643593519882
nl
0.5023885350318471
da
0.46808510638297873
sv
0.4653550042771599
fr
0.423963133640553
sk
0.423963133640553
de
0.41588785046728977
pl
0.41259398496240596
yo
0.39671814671814676
ro
0.3811881188118812
ca
0.37934458788480635
it
0.3530020703933748
cs
0.3482794577685088
es
0.3372216330858961
ms
0.32505399568034554
is
0.31917211328976036
sq
0.2937853107344633
pt
0.27409988385598144
hr
0.2550655542312277
fi
0.23873325213154686
lt
0.23218673218673216
hi
0.19665809768637532
eu
0.18619791666666666
az
0.17437252311756934
et
0.1677762982689747
lv
0.16331994645247658
sl
0.10329985652797705
be
0.10071942446043164
tr
0.10071942446043164
hu
0.09682080924855492
uk
0.09156976744186046
vi
0.09156976744186046
reliable
true
passes
false
3
name
"Hunter"
dialogue
"Sorry, I don’t speak Spanish. Could you—"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8144712430426716
tl
0.6268656716417911
no
0.42857142857142855
sv
0.42084942084942084
it
0.4174757281553398
sq
0.4163424124513619
da
0.4117647058823529
cs
0.37888198757763975
ro
0.3617021276595745
hr
0.31662870159453305
ca
0.3150684931506849
hu
0.3150684931506849
pl
0.29577464788732394
fr
0.27184466019417475
pt
0.25
yo
0.2248062015503876
de
0.2227979274611399
nl
0.21052631578947367
sk
0.1935483870967742
be
0.1891891891891892
tr
0.1891891891891892
az
0.17355371900826447
et
0.17355371900826447
is
0.17355371900826447
lt
0.17355371900826447
lv
0.17355371900826447
uk
0.17355371900826447
vi
0.17355371900826447
reliable
true
passes
true
4
name
"Maria"
dialogue
"These photos... they make me sad. Too many shadows now."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8078060319337669
fr
0.45652173913043476
sq
0.4328097731239092
es
0.358974358974359
it
0.3564356435643564
pt
0.34077079107505076
nl
0.3229166666666667
de
0.3143459915611814
hr
0.2696629213483146
da
0.23529411764705882
et
0.2261904761904762
no
0.21875
sl
0.21307506053268765
ms
0.20537897310513448
lt
0.19753086419753088
tr
0.1935483870967742
hi
0.19154228855721395
tl
0.19154228855721395
fi
0.1875
ca
0.1792929292929293
lv
0.1792929292929293
reliable
true
passes
false
5
name
"Hunter"
dialogue
"Shadows?"
detectedLang
"de"
heavyLang
"en"
scores
de
0.609375
en
0.609375
tr
0.609375
reliable
false
passes
true
6
name
"Maria"
dialogue
"Here. This street. Before, it was bright. Now, no one walks. Only... disappearances."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8160476524176594
tl
0.5547073791348601
fr
0.5009505703422054
nl
0.421806167400881
pt
0.41731409544950054
lv
0.39999999999999997
pl
0.396551724137931
hr
0.38162544169611307
no
0.38162544169611307
sq
0.38016528925619836
ca
0.3526510480887793
de
0.3354430379746835
yo
0.3110236220472441
it
0.30463576158940403
es
0.3009320905459388
da
0.2981283422459893
sk
0.25213675213675213
sv
0.20933734939759033
ms
0.15730337078651685
tr
0.1435562805872757
hu
0.1264559068219634
sl
0.12060301507537688
cs
0.10102739726027396
et
0.10102739726027396
is
0.10102739726027396
lt
0.10102739726027396
ro
0.10102739726027396
reliable
true
passes
false
7
name
"Hunter"
dialogue
"Disappearances?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.7563352826510721
fr
0.7146118721461188
pt
0.5629370629370629
ca
0.5471014492753623
nl
0.45652173913043476
ms
0.43946188340807174
es
0.41588785046728977
it
0.410377358490566
lv
0.3718592964824121
tl
0.3718592964824121
reliable
true
passes
true
8
name
"Maria"
dialogue
"—it hides things in the dark."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8248686514886164
nl
0.6784565916398714
tl
0.64349376114082
yo
0.5753715498938429
sv
0.562363238512035
de
0.5485327313769752
lv
0.46236559139784944
no
0.4550408719346049
fr
0.45054945054945056
sq
0.45054945054945056
sl
0.4350282485875706
ms
0.43342776203966005
da
0.42857142857142855
it
0.42363112391930835
ro
0.4152046783625731
et
0.3464052287581699
ca
0.3150684931506849
is
0.3055555555555556
az
0.29577464788732394
pl
0.29577464788732394
reliable
true
passes
false
9
name
"Hunter"
dialogue
"I’ve got to take this. But I’d like to talk more later. Maybe you can show me those photos?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8249619482496194
tl
0.6026261230131306
fr
0.48614834673815904
nl
0.43405511811023617
no
0.4197780020181635
sl
0.3947368421052632
pt
0.3546576879910213
sq
0.30133657351154314
de
0.2830423940149626
pl
0.2684478371501272
cs
0.26658163265306123
da
0.2561448900388098
hr
0.25227568270481143
lv
0.25130208333333337
lt
0.24242424242424243
es
0.2404227212681638
hi
0.2101648351648352
ca
0.20470262793914246
yo
0.19241573033707865
sk
0.18670438472418668
et
0.1417910447761194
sv
0.13010590015128592
ms
0.1274658573596358
it
0.12213740458015267
az
0.11809815950920245
tr
0.11809815950920245
fi
0.11538461538461538
reliable
true
passes
true
10
name
"Hunter"
dialogue
"Yeah, I’m on my way."
detectedLang
"en"
heavyLang
"en"
scores
en
0.804177545691906
tl
0.7058823529411765
pl
0.5398773006134969
cs
0.5176848874598071
sk
0.5176848874598071
et
0.506578947368421
fi
0.5
fr
0.42084942084942084
ca
0.39759036144578314
hr
0.3697478991596639
hi
0.358974358974359
yo
0.3333333333333333
reliable
true
passes
true