NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-03-18-01KM079AMHSKYEXA2ZM7R891G5
Run Details
Model:
Mistral Small 4
Test:
Language Writing
Scenario:
Character dialogue (Spanish) in a story
Duration:
6.7s
Cost:
$0.000461
Provider:
Mistral
Evaluation summary
Score
Evaluator
Details Link
60.00%
Parse dialogue
(details)
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Maria"> Maria is a 30-year old college student on a study abroad program. Born in Spain, she is fluent in Spanish and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Spanish, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Maria is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Spanish, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Maria and Hunter as a voice sheet: Maria: "..." Hunter: "..."
Model response
Messages
Meta
AI
**Scene: The Café in Alborn** *The interior of *The Brewed Bean*, Alborn’s cozy café, hums with quiet chatter as the scent of coffee and cinnamon lingers in the air. Maria sits by the window, her camera resting on the table, her fingers absentmindedly tracing its edges. Outside, the golden afternoon light filters through the trees, casting long shadows on the quiet street.* *The bell above the door chimes as Hunter steps inside. His sharp eyes scan the room before landing on Maria. He approaches her table, his expression guarded but polite.* --- **Hunter:** *(pulling out the chair across from Maria and sitting down without waiting for an invitation)* “Good afternoon. Mind if I ask you a few questions?” *Maria looks up, startled, her dark eyes widening slightly. She hesitates, then smiles politely but cautiously.* **Maria:** *(hesitant, in accented but clear English)* “Yes. Of course.” --- **Hunter:** *(leaning forward slightly, hands folded on the table)* “I’m Detective Hunter. Trying to piece together what happened the night of the 12th. You were near the old mill around dusk, right?” *Maria’s fingers tighten around her camera. She glances out the window, her expression clouding over.* **Maria:** *(in Spanish, shaken)* “Sí… I was taking photos. It was beautiful—” *(she swallows, her voice trembling slightly)* “But then I heard… noises. Like someone was there, but not alone.” --- **Hunter:** *(tilts his head, confused by the sudden language shift)* “Wait, what? I don’t—” *(he sighs, rubbing his temple)* “Could you speak English? Slowly?” *Maria blinks, realizing her mistake. She takes a deep breath, forcing herself to switch languages.* **Maria:** *(in slow, careful English, her hands trembling slightly)* “I—I saw a figure. A man. He was arguing with someone near the mill. Then… then I heard a scream. After that… nothing. Just silence.” --- **Hunter:** *(leaning back, arms crossing)* “And you didn’t call the police?” **Maria:** *(shaking her head firmly, her voice rising slightly)* “No! I—I didn’t know. I was scared. I ran. I didn’t—” *(she stops, pressing her lips together, her breath uneven.)* --- **Hunter:** *(nodding, though his frown deepens)* “Alright. I need you to come by the station later and give a full statement. Understood?” *Maria nods mutely, her knuckles white around her camera.* --- *Hunter’s phone suddenly rings—an urgent, shrill sound that makes Maria flinch. He pulls it from his pocket, glances at the screen, and curses under his breath.* **Hunter:** *(standing abruptly, his chair scraping against the wooden floor)* “Gotta take this. Don’t go anywhere.” *(He walks toward the café’s back exit, answering the call as he goes.)* “Yeah?” *Maria watches him leave, her breath shaky. She looks down at her camera again, her heart pounding.* *The café’s murmur returns, wrapping around her like a fog.* --- **End Scene.** --- Would you like any adjustments to the tone or dialogue flow?
created_at
"2026-03-18T10:18:59.312Z"
3/18/2026, 10:18:59 AM
model
"mistralai/mistral-small-2603"
1/1/2603, 12:00:00 AM
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
650
moderation_latency
(null)
generation_time
6206
tokens_prompt
317
tokens_completion
826
native_tokens_prompt
281
native_tokens_completion
698
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.00046095
router
(null)
provider_responses
0
endpoint_id
"f5ed6283-4e17-457d-98cd-2ec0c318171d"
id
"d22073f8c77f40bcb8231fed85d6e167"
is_byok
false
latency
634
model_permaslug
"mistralai/mistral-small-2603"
1/1/2603, 12:00:00 AM
provider_name
"Mistral"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.14.0; linux; x64))"
http_referer
(null)
api_type
"completions"
id
"gen-1773829139-QUrTHocaDpXIXh8FS9aw"
upstream_id
"d22073f8c77f40bcb8231fed85d6e167"
total_cost
0.00046095
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Mistral"
Evaluation details
Result
Evaluator
Details
Meta Data
60.00%
Parse dialogue
n/a
dialogue
0
name
"Hunter"
dialogue
"“Good afternoon. Mind if I ask you a few questions?”"
detectedLang
"en"
heavyLang
"en"
scores
en
0.809368191721133
tl
0.6666666666666666
it
0.5726495726495726
fr
0.5705521472392638
ca
0.5430809399477807
pt
0.527027027027027
cs
0.47368421052631576
hu
0.47049924357034795
da
0.4688922610015175
no
0.4631901840490798
sv
0.46236559139784944
es
0.4479495268138801
sk
0.44267515923566875
hr
0.4176372712146422
pl
0.39759036144578314
ro
0.3955094991364421
et
0.3794326241134752
sq
0.37050359712230213
yo
0.37050359712230213
nl
0.3269230769230769
tr
0.29577464788732394
lt
0.29292929292929293
is
0.2827868852459016
az
0.2753623188405797
lv
0.2753623188405797
vi
0.2753623188405797
sl
0.20454545454545453
be
0.16666666666666666
eu
0.16666666666666666
de
0.1606714628297362
fi
0.15254237288135594
ms
0.15254237288135594
uk
0.15254237288135594
reliable
true
passes
true
1
name
"Maria"
dialogue
"“Yes. Of course.”"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8275862068965517
tl
0.7382198952879581
fr
0.6655518394648829
nl
0.5575221238938053
yo
0.5305164319248826
sq
0.49238578680203043
no
0.4845360824742268
is
0.4708994708994709
ro
0.46236559139784944
de
0.453551912568306
reliable
true
passes
false
2
name
"Hunter"
dialogue
"“I’m Detective Hunter. Trying to piece together what happened the night of the 12th. You were near the old mill around dusk, right?”"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8248407643312101
tl
0.6859535591929958
no
0.3911439114391144
yo
0.3861607142857143
da
0.3773584905660377
fr
0.3357487922705314
lv
0.31077694235588976
nl
0.3008474576271187
de
0.2850953206239168
ro
0.2737676056338028
cs
0.25406871609403253
sl
0.23041044776119401
ca
0.22462406015037595
it
0.2224316682375118
pt
0.22022684310018903
sq
0.21800947867298578
sv
0.20673076923076925
hr
0.18154761904761904
es
0.17746759720837485
ms
0.1424116424116424
pl
0.140625
sk
0.13793103448275862
lt
0.11194833153928956
is
0.09737417943107221
tr
0.0667420814479638
reliable
true
passes
true
3
name
"Maria"
dialogue
"“Sí… I was taking photos. It was beautiful—” “But then I heard… noises. Like someone was there, but not alone.”"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8079287031346035
tl
0.5474293989862419
fr
0.50199203187251
de
0.4175209692451072
yo
0.3890518084066471
sq
0.37122736418511065
no
0.36289500509684
pl
0.33083511777301927
ca
0.33011789924973206
nl
0.3293991416309013
es
0.2913832199546485
et
0.2774566473988439
tr
0.2724097788125727
pt
0.2681498829039813
lv
0.26035502958579887
sv
0.25059952038369304
it
0.24425634824667475
lt
0.18619791666666666
sk
0.18619791666666666
da
0.1819371727748691
hr
0.1819371727748691
is
0.17654808959156787
cs
0.14383561643835618
ro
0.12587412587412586
fi
0.11347517730496455
hi
0.10968660968660969
sl
0.10201149425287356
be
0.10071942446043164
hu
0.09682080924855492
az
0.09156976744186046
uk
0.09156976744186046
vi
0.09156976744186046
reliable
true
passes
false
4
name
"Hunter"
dialogue
"“Wait, what? I don’t—” “Could you speak English? Slowly?”"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8208802456499489
tl
0.5358090185676392
no
0.3934142114384749
da
0.3761140819964349
hr
0.3761140819964349
sv
0.375
cs
0.3433395872420263
ro
0.31640625
ca
0.2827868852459016
sq
0.2768595041322314
pl
0.2647058823529412
it
0.24731182795698922
fr
0.24242424242424243
yo
0.19908466819221968
de
0.17061611374407584
ms
0.17061611374407584
sk
0.17061611374407584
be
0.16666666666666666
tr
0.16666666666666666
hu
0.1606714628297362
az
0.15254237288135594
et
0.15254237288135594
is
0.15254237288135594
lt
0.15254237288135594
lv
0.15254237288135594
uk
0.15254237288135594
vi
0.15254237288135594
reliable
true
passes
true
5
name
"Maria"
dialogue
"“I—I saw a figure. A man. He was arguing with someone near the mill. Then… then I heard a scream. After that… nothing. Just silence.”"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8132886943085244
tl
0.5956497490239822
no
0.5205026455026455
da
0.5192307692307693
ca
0.47804175665946724
sv
0.46925329428989754
yo
0.43972179289026275
es
0.4120032441200324
sq
0.4057377049180328
nl
0.3855932203389831
fr
0.3845500848896435
ro
0.37928082191780826
de
0.3766122098022356
pt
0.36736474694589877
ms
0.3538324420677362
cs
0.348607367475292
it
0.34802158273381295
lv
0.29816069699903197
sk
0.2706237424547284
hr
0.257172131147541
lt
0.2479253112033195
sl
0.24242424242424243
pl
0.24163179916317992
et
0.23924449108079748
hu
0.2352320675105485
tr
0.22790202342917998
fi
0.1751990898748578
is
0.15990730011587484
az
0.15501165501165504
vi
0.15501165501165504
be
0.0880503144654088
eu
0.0880503144654088
uk
0.0799492385786802
reliable
true
passes
false
6
name
"Hunter"
dialogue
"“And you didn’t call the police?”"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8392857142857143
tl
0.7305389221556886
cs
0.5360824742268042
fr
0.5161290322580645
yo
0.4779582366589328
no
0.4498777506112469
ro
0.43890274314214467
tr
0.43324937027707805
nl
0.43037974683544306
da
0.42748091603053434
hr
0.42748091603053434
sv
0.4260204081632653
it
0.42455242966751916
sl
0.4186046511627907
ms
0.4155844155844156
sq
0.4155844155844156
sk
0.4109947643979057
eu
0.29467084639498436
et
0.2834394904458599
lv
0.2834394904458599
pl
0.281150159744409
lt
0.27884615384615385
fi
0.27184466019417475
de
0.26229508196721313
az
0.25
es
0.25
hu
0.25
ca
0.24242424242424243
pt
0.23728813559322032
reliable
true
passes
true
7
name
"Maria"
dialogue
"“No! I—I didn’t know. I was scared. I ran. I didn’t—”"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8248072880168186
tl
0.5503597122302158
yo
0.5335820895522388
it
0.5309568480300189
ca
0.5219885277246654
tr
0.5078740157480316
no
0.49186991869918695
hr
0.4897959183673469
pl
0.44567627494456763
lv
0.4369369369369369
ro
0.40191387559808617
sk
0.3946731234866829
da
0.3573264781491003
pt
0.3556701030927836
sv
0.3556701030927836
es
0.3540051679586563
nl
0.34895833333333337
sq
0.34895833333333337
de
0.32249322493224936
cs
0.29577464788732394
be
0.21875
hu
0.21135646687697163
az
0.20127795527156547
et
0.20127795527156547
is
0.20127795527156547
lt
0.20127795527156547
uk
0.20127795527156547
vi
0.20127795527156547
reliable
true
passes
false
8
name
"Hunter"
dialogue
"“Alright. I need you to come by the station later and give a full statement. Understood?”"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8226950354609929
da
0.7023809523809523
tl
0.6844520940906483
no
0.6789258610624634
sv
0.6374423203691496
yo
0.6048850574712644
cs
0.5886312640239342
pl
0.582701062215478
fr
0.5820668693009119
sk
0.553208773354996
nl
0.5506535947712418
de
0.5439469320066335
it
0.5111111111111111
hr
0.47267497603068076
sq
0.4701348747591522
ca
0.416135881104034
ro
0.4136460554371002
et
0.3707093821510297
lt
0.3707093821510297
lv
0.3663594470046083
hu
0.34210526315789475
pt
0.3381468110709988
sl
0.3325242718446602
az
0.32014833127317677
tr
0.2724867724867725
es
0.26861702127659576
ms
0.26666666666666666
fi
0.20863309352517986
is
0.2005813953488372
vi
0.19472913616398244
zh
0.12280701754385964
hi
0.12140575079872205
be
0.11290322580645161
eu
0.11290322580645161
uk
0.10277324632952692
reliable
true
passes
true
9
name
"Hunter"
dialogue
"“Gotta take this. Don’t go anywhere.” “Yeah?”"
detectedLang
"en"
heavyLang
"en"
scores
en
0.7616984402079723
tl
0.647887323943662
it
0.4186046511627907
fi
0.289405684754522
hu
0.2819843342036553
pl
0.2819843342036553
de
0.22096317280453256
sl
0.22096317280453256
sq
0.22096317280453256
sv
0.21875
yo
0.21875
reliable
true
passes
true