NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-10-07-01M4AV4G8QS0N7XYQZ25ZJFFXT
Run Details
Model:
Mistral Medium 3.5
Test:
Language Writing
Scenario:
Character dialogue (Spanish) in a story
Duration:
3.2s
Cost:
$0.002904
Provider:
Mistral
Evaluation summary
Score
Evaluator
Details Link
100.00%
Parse dialogue
(details)
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Maria"> Maria is a 30-year old college student on a study abroad program. Born in Spain, she is fluent in Spanish and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Spanish, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Maria is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Spanish, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Maria and Hunter as a voice sheet: Maria: "..." Hunter: "..."
Model response
Messages
Meta
AI
Here’s the dialogue formatted as a voice sheet, capturing the tension and language barrier between Maria and Hunter: --- **Maria:** *(murmuring to herself, examining her camera)* "No puedo creer lo que vi... fue tan extraño." *(She looks up, startled, as Hunter approaches.)* **Hunter:** *(firm but polite)* "Ma’am, I’m Detective Hunter. I need to ask you a few questions about what happened at the festival last night. You were there, right?" **Maria:** *(nervously, in rapid Spanish)* "Sí, estuve allí... pero no sé nada. Solo vi... sombras. Y luego... el grito." *(She shivers, clutching her camera tighter.)* **Hunter:** *(frowning, leaning in slightly)* "I’m sorry, I don’t understand. Do you speak English?" **Maria:** *(shaking her head, frustrated)* "No inglés. Solo español. ¿Usted... habla español?" *(Her voice wavers, eyes darting around as if expecting danger.)* **Hunter:** *(sighs, rubbing his temple)* "No, I don’t. Look, maybe we can—" *(His phone rings. He checks it, then straightens up.)* "I’ve gotta take this. Stay here." *(He steps away, answering the call with a gruff,)* "Hunter." **Maria:** *(to herself, relieved but still uneasy)* "Dios mío, ¿qué está pasando en este pueblo?" --- This keeps the scene tense, highlights the language barrier, and sets up intrigue for the mystery.
created_at
"2026-10-07T09:29:26.047Z"
10/7/2026, 9:29:26 AM
model
"mistralai/mistral-medium-3.5-20260430"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
355
moderation_latency
(null)
generation_time
3155
tokens_prompt
304
tokens_completion
344
native_tokens_prompt
281
native_tokens_completion
331
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
"default"
usage
0.002904
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1791365366-zaoV20jObFyt4DPlBLOG"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1791365366-D0AC68zUK6NHIjjDw3Br"
upstream_id
"1688e4515d32496a90d032402bf6c67d"
provider_responses
0
endpoint_id
"d21d316f-d540-4718-b36e-3beff85d0cf9"
id
"1688e4515d32496a90d032402bf6c67d"
is_byok
false
latency
355
model_permaslug
"mistralai/mistral-medium-3.5-20260430"
provider_name
"Mistral"
status
200
total_cost
0.002904
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Mistral"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
100.00%
Parse dialogue
n/a
dialogue
0
name
"Maria"
dialogue
"No puedo creer lo que vi... fue tan extraño."
detectedLang
"es"
heavyLang
"es"
scores
es
0.8112659698025553
ca
0.6400885935769657
pt
0.5917085427135679
en
0.5428973277074542
it
0.477491961414791
tl
0.4519392917369309
fr
0.41016333938294003
no
0.40693430656934304
yo
0.40693430656934304
sv
0.40476190476190477
vi
0.3701550387596899
sk
0.34077079107505076
da
0.30406852248394006
lv
0.2872807017543859
hr
0.23708920187793428
ms
0.22062350119904073
tr
0.21307506053268765
nl
0.20147420147420148
ro
0.20147420147420148
de
0.19154228855721395
pl
0.1875
cs
0.1751269035532995
reliable
true
passes
true
1
name
"Hunter"
dialogue
"Ma’am, I’m Detective Hunter. I need to ask you a few questions about what happened at the festival last night. You were there, right?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8201089070400622
tl
0.6671464555595539
fr
0.5342396777442094
da
0.5182291666666667
no
0.5174752217005738
it
0.4939824945295405
ca
0.48208286674132134
pt
0.44710101613867304
cs
0.4325153374233129
nl
0.4167717528373266
ro
0.4156664560960202
sq
0.4104525175270874
hr
0.40705128205128205
es
0.3808567603748327
de
0.3775235531628533
sv
0.3660041124057573
sl
0.3616287094547964
yo
0.3616287094547964
et
0.33405327573794097
sk
0.32824981844589685
pl
0.3168389955686854
ms
0.29064417177914115
lt
0.28846153846153844
lv
0.25583266291230894
hu
0.23868312757201646
az
0.21343537414965988
tr
0.18213969938107868
is
0.12982126058325494
vi
0.12570888468809074
fi
0.11988582302568983
be
0.07035175879396985
eu
0.07035175879396985
uk
0.06376518218623482
reliable
true
passes
true
2
name
"Maria"
dialogue
"Sí, estuve allí... pero no sé nada. Solo vi... sombras. Y luego... el grito."
detectedLang
"es"
heavyLang
"es"
scores
es
0.8078478964401294
ca
0.5862369337979094
pt
0.5518867924528302
it
0.5108135942327497
tl
0.46022727272727276
yo
0.3300423131170663
no
0.31948424068767906
vi
0.29420505200594355
fr
0.27811550151975684
pl
0.27480916030534347
da
0.23014586709886548
sv
0.2263843648208469
lv
0.21617161716171615
hu
0.20833333333333331
is
0.205685618729097
ro
0.19627749576988157
en
0.17962003454231434
hr
0.1753472222222222
sk
0.1607773851590106
tr
0.15630550621669628
lt
0.13793103448275862
reliable
true
passes
true
3
name
"Hunter"
dialogue
"I’m sorry, I don’t understand. Do you speak English?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8052580331061344
tl
0.6592844974446337
no
0.5670995670995671
da
0.5614035087719298
sv
0.51278928136419
cs
0.5
pl
0.464524765729585
hr
0.4528043775649795
sk
0.4227994227994228
de
0.39849624060150374
pt
0.3902439024390244
sq
0.38556067588325654
ro
0.3710691823899371
it
0.34959349593495936
nl
0.3079584775086505
vi
0.30313588850174217
yo
0.2920353982300885
ca
0.25650557620817843
is
0.25512104283054005
sl
0.23076923076923078
ms
0.15254237288135594
be
0.14893617021276595
tr
0.14893617021276595
hu
0.14346895074946467
az
0.13606911447084233
et
0.13606911447084233
lt
0.13606911447084233
lv
0.13606911447084233
uk
0.13606911447084233
reliable
true
passes
true
4
name
"Maria"
dialogue
"No inglés. Solo español. ¿Usted... habla español?"
detectedLang
"es"
heavyLang
"es"
scores
es
0.8129251700680273
pt
0.5370370370370371
it
0.5258620689655172
ca
0.4791666666666667
eu
0.47817836812144215
en
0.4376278118609407
fr
0.39560439560439564
tl
0.39560439560439564
no
0.38752783964365256
lv
0.3226600985221675
hu
0.2724867724867725
hr
0.26861702127659576
da
0.25271739130434784
sk
0.2486338797814208
tr
0.24242424242424243
et
0.21875
pl
0.21428571428571427
reliable
true
passes
true
5
name
"Hunter"
dialogue
"Hunter."
detectedLang
"en"
heavyLang
"de"
scores
en
0.7797356828193832
de
0.6376811594202898
da
0.6212121212121212
no
0.609375
fr
0.5901639344262295
sv
0.5833333333333334
tl
0.5726495726495726
it
0.5575221238938053
nl
0.5575221238938053
pt
0.5575221238938053
ca
0.5412844036697247
ms
0.5412844036697247
ro
0.5412844036697247
sl
0.5412844036697247
sq
0.5412844036697247
tr
0.5412844036697247
reliable
false
passes
true
6
name
"Maria"
dialogue
"Dios mío, ¿qué está pasando en este pueblo?"
detectedLang
"es"
heavyLang
"es"
scores
es
0.8217757615035646
pt
0.6483375959079284
ca
0.4888475836431227
ro
0.439918533604888
tl
0.3861607142857143
eu
0.3806306306306307
sk
0.3721461187214612
nl
0.3574766355140187
da
0.34988179669030733
sv
0.34988179669030733
fr
0.34679334916864607
no
0.3357487922705314
is
0.3276283618581907
it
0.3226600985221675
lt
0.3055555555555556
tr
0.2857142857142857
lv
0.27055702917771884
ms
0.260752688172043
cs
0.2403314917127072
hu
0.23822714681440443
fi
0.233983286908078
sl
0.21428571428571427
pl
0.20520231213872833
sq
0.20520231213872833
reliable
true
passes
true