NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-09-25-01M3CKEAS1JVBT0RX1XE02N16B
Run Details
Model:
Mistral Medium 3.5 (Reasoning)
Test:
Language Writing
Scenario:
Character dialogue (Spanish) in a story
Duration:
4.0s
Cost:
$0.003939
Provider:
Mistral
Evaluation summary
Score
Evaluator
Details Link
100.00%
Parse dialogue
(details)
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Maria"> Maria is a 30-year old college student on a study abroad program. Born in Spain, she is fluent in Spanish and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Spanish, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Maria is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Spanish, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Maria and Hunter as a voice sheet: Maria: "..." Hunter: "..."
Model response
Messages
Meta
AI
Here’s the dialogue formatted as a voice sheet, capturing the tension and language barrier between Maria and Hunter: --- **Maria:** *(murmuring to herself, examining her camera)* "No puede ser... esto no tiene sentido..." *(This can't be... this doesn't make sense...)* **Hunter:** *(approaches, stern but polite)* "Ma’am, I’m Detective Hunter. I need to ask you a few questions about what happened at the festival last night. You were there, right?" **Maria:** *(startled, clutching her camera tighter, responds rapidly in Spanish)* "¡Yo no sé nada! Solo estaba tomando fotos... pero vi... vi algo extraño. Alguien... alguien desapareció." *(I don’t know anything! I was just taking photos... but I saw... I saw something strange. Someone... someone disappeared.)* **Hunter:** *(frowning, rubbing his temple)* "Slow down, ma’am. I don’t understand. You’re gonna have to speak English." **Maria:** *(frustrated, gesturing wildly)* "¡No hablo inglés! ¡No entiendo lo que está pasando!" *(I don’t speak English! I don’t understand what’s happening!)* **Hunter:** *(sighs, pulling out a notepad)* "Okay, okay. Let’s try this—point to where you were. Maybe we can figure it out." *(He taps the notepad, encouraging her to draw.)* **Maria:** *(nods, sketching quickly, still muttering in Spanish)* "Aquí... cerca del puesto de manzanas. Había un hombre con un abrigo oscuro..." *(Here... near the apple stand. There was a man in a dark coat...)* **Hunter:** *(leaning in, studying the sketch)* "Dark coat, near the apple stand. Got it. Anything else?" *(His phone rings—he checks it, then curses under his breath.)* "I’ve gotta take this. Stay here." *(He steps away, answering the call.)* "Hunter... yeah, I’m on it." **Maria:** *(watching him leave, whispering to herself)* "Dios mío... ¿qué hago ahora?" *(My God... what do I do now?)* ---
created_at
"2026-09-25T15:37:46.549Z"
9/25/2026, 3:37:46 PM
model
"mistralai/mistral-medium-3.5-20260430"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
375
moderation_latency
(null)
generation_time
3916
tokens_prompt
304
tokens_completion
483
native_tokens_prompt
281
native_tokens_completion
469
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
"default"
usage
0.003939
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1790350666-FNPd6BtFrYb4pOtZEVRP"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1790350666-Gvmghyj31oCaWpRzY9Qt"
upstream_id
"eb562edd4cea42d5997fc6f4d6b8d79f"
provider_responses
0
endpoint_id
"d21d316f-d540-4718-b36e-3beff85d0cf9"
id
"eb562edd4cea42d5997fc6f4d6b8d79f"
is_byok
false
latency
370
model_permaslug
"mistralai/mistral-medium-3.5-20260430"
provider_name
"Mistral"
status
200
total_cost
0.003939
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Mistral"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
100.00%
Parse dialogue
n/a
dialogue
0
name
"Maria"
dialogue
"No puede ser... esto no tiene sentido..."
detectedLang
"es"
heavyLang
"es"
scores
es
0.8344370860927153
pt
0.6676514032496307
no
0.6173469387755102
ca
0.608695652173913
it
0.6059544658493871
tl
0.4955156950672646
en
0.4260204081632653
tr
0.4015957446808511
fr
0.3935309973045822
ro
0.3835616438356164
fi
0.3818681318681319
lv
0.3679775280898876
hr
0.3098159509202454
da
0.3055555555555556
sv
0.3055555555555556
sk
0.2879746835443038
nl
0.27652733118971057
eu
0.27184466019417475
ms
0.267100977198697
pl
0.25
az
0.21875
reliable
true
passes
true
1
name
"Hunter"
dialogue
"Ma’am, I’m Detective Hunter. I need to ask you a few questions about what happened at the festival last night. You were there, right?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8201089070400622
tl
0.6671464555595539
fr
0.5342396777442094
da
0.5182291666666667
no
0.5174752217005738
it
0.4939824945295405
ca
0.48208286674132134
pt
0.44710101613867304
cs
0.4325153374233129
nl
0.4167717528373266
ro
0.4156664560960202
sq
0.4104525175270874
hr
0.40705128205128205
es
0.3808567603748327
de
0.3775235531628533
sv
0.3660041124057573
sl
0.3616287094547964
yo
0.3616287094547964
et
0.33405327573794097
sk
0.32824981844589685
pl
0.3168389955686854
ms
0.29064417177914115
lt
0.28846153846153844
lv
0.25583266291230894
hu
0.23868312757201646
az
0.21343537414965988
tr
0.18213969938107868
is
0.12982126058325494
vi
0.12570888468809074
fi
0.11988582302568983
be
0.07035175879396985
eu
0.07035175879396985
uk
0.06376518218623482
reliable
true
passes
true
2
name
"Maria"
dialogue
"¡Yo no sé nada! Solo estaba tomando fotos... pero vi... vi algo extraño. Alguien... alguien desapareció."
detectedLang
"es"
heavyLang
"es"
scores
es
0.8109796186719265
pt
0.6967299578059071
ca
0.6353836398224477
it
0.5064377682403434
tl
0.45652173913043476
en
0.42557442557442554
sv
0.3823845327604726
sk
0.35825892857142855
no
0.3290548424737456
lv
0.3154761904761905
tr
0.29012345679012347
pl
0.28214731585518105
nl
0.2730720606826802
de
0.2684478371501272
eu
0.26282051282051283
da
0.25902061855670105
yo
0.23841059602649006
hr
0.22611036339165547
et
0.222972972972973
fr
0.2144808743169399
lt
0.1991643454038997
ro
0.19692737430167598
cs
0.19127988748241914
is
0.17621776504297992
vi
0.14814814814814814
hu
0.14688427299703263
ms
0.11809815950920245
sl
0.1043613707165109
sq
0.0987460815047022
az
0.09305993690851734
reliable
true
passes
true
3
name
"Hunter"
dialogue
"Slow down, ma’am. I don’t understand. You’re gonna have to speak English."
detectedLang
"en"
heavyLang
"en"
scores
en
0.7821576763485477
da
0.592391304347826
no
0.5466321243523317
tl
0.47968285431119917
sv
0.4450317124735729
pl
0.39236111111111116
hr
0.38380281690140844
cs
0.37869822485207094
sk
0.3581907090464548
de
0.3354430379746835
ro
0.3101182654402102
yo
0.29906542056074764
it
0.284741144414169
lv
0.2605633802816902
et
0.2584745762711864
nl
0.2532005689900427
lt
0.24132947976878616
ca
0.2081447963800905
is
0.20694864048338368
sq
0.2033383915022762
sl
0.1873065015479876
fi
0.1796875
ms
0.12060301507537688
be
0.11764705882352942
tr
0.11764705882352942
hu
0.11317567567567569
az
0.10714285714285714
uk
0.10714285714285714
vi
0.10714285714285714
reliable
true
passes
true
4
name
"Maria"
dialogue
"¡No hablo inglés! ¡No entiendo lo que está pasando!"
detectedLang
"es"
heavyLang
"es"
scores
es
0.8235887096774193
pt
0.7545582047685835
ca
0.6605237633365665
it
0.6022727272727273
fr
0.5320855614973261
tl
0.4195688225538972
lv
0.3996569468267582
en
0.35779816513761464
sk
0.32432432432432434
tr
0.3217054263565891
et
0.3055555555555556
pl
0.29435483870967744
yo
0.2813141683778234
lt
0.25690021231422505
hu
0.2273730684326711
hr
0.22394678492239467
ms
0.21700223713646533
no
0.21700223713646533
eu
0.21171171171171171
fi
0.20634920634920634
vi
0.20634920634920634
cs
0.19908466819221968
nl
0.18032786885245902
ro
0.16864608076009502
sq
0.16864608076009502
reliable
true
passes
true
5
name
"Hunter"
dialogue
"Okay, okay. Let’s try this—point to where you were. Maybe we can figure it out."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8201438848920863
tl
0.6268656716417911
fr
0.41245593419506466
pl
0.39759036144578314
nl
0.39686369119420983
da
0.3946731234866829
sq
0.32523616734143057
yo
0.29873772791023845
cs
0.29478138222849076
lv
0.2937853107344633
no
0.2625368731563422
ca
0.23547400611620795
de
0.22720247295208654
ro
0.22720247295208654
sk
0.20886075949367086
sl
0.19484702093397743
hr
0.1883116883116883
lt
0.17218543046357618
az
0.1334488734835355
tr
0.1334488734835355
es
0.12126537785588754
it
0.12126537785588754
pt
0.12126537785588754
reliable
true
passes
true
6
name
"Maria"
dialogue
"Aquí... cerca del puesto de manzanas. Había un hombre con un abrigo oscuro..."
detectedLang
"es"
heavyLang
"es"
scores
es
0.7915839618896388
it
0.6865671641791045
ca
0.6483590087073007
pt
0.5700245700245701
ro
0.46862348178137647
fr
0.4414893617021277
tl
0.4385026737967915
lv
0.3597560975609756
da
0.2953020134228188
sv
0.2905405405405405
hr
0.2857142857142857
no
0.2857142857142857
yo
0.27586206896551724
sl
0.27083333333333337
lt
0.2698191933240611
nl
0.22566371681415928
ms
0.22451994091580502
vi
0.19969512195121952
tr
0.15730337078651685
hu
0.15594855305466235
sk
0.15594855305466235
cs
0.13223140495867766
eu
0.11764705882352942
de
0.11317567567567569
az
0.10714285714285714
en
0.10714285714285714
sq
0.10714285714285714
reliable
true
passes
true
7
name
"Hunter"
dialogue
"Hunter... yeah, I’m on it."
detectedLang
"en"
heavyLang
"en"
scores
en
0.7979214780600462
tl
0.7093023255813954
fr
0.5084269662921348
ca
0.47447447447447455
et
0.46808510638297873
yo
0.4631901840490798
fi
0.4615384615384615
sq
0.453125
de
0.3346007604562738
hr
0.3346007604562738
lv
0.32950191570881227
hi
0.32432432432432434
pl
0.32432432432432434
da
0.31906614785992216
no
0.308300395256917
cs
0.3
sk
0.3
sv
0.2857142857142857
it
0.2647058823529412
nl
0.2647058823529412
pt
0.2647058823529412
ms
0.25213675213675213
ro
0.25213675213675213
sl
0.25213675213675213
tr
0.25213675213675213
reliable
true
passes
true
8
name
"Maria"
dialogue
"Dios mío... ¿qué hago ahora?"
detectedLang
"es"
heavyLang
"es"
scores
es
0.7702909647779479
ca
0.3697478991596639
pt
0.34210526315789475
reliable
true
passes
true