NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-09-25-01M3CKFGCWSC0C927ZH2PDV66K
Run Details
Model:
Mistral Medium 3.5 (Reasoning)
Test:
Language Writing
Scenario:
Character dialogue (Spanish) in a story
Duration:
4.9s
Cost:
$0.004907
Provider:
Mistral
Evaluation summary
Score
Evaluator
Details Link
100.00%
Parse dialogue
(details)
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Maria"> Maria is a 30-year old college student on a study abroad program. Born in Spain, she is fluent in Spanish and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Spanish, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Maria is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Spanish, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Maria and Hunter as a voice sheet: Maria: "..." Hunter: "..."
Model response
Messages
Meta
AI
**Voice Sheet: Café Encounter** --- **Maria:** *(murmuring to herself, examining her camera)* "No puedo creer que esto haya pasado aquí... en este pueblo tan tranquilo." *(I can’t believe this happened here… in such a quiet town.)* **Hunter:** *(approaching, clearing his throat)* "Excuse me, miss. I’m Detective Hunter. I’m looking into the recent disappearances. Did you see anything unusual around here lately?" **Maria:** *(startled, looking up, speaking rapidly in Spanish)* "¡Dios mío! Sí, sí vi algo… pero no sé cómo explicarlo. Fue… fue aterrador." *(Oh my God! Yes, I saw something… but I don’t know how to explain it. It was… it was terrifying.)* **Hunter:** *(frowning, shaking his head slightly)* "I’m sorry, I don’t understand. Do you speak English?" **Maria:** *(panicked, gesturing with her hands)* "No, no hablo inglés. Lo siento, lo siento mucho." *(No, I don’t speak English. I’m sorry, I’m so sorry.)* **Hunter:** *(sighing, rubbing his temple)* "Okay, okay. Maybe we can figure this out another way. *(pulls out his phone, opening a translation app)* Can you… point to what you saw? Or draw it?" **Maria:** *(nodding eagerly, relieved)* "Sí, sí, puedo intentar." *(Yes, yes, I can try.)* *(She grabs a napkin and starts sketching frantically, her hand shaking.)* **Hunter:** *(leaning in, studying the drawing as she works)* "Take your time. Whatever you saw, it might help." **Maria:** *(whispering, still drawing)* "Era de noche… y había una figura cerca del bosque. No era normal." *(It was night… and there was a figure near the woods. It wasn’t normal.)* **Hunter:** *(phone rings, he checks the caller ID and curses under his breath)* "I’ve got to take this. *(to Maria)* Stay here, okay? I’ll be right back." *(He steps away, answering the call.)* **Maria:** *(calling after him, anxious)* "¡Espere! ¿Volverá?" *(Wait! Will you come back?)* **Hunter:** *(over his shoulder, already distracted by the call)* "Yeah, I’ll be back. Just… don’t go anywhere." **Maria:** *(muttering to herself, clutching her camera)* "No entiende nada… ¿y si no regresa?" *(He doesn’t understand anything… what if he doesn’t come back?)* --- *(Hunter leaves the café, still on the phone, as Maria watches him go, her expression a mix of fear and frustration.)*
created_at
"2026-09-25T15:38:25.06Z"
9/25/2026, 3:38:25 PM
model
"mistralai/mistral-medium-3.5-20260430"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
428
moderation_latency
(null)
generation_time
4891
tokens_prompt
304
tokens_completion
603
native_tokens_prompt
281
native_tokens_completion
598
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
"default"
usage
0.0049065
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1790350705-W8uK2mYiBF1oQD9GR9dD"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1790350705-rgxy6qpl7qN68exqlgKa"
upstream_id
"09784e3ecebb4a5880b27bcef7d329e6"
provider_responses
0
endpoint_id
"d21d316f-d540-4718-b36e-3beff85d0cf9"
id
"09784e3ecebb4a5880b27bcef7d329e6"
is_byok
false
latency
427
model_permaslug
"mistralai/mistral-medium-3.5-20260430"
provider_name
"Mistral"
status
200
total_cost
0.0049065
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Mistral"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
100.00%
Parse dialogue
n/a
dialogue
0
name
"Maria"
dialogue
"No puedo creer que esto haya pasado aquí... en este pueblo tan tranquilo."
detectedLang
"es"
heavyLang
"es"
scores
es
0.8135719612229679
ca
0.656121045392022
pt
0.6118012422360247
tl
0.49748743718592964
fr
0.4742376445846478
en
0.43438914027149317
lv
0.375
no
0.37421777221526903
ro
0.37421777221526903
tr
0.3429697766097241
ms
0.3315508021390375
sk
0.32432432432432434
eu
0.3206521739130435
it
0.3045897079276773
nl
0.30167597765363136
pl
0.30167597765363136
da
0.29676511954992973
sv
0.29278642149929274
lt
0.2732558139534884
hr
0.24698795180722888
sq
0.2223950233281493
is
0.21135646687697163
sl
0.21135646687697163
vi
0.14965986394557826
hu
0.14675767918088736
yo
0.14675767918088736
fi
0.14383561643835618
de
0.11816578483245149
az
0.10554561717352416
cs
0.10554561717352416
et
0.10554561717352416
reliable
true
passes
true
1
name
"Hunter"
dialogue
"Excuse me, miss. I’m Detective Hunter. I’m looking into the recent disappearances. Did you see anything unusual around here lately?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.7995877233165369
tl
0.5882352941176471
fr
0.5244565217391305
nl
0.4760479041916168
pt
0.453125
sq
0.3977976600137646
ca
0.3767806267806268
es
0.36777456647398843
ms
0.35137138621200886
it
0.3508902077151336
sv
0.34161023325808876
ro
0.33962264150943394
no
0.32950191570881227
et
0.29718875502008035
da
0.2744610281923715
de
0.2726517040731505
cs
0.25213675213675213
sl
0.24045138888888892
sk
0.20670897552130554
fi
0.14883268482490272
pl
0.14215686274509806
hr
0.12935323383084577
yo
0.10896130346232179
hi
0.07991587802313353
lv
0.0779768177028451
is
0.07505285412262157
lt
0.06716417910447761
tr
0.06316916488222697
reliable
true
passes
true
2
name
"Maria"
dialogue
"¡Dios mío! Sí, sí vi algo… pero no sé cómo explicarlo. Fue… fue aterrador."
detectedLang
"es"
heavyLang
"es"
scores
es
0.7855701311806257
ca
0.5982986767485822
pt
0.5676500508646999
it
0.5159453302961275
tl
0.4487678339818417
sv
0.41054091539528437
en
0.4072524407252441
yo
0.3550834597875569
no
0.3441358024691358
ro
0.30668841761827076
fr
0.2975206611570248
eu
0.2582897033158813
da
0.2504409171075838
nl
0.2504409171075838
lv
0.23561151079136694
is
0.22445255474452555
hr
0.1920152091254753
vi
0.1904761904761905
sk
0.17635658914728683
tr
0.17153996101364524
pl
0.15
de
0.1431451612903226
sl
0.1431451612903226
reliable
true
passes
true
3
name
"Hunter"
dialogue
"I’m sorry, I don’t understand. Do you speak English?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8052580331061344
tl
0.6592844974446337
no
0.5670995670995671
da
0.5614035087719298
sv
0.51278928136419
cs
0.5
pl
0.464524765729585
hr
0.4528043775649795
sk
0.4227994227994228
de
0.39849624060150374
pt
0.3902439024390244
sq
0.38556067588325654
ro
0.3710691823899371
it
0.34959349593495936
nl
0.3079584775086505
vi
0.30313588850174217
yo
0.2920353982300885
ca
0.25650557620817843
is
0.25512104283054005
sl
0.23076923076923078
ms
0.15254237288135594
be
0.14893617021276595
tr
0.14893617021276595
hu
0.14346895074946467
az
0.13606911447084233
et
0.13606911447084233
lt
0.13606911447084233
lv
0.13606911447084233
uk
0.13606911447084233
reliable
true
passes
true
4
name
"Maria"
dialogue
"No, no hablo inglés. Lo siento, lo siento mucho."
detectedLang
"es"
heavyLang
"es"
scores
es
0.8256624825662483
pt
0.638728323699422
it
0.6268656716417911
ca
0.5487364620938628
sk
0.5404411764705882
lt
0.45652173913043476
tl
0.42660550458715596
tr
0.39903846153846156
yo
0.3540051679586563
lv
0.3438320209973753
en
0.2937853107344633
hu
0.2917847025495751
hr
0.2877492877492877
no
0.2795389048991354
cs
0.2732558139534884
vi
0.2668621700879765
fr
0.26035502958579887
et
0.23547400611620795
pl
0.23076923076923078
reliable
true
passes
true
5
name
"Hunter"
dialogue
"Okay, okay. Maybe we can figure this out another way. Can you… point to what you saw? Or draw it?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8203285420944558
tl
0.6670894102726695
fr
0.4496855345911949
da
0.4348762109795479
pl
0.38596491228070173
yo
0.2886178861788618
cs
0.284741144414169
lv
0.2837653478854025
no
0.2532005689900427
es
0.2435158501440922
sq
0.2369186046511628
ca
0.22680412371134018
ro
0.21875
sk
0.2009132420091324
nl
0.1984732824427481
sl
0.1873065015479876
hr
0.18096723868954756
lt
0.16534181240063595
ms
0.16
az
0.12790697674418602
tr
0.12790697674418602
de
0.11616161616161616
it
0.11616161616161616
pt
0.11616161616161616
reliable
true
passes
true
6
name
"Maria"
dialogue
"Sí, sí, puedo intentar."
detectedLang
"es"
heavyLang
"es"
scores
es
0.8091603053435115
ca
0.7131931166347993
pt
0.6527777777777778
ro
0.6259351620947631
ms
0.608355091383812
sl
0.6073298429319371
da
0.6021220159151194
no
0.5978552278820375
sv
0.5956873315363882
de
0.592391304347826
hr
0.5912806539509536
it
0.5426829268292682
en
0.526813880126183
pl
0.5222929936305732
fr
0.5161290322580645
lt
0.506578947368421
yo
0.49664429530201337
eu
0.4915254237288135
sq
0.4915254237288135
nl
0.4845360824742268
cs
0.4755244755244755
tl
0.4755244755244755
sk
0.471830985915493
lv
0.3644067796610169
is
0.3333333333333333
fi
0.32432432432432434
tr
0.32432432432432434
et
0.3181818181818182
hu
0.3181818181818182
az
0.3087557603686636
vi
0.29577464788732394
reliable
true
passes
true
7
name
"Hunter"
dialogue
"Take your time. Whatever you saw, it might help."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8271889400921658
tl
0.6567505720823799
da
0.44547134935304994
no
0.441340782122905
ms
0.3723849372384937
pt
0.34210526315789475
yo
0.3333333333333333
fr
0.3273542600896861
nl
0.22680412371134018
sv
0.22680412371134018
lv
0.2227979274611399
sq
0.2227979274611399
hr
0.21875
cs
0.20634920634920634
sl
0.20634920634920634
de
0.19786096256684493
reliable
true
passes
true
8
name
"Maria"
dialogue
"Era de noche… y había una figura cerca del bosque. No era normal."
detectedLang
"es"
heavyLang
"es"
scores
es
0.8037505451373747
ca
0.7183979974968712
it
0.6955345060893099
pt
0.6557000765110941
ro
0.64171974522293
fr
0.5786516853932584
en
0.503858875413451
de
0.5033112582781457
no
0.4938132733408324
tl
0.45848375451263534
da
0.43890274314214467
tr
0.42084942084942084
sq
0.3818681318681319
sv
0.3784530386740331
ms
0.3697478991596639
pl
0.34687953555878087
eu
0.3333333333333333
nl
0.3202416918429003
lv
0.3055555555555556
az
0.303405572755418
hr
0.26229508196721313
sl
0.25864909390444807
sk
0.25
vi
0.17883211678832117
hu
0.1773308957952468
yo
0.17279411764705882
fi
0.12280701754385964
lt
0.12280701754385964
cs
0.11591355599214145
et
0.11591355599214145
reliable
true
passes
true
9
name
"Hunter"
dialogue
"I’ve got to take this. Stay here, okay? I’ll be right back."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8272458045409673
tl
0.6880570409982175
yo
0.47839046199701935
lt
0.38162544169611307
sl
0.36247723132969034
no
0.3433395872420263
da
0.3371212121212121
pl
0.27835051546391754
sk
0.2738589211618257
cs
0.2723492723492723
lv
0.2584745762711864
hu
0.2505353319057816
hr
0.24892703862660948
sq
0.2222222222222222
de
0.17452830188679244
fr
0.17452830188679244
reliable
true
passes
true
10
name
"Maria"
dialogue
"¡Espere! ¿Volverá?"
detectedLang
"es"
heavyLang
"la"
scores
es
0.7803163444639719
pt
0.6575342465753424
it
0.576271186440678
cs
0.4813278008298755
is
0.47257383966244726
ca
0.46351931330472107
eu
0.4541484716157206
sv
0.4444444444444444
yo
0.4131455399061033
sk
0.410377358490566
en
0.3961352657004831
ro
0.3842364532019704
no
0.3654822335025381
tl
0.3654822335025381
reliable
true
passes
true
11
name
"Hunter"
dialogue
"Yeah, I’ll be back. Just… don’t go anywhere."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8011928429423459
tl
0.6376811594202898
yo
0.3839835728952772
hu
0.2805755395683453
lt
0.27184466019417475
pl
0.2647058823529412
et
0.2537313432835821
sv
0.2537313432835821
de
0.20634920634920634
sq
0.20634920634920634
ca
0.20424403183023873
reliable
true
passes
true
12
name
"Maria"
dialogue
"No entiende nada… ¿y si no regresa?"
detectedLang
"es"
heavyLang
"es"
scores
es
0.8160261651676206
pt
0.7318235995232419
fr
0.6631736526946107
ca
0.6549079754601227
it
0.632952691680261
no
0.5697896749521989
sq
0.5490981963927856
ro
0.49776785714285715
tl
0.49324324324324326
sk
0.4874715261958998
nl
0.4693396226415094
en
0.46428571428571425
sl
0.44717444717444715
hr
0.44581280788177335
pl
0.4444444444444444
et
0.44306930693069313
eu
0.43467336683417085
da
0.3679775280898876
lv
0.3679775280898876
yo
0.35344827586206895
cs
0.34593023255813954
de
0.3202416918429003
vi
0.303405572755418
sv
0.29245283018867924
fi
0.2879746835443038
tr
0.281150159744409
lt
0.24242424242424243
reliable
true
passes
true