NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-10-07-01M4ASJ4QWFSGZVR3FEMG1E4RN
Run Details
Model:
Mistral Medium 3.5
Test:
Language Writing
Scenario:
Character dialogue (Spanish) in a story
Duration:
5.0s
Cost:
$0.004614
Provider:
Mistral
Evaluation summary
Score
Evaluator
Details Link
100.00%
Parse dialogue
(details)
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Maria"> Maria is a 30-year old college student on a study abroad program. Born in Spain, she is fluent in Spanish and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Spanish, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Maria is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Spanish, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Maria and Hunter as a voice sheet: Maria: "..." Hunter: "..."
Model response
Messages
Meta
AI
Here’s the dialogue formatted as a voice sheet, capturing the tension and language barrier between Maria and Hunter: --- **Maria:** *(murmuring to herself, adjusting her camera)* "No puedo creer lo que vi... fue tan extraño..." *(I can't believe what I saw... it was so strange...)* **Hunter:** *(approaching, stern but polite)* "Ma'am, I’m Detective Hunter. I need to ask you a few questions about what happened near the old mill last night. Did you see anything unusual?" **Maria:** *(startled, clutching her camera tighter, speaking rapidly in Spanish)* "¡Sí, sí! Vi... vi algo. Una sombra, un hombre... pero no sé, no hablo inglés! ¡Ay, Dios mío!" *(Yes, yes! I saw... I saw something. A shadow, a man... but I don’t know, I don’t speak English! Oh my God!)* **Hunter:** *(frowning, rubbing his temple)* "Slow down, ma'am. I don’t understand. You’re gonna have to speak English—do you know any at all?" **Maria:** *(shaking her head, frustrated)* "No, no inglés. Solo español. ¿Usted... no habla español?" *(No, no English. Only Spanish. You... don’t speak Spanish?)* **Hunter:** *(sighing, pulling out a notepad)* "No, I don’t. Look, just... point to where you were. Maybe draw it." *(He slides the notepad and a pen toward her.)* **Maria:** *(hesitant, then sketching quickly)* "Aquí... aquí estaba yo. Y él... él estaba allí." *(Here... here I was. And he... he was there.)* *(She taps the paper urgently.)* **Hunter:** *(leaning in, studying the sketch)* "That’s near the river. You saw a man there? What was he doing?" **Maria:** *(throwing her hands up, exasperated)* "¡No sé! ¡Corría! ¡Y luego... desapareció!" *(I don’t know! He was running! And then... he disappeared!)* **Hunter:** *(phone rings; he checks the caller ID and curses under his breath)* "I’ve gotta take this. *(Into phone:)* Hunter here. Yeah, I’m on it." *(To Maria:)* "Don’t go anywhere. I’ll find someone who speaks Spanish." *(He walks away, already barking orders into the phone.)* **Maria:** *(whispering to herself, staring at the sketch)* "¿Qué está pasando en este pueblo?" *(What is happening in this town?)* ---
created_at
"2026-10-07T09:01:55.991Z"
10/7/2026, 9:01:55 AM
model
"mistralai/mistral-medium-3.5-20260430"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
322
moderation_latency
(null)
generation_time
4752
tokens_prompt
304
tokens_completion
553
native_tokens_prompt
281
native_tokens_completion
559
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
"default"
usage
0.004614
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1791363716-Cc6ZLg4WZZXlFdUf2SMp"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1791363716-qtSsietr8Ag2ITPUdycF"
upstream_id
"fe8b132582c14de5a4ee114e8a5f2e7f"
provider_responses
0
endpoint_id
"d21d316f-d540-4718-b36e-3beff85d0cf9"
id
"fe8b132582c14de5a4ee114e8a5f2e7f"
is_byok
false
latency
315
model_permaslug
"mistralai/mistral-medium-3.5-20260430"
provider_name
"Mistral"
status
200
total_cost
0.004614
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Mistral"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
100.00%
Parse dialogue
n/a
dialogue
0
name
"Maria"
dialogue
"No puedo creer lo que vi... fue tan extraño..."
detectedLang
"es"
heavyLang
"es"
scores
es
0.8112659698025553
ca
0.6400885935769657
pt
0.5917085427135679
en
0.5428973277074542
it
0.477491961414791
tl
0.4519392917369309
fr
0.41016333938294003
no
0.40693430656934304
yo
0.40693430656934304
sv
0.40476190476190477
vi
0.3701550387596899
sk
0.34077079107505076
da
0.30406852248394006
lv
0.2872807017543859
hr
0.23708920187793428
ms
0.22062350119904073
tr
0.21307506053268765
nl
0.20147420147420148
ro
0.20147420147420148
de
0.19154228855721395
pl
0.1875
cs
0.1751269035532995
reliable
true
passes
true
1
name
"Hunter"
dialogue
"Ma'am, I’m Detective Hunter. I need to ask you a few questions about what happened near the old mill last night. Did you see anything unusual?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8124278568680262
tl
0.6212121212121212
fr
0.4749596122778676
it
0.4196428571428571
ca
0.401840490797546
no
0.4003690036900369
da
0.39365671641791045
pt
0.3902439024390244
et
0.3875628140703518
ro
0.3564356435643564
sq
0.3547319655857048
yo
0.3495663775850567
cs
0.34695244474212994
nl
0.3280496209510682
es
0.3219749652294854
hr
0.3080198722498226
sv
0.29906542056074764
pl
0.27293064876957496
ms
0.2669172932330827
sl
0.25685975609756095
sk
0.25515660809778457
de
0.24301242236024848
lv
0.2073170731707317
lt
0.2034313725490196
hu
0.18614357262103506
tr
0.17442845046570704
is
0.12398921832884095
az
0.12003610108303249
vi
0.12003610108303249
be
0.06698564593301436
eu
0.06698564593301436
fi
0.06069364161849711
uk
0.06069364161849711
reliable
true
passes
true
2
name
"Maria"
dialogue
"¡Sí, sí! Vi... vi algo. Una sombra, un hombre... pero no sé, no hablo inglés! ¡Ay, Dios mío!"
detectedLang
"es"
heavyLang
"es"
scores
es
0.7819100091827365
ca
0.6489283074648927
it
0.634334103156274
tl
0.5548266166822867
pt
0.46327683615819204
lv
0.44509345794392524
fr
0.4263285024154589
yo
0.4171779141104295
tr
0.35374149659863946
ro
0.3384401114206128
no
0.31948424068767906
sk
0.28785607196401797
da
0.23014586709886548
sv
0.2263843648208469
is
0.205685618729097
en
0.17962003454231434
hu
0.1782006920415225
hr
0.1753472222222222
vi
0.1739130434782609
az
0.16520210896309317
sl
0.15780141843971632
et
0.1394927536231884
pl
0.13636363636363635
reliable
true
passes
true
3
name
"Hunter"
dialogue
"Slow down, ma'am. I don’t understand. You’re gonna have to speak English—do you know any at all?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.7980251346499102
da
0.5815251084934904
no
0.5628238341968912
tl
0.5466756212222968
cs
0.44029850746268656
sv
0.4220890410958904
pl
0.41659464131374246
hr
0.39839572192513373
sk
0.38636363636363635
de
0.3330039525691699
sq
0.3236472945891784
yo
0.3091095189355169
it
0.2939330543933054
ca
0.28646934460887946
et
0.28646934460887946
sl
0.26310043668122274
ro
0.25905598243688255
lv
0.21511627906976746
nl
0.20867526377491208
vi
0.2049469964664311
lt
0.1983372921615202
pt
0.18772563176895307
is
0.1687192118226601
fi
0.14556962025316456
ms
0.09638554216867469
be
0.09395973154362416
tr
0.09395973154362416
hu
0.09029649595687331
az
0.08536585365853659
uk
0.08536585365853659
reliable
true
passes
true
4
name
"Maria"
dialogue
"No, no inglés. Solo español. ¿Usted... no habla español?"
detectedLang
"es"
heavyLang
"es"
scores
es
0.8129251700680273
pt
0.5370370370370371
it
0.5258620689655172
ca
0.4791666666666667
eu
0.47817836812144215
en
0.4376278118609407
fr
0.39560439560439564
tl
0.39560439560439564
no
0.38752783964365256
lv
0.3226600985221675
hu
0.2724867724867725
hr
0.26861702127659576
da
0.25271739130434784
sk
0.2486338797814208
tr
0.24242424242424243
et
0.21875
pl
0.21428571428571427
reliable
true
passes
true
5
name
"Hunter"
dialogue
"No, I don’t. Look, just... point to where you were. Maybe draw it."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8253903040262941
tl
0.6707978311386522
pl
0.5017584994138335
lv
0.48609431680773885
da
0.48233861144945184
hr
0.4558258642765685
no
0.452319587628866
ca
0.45161290322580644
cs
0.42489851150202973
yo
0.41379310344827586
sq
0.4121715076071923
sk
0.4097222222222222
sv
0.3609022556390977
fr
0.32432432432432434
it
0.31451612903225806
lt
0.28209459459459457
et
0.2796610169491525
tr
0.27101200686106347
pt
0.24511545293072823
es
0.24377224199288253
sl
0.2216117216117216
ro
0.17475728155339806
de
0.1550695825049702
be
0.1414141414141414
hu
0.1361788617886179
az
0.1290983606557377
is
0.1290983606557377
uk
0.1290983606557377
vi
0.1290983606557377
reliable
true
passes
true
6
name
"Maria"
dialogue
"Aquí... aquí estaba yo. Y él... él estaba allí."
detectedLang
"es"
heavyLang
"es"
scores
es
0.8340707964601769
ca
0.6781115879828327
fr
0.4485294117647059
pt
0.3784530386740331
eu
0.3343195266272189
pl
0.3181818181818182
vi
0.303405572755418
yo
0.29467084639498436
en
0.2902208201892744
tl
0.25742574257425743
reliable
true
passes
true
7
name
"Hunter"
dialogue
"That’s near the river. You saw a man there? What was he doing?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8367198838896952
tl
0.604221635883905
de
0.5504495504495505
yo
0.5212765957446809
nl
0.5197438633938101
da
0.4730679156908665
ca
0.46492271105826394
sv
0.44581280788177335
no
0.4375
sq
0.42159383033419023
it
0.412532637075718
es
0.39271255060728744
fr
0.3715083798882682
ms
0.3487698986975398
pt
0.3283582089552239
cs
0.3181818181818182
lv
0.2834394904458599
lt
0.281150159744409
hu
0.25742574257425743
fi
0.2549668874172185
ro
0.23599320882852293
sk
0.22413793103448276
hr
0.199288256227758
pl
0.1891891891891892
sl
0.16666666666666666
tr
0.14611005692599618
is
0.14285714285714285
az
0.1346153846153846
eu
0.1346153846153846
vi
0.1346153846153846
et
0.12280701754385964
reliable
true
passes
true
8
name
"Maria"
dialogue
"¡No sé! ¡Corría! ¡Y luego... desapareció!"
detectedLang
"es"
heavyLang
"es"
scores
es
0.8248407643312101
ca
0.7227822580645161
pt
0.6419270833333334
en
0.494485294117647
it
0.47817836812144215
is
0.42105263157894735
fr
0.40476190476190477
pl
0.39560439560439564
sk
0.39159292035398224
tr
0.375
yo
0.3721461187214612
tl
0.3559718969555035
lv
0.3226600985221675
hr
0.26861702127659576
hu
0.2647058823529412
vi
0.26273458445040215
no
0.260752688172043
eu
0.2506811989100818
ms
0.21875
nl
0.207492795389049
reliable
true
passes
true
9
name
"Hunter"
dialogue
"Don’t go anywhere. I’ll find someone who speaks Spanish."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8104265402843602
tl
0.5689655172413793
da
0.29947460595446584
de
0.2907801418439716
sq
0.2831541218637993
et
0.25788497217068646
pl
0.2125984251968504
nl
0.16666666666666666
no
0.16666666666666666
ro
0.16666666666666666
sv
0.16666666666666666
es
0.16317991631799164
pt
0.16317991631799164
yo
0.16142557651991615
hu
0.15074309978768577
reliable
true
passes
true
10
name
"Maria"
dialogue
"¿Qué está pasando en este pueblo?"
detectedLang
"es"
heavyLang
"es"
scores
es
0.8378962536023055
pt
0.6926229508196721
ca
0.5389344262295082
ro
0.4897959183673469
tl
0.43467336683417085
eu
0.4289340101522843
sk
0.4201030927835051
nl
0.40476190476190477
da
0.3967828418230563
sv
0.3967828418230563
fr
0.3935309973045822
no
0.3818681318681319
is
0.3732590529247911
it
0.3679775280898876
lt
0.34971098265895956
tr
0.3283582089552239
lv
0.3119266055045872
ms
0.30124223602484473
cs
0.27884615384615385
hu
0.27652733118971057
fi
0.27184466019417475
sl
0.25
pl
0.2398648648648649
sq
0.2398648648648649
reliable
true
passes
true