NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-10-07-01M4ATB485A0ZEZKEK1ZEECC6B
Run Details
Model:
Mistral Medium 3.5
Test:
Language Writing
Scenario:
Character dialogue (French) in a story
Duration:
3.0s
Cost:
$0.002851
Provider:
Mistral
Evaluation summary
Score
Evaluator
Details Link
100.00%
Parse dialogue
(details)
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Marie"> Marie is a 30-year old college student on a study abroad program. Born in France, she is fluent in French and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of French, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Marie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in French, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Marie and Hunter as a voice sheet: Marie: "..." Hunter: "..."
Model response
Messages
Meta
AI
Here’s the dialogue formatted as a voice sheet, capturing the language barrier and tension between Marie and Hunter: --- **Marie:** *(muttering to herself in French, adjusting her camera)* "Je n'arrive pas à croire que cela se soit produit ici..." **Hunter:** *(approaching, stern but polite)* "Ma'am, I’m Detective Hunter. Mind if I ask you a few questions about what happened at the festival last night?" **Marie:** *(startled, responding in rapid French)* "Quoi? Je... je ne comprends pas! Vous parlez français?" **Hunter:** *(frowning, shaking his head)* "No, I don’t. Listen, did you see anything unusual? A disturbance, maybe?" **Marie:** *(panicked, gesturing with her hands)* "Il y avait un homme bizarre près de la scène! Il a disparu dans l'ombre, et puis... et puis plus rien!" **Hunter:** *(rubbing his temples, frustrated)* "Slow down. You’re gonna have to speak English, or—" *(pauses, noticing her distress)* "Look, I’ll find someone who can translate. Just... stay here." **Marie:** *(nodding, still agitated)* "Oui, oui, d'accord... mais dépêchez-vous!" **Hunter:** *(phone rings; he checks it, sighs)* "I gotta take this. Don’t go anywhere." *(steps away, answering)* "Hunter here." --- This keeps the tension high while emphasizing the language barrier and Hunter’s no-nonsense demeanor.
created_at
"2026-10-07T09:15:34.541Z"
10/7/2026, 9:15:34 AM
model
"mistralai/mistral-medium-3.5-20260430"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
311
moderation_latency
(null)
generation_time
2924
tokens_prompt
303
tokens_completion
343
native_tokens_prompt
281
native_tokens_completion
324
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
"default"
usage
0.0028515
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1791364534-3O3oowfti83Zy7azb0Jx"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1791364534-0vO5i1Z5WdzQ1bOTBjUv"
upstream_id
"c921b2f0c49a426ab556f9e20b1f804a"
provider_responses
0
endpoint_id
"d21d316f-d540-4718-b36e-3beff85d0cf9"
id
"c921b2f0c49a426ab556f9e20b1f804a"
is_byok
false
latency
310
model_permaslug
"mistralai/mistral-medium-3.5-20260430"
provider_name
"Mistral"
status
200
total_cost
0.0028515
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Mistral"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
100.00%
Parse dialogue
n/a
dialogue
0
name
"Marie"
dialogue
"Je n'arrive pas à croire que cela se soit produit ici..."
detectedLang
"fr"
heavyLang
"fr"
scores
fr
0.8231132075471699
pt
0.5743473325766175
ca
0.5398773006134969
sq
0.5148771021992239
es
0.5098039215686274
yo
0.5098039215686274
hr
0.503968253968254
sl
0.5033112582781457
cs
0.49186991869918695
nl
0.43095599393019723
da
0.3961352657004831
it
0.39418416801292405
no
0.37913907284768217
sk
0.3644067796610169
ro
0.3444055944055944
en
0.30683918669131244
pl
0.3029739776951673
lt
0.2964352720450282
ms
0.2937853107344633
sv
0.28977272727272724
de
0.28842504743833014
fi
0.21383647798742136
lv
0.15730337078651685
eu
0.1515837104072398
tl
0.1515837104072398
reliable
true
passes
true
1
name
"Hunter"
dialogue
"Ma'am, I’m Detective Hunter. Mind if I ask you a few questions about what happened at the festival last night?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8116868294909838
tl
0.6688077077478924
fr
0.5625662778366914
it
0.5225694444444445
da
0.5192307692307693
no
0.5169789227166276
ca
0.5106761565836299
pt
0.4755244755244755
nl
0.4448183041722746
ro
0.4436952124072825
sv
0.43454420836189167
cs
0.41029306647605435
es
0.4081779053084649
sq
0.406901509705248
hr
0.3861607142857143
et
0.3336025848142165
sl
0.32817589576547235
yo
0.3193069306930693
de
0.3170529801324503
ms
0.31478405315614616
hu
0.314214463840399
sk
0.27947598253275113
pl
0.26273458445040215
lt
0.24726277372262775
az
0.23327137546468402
tr
0.19980601357904945
lv
0.19196865817825662
is
0.14330218068535827
vi
0.13883089770354906
fi
0.13249211356466878
be
0.0782122905027933
eu
0.0782122905027933
uk
0.07094594594594594
reliable
true
passes
true
2
name
"Marie"
dialogue
"Quoi? Je... je ne comprends pas! Vous parlez français?"
detectedLang
"fr"
heavyLang
"fr"
scores
fr
0.806432400238237
ca
0.6621621621621622
it
0.5811855670103093
nl
0.5784695201037613
sl
0.574607329842932
hr
0.5660881174899867
sq
0.5337159253945482
cs
0.5269286754002911
ro
0.5213549337260678
lt
0.5192307692307693
en
0.5170876671619613
pt
0.5134730538922155
es
0.5098039215686274
de
0.47833065810593905
sk
0.468954248366013
yo
0.42781690140845074
tl
0.4196428571428571
pl
0.4122965641952984
lv
0.40476190476190477
hu
0.4025735294117647
tr
0.3992606284658041
ms
0.3879472693032015
no
0.2919389978213508
az
0.2903930131004367
da
0.2793791574279379
sv
0.2793791574279379
fi
0.21307506053268765
eu
0.19753086419753088
et
0.16237113402061853
is
0.15364583333333331
reliable
true
passes
true
3
name
"Hunter"
dialogue
"No, I don’t. Listen, did you see anything unusual? A disturbance, maybe?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.7817955112219451
tl
0.5911214953271028
no
0.5481927710843374
pt
0.518348623853211
es
0.5161290322580645
hr
0.512987012987013
it
0.500475737392959
sq
0.4852941176470589
ca
0.48224852071005914
fr
0.4664634146341463
da
0.4593202883625128
cs
0.4587628865979381
sv
0.4519832985386221
de
0.44208289054197664
sk
0.43910256410256415
et
0.4330453563714903
ro
0.41731409544950054
pl
0.41536748329621387
lv
0.39999999999999997
hu
0.36594202898550726
tr
0.3651753325272068
yo
0.3354430379746835
fi
0.3234536082474227
nl
0.3181818181818182
ms
0.29340511440107675
sl
0.28765264586160105
is
0.2837653478854025
eu
0.26264044943820225
lt
0.2164179104477612
az
0.20212765957446807
vi
0.20212765957446807
be
0.11764705882352942
uk
0.10714285714285714
reliable
true
passes
true
4
name
"Marie"
dialogue
"Il y avait un homme bizarre près de la scène! Il a disparu dans l'ombre, et puis... et puis plus rien!"
detectedLang
"fr"
heavyLang
"fr"
scores
fr
0.8256624825662483
ca
0.6564046179219352
es
0.6153846153846154
it
0.5838881491344874
ro
0.5810991957104558
da
0.5
no
0.4399641577060932
sq
0.4379496402877698
yo
0.39671814671814676
en
0.3926141885325559
et
0.38484251968503935
pt
0.38362919132149903
tl
0.3407172995780591
tr
0.29298642533936653
sv
0.2889647326507395
hu
0.28815489749430523
vi
0.28734321550741165
az
0.284077892325315
lv
0.27494199535962877
nl
0.26297169811320753
pl
0.251497005988024
de
0.24516908212560387
cs
0.2433414043583535
sk
0.24150485436893204
fi
0.18407310704960833
eu
0.1830065359477124
ms
0.1677762982689747
hr
0.1519674355495251
sl
0.12587412587412586
lt
0.11598302687411598
is
0.10714285714285714
reliable
true
passes
true
5
name
"Hunter"
dialogue
"Look, I’ll find someone who can translate. Just... stay here."
detectedLang
"en"
heavyLang
"en"
scores
en
0.818934299017072
tl
0.40476190476190477
ca
0.3955094991364421
sq
0.32950191570881227
ro
0.3230174081237911
da
0.317738791423002
et
0.3150684931506849
sv
0.3150684931506849
pt
0.3110236220472441
es
0.3069306930693069
tr
0.2857142857142857
hr
0.2827868852459016
it
0.2827868852459016
no
0.2827868852459016
az
0.279835390946502
vi
0.2009132420091324
fr
0.18604651162790697
pl
0.16666666666666666
de
0.1606714628297362
eu
0.1606714628297362
lt
0.1606714628297362
lv
0.1606714628297362
nl
0.15254237288135594
sk
0.15254237288135594
cs
0.14425427872860636
ms
0.14425427872860636
sl
0.14425427872860636
reliable
true
passes
true
6
name
"Marie"
dialogue
"Oui, oui, d'accord... mais dépêchez-vous!"
detectedLang
"fr"
heavyLang
"fr"
scores
fr
0.7914735866543096
ca
0.5647969052224371
it
0.5263157894736842
es
0.43324937027707805
pt
0.4318181818181818
en
0.267100977198697
ro
0.267100977198697
tl
0.267100977198697
nl
0.24242424242424243
reliable
true
passes
true
7
name
"Hunter"
dialogue
"Hunter here."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8036649214659686
sq
0.6794871794871795
de
0.5398773006134969
da
0.5222929936305732
no
0.5098039215686274
fr
0.4897959183673469
sv
0.4827586206896552
tl
0.471830985915493
it
0.45652173913043476
nl
0.45652173913043476
pt
0.45652173913043476
ca
0.44029850746268656
ms
0.44029850746268656
ro
0.44029850746268656
sl
0.44029850746268656
tr
0.44029850746268656
reliable
true
passes
true