NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-09-25-01M3CKEF50J1X9Z47BWQ544WDG
Run Details
Model:
Mistral Medium 3.5 (Reasoning)
Test:
Language Writing
Scenario:
Character dialogue (French) in a story
Duration:
5.9s
Cost:
$0.004854
Provider:
Mistral
Evaluation summary
Score
Evaluator
Details Link
100.00%
Parse dialogue
(details)
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Marie"> Marie is a 30-year old college student on a study abroad program. Born in France, she is fluent in French and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of French, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Marie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in French, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Marie and Hunter as a voice sheet: Marie: "..." Hunter: "..."
Model response
Messages
Meta
AI
**Voice Sheet: Café Encounter** --- **Marie:** *(muttering to herself, adjusting her camera)* "C'est étrange... je n'arrive pas à croire que cela se passe ici." *(She sighs, looking troubled as she flips through the photos on her camera.)* **Hunter:** *(approaches the table, badge visible)* "Ma'am, I’m Detective Hunter. I need to ask you a few questions about what happened at the festival last night. You were there, right?" **Marie:** *(startled, looks up, eyes wide)* "Oh! Euh... oui, j’étais là-bas, mais... c’était... effrayant." *(She gestures nervously, her French rapid and emotional.)* "Il y avait du sang près de la grange, et puis... cette personne a disparu. Personne ne semble savoir ce qui s’est passé!" **Hunter:** *(frowns, rubbing his temple)* "Uh... slow down. I didn’t catch any of that. You speak English, right?" **Marie:** *(shakes her head, frustrated)* "Non, non, je ne parle pas anglais. Désolée." *(She points at her camera, then to the door, miming someone running away.)* "J’ai vu quelque chose... mais je ne sais pas comment vous l’expliquer." **Hunter:** *(sighs, pulling out a notepad)* "Okay, okay. Let’s try this—point to where it happened on this map." *(He slides a town map across the table.)* **Marie:** *(nods eagerly, pointing to the edge of the festival grounds near the old barn)* "Là! Près de la vieille grange. Il y avait... des traces. Comme si quelqu’un avait été traîné." *(She shudders, wrapping her arms around herself.)* **Hunter:** *(jots down notes, muttering)* "Trailed? Dragged? Man, I wish I knew what she’s saying." *(He looks up, more gently.)* "Look, I’m gonna need you to come down to the station later. Maybe we can find someone who speaks... whatever language this is." **Marie:** *(nods, though still uneasy)* "D’accord, d’accord. Je viendrai. Mais... faites attention. Je pense que ce n’est pas fini." *(She glances around the café, as if expecting someone to be listening.)* **Hunter:** *(phone rings, he checks the caller ID and stands up)* "I gotta take this. Stay here, okay? Don’t leave town." *(He answers the phone as he walks away.)* "Hunter here. What’ve you got?" **Marie:** *(watches him leave, then whispers to herself)* "Mon Dieu, qu’est-ce que j’ai fait en venant ici..." --- **End Scene**
created_at
"2026-09-25T15:37:51.016Z"
9/25/2026, 3:37:51 PM
model
"mistralai/mistral-medium-3.5-20260430"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
411
moderation_latency
(null)
generation_time
5914
tokens_prompt
303
tokens_completion
597
native_tokens_prompt
281
native_tokens_completion
591
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
"default"
usage
0.004854
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1790350671-CIAOS4HIhKxcljQVPAKo"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1790350671-P3Ce4ueZunjZe0ZZOCQB"
upstream_id
"624cad19ae624ae0ab6b84334dcb6f79"
provider_responses
0
endpoint_id
"d21d316f-d540-4718-b36e-3beff85d0cf9"
id
"624cad19ae624ae0ab6b84334dcb6f79"
is_byok
false
latency
411
model_permaslug
"mistralai/mistral-medium-3.5-20260430"
provider_name
"Mistral"
status
200
total_cost
0.004854
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Mistral"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
100.00%
Parse dialogue
n/a
dialogue
0
name
"Marie"
dialogue
"C'est étrange... je n'arrive pas à croire que cela se passe ici."
detectedLang
"fr"
heavyLang
"fr"
scores
fr
0.8226950354609929
pt
0.5919243986254296
ca
0.5673952641165756
da
0.5005257623554153
nl
0.485373781148429
no
0.47687224669603523
yo
0.4508670520231214
it
0.43113772455089816
de
0.4193154034229829
sq
0.4025157232704403
sv
0.39567430025445294
es
0.39490445859872614
sl
0.391025641025641
hr
0.3902439024390244
cs
0.37335092348284965
en
0.36412315930388217
et
0.25196850393700787
ms
0.23878205128205127
sk
0.23387096774193547
ro
0.20168067226890754
fi
0.17677642980935876
lt
0.1607773851590106
pl
0.1607773851590106
tl
0.13479052823315119
is
0.12037037037037036
reliable
true
passes
true
1
name
"Hunter"
dialogue
"Ma'am, I’m Detective Hunter. I need to ask you a few questions about what happened at the festival last night. You were there, right?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8201089070400622
tl
0.6671464555595539
fr
0.5342396777442094
da
0.5182291666666667
no
0.5174752217005738
it
0.4939824945295405
ca
0.48208286674132134
pt
0.44710101613867304
cs
0.4325153374233129
nl
0.4167717528373266
ro
0.4156664560960202
sq
0.4104525175270874
hr
0.40705128205128205
es
0.3808567603748327
de
0.3775235531628533
sv
0.3660041124057573
sl
0.3616287094547964
yo
0.3616287094547964
et
0.33405327573794097
sk
0.32824981844589685
pl
0.3168389955686854
ms
0.29064417177914115
lt
0.28846153846153844
lv
0.25583266291230894
hu
0.23868312757201646
az
0.21343537414965988
tr
0.18213969938107868
is
0.12982126058325494
vi
0.12570888468809074
fi
0.11988582302568983
be
0.07035175879396985
eu
0.07035175879396985
uk
0.06376518218623482
reliable
true
passes
true
2
name
"Marie"
dialogue
"Il y avait du sang près de la grange, et puis... cette personne a disparu. Personne ne semble savoir ce qui s’est passé!"
detectedLang
"fr"
heavyLang
"fr"
scores
fr
0.8286248442044039
ca
0.6713147410358565
it
0.6357615894039735
no
0.5583511777301927
ro
0.5528455284552846
da
0.5462046204620462
es
0.5186697782963827
en
0.5033112582781457
de
0.4891640866873065
pt
0.4380108991825613
hu
0.427877947295423
sq
0.4250871080139373
nl
0.42105263157894735
sv
0.38843587842846555
tr
0.3782969103240392
vi
0.3544600938967136
tl
0.34731012658227844
lt
0.3373493975903614
cs
0.3270799347471452
ms
0.3136439267886855
yo
0.31077694235588976
hr
0.298469387755102
et
0.29426860564585117
pl
0.2912371134020619
sk
0.2775831873905429
az
0.2712014134275618
fi
0.2560865644724977
eu
0.25474254742547425
sl
0.25136116152450094
lv
0.23112767940354148
is
0.19747081712062256
reliable
true
passes
true
3
name
"Hunter"
dialogue
"Uh... slow down. I didn’t catch any of that. You speak English, right?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8175182481751825
tl
0.6540422432629278
no
0.4540229885057471
de
0.3902439024390244
sv
0.38788659793814434
da
0.375
yo
0.3658210947930574
ca
0.3632707774798928
hr
0.30758017492711365
it
0.2857142857142857
cs
0.27811550151975684
tr
0.26356589147286824
fr
0.2578125
ro
0.2543171114599686
is
0.24242424242424243
sq
0.22003284072249588
nl
0.2096505823627288
pl
0.2096505823627288
ms
0.1316270566727605
sk
0.1316270566727605
be
0.12844036697247707
hu
0.12361623616236161
az
0.1171003717472119
et
0.1171003717472119
lt
0.1171003717472119
lv
0.1171003717472119
uk
0.1171003717472119
vi
0.1171003717472119
reliable
true
passes
true
4
name
"Marie"
dialogue
"J’ai vu quelque chose... mais je ne sais pas comment vous l’expliquer."
detectedLang
"fr"
heavyLang
"fr"
scores
fr
0.8302965344765987
ca
0.5352250489236791
en
0.5
it
0.4957537154989384
nl
0.4533947065592635
hr
0.4221411192214112
sq
0.391025641025641
pt
0.38788659793814434
sl
0.38788659793814434
cs
0.3807040417209909
de
0.3290960451977401
yo
0.32239657631954355
sk
0.30453879941434847
lt
0.2983751846381093
tl
0.28892215568862273
ro
0.27921092564491656
pl
0.24960505529225907
hu
0.23387096774193547
lv
0.1782006920415225
tr
0.16520210896309317
fi
0.15630550621669628
ms
0.15026833631484796
da
0.12361623616236161
no
0.12361623616236161
az
0.1171003717472119
sv
0.1171003717472119
reliable
true
passes
true
5
name
"Hunter"
dialogue
"Okay, okay. Let’s try this—point to where it happened on this map."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8179335457441966
tl
0.6789727126805778
fr
0.43899018232819076
pl
0.43741209563994377
yo
0.4186046511627907
da
0.3911719939117199
lv
0.34210526315789475
sk
0.34102141680395387
cs
0.33993399339933994
hr
0.33774834437086093
nl
0.332220367278798
sq
0.2907801418439716
et
0.2779783393501805
fi
0.2727272727272727
sl
0.23224568138195778
no
0.21414538310412573
lt
0.20634920634920634
ca
0.19839679358717435
hi
0.17355371900826447
de
0.16317991631799164
reliable
true
passes
true
6
name
"Marie"
dialogue
"Là! Près de la vieille grange. Il y avait... des traces. Comme si quelqu’un avait été traîné."
detectedLang
"fr"
heavyLang
"fr"
scores
fr
0.8038666293079294
ca
0.6335078534031413
it
0.5937318630295996
es
0.5189003436426117
en
0.5155709342560554
no
0.48186528497409326
tl
0.46808510638297873
ro
0.4594594594594595
da
0.4313566206336312
yo
0.3986254295532647
de
0.3848857644991213
nl
0.36247723132969034
sq
0.36189608021877845
vi
0.32627526467757456
pt
0.32497589199614274
sv
0.279835390946502
tr
0.27083333333333337
sk
0.20634920634920634
az
0.20273348519362186
cs
0.20273348519362186
et
0.20182440136830104
pl
0.2
sl
0.19540229885057472
lt
0.15764139590854392
fi
0.15560916767189384
hu
0.12170639899623588
eu
0.09090909090909091
hr
0.08735332464146023
ms
0.08256880733944955
reliable
true
passes
true
7
name
"Hunter"
dialogue
"Look, I’m gonna need you to come down to the station later. Maybe we can find someone who speaks... whatever language this is."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8224278949634094
tl
0.5634920634920635
nl
0.5228455754771545
da
0.4731800766283525
no
0.43376801647220314
yo
0.4140625
et
0.39338235294117646
fr
0.37876506024096385
sv
0.3441971383147853
de
0.3436754176610978
pl
0.3136439267886855
it
0.3032094594594595
cs
0.2479489516864175
ro
0.24242424242424243
lt
0.22680412371134018
ms
0.21353670162059105
pt
0.2112810707456979
fi
0.19275929549902154
sk
0.18799212598425197
lv
0.1831683168316832
sl
0.1823587710604559
hr
0.17828685258964144
is
0.1758241758241758
hu
0.15730337078651685
sq
0.14948453608247422
az
0.14507772020725387
tr
0.14151925078043703
es
0.08637873754152825
eu
0.08637873754152825
ca
0.08536585365853659
zh
0.08536585365853659
hi
0.08435072142064373
reliable
true
passes
true
8
name
"Marie"
dialogue
"D’accord, d’accord. Je viendrai. Mais... faites attention. Je pense que ce n’est pas fini."
detectedLang
"fr"
heavyLang
"fr"
scores
fr
0.8046148120580573
ca
0.6552856204858832
it
0.5952197378565921
en
0.5661157024793388
es
0.5516652433817251
pt
0.5481927710843374
nl
0.5235934664246824
tl
0.45083682008368203
lt
0.4479495268138801
ro
0.4067796610169492
lv
0.3951612903225807
no
0.3951612903225807
sv
0.38953488372093026
de
0.38739789964994165
yo
0.38089622641509435
da
0.36746987951807225
sl
0.3137254901960784
hr
0.3119266055045872
ms
0.28765264586160105
et
0.2778541953232462
sq
0.26675977653631283
cs
0.21875
fi
0.2164179104477612
sk
0.2164179104477612
az
0.19601837672281774
pl
0.14772727272727273
zh
0.12790697674418602
reliable
true
passes
true
9
name
"Hunter"
dialogue
"Hunter here. What’ve you got?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8225377107364685
it
0.4490358126721763
sq
0.4428969359331476
tl
0.42028985507246375
de
0.3055555555555556
da
0.2907801418439716
cs
0.2805755395683453
no
0.2805755395683453
fr
0.2647058823529412
sv
0.25925925925925924
nl
0.23954372623574144
pt
0.23954372623574144
ca
0.2277992277992278
ms
0.2277992277992278
ro
0.2277992277992278
sl
0.2277992277992278
tr
0.2277992277992278
reliable
true
passes
true
10
name
"Marie"
dialogue
"Mon Dieu, qu’est-ce que j’ai fait en venant ici..."
detectedLang
"fr"
heavyLang
"fr"
scores
fr
0.8225152129817445
ca
0.5448634590377113
es
0.49275362318840576
da
0.39236111111111116
pt
0.32950191570881227
nl
0.30417495029821073
sv
0.29718875502008035
ro
0.28716904276985744
no
0.2842535787321063
is
0.2768595041322314
tr
0.2391304347826087
lt
0.19908466819221968
fi
0.1935483870967742
hi
0.1822429906542056
it
0.1822429906542056
en
0.18032786885245902
eu
0.1764705882352941
sl
0.1764705882352941
reliable
true
passes
true