NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-03-18-01KM07F5MAHKTW96GW5VNWC7EH
Run Details
Model:
Mistral Small 4
Test:
Language Writing
Scenario:
Character dialogue (French) in a story
Duration:
5.0s
Cost:
$0.000335
Provider:
Mistral
Evaluation summary
Score
Evaluator
Details Link
84.62%
Parse dialogue
(details)
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Marie"> Marie is a 30-year old college student on a study abroad program. Born in France, she is fluent in French and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of French, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Marie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in French, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Marie and Hunter as a voice sheet: Marie: "..." Hunter: "..."
Model response
Messages
Meta
AI
**Voice Sheet:** *(Scene: A quaint café in Alborn, MN. The soft hum of chatter and the clinking of coffee cups fill the air. Marie sits at a small table by the window, her camera resting in front of her as she absentmindedly flips through the photos. Hunter strides in, his sharp eyes scanning the room before landing on Marie. He approaches her table.)* --- **Hunter:** *(firm, no-nonsense)* Excuse me, miss. Are you Marie? **Marie:** *(looks up, startled, then nods slowly)* Oui...? **Hunter:** *(pulls out a chair, sits down without waiting for an invitation)* I'm Detective Hunter. I need to ask you about the disappearances in town. **Marie:** *(frowns, her fingers tightening around her camera)* Les disparitions...? **Hunter:** Yeah. The people who’ve gone missing. Did you see anything unusual in the last couple of days? Maybe someone acting strange? **Marie:** *(shakes her head, voice trembling slightly as she switches to rapid French)* Non, mais... c'était terrible... Ils ont juste disparu. Comme ça. Personne ne sait où ils sont allés. **Hunter:** *(blinks, completely lost)* Uh... what? Look, I don’t speak French. Can you try speaking in English? **Marie:** *(sighs, switching hesitantly to English, but heavily accented and broken)* I... I saw nothing. But it is scary. The town is never like this before. People are... disappearing. One by one. **Hunter:** *(leans in, serious)* Did you see anyone suspicious? A stranger maybe? **Marie:** *(shakes head, but her eyes dart nervously around the café)* Non... everyone here is... familiar. But some of them... *(she hesitates, then lowers her voice)* They look... worried. Like they are hiding something. **Hunter:** *(nods, jots down notes)* Alright. If you think of anything else— *(His phone rings. He pulls it out, checks the screen, and his expression darkens.)* **Hunter:** *(to Marie, abrupt)* I’ve got to take this. Stay safe, okay? **Marie:** *(nods, still troubled, fingers tracing the edge of her camera)* Oui... soyez prudent. *(Hunter answers the call as he strides toward the door, leaving Marie alone at the table, her gaze fixed on the window, where the quiet, small-town streets of Alborn seem suddenly ominous.)* --- Would you like any adjustments to the tone or pacing?
created_at
"2026-03-18T10:22:10.584Z"
3/18/2026, 10:22:10 AM
model
"mistralai/mistral-small-2603"
1/1/2603, 12:00:00 AM
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
663
moderation_latency
(null)
generation_time
4873
tokens_prompt
316
tokens_completion
605
native_tokens_prompt
281
native_tokens_completion
546
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
256
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.00033519
router
(null)
provider_responses
0
endpoint_id
"f5ed6283-4e17-457d-98cd-2ec0c318171d"
id
"acc3eabadb954fc6b94a76a30aeeee32"
is_byok
false
latency
663
model_permaslug
"mistralai/mistral-small-2603"
1/1/2603, 12:00:00 AM
provider_name
"Mistral"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.14.0; linux; x64))"
http_referer
(null)
api_type
"completions"
id
"gen-1773829330-TD8gEN1krhxmSNfM7uNL"
upstream_id
"acc3eabadb954fc6b94a76a30aeeee32"
total_cost
0.00033519
cache_discount
0.00003456
upstream_inference_cost
0
provider_name
"Mistral"
Evaluation details
Result
Evaluator
Details
Meta Data
84.62%
Parse dialogue
n/a
dialogue
0
name
"Hunter"
dialogue
"Excuse me, miss. Are you Marie?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.738562091503268
ro
0.6204933586337761
tl
0.5604395604395604
it
0.5485327313769752
fr
0.5412844036697247
no
0.5412844036697247
sq
0.51338199513382
es
0.45799457994579945
pt
0.4444444444444444
sl
0.4444444444444444
et
0.441340782122905
ms
0.42363112391930835
nl
0.42363112391930835
da
0.4152046783625731
sv
0.4152046783625731
cs
0.4065281899109792
fi
0.40119760479041916
hr
0.2727272727272727
ca
0.25925925925925924
lt
0.250936329588015
pl
0.250936329588015
de
0.23954372623574144
eu
0.23954372623574144
sk
0.23954372623574144
yo
0.23954372623574144
lv
0.2277992277992278
reliable
true
passes
true
1
name
"Marie"
dialogue
"Oui...?"
detectedLang
"fr"
heavyLang
"fr"
scores
fr
0.8076923076923077
reliable
false
passes
true
2
name
"Hunter"
dialogue
"I'm Detective Hunter. I need to ask you about the disappearances in town."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8194014447884416
tl
0.6058558558558559
fr
0.5554614733276884
it
0.527027027027027
ro
0.5084269662921348
ca
0.5014245014245015
no
0.4912790697674419
nl
0.4827586206896552
da
0.48122529644268774
sv
0.467005076142132
yo
0.44385593220338987
sl
0.4330453563714903
pt
0.4287268770402612
cs
0.42371020856201974
sq
0.4094488188976378
pl
0.396551724137931
hr
0.38016528925619836
de
0.37796208530805686
ms
0.37125748502994016
es
0.3371212121212121
lv
0.33035714285714285
sk
0.279835390946502
et
0.2778541953232462
lt
0.24132947976878616
az
0.21875
tr
0.19724770642201836
be
0.11764705882352942
hu
0.11317567567567569
is
0.10714285714285714
uk
0.10714285714285714
vi
0.10714285714285714
reliable
true
passes
true
3
name
"Marie"
dialogue
"Les disparitions...?"
detectedLang
"fr"
heavyLang
"fr"
scores
fr
0.8065015479876162
en
0.7795414462081128
ca
0.7577519379844961
es
0.6130030959752323
tl
0.5901639344262295
de
0.5614035087719298
pt
0.4444444444444444
it
0.43438914027149317
ro
0.43438914027149317
no
0.42660550458715596
da
0.375
sv
0.375
cs
0.3556701030927836
sk
0.3556701030927836
sq
0.3556701030927836
reliable
true
passes
true
4
name
"Hunter"
dialogue
"Yeah. The people who’ve gone missing. Did you see anything unusual in the last couple of days? Maybe someone acting strange?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8054001459498905
tl
0.5796111403047819
nl
0.5513180033651149
fr
0.4520547945205479
ms
0.41690962099125367
de
0.4087213599408721
no
0.40564635958395245
et
0.3730407523510972
sv
0.35117599351175993
da
0.34047815333882936
ro
0.3254637436762226
is
0.3237531699070161
pt
0.31565440547476475
it
0.31153184165232356
yo
0.2779783393501805
es
0.23882017126546146
sl
0.23224568138195778
sq
0.22854387656702024
az
0.20634920634920634
ca
0.17355371900826447
pl
0.1683991683991684
cs
0.1675338189386056
hr
0.16317991631799164
sk
0.0990990990990991
fi
0.0888382687927107
lv
0.08045977011494253
lt
0.07727797001153403
tr
0.06868451688009314
reliable
true
passes
true
5
name
"Marie"
dialogue
"Non, mais... c'était terrible... Ils ont juste disparu. Comme ça. Personne ne sait où ils sont allés."
detectedLang
"fr"
heavyLang
"fr"
scores
fr
0.8136467889908257
it
0.5210022107590273
en
0.48778565799842394
es
0.4820717131474103
ca
0.47791164658634533
pt
0.46546052631578944
et
0.3737957610789981
ro
0.3493493493493494
de
0.34738955823293177
sq
0.336734693877551
tl
0.3271221532091097
da
0.3236212278876171
hu
0.3236212278876171
sv
0.3236212278876171
nl
0.3157894736842105
no
0.31216931216931215
cs
0.24418604651162787
lt
0.21968787515006
lv
0.214975845410628
hr
0.20924574209245742
tr
0.19852034525277434
eu
0.19554455445544552
ms
0.19254658385093168
fi
0.18444165621079048
sk
0.16452442159383035
sl
0.16452442159383035
az
0.15803108808290156
pl
0.15364583333333331
is
0.08835904628330996
reliable
true
passes
true
6
name
"Hunter"
dialogue
"Uh... what? Look, I don’t speak French. Can you try speaking in English?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8154981549815498
tl
0.6437054631828979
sv
0.4630071599045346
nl
0.44306930693069313
it
0.4296577946768061
no
0.4102228047182176
ro
0.40318302387267907
de
0.39919893190921224
ms
0.34210526315789475
az
0.33234421364985167
ca
0.32330827067669177
da
0.31921331316187596
hr
0.31921331316187596
pl
0.3181818181818182
cs
0.2890995260663507
yo
0.27999999999999997
pt
0.267100977198697
sl
0.2549668874172185
lt
0.25
tr
0.24623115577889448
is
0.22945205479452058
sq
0.22945205479452058
es
0.17883211678832117
sk
0.13793103448275862
fr
0.1362763915547025
be
0.1346153846153846
hu
0.12959381044487428
et
0.12280701754385964
lv
0.12280701754385964
uk
0.12280701754385964
vi
0.12280701754385964
reliable
true
passes
true
7
name
"Marie"
dialogue
"I... I saw nothing. But it is scary. The town is never like this before. People are... disappearing. One by one."
detectedLang
"en"
heavyLang
"en"
scores
en
0.821869005206906
tl
0.5784695201037613
no
0.5034377387318564
da
0.48083067092651754
nl
0.46013289036544847
sv
0.4318181818181818
ms
0.40693430656934304
hu
0.37619961612284064
yo
0.375
pl
0.3374108053007136
ro
0.3271221532091097
fr
0.32642487046632124
sk
0.3150684931506849
sq
0.3143459915611814
it
0.30851063829787234
cs
0.26636568848758463
hr
0.25799086757990863
lv
0.2562929061784897
is
0.19254658385093168
ca
0.1751269035532995
lt
0.1751269035532995
de
0.11202185792349727
sl
0.10344827586206896
pt
0.09972299168975068
be
0.09722222222222222
tr
0.09722222222222222
az
0.08835904628330996
et
0.08835904628330996
uk
0.08835904628330996
vi
0.08835904628330996
reliable
true
passes
false
8
name
"Hunter"
dialogue
"Did you see anyone suspicious? A stranger maybe?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.7986191024165707
tl
0.5944380069524914
fr
0.5448634590377113
no
0.5091164095371669
da
0.5
de
0.49348769898697536
nl
0.4852941176470589
sv
0.4696969696969697
ro
0.4631901840490798
cs
0.45567651632970446
et
0.45482866043613707
hu
0.41077441077441074
pt
0.3944636678200692
sk
0.38380281690140844
ca
0.37275985663082434
it
0.37275985663082434
es
0.36823104693140796
hr
0.36479128856624315
ms
0.3613138686131387
pl
0.3433395872420263
sl
0.3371212121212121
lt
0.2985971943887776
is
0.2886178861788618
lv
0.2857142857142857
tr
0.279835390946502
sq
0.2723492723492723
az
0.2693110647181628
yo
0.2537313432835821
eu
0.16666666666666666
vi
0.16666666666666666
fi
0.15254237288135594
reliable
true
passes
true
9
name
"Marie"
dialogue
"Non... everyone here is... familiar. But some of them... They look... worried. Like they are hiding something."
detectedLang
"en"
heavyLang
"en"
scores
en
0.826137351492321
tl
0.4805194805194805
nl
0.43872778297474274
no
0.39086294416243655
fr
0.3630573248407643
es
0.35135135135135137
pt
0.34497816593886466
it
0.3340732519422864
is
0.2966002344665885
yo
0.2797118847539016
ca
0.2753623188405797
ro
0.2709599027946537
sq
0.23273657289002556
ms
0.23076923076923078
da
0.2125984251968504
eu
0.20844327176781002
hu
0.20424403183023873
de
0.2
lt
0.10979228486646886
sk
0.10714285714285714
sv
0.10581222056631893
reliable
true
passes
false
10
name
"Hunter"
dialogue
"Alright. If you think of anything else—"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8251748251748252
tl
0.5870870870870871
nl
0.4510978043912176
yo
0.40476190476190477
no
0.3792325056433409
de
0.36342592592592593
sq
0.26666666666666666
sv
0.26666666666666666
is
0.2445054945054945
cs
0.22096317280453256
ms
0.22096317280453256
da
0.21203438395415475
fr
0.21203438395415475
reliable
true
passes
true
11
name
"Hunter"
dialogue
"I’ve got to take this. Stay safe, okay?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8182552504038773
tl
0.6767241379310345
sl
0.4693396226415094
yo
0.3784530386740331
pl
0.375
sk
0.3697478991596639
cs
0.3679775280898876
lv
0.3515850144092219
hr
0.3401759530791789
no
0.3263473053892215
da
0.3161094224924012
lt
0.3161094224924012
reliable
true
passes
true
12
name
"Marie"
dialogue
"Oui... soyez prudent."
detectedLang
"fr"
heavyLang
"fr"
scores
fr
0.7002398081534772
ca
0.3961352657004831
en
0.3902439024390244
az
0.375
et
0.358974358974359
nl
0.358974358974359
pl
0.358974358974359
ro
0.358974358974359
sk
0.358974358974359
tl
0.358974358974359
cs
0.34895833333333337
no
0.34895833333333337
da
0.33510638297872336
de
0.33510638297872336
sv
0.33510638297872336
hu
0.3206521739130435
sq
0.3206521739130435
reliable
true
passes
true