NC Bench
Overview
About
Tests
Models
Vendors
Run: 2026-02-20-01KHXPVC39A94K1S5G9962GYAH
Run Details
Model:
Mistral Small 3.2 24B
Test:
Language Writing
Scenario:
Character dialogue (German) in a story
Duration:
10.2s
Cost:
$0.000357
Provider:
Mistral
Evaluation summary
Score
Evaluator
Details Link
100.00%
Parse dialogue
(details)
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Melanie"> Melanie is a 30-year old college student on a study abroad program. Born in Germany, she is fluent in German and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of German, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Melanie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in German, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Melanie and Hunter as a voice sheet: Melanie: "..." Hunter: "..."
Model response
Messages
Meta
AI
**Scene: A Cozy Café in Alborn, MN** *Melanie sits at a corner table, her camera in hand, scrolling through the photos she took earlier. The café is bustling with the usual afternoon crowd. Hunter, in his typical no-nonsense attire, enters and scans the room. His eyes land on Melanie, who stands out due to her foreign appearance and the camera she's engrossed in.* **Hunter:** (approaches Melanie's table) Excuse me, miss. Do you mind if I ask you a few questions? *Melanie looks up, startled. She doesn't understand a word Hunter says but senses the urgency in his tone.* **Melanie:** (in German) Entschuldigung, ich verstehe nicht. Ich spreche kein Englisch. **Hunter:** (confused) I'm sorry, I didn't catch that. Are you a student here? **Melanie:** (in German, troubled) Ja, ich bin Austauschstudentin. Ich bin gestern Abend spazieren gegangen und habe etwas Seltsames gesehen. **Hunter:** (frustrated, trying to understand) Look, I'm Detective Hunter. I'm investigating some recent disappearances in town. Did you see something unusual last night? **Melanie:** (in German, shaken) Ja, ich habe jemanden gesehen, der sich sehr seltsam verhielt. Sie schienen jemanden zu verfolgen. **Hunter:** (trying to piece together the conversation) Okay, so you saw someone acting strangely. Can you describe them? **Melanie:** (in German) Es war dunkel, aber ich glaube, es war ein Mann. Er trug eine dunkle Jacke und einen Hut. Er sah aus wie ein Schatten. **Hunter:** (frustrated) Miss, I wish I could understand you. Do you speak any English at all? **Melanie:** (in German, apologetic) Es tut mir leid. Ich spreche wirklich kein Englisch. Vielleicht kann jemand übersetzen? **Hunter:** (sighs) Maybe I can find someone who speaks German. In the meantime, can you show me what you saw? Do you have any photos? *Melanie nods and scrolls through her camera, showing Hunter the photos she took the previous night. Hunter leans in, trying to make sense of the images.* **Melanie:** (in German, pointing at the camera) Das ist der Mann, den ich gesehen habe. **Hunter:** (squinting at the camera) I can't be sure, but this might be a lead. I need to get this to someone who can translate and understand what you're saying. *Just then, Hunter's phone rings. He pulls it out and checks the caller ID.* **Hunter:** (to Melanie) I'm sorry, I have to take this. Please, don't leave town. I'll be back as soon as I can. *Melanie nods, still shaken but relieved that someone is taking her concerns seriously. Hunter answers the call and walks away, already engrossed in the conversation.* **Hunter:** (into the phone) This is Detective Hunter. What do you have for me? *Melanie watches Hunter leave, her mind racing with the events of the past night and the strange encounter at the café. She clutches her camera tightly, feeling a mix of fear and determination.* **Melanie:** (to herself, in German) Ich muss herausfinden, was hier vor sich geht. Vielleicht kann ich helfen. *She takes a deep breath and looks around the café, her eyes landing on a local newspaper. She picks it up, hoping to find some clues or information that might help her understand the situation better.* **Voice Sheet:** **Melanie:** - "Entschuldigung, ich verstehe nicht. Ich spreche kein Englisch." - "Ja, ich bin Austauschstudentin. Ich bin gestern Abend spazieren gegangen und habe etwas Seltsames gesehen." - "Ja, ich habe jemanden gesehen, der sich sehr seltsam verhielt. Sie schienen jemanden zu verfolgen." - "Es war dunkel, aber ich glaube, es war ein Mann. Er trug eine dunkle Jacke und einen Hut. Er sah aus wie ein Schatten." - "Es tut mir leid. Ich spreche wirklich kein Englisch. Vielleicht kann jemand übersetzen?" - "Das ist der Mann, den ich gesehen habe." - "Ich muss herausfinden, was hier vor sich geht. Vielleicht kann ich helfen." **Hunter:** - "Excuse me, miss. Do you mind if I ask you a few questions?" - "I'm sorry, I didn't catch that. Are you a student here?" - "Look, I'm Detective Hunter. I'm investigating some recent disappearances in town. Did you see something unusual last night?" - "Okay, so you saw someone acting strangely. Can you describe them?" - "Miss, I wish I could understand you. Do you speak any English at all?" - "Maybe I can find someone who speaks German. In the meantime, can you show me what you saw? Do you have any photos?" - "I'm sorry, I have to take this. Please, don't leave town. I'll be back as soon as I can." - "This is Detective Hunter. What do you have for me?"
created_at
"2026-02-20T14:21:52.115Z"
2/20/2026, 2:21:52 PM
model
"mistralai/mistral-small-3.2-24b-instruct-2506"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
237
moderation_latency
(null)
generation_time
9978
tokens_prompt
319
tokens_completion
1183
native_tokens_prompt
273
native_tokens_completion
1099
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.000357
router
(null)
provider_responses
0
endpoint_id
"23fd6b91-74d8-45fc-ac00-cf141ec7f4a5"
id
"81fa22f1eefe4dd79684b9e8c22ff943"
is_byok
false
latency
237
model_permaslug
"mistralai/mistral-small-3.2-24b-instruct-2506"
provider_name
"Mistral"
status
200
api_type
"completions"
id
"gen-1771597312-ztteeo8VoiXStYfoYoB5"
upstream_id
"81fa22f1eefe4dd79684b9e8c22ff943"
total_cost
0.000357
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Mistral"
Evaluation details
Result
Evaluator
Details
Meta Data
100.00%
Parse dialogue
n/a
dialogue
0
name
"Hunter"
dialogue
"Excuse me, miss. Do you mind if I ask you a few questions?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.7949699289229087
pt
0.5980707395498392
fr
0.5972073039742213
it
0.5941558441558442
sq
0.5567375886524822
cs
0.5443499392466585
tl
0.5341614906832298
ca
0.5259165613147914
pl
0.4993324432576769
hr
0.4973190348525469
sk
0.4710860366713681
hu
0.4533527696793003
es
0.45255474452554745
et
0.4517543859649123
no
0.44933920704845814
sv
0.44526627218934917
sl
0.4427934621099554
yo
0.43095599393019723
nl
0.4038155802861685
vi
0.39418416801292405
ro
0.37913907284768217
da
0.36006825938566556
ms
0.2816091954022989
tr
0.2816091954022989
lt
0.27884615384615385
fi
0.2690058479532163
is
0.2690058479532163
az
0.2618110236220473
lv
0.2618110236220473
be
0.15730337078651685
eu
0.15730337078651685
de
0.1515837104072398
uk
0.14383561643835618
reliable
true
passes
true
1
name
"Melanie"
dialogue
"Entschuldigung, ich verstehe nicht. Ich spreche kein Englisch."
detectedLang
"de"
heavyLang
"de"
scores
de
0.8171256454388985
nl
0.6398305084745763
ro
0.35703479576399394
no
0.3431221020092735
en
0.3410852713178295
sk
0.3122977346278317
ms
0.30213464696223313
lt
0.28209459459459457
hr
0.2595818815331011
da
0.24911660777385158
it
0.24911660777385158
is
0.24242424242424243
sv
0.23561151079136694
pl
0.21296296296296297
sl
0.20560747663551404
cs
0.1904761904761905
hu
0.1448692152917505
es
0.1290983606557377
fr
0.1290983606557377
pt
0.1290983606557377
az
0.121900826446281
ca
0.121900826446281
sq
0.121900826446281
reliable
true
passes
true
2
name
"Hunter"
dialogue
"I'm sorry, I didn't catch that. Are you a student here?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8148148148148148
tl
0.6264940239043824
ro
0.5795964125560539
it
0.563953488372093
cs
0.5492788461538461
sq
0.5426829268292682
sv
0.53125
pl
0.49528936742934054
ca
0.48700410396716826
no
0.48559670781893005
fr
0.4820441988950276
da
0.473314606741573
sk
0.4688385269121813
hr
0.4665718349928876
hu
0.4292237442922375
de
0.4230769230769231
pt
0.3902439024390244
lt
0.3644067796610169
nl
0.358974358974359
az
0.3567753001715266
yo
0.35456110154905335
lv
0.35121107266435986
et
0.34325744308231176
sl
0.28435114503816794
tr
0.2816091954022989
is
0.2690058479532163
vi
0.2618110236220473
es
0.26035502958579887
be
0.15730337078651685
eu
0.15730337078651685
fi
0.14383561643835618
ms
0.14383561643835618
uk
0.14383561643835618
reliable
true
passes
true
3
name
"Melanie"
dialogue
"Ja, ich bin Austauschstudentin. Ich bin gestern Abend spazieren gegangen und habe etwas Seltsames gesehen."
detectedLang
"de"
heavyLang
"de"
scores
de
0.788135593220339
nl
0.5169082125603864
ca
0.46808510638297873
no
0.43775100401606426
da
0.42857142857142855
sv
0.42244224422442245
fi
0.38217122683142096
et
0.3607305936073059
en
0.35720844811753905
ro
0.33899905571293676
it
0.3217054263565891
sk
0.317738791423002
sq
0.29221435793731043
fr
0.2907801418439716
es
0.28716904276985744
is
0.27007299270072993
pl
0.26624737945492666
lv
0.25611052072263546
pt
0.2456896551724138
yo
0.24160346695557963
eu
0.23995656894679696
tl
0.2391304347826087
tr
0.20364050056882824
ms
0.1774383078730905
cs
0.15254237288135594
hr
0.15254237288135594
lt
0.15254237288135594
az
0.10941475826972011
sl
0.10256410256410256
reliable
true
passes
true
4
name
"Hunter"
dialogue
"Look, I'm Detective Hunter. I'm investigating some recent disappearances in town. Did you see something unusual last night?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.801980198019802
tl
0.6240601503759399
fr
0.559228650137741
pt
0.5410212277682157
ro
0.5296884185773074
nl
0.5240928019036288
it
0.4861913937058446
ca
0.45799457994579945
es
0.4421199442119944
sv
0.43422913719943423
de
0.4281629735525375
ms
0.4034302759134974
et
0.375487900078064
sl
0.36958234830575254
da
0.36153232242617717
no
0.35170178282009723
cs
0.3469387755102041
hr
0.2945326278659612
sk
0.2647058823529412
sq
0.2523364485981308
az
0.20159680638722555
lt
0.1911021233569262
yo
0.1683991683991684
pl
0.16054564533053514
lv
0.15254237288135594
is
0.14712153518123666
fi
0.06868451688009314
tr
0.06868451688009314
reliable
true
passes
true
5
name
"Melanie"
dialogue
"Ja, ich habe jemanden gesehen, der sich sehr seltsam verhielt. Sie schienen jemanden zu verfolgen."
detectedLang
"de"
heavyLang
"de"
scores
de
0.8225901833234771
nl
0.560117302052786
da
0.5053586150041219
no
0.471830985915493
et
0.4291151284490961
sv
0.4152046783625731
fi
0.35135135135135137
eu
0.34497816593886466
pl
0.33847850055126794
ca
0.3142857142857143
tr
0.26199261992619927
sk
0.25742574257425743
es
0.22580645161290325
yo
0.21363040629095675
sq
0.2052980132450331
lv
0.16083916083916083
ro
0.14893617021276595
hu
0.14772727272727273
ms
0.12790697674418602
it
0.12663755458515283
fr
0.11764705882352942
sl
0.11764705882352942
en
0.10581222056631893
reliable
true
passes
true
6
name
"Hunter"
dialogue
"Okay, so you saw someone acting strangely. Can you describe them?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8021760633036598
tl
0.5675675675675675
es
0.5438996579247435
de
0.4791666666666667
nl
0.47643979057591623
ro
0.464524765729585
no
0.45799457994579945
pt
0.4520547945205479
fr
0.43977591036414565
ca
0.4065281899109792
ms
0.38837920489296635
sl
0.37402190923317685
sv
0.3610223642172524
it
0.358974358974359
sk
0.3265993265993266
cs
0.28698752228163993
hr
0.2805755395683453
da
0.2766726943942134
is
0.26199261992619927
az
0.2537313432835821
tr
0.2537313432835821
yo
0.23954372623574144
vi
0.19839679358717435
pl
0.16317991631799164
lv
0.14893617021276595
lt
0.14346895074946467
et
0.12854030501089325
sq
0.12854030501089325
reliable
true
passes
true
7
name
"Melanie"
dialogue
"Es war dunkel, aber ich glaube, es war ein Mann. Er trug eine dunkle Jacke und einen Hut. Er sah aus wie ein Schatten."
detectedLang
"de"
heavyLang
"de"
scores
de
0.8132720482619937
no
0.5689655172413793
nl
0.5310245310245311
da
0.40092165898617516
is
0.3387589013224822
en
0.3172268907563025
fi
0.2857142857142857
sv
0.22985781990521328
pl
0.22894424673784108
ca
0.18444165621079048
es
0.18444165621079048
sk
0.16020671834625322
lv
0.15584415584415584
eu
0.14361001317523056
hu
0.1356382978723404
ms
0.13333333333333333
tl
0.13333333333333333
lt
0.12280701754385964
it
0.11444141689373298
tr
0.09972299168975068
reliable
true
passes
true
8
name
"Hunter"
dialogue
"Miss, I wish I could understand you. Do you speak any English at all?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8229166666666666
no
0.6413502109704641
da
0.6178057553956835
tl
0.6136363636363636
sv
0.5370370370370371
cs
0.48484848484848486
pl
0.44948186528497414
de
0.442257217847769
hr
0.4378306878306878
sq
0.4318181818181818
sk
0.40807799442896936
ca
0.38936781609195403
ro
0.35703479576399394
it
0.3055555555555556
nl
0.2951907131011609
vi
0.2904841402337229
yo
0.2796610169491525
pt
0.2685025817555938
et
0.2621527777777778
is
0.24377224199288253
sl
0.22018348623853207
fr
0.2085661080074488
ms
0.1448692152917505
be
0.1414141414141414
tr
0.1414141414141414
hu
0.1361788617886179
az
0.1290983606557377
lt
0.1290983606557377
lv
0.1290983606557377
uk
0.1290983606557377
reliable
true
passes
true
9
name
"Melanie"
dialogue
"Es tut mir leid. Ich spreche wirklich kein Englisch. Vielleicht kann jemand übersetzen?"
detectedLang
"de"
heavyLang
"de"
scores
de
0.8206814106395696
nl
0.48186528497409326
da
0.3603411513859275
no
0.34782608695652173
en
0.3442622950819672
ca
0.33920704845814975
eu
0.3281075027995521
ro
0.29577464788732394
hr
0.29328621908127206
fi
0.28825622775800713
sk
0.24337957124842372
lt
0.23175416133162616
ms
0.21052631578947367
fr
0.19893190921228304
es
0.19678714859437751
is
0.19678714859437751
lv
0.16666666666666666
pl
0.16083916083916083
sl
0.15492957746478872
hu
0.1452991452991453
yo
0.12790697674418602
tr
0.10979228486646886
sv
0.10714285714285714
it
0.1031390134529148
reliable
true
passes
true
10
name
"Hunter"
dialogue
"Maybe I can find someone who speaks German. In the meantime, can you show me what you saw? Do you have any photos?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8167752442996742
tl
0.5616883116883117
sq
0.4851258581235698
nl
0.44897959183673475
it
0.43277310924369744
ca
0.42699490662139217
pt
0.4150779896013865
ro
0.4089316987740806
da
0.4073748902546093
fr
0.3946188340807175
ms
0.37615526802218113
sv
0.3679775280898876
sl
0.34908389585342336
yo
0.34782608695652173
pl
0.3433852140077821
no
0.3290258449304175
es
0.3283582089552239
cs
0.31886982845610495
et
0.3055555555555556
az
0.303405572755418
de
0.30268595041322316
tr
0.30124223602484473
hr
0.2773019271948608
sk
0.23208191126279862
vi
0.2049469964664311
lt
0.17481662591687042
lv
0.16563658838071693
hi
0.10239361702127658
fi
0.09999999999999999
be
0.09395973154362416
hu
0.09029649595687331
is
0.08536585365853659
uk
0.08536585365853659
reliable
true
passes
true
11
name
"Melanie"
dialogue
"Das ist der Mann, den ich gesehen habe."
detectedLang
"de"
heavyLang
"de"
scores
de
0.8541801685029164
no
0.6179966044142614
da
0.5802238805970149
eu
0.5150862068965517
nl
0.460431654676259
pt
0.42455242966751916
sv
0.3967828418230563
sk
0.3553008595988539
pl
0.3382352941176471
hi
0.3202416918429003
cs
0.29467084639498436
tr
0.29467084639498436
fi
0.281150159744409
is
0.25742574257425743
reliable
true
passes
true
12
name
"Hunter"
dialogue
"I can't be sure, but this might be a lead. I need to get this to someone who can translate and understand what you're saying."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8282573849324479
tl
0.6016994158258099
no
0.5262160454832596
da
0.500998003992016
yo
0.4549418604651163
pl
0.40664556962025317
cs
0.4052339413164156
hr
0.402390438247012
sk
0.39320388349514557
sv
0.3857493857493857
ro
0.38524590163934425
lt
0.36332767402376914
ca
0.36224489795918363
de
0.3483927019982624
tr
0.3403693931398417
it
0.33510638297872336
fr
0.3237150586113616
hu
0.3119266055045872
et
0.30167597765363136
lv
0.30037313432835816
is
0.2937853107344633
nl
0.293119698397738
pt
0.28435114503816794
es
0.2767598842815815
sq
0.2704280155642024
sl
0.2647058823529412
az
0.26398429833169773
vi
0.22760041194644695
eu
0.1544532130777903
ms
0.13990825688073394
be
0.08536585365853659
fi
0.07749077490774908
uk
0.07749077490774908
reliable
true
passes
true
13
name
"Hunter"
dialogue
"I'm sorry, I have to take this. Please, don't leave town. I'll be back as soon as I can."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8197734294541709
tl
0.5796637309847879
yo
0.44620253164556967
da
0.42622950819672134
lt
0.34701492537313433
hu
0.3371212121212121
pl
0.3320610687022901
hr
0.3269230769230769
no
0.32605905006418484
pt
0.31462140992167104
cs
0.3101182654402102
sq
0.2981283422459893
ca
0.2905405405405405
it
0.2905405405405405
sk
0.279835390946502
sl
0.27486187845303867
ro
0.26573426573426573
lv
0.2605633802816902
tr
0.21875
az
0.21052631578947367
sv
0.2081447963800905
ja
0.16
ms
0.1518578352180937
be
0.11764705882352942
et
0.10714285714285714
is
0.10714285714285714
uk
0.10714285714285714
vi
0.10714285714285714
reliable
true
passes
true
14
name
"Hunter"
dialogue
"This is Detective Hunter. What do you have for me?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8330765279917822
tl
0.6368715083798884
pt
0.634009009009009
da
0.5922208281053952
sq
0.5619946091644205
no
0.5560109289617486
nl
0.544179523141655
fr
0.5227606461086637
sl
0.5068285280728376
it
0.49297971918876754
ro
0.48899371069182396
cs
0.46546052631578944
es
0.4628099173553719
ca
0.4237588652482269
yo
0.37858508604206503
hr
0.365234375
de
0.3460764587525151
hu
0.32150313152400833
ms
0.3055555555555556
pl
0.3055555555555556
sv
0.29653679653679654
sk
0.28884026258205686
vi
0.2545871559633027
et
0.2261904761904762
is
0.22062350119904073
fi
0.1875
tr
0.15364583333333331
reliable
true
passes
true
15
name
"Melanie"
dialogue
"Ich muss herausfinden, was hier vor sich geht. Vielleicht kann ich helfen."
detectedLang
"de"
heavyLang
"de"
scores
de
0.8385871629320167
nl
0.5936902485659656
fi
0.36377245508982037
no
0.28451178451178455
is
0.2685025817555938
en
0.2608695652173913
az
0.24242424242424243
ro
0.2328519855595668
sk
0.22586520947176683
da
0.22445255474452555
tr
0.2216117216117216
pl
0.21296296296296297
hu
0.19659735349716445
sv
0.1935483870967742
fr
0.17153996101364524
yo
0.169921875
es
0.15841584158415842
sq
0.15841584158415842
reliable
true
passes
true