NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-03-18-01KM08SX8Y059SCD3BSPHK04EZ
Run Details
Model:
Mistral Small 4
Test:
Language Writing
Scenario:
Character dialogue (German) in a story
Duration:
7.7s
Cost:
$0.000438
Provider:
Mistral
Evaluation summary
Score
Evaluator
Details Link
100.00%
Parse dialogue
(details)
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Melanie"> Melanie is a 30-year old college student on a study abroad program. Born in Germany, she is fluent in German and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of German, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Melanie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in German, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Melanie and Hunter as a voice sheet: Melanie: "..." Hunter: "..."
Model response
Messages
Meta
AI
**Voice Sheet: Melanie & Hunter** *[Scene: A quiet café in Alborn, MN. Melanie sits at a small wooden table, fiddling with her camera. The hum of conversations and the occasional clink of mugs fill the air. Hunter, dressed in casual but rugged clothing, approaches her table.]* --- **Hunter:** *(clears throat)* Excuse me, miss. Mind if I sit? **Melanie:** *(looks up, startled, then nods slightly)* Ja… ja, bitte. *[Hunter sits across from her, studying her face.]* **Hunter:** You’re the woman who’s been walking around with that big camera, right? The one who’s always taking pictures of the old mill? **Melanie:** *(nods slowly, gripping her camera tighter)* Ja. Das ist mein Hobby. Landscape photography. **Hunter:** *(smirks slightly)* You’re new around here, aren’t you? I don’t think I’ve seen you before. **Melanie:** *(hesitates, then swallows)* Ich bin hier für mein Studium. Austauschprogramm. **Hunter:** *(nods, then gets serious)* Listen, I need to ask you something. You know anything about… the disappearances? *[Melanie’s eyes widen. She looks down at her camera, then back at Hunter, her voice trembling as she speaks in German.]* **Melanie:** *(in broken, nervous German)* Das… das ist schrecklich. Ich habe Angst hier. Die Stadt… sie fühlt sich nicht sicher an. **Hunter:** *(blinks, confused)* Whoa—whoa, hold on. I don’t speak—(pauses, tries to gesture awkwardly) Uh… *Darf ich fragen…?* Wait, no—(frustrated) Do you speak English at all? **Melanie:** *(shakes head quickly, still in German)* Nur ein bisschen. Nicht gut. **Hunter:** *(sighs, runs a hand through his hair)* Alright, look—I don’t know what you just said, but you seem pretty shook up. You got a reason to be scared? **Melanie:** *(nods rapidly, switches back to English, heavily accented but clear enough)* Ja. Die Leute… sie sagen, es ist nicht sicher. Seit die Leute verschwinden. **Hunter:** *(leaning forward, serious)* What people? You know who’s missing? **Melanie:** *(shakes head, eyes darting around nervously)* Nein… aber ich habe… Bilder. Von der Mühle. Ich denke… (whispers) *etwas ist nicht richtig.* *[Hunter’s phone rings loudly. He pulls it out, checks the screen, then sighs.]* **Hunter:** Gotta take this. Keep your head down, alright? Stick to busy spots. (stands up, gives her a nod) And… try not to take pictures of the mill. Just… be careful. *[Melanie nods, clutching her camera. Hunter answers the call as he walks away, leaving her alone at the table, the weight of unspoken words hanging in the air.]* --- *[End Scene.]*
created_at
"2026-03-18T10:45:31.05Z"
3/18/2026, 10:45:31 AM
model
"mistralai/mistral-small-2603"
1/1/2603, 12:00:00 AM
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
361
moderation_latency
(null)
generation_time
7614
tokens_prompt
319
tokens_completion
698
native_tokens_prompt
285
native_tokens_completion
663
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
16
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.00043839
router
(null)
provider_responses
0
endpoint_id
"f5ed6283-4e17-457d-98cd-2ec0c318171d"
id
"82ef26bff6ae49ebac3dab8522db27df"
is_byok
false
latency
361
model_permaslug
"mistralai/mistral-small-2603"
1/1/2603, 12:00:00 AM
provider_name
"Mistral"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.14.0; linux; x64))"
http_referer
(null)
api_type
"completions"
id
"gen-1773830731-XMtJ1oaVHbAmllPDqaJl"
upstream_id
"82ef26bff6ae49ebac3dab8522db27df"
total_cost
0.00043839
cache_discount
0.00000216
upstream_inference_cost
0
provider_name
"Mistral"
Evaluation details
Result
Evaluator
Details
Meta Data
100.00%
Parse dialogue
n/a
dialogue
0
name
"Hunter"
dialogue
"Excuse me, miss. Mind if I sit?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.7198879551820728
no
0.6268656716417911
sq
0.5850622406639004
da
0.5735607675906184
et
0.5515695067264574
sv
0.54337899543379
it
0.4936708860759494
tl
0.4666666666666667
hu
0.43661971830985913
hr
0.41002949852507375
ca
0.40828402366863903
pl
0.38650306748466257
cs
0.3442622950819672
es
0.33774834437086093
fr
0.3127147766323024
ro
0.3103448275862069
pt
0.3055555555555556
sl
0.3055555555555556
yo
0.30313588850174217
ms
0.29577464788732394
nl
0.29577464788732394
fi
0.2727272727272727
sk
0.2647058823529412
be
0.25925925925925924
tr
0.25925925925925924
az
0.23954372623574144
is
0.23954372623574144
lt
0.23954372623574144
lv
0.23954372623574144
uk
0.23954372623574144
vi
0.23954372623574144
reliable
true
passes
true
1
name
"Melanie"
dialogue
"Ja… ja, bitte."
detectedLang
"de"
heavyLang
"de"
scores
de
0.8106060606060606
et
0.7807017543859649
da
0.673913043478261
fi
0.6710526315789473
lv
0.6052631578947368
ca
0.592391304347826
nl
0.5283018867924528
sk
0.5283018867924528
pl
0.5161290322580645
sl
0.5161290322580645
it
0.5
no
0.5
sq
0.5
sv
0.5
yo
0.5
reliable
true
passes
true
2
name
"Hunter"
dialogue
"You’re the woman who’s been walking around with that big camera, right? The one who’s always taking pictures of the old mill?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8169838945827232
tl
0.6819338422391859
nl
0.45652173913043476
no
0.3961352657004831
fr
0.39564867042707497
ro
0.34210526315789475
de
0.3368700265251989
pl
0.2944496707431797
sv
0.2877492877492877
yo
0.2816091954022989
ca
0.2661448140900196
ms
0.2331288343558282
da
0.2299794661190965
sq
0.22680412371134018
et
0.18389553862894453
fi
0.1758241758241758
is
0.1758241758241758
hr
0.17400881057268722
it
0.17400881057268722
es
0.1166077738515901
tr
0.10287081339712918
lv
0.09963985594237695
cs
0.08647990255785627
pt
0.08647990255785627
sk
0.08647990255785627
sl
0.08647990255785627
reliable
true
passes
true
3
name
"Melanie"
dialogue
"Ja. Das ist mein Hobby. Landscape photography."
detectedLang
"de"
heavyLang
"de"
scores
de
0.6973929236499069
en
0.6412803532008831
fr
0.481658692185008
da
0.365234375
hi
0.3602362204724409
sv
0.3551587301587301
pt
0.3380855397148676
et
0.32150313152400833
fi
0.3200836820083682
tl
0.3114406779661017
lv
0.26136363636363635
is
0.25968109339407747
ca
0.2511520737327189
no
0.2511520737327189
nl
0.2261904761904762
tr
0.2243436754176611
eu
0.20537897310513448
sk
0.20537897310513448
pl
0.19753086419753088
sl
0.19753086419753088
sq
0.1875
yo
0.1875
ms
0.17721518987341772
reliable
true
passes
true
4
name
"Hunter"
dialogue
"You’re new around here, aren’t you? I don’t think I’ve seen you before."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8289428669175505
tl
0.570446735395189
no
0.42263279445727486
sv
0.4110718492343934
sq
0.36948297604035313
da
0.36224489795918363
hr
0.35064935064935066
cs
0.32614555256064687
ro
0.3065187239944522
it
0.258160237388724
tr
0.2537313432835821
et
0.24471299093655588
nl
0.24127465857359634
yo
0.23076923076923078
hu
0.2223950233281493
ca
0.2163009404388715
lt
0.2125984251968504
sk
0.20760697305863707
pl
0.20127795527156547
be
0.12280701754385964
az
0.11190053285968028
is
0.11190053285968028
lv
0.11190053285968028
uk
0.11190053285968028
vi
0.11190053285968028
de
0.10554561717352416
fr
0.10554561717352416
ms
0.10554561717352416
sl
0.10554561717352416
reliable
true
passes
true
5
name
"Melanie"
dialogue
"Ich bin hier für mein Studium. Austauschprogramm."
detectedLang
"de"
heavyLang
"de"
scores
de
0.7817327065144392
nl
0.5357142857142857
pl
0.48657187993680884
sk
0.48412698412698413
sv
0.477491961414791
en
0.473257698541329
cs
0.45652173913043476
ms
0.4217081850533808
fr
0.3970315398886827
hr
0.3925233644859813
sq
0.3925233644859813
it
0.37977099236641226
lt
0.37977099236641226
lv
0.37977099236641226
ro
0.37977099236641226
no
0.37858508604206503
da
0.36274509803921573
tl
0.35770750988142297
tr
0.3380855397148676
es
0.28414096916299564
et
0.27293064876957496
sl
0.27293064876957496
fi
0.23529411764705882
pt
0.1875
ca
0.17721518987341772
yo
0.17721518987341772
hu
0.1709183673469388
is
0.1709183673469388
reliable
true
passes
true
6
name
"Hunter"
dialogue
"Listen, I need to ask you something. You know anything about… the disappearances?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.813167259786477
tl
0.5214220601640838
no
0.5009505703422054
da
0.4842829076620825
fr
0.4637385086823289
sv
0.42052980132450335
cs
0.4179600886917961
sq
0.41666666666666663
lv
0.396551724137931
yo
0.38668224299065423
hr
0.38596491228070173
pl
0.38452520515826494
nl
0.36746987951807225
pt
0.3651753325272068
ca
0.35503685503685506
sk
0.33375634517766495
it
0.3320610687022901
ms
0.32605905006418484
es
0.30463576158940403
et
0.2778541953232462
fi
0.2636746143057504
de
0.26160337552742613
sl
0.25531914893617025
lt
0.24132947976878616
ro
0.22566371681415928
hu
0.21875
tr
0.20694864048338368
is
0.20212765957446807
eu
0.1822429906542056
be
0.11764705882352942
az
0.10714285714285714
uk
0.10714285714285714
vi
0.10714285714285714
reliable
true
passes
true
7
name
"Melanie"
dialogue
"Das… das ist schrecklich. Ich habe Angst hier. Die Stadt… sie fühlt sich nicht sicher an."
detectedLang
"de"
heavyLang
"de"
scores
de
0.8490021008403361
nl
0.6001390820584145
fr
0.36393805309734517
pl
0.34210526315789475
da
0.29187192118226607
en
0.2684478371501272
yo
0.2404227212681638
ro
0.2271505376344086
pt
0.22402159244264505
sv
0.22402159244264505
tr
0.222972972972973
no
0.21981004070556312
ms
0.20138888888888887
it
0.19241573033707865
sk
0.17739628040057226
vi
0.1593567251461988
hi
0.15565345080763582
eu
0.1531664212076583
cs
0.14814814814814814
tl
0.11128284389489954
hr
0.10156250000000001
sl
0.10156250000000001
sq
0.10156250000000001
reliable
true
passes
true
8
name
"Hunter"
dialogue
"Whoa—whoa, hold on. I don’t speak— Uh… Darf ich fragen…? Wait, no— Do you speak English at all?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.7691292875989446
tl
0.6096654275092938
da
0.5653973509933775
no
0.5565878378378378
de
0.5450606585788562
pl
0.5084269662921348
hr
0.4976076555023924
sk
0.48478900883218845
sv
0.4360902255639098
cs
0.4268558951965066
ca
0.41471571906354515
sq
0.38089622641509435
et
0.36746987951807225
pt
0.358974358974359
it
0.3371212121212121
yo
0.3137254901960784
es
0.29624664879356566
lv
0.2698191933240611
fr
0.26264044943820225
vi
0.24892703862660948
ro
0.23580786026200873
tr
0.23133235724743775
fi
0.2222222222222222
sl
0.18604651162790697
nl
0.1847826086956522
hi
0.13793103448275862
ms
0.12060301507537688
be
0.11764705882352942
hu
0.11317567567567569
az
0.10714285714285714
is
0.10714285714285714
lt
0.10714285714285714
uk
0.10714285714285714
reliable
true
passes
true
9
name
"Melanie"
dialogue
"Nur ein bisschen. Nicht gut."
detectedLang
"de"
heavyLang
"de"
scores
de
0.8576512455516014
nl
0.5381062355658198
sv
0.4791666666666667
no
0.41348973607038125
cs
0.3333333333333333
ms
0.3333333333333333
is
0.3055555555555556
da
0.2805755395683453
reliable
true
passes
true
10
name
"Hunter"
dialogue
"Alright, look—I don’t know what you just said, but you seem pretty shook up. You got a reason to be scared?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8184864562971237
tl
0.5932415519399249
yo
0.4477485131690739
hr
0.41282746160794936
cs
0.40693430656934304
sk
0.40202391904323825
ca
0.3925233644859813
no
0.37977099236641226
it
0.37917860553963706
da
0.37439846005774785
ro
0.37137330754352027
pl
0.3602362204724409
lt
0.35707220573689413
lv
0.34673366834170855
et
0.34343434343434337
hu
0.34343434343434337
sv
0.3179433368310598
sl
0.31650893796004204
fr
0.30032292787944026
sq
0.29729729729729726
pt
0.2588369441277081
is
0.25799086757990863
es
0.236192714453584
fi
0.2316784869976359
nl
0.18546365914786966
tr
0.18444165621079048
de
0.17825537294563845
az
0.1698595146871009
vi
0.1698595146871009
be
0.09722222222222222
eu
0.09722222222222222
ms
0.08835904628330996
uk
0.08835904628330996
reliable
true
passes
true
11
name
"Melanie"
dialogue
"Ja. Die Leute… sie sagen, es ist nicht sicher. Seit die Leute verschwinden."
detectedLang
"de"
heavyLang
"de"
scores
de
0.8428222144603562
nl
0.609375
da
0.5140388768898488
sv
0.49888641425389757
ca
0.47976878612716767
es
0.4538834951456311
hu
0.3818681318681319
no
0.35988620199146515
lv
0.3430656934306569
et
0.3401759530791789
tr
0.32330827067669177
sq
0.32228915662650603
pl
0.29906542056074764
lt
0.27184466019417475
yo
0.265905383360522
fr
0.26108374384236455
fi
0.2537313432835821
en
0.24369747899159663
it
0.24242424242424243
hi
0.1906474820143885
cs
0.1818181818181818
sk
0.15730337078651685
sl
0.15094339622641512
tl
0.13793103448275862
is
0.12959381044487428
pt
0.12280701754385964
az
0.11591355599214145
ro
0.11591355599214145
reliable
true
passes
true
12
name
"Hunter"
dialogue
"What people? You know who’s missing?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.82421875
tl
0.6311475409836066
nl
0.55
is
0.40318302387267907
da
0.3818681318681319
ms
0.3283582089552239
sv
0.29906542056074764
no
0.2694805194805195
cs
0.25742574257425743
fi
0.25742574257425743
ca
0.24242424242424243
de
0.24242424242424243
fr
0.24242424242424243
az
0.22413793103448276
et
0.22413793103448276
it
0.22413793103448276
pt
0.22413793103448276
reliable
true
passes
true
13
name
"Melanie"
dialogue
"Nein… aber ich habe… Bilder. Von der Mühle. Ich denke… etwas ist nicht richtig."
detectedLang
"de"
heavyLang
"de"
scores
de
0.8384353741496599
nl
0.5658135283363803
no
0.5432692307692307
tr
0.4318181818181818
da
0.36666666666666664
sv
0.34392265193370164
az
0.3271954674220963
sk
0.291044776119403
en
0.24603174603174602
pl
0.19491525423728812
hi
0.18244406196213425
eu
0.1782006920415225
cs
0.1739130434782609
it
0.1607773851590106
tl
0.1607773851590106
is
0.1410488245931284
ru
0.13479052823315119
fr
0.13003663003663005
reliable
true
passes
true
14
name
"Hunter"
dialogue
"Gotta take this. Keep your head down, alright? Stick to busy spots. And… try not to take pictures of the mill. Just… be careful."
detectedLang
"en"
heavyLang
"en"
scores
en
0.7767169695103172
tl
0.6378621378621377
yo
0.46886446886446886
nl
0.4052502050861362
no
0.3798118049615056
fr
0.36681222707423583
ro
0.3192488262910798
de
0.31214421252371916
sv
0.31214421252371916
da
0.3114909781576448
et
0.28430404738400794
ca
0.25411522633744854
pl
0.2518059855521156
hu
0.23684210526315788
sk
0.23280423280423282
cs
0.23199152542372883
lt
0.22954303931987244
lv
0.2204301075268817
sl
0.21536796536796535
it
0.21451787648970747
ms
0.17707150964812712
hr
0.13793103448275862
fi
0.13381123058542413
is
0.10933660933660934
sq
0.09713574097135741
tr
0.09713574097135741
es
0.09488139825218476
reliable
true
passes
true