NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-10-07-01M4AVMV71XM8HXCSHBJRDQV4P
Run Details
Model:
Mistral Medium 3.5
Test:
Language Writing
Scenario:
Character dialogue (Italian) in a story
Duration:
5.2s
Cost:
$0.005121
Provider:
Mistral
Evaluation summary
Score
Evaluator
Details Link
100.00%
Parse dialogue
(details)
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Isabella"> Isabella is a 30-year old college student on a study abroad program. Born in Italy, she is fluent in Italian and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Italian, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Isabella is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Italian, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Isabella and Hunter as a voice sheet: Isabella: "..." Hunter: "..."
Model response
Messages
Meta
AI
**Voice Sheet:** --- **Isabella:** *(softly, in Italian, to herself as she reviews photos)* "Questa luce... è perfetta." *(This light... it's perfect.)* *(Hunter approaches, pulling out a notepad. He clears his throat.)* **Hunter:** "Ma'am, I’m Detective Hunter. Mind if I ask you a few questions about what happened at the festival last night?" **Isabella:** *(startled, looks up, responds in rapid Italian)* "Io... io non ho visto nulla! Non so nulla!" *(I... I didn’t see anything! I don’t know anything!)* *(Her hands tremble slightly as she clutches her camera.)* **Hunter:** *(frowning, leaning in slightly)* "Ma’am, I’m gonna need you to slow down. You’re gonna have to speak English for me." **Isabella:** *(more agitated, still in Italian)* "Non parlo inglese! Non capisco!" *(I don’t speak English! I don’t understand!)* *(She gestures helplessly with her hands, her voice rising.)* **Hunter:** *(sighs, rubbing his temple)* "Alright, alright. Let me try this again." *(He pulls out his phone, opens a translation app, and types slowly.)* "Did. You. See. Anything. Unusual. Last. Night." *(He shows her the translated Italian on the screen: "Hai visto qualcosa di strano ieri sera?")* **Isabella:** *(reads the screen, then looks back at Hunter, her expression conflicted. She hesitates, then speaks slowly in Italian, as if choosing her words carefully.)* "C’era... un uomo. Vicino al bosco. Portava qualcosa di pesante." *(There was... a man. Near the woods. He was carrying something heavy.)* *(She shivers, wrapping her arms around herself.)* **Hunter:** *(types frantically into the app, then reads the translation aloud as it appears)* "A man... near the woods... carrying something heavy." *(He looks up sharply.)* "What time was this?" **Isabella:** *(glances at her camera, then back at Hunter. She points to the screen of her camera, showing a timestamped photo of the festival grounds at dusk.)* "Verso le sette. Forse un po’ prima." *(Around seven. Maybe a little before.)* **Hunter:** *(nods, scribbling notes. His phone rings—he checks the caller ID and curses under his breath.)* "I’ve gotta take this. *(To Isabella, gesturing to his phone)* Stay here. We’re not done." *(He steps away, answering the call.)* "Hunter here. Yeah, I’m on it." *(Isabella watches him, her expression a mix of relief and lingering fear. She hugs her camera closer, as if it’s a shield.)* --- **End Scene.**
created_at
"2026-10-07T09:38:21.544Z"
10/7/2026, 9:38:21 AM
model
"mistralai/mistral-medium-3.5-20260430"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
346
moderation_latency
(null)
generation_time
5161
tokens_prompt
308
tokens_completion
627
native_tokens_prompt
289
native_tokens_completion
625
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
"default"
usage
0.005121
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1791365901-I1CTRjDtq5bxueuLArOc"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1791365901-CGPxqyOopLiDXarUdQcR"
upstream_id
"e527bf887222468bbf5f37e6632ff339"
provider_responses
0
endpoint_id
"d21d316f-d540-4718-b36e-3beff85d0cf9"
id
"e527bf887222468bbf5f37e6632ff339"
is_byok
false
latency
346
model_permaslug
"mistralai/mistral-medium-3.5-20260430"
provider_name
"Mistral"
status
200
total_cost
0.005121
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Mistral"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
100.00%
Parse dialogue
n/a
dialogue
0
name
"Isabella"
dialogue
"Questa luce... è perfetta."
detectedLang
"it"
heavyLang
"it"
scores
it
0.8221544715447155
pt
0.5949074074074074
ca
0.5901639344262295
sv
0.580335731414868
fi
0.5466321243523317
is
0.5442708333333333
en
0.5098039215686274
fr
0.49567723342939485
es
0.4648318042813456
ro
0.4648318042813456
yo
0.44089456869009586
tl
0.41471571906354515
hr
0.308300395256917
sk
0.3
sl
0.3
lv
0.2886178861788618
da
0.2857142857142857
de
0.2857142857142857
sq
0.2857142857142857
nl
0.2647058823529412
tr
0.2647058823529412
ms
0.2584745762711864
no
0.2584745762711864
reliable
true
passes
true
1
name
"Hunter"
dialogue
"Ma'am, I’m Detective Hunter. Mind if I ask you a few questions about what happened at the festival last night?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8116868294909838
tl
0.6688077077478924
fr
0.5625662778366914
it
0.5225694444444445
da
0.5192307692307693
no
0.5169789227166276
ca
0.5106761565836299
pt
0.4755244755244755
nl
0.4448183041722746
ro
0.4436952124072825
sv
0.43454420836189167
cs
0.41029306647605435
es
0.4081779053084649
sq
0.406901509705248
hr
0.3861607142857143
et
0.3336025848142165
sl
0.32817589576547235
yo
0.3193069306930693
de
0.3170529801324503
ms
0.31478405315614616
hu
0.314214463840399
sk
0.27947598253275113
pl
0.26273458445040215
lt
0.24726277372262775
az
0.23327137546468402
tr
0.19980601357904945
lv
0.19196865817825662
is
0.14330218068535827
vi
0.13883089770354906
fi
0.13249211356466878
be
0.0782122905027933
eu
0.0782122905027933
uk
0.07094594594594594
reliable
true
passes
true
2
name
"Isabella"
dialogue
"Io... io non ho visto nulla! Non so nulla!"
detectedLang
"it"
heavyLang
"it"
scores
it
0.803729146221786
sk
0.591002044989775
no
0.5841995841995842
sl
0.5444191343963554
en
0.5073891625615764
ca
0.5024875621890548
fi
0.5012468827930174
pt
0.46808510638297873
es
0.4594594594594595
tl
0.4444444444444444
yo
0.38650306748466257
de
0.37888198757763975
cs
0.3464052287581699
fr
0.3442622950819672
vi
0.3311036789297659
lt
0.3055555555555556
eu
0.30313588850174217
et
0.29577464788732394
az
0.2727272727272727
sq
0.2727272727272727
sv
0.2727272727272727
da
0.2647058823529412
is
0.2647058823529412
lv
0.2647058823529412
reliable
true
passes
true
3
name
"Hunter"
dialogue
"Ma’am, I’m gonna need you to slow down. You’re gonna have to speak English for me."
detectedLang
"en"
heavyLang
"en"
scores
en
0.7904191616766467
tl
0.5174632352941176
da
0.47864945382323737
no
0.45595854922279794
et
0.40273037542662116
cs
0.284741144414169
sl
0.284741144414169
fi
0.26573426573426573
hr
0.2636746143057504
it
0.24892703862660948
pt
0.24892703862660948
ms
0.2290748898678414
sq
0.21991084695393756
yo
0.20694864048338368
pl
0.20454545454545453
sk
0.2009132420091324
lv
0.18856259659969088
lt
0.16534181240063595
es
0.16267942583732056
fr
0.14772727272727273
nl
0.13793103448275862
de
0.12060301507537688
ro
0.12060301507537688
sv
0.12060301507537688
reliable
true
passes
true
4
name
"Isabella"
dialogue
"Non parlo inglese! Non capisco!"
detectedLang
"it"
heavyLang
"it"
scores
it
0.8015873015873016
es
0.7126436781609196
pt
0.6464646464646464
fr
0.6049661399548533
en
0.576271186440678
yo
0.5283018867924528
ca
0.4807121661721069
ro
0.4807121661721069
tl
0.4582043343653251
et
0.4444444444444444
eu
0.3320610687022901
az
0.2857142857142857
sk
0.2857142857142857
hu
0.2768595041322314
pl
0.2768595041322314
cs
0.2647058823529412
de
0.2647058823529412
hr
0.2647058823529412
lt
0.2647058823529412
ms
0.2647058823529412
nl
0.2647058823529412
sl
0.2647058823529412
da
0.25213675213675213
lv
0.25213675213675213
no
0.25213675213675213
sq
0.25213675213675213
sv
0.25213675213675213
tr
0.25213675213675213
reliable
true
passes
true
5
name
"Hunter"
dialogue
"Did. You. See. Anything. Unusual. Last. Night."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8094248094248094
tl
0.6258503401360545
et
0.5614035087719298
ms
0.36046511627906974
sq
0.26666666666666666
cs
0.22096317280453256
es
0.21875
nl
0.21875
pt
0.21875
da
0.21203438395415475
de
0.21203438395415475
fr
0.21203438395415475
no
0.21203438395415475
yo
0.21203438395415475
reliable
true
passes
true
6
name
"Isabella"
dialogue
"C’era... un uomo. Vicino al bosco. Portava qualcosa di pesante."
detectedLang
"it"
heavyLang
"it"
scores
it
0.8229166666666666
es
0.6111619396157365
ca
0.61044912923923
fr
0.5641025641025641
pt
0.5380434782608695
ro
0.5052386495925495
ms
0.5011737089201878
yo
0.41460055096418735
lv
0.41379310344827586
nl
0.38226744186046513
de
0.34815950920245403
tl
0.3264659270998415
sq
0.2747440273037543
en
0.27101200686106347
hr
0.27101200686106347
da
0.25438596491228066
et
0.2517605633802817
sl
0.2504409171075838
sk
0.23835125448028674
no
0.23423423423423423
cs
0.2328519855595668
fi
0.1904761904761905
vi
0.18582375478927202
eu
0.18426103646833014
pl
0.1361788617886179
hu
0.1290983606557377
az
0.121900826446281
lt
0.121900826446281
sv
0.121900826446281
tr
0.121900826446281
reliable
true
passes
true
7
name
"Hunter"
dialogue
"What time was this?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8561151079136691
tl
0.6563573883161512
nl
0.5726495726495726
de
0.54337899543379
yo
0.46524064171123
hr
0.45652173913043476
pt
0.45652173913043476
da
0.42857142857142855
no
0.42857142857142855
reliable
true
passes
true
8
name
"Isabella"
dialogue
"Verso le sette. Forse un po’ prima."
detectedLang
"it"
heavyLang
"it"
scores
it
0.8111263736263735
ro
0.6545226130653266
fr
0.650571791613723
es
0.6465295629820053
no
0.5955882352941176
sl
0.548440065681445
de
0.5401337792642141
nl
0.5385906040268457
yo
0.535472972972973
ca
0.5233968804159446
da
0.5175438596491229
hr
0.5175438596491229
en
0.5166959578207382
hu
0.5124113475177305
is
0.4821092278719397
lt
0.4821092278719397
tl
0.46911196911196906
pt
0.45
sq
0.4444444444444444
sk
0.4008714596949891
cs
0.39956331877729256
lv
0.3778280542986425
sv
0.358974358974359
tr
0.33894230769230765
pl
0.314214463840399
ms
0.28756476683937826
et
0.233983286908078
az
0.17664670658682635
reliable
true
passes
true
9
name
"Hunter"
dialogue
"Hunter here. Yeah, I’m on it."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8041136141038198
tl
0.6810207336523126
sq
0.550561797752809
fr
0.47506561679790027
ca
0.441340782122905
et
0.4350282485875706
yo
0.4301994301994302
fi
0.42857142857142855
de
0.3055555555555556
hr
0.3055555555555556
lv
0.3006993006993007
hi
0.29577464788732394
pl
0.29577464788732394
da
0.2907801418439716
no
0.2805755395683453
cs
0.2727272727272727
sk
0.2727272727272727
sv
0.25925925925925924
it
0.23954372623574144
nl
0.23954372623574144
pt
0.23954372623574144
ms
0.2277992277992278
ro
0.2277992277992278
sl
0.2277992277992278
tr
0.2277992277992278
reliable
true
passes
true