NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-10-07-01M4AVSNC5F4EFE9XHEE9XEJX7
Run Details
Model:
Mistral Medium 3.5
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
6.8s
Cost:
$0.005701
Provider:
Mistral
Evaluation summary
Score
Evaluator
Details Link
50.00%
Parse dialogue
(details)
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."
Model response
Messages
Meta
AI
**Voice Sheet:** --- **Selvi:** *(muttering to herself in Hindi, brows furrowed as she reviews photos on her camera)* "Yeh kya ho raha hai... main samajh nahi paa rahi..." *(This can't be happening... I don’t understand...)* *(Hunter approaches, pulling out a notepad. He clears his throat.)* **Hunter:** "Ma’am, I’m Detective Hunter. Mind if I ask you a few questions about what happened at the festival last night?" *(Selvi looks up, startled. She responds rapidly in Hindi, her voice trembling.)* **Selvi:** "Ji, kal raat ko... main wahan thi, lekin... maine kuchh nahi dekha! Woh log gayab ho gaye!" *(Yes, last night... I was there, but... I didn’t see anything! Those people just disappeared!)* *(Hunter blinks, completely lost. He flips through his notepad, then holds up a hand.)* **Hunter:** "Whoa, slow down. I—I don’t understand. You speak English, right?" *(Selvi shakes her head frantically, gesturing to her camera, then to the empty street outside. She speaks faster, more urgently.)* **Selvi:** "Main angrezi nahi bolti! Par... par maine unke chehre dekhe the! Camera mein hai!" *(I don’t speak English! But... but I saw their faces! They’re in my camera!)* *(Hunter rubs his temples, sighing. He pulls out his phone, typing a quick message—likely to a translator app—but it’s slow going. He tries again, speaking louder, as if volume will help.)* **Hunter:** "Okay. Okay. You—you took pictures? Of the missing people?" *(Selvi nods vigorously, tapping her camera screen. She points at it, then at Hunter, her expression pleading.)* **Selvi:** "Haan! Yeh lo, dekhiye!" *(Yes! Here, look!)* *(Hunter takes the camera, squinting at the images. His phone rings—an urgent, official tone. He curses under his breath, then holds up a finger to Selvi.)* **Hunter:** "Hold that thought. I gotta take this." *(He steps away, answering the call.)* "Hunter here... Yeah, I’m on it... No, I found a possible witness, but—" *(He glances back at Selvi, who’s wringing her hands, still muttering in Hindi.)* "—she doesn’t speak English. I’ll need an interpreter. Be there in ten." *(He hangs up, turning back to Selvi. She’s standing now, looking desperate. He holds up his hands in a calming gesture.)* **Hunter:** "Look, I—I don’t know what you’re saying, but I *need* you to stay here. I’ll be back. Don’t leave, okay?" *(Selvi doesn’t understand, but she nods at his tone, clutching her camera tighter. Hunter hesitates, then jogs off toward his car, already dialing another number.)* **Selvi:** *(to herself, watching him leave, still shaken)* "Kya karun main...?" *(What do I do...?)* --- **End Scene.**
created_at
"2026-10-07T09:40:59.406Z"
10/7/2026, 9:40:59 AM
model
"mistralai/mistral-medium-3.5-20260430"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
367
moderation_latency
(null)
generation_time
6734
tokens_prompt
302
tokens_completion
689
native_tokens_prompt
286
native_tokens_completion
703
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
"default"
usage
0.0057015
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1791366059-bgojlx2CoPffaXw8L5zZ"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1791366059-NT4AhzBb2MOagOLFsdxH"
upstream_id
"b87f7f929feb49e495979fcd15df5c46"
provider_responses
0
endpoint_id
"d21d316f-d540-4718-b36e-3beff85d0cf9"
id
"b87f7f929feb49e495979fcd15df5c46"
is_byok
false
latency
367
model_permaslug
"mistralai/mistral-medium-3.5-20260430"
provider_name
"Mistral"
status
200
total_cost
0.0057015
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Mistral"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
50.00%
Parse dialogue
n/a
dialogue
0
name
"Selvi"
dialogue
"Yeh kya ho raha hai... main samajh nahi paa rahi..."
detectedLang
"no"
heavyLang
"tl"
scores
no
0.5401337792642141
et
0.47115384615384615
it
0.42827442827442824
tl
0.41737288135593226
eu
0.375
vi
0.36342592592592593
ca
0.3037974683544304
sk
0.28756476683937826
cs
0.27821522309711283
fi
0.2744063324538259
is
0.27055702917771884
en
0.2647058823529412
lv
0.260752688172043
fr
0.24242424242424243
da
0.23822714681440443
sv
0.22535211267605632
de
0.22096317280453256
ms
0.20520231213872833
reliable
false
passes
false
1
name
"Hunter"
dialogue
"Ma’am, I’m Detective Hunter. Mind if I ask you a few questions about what happened at the festival last night?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8116868294909838
tl
0.6688077077478924
fr
0.5625662778366914
it
0.5225694444444445
da
0.5192307692307693
no
0.5169789227166276
ca
0.5106761565836299
pt
0.4755244755244755
nl
0.4448183041722746
ro
0.4436952124072825
sv
0.43454420836189167
cs
0.41029306647605435
es
0.4081779053084649
sq
0.406901509705248
hr
0.3861607142857143
et
0.3336025848142165
sl
0.32817589576547235
yo
0.3193069306930693
de
0.3170529801324503
ms
0.31478405315614616
hu
0.314214463840399
sk
0.27947598253275113
pl
0.26273458445040215
lt
0.24726277372262775
az
0.23327137546468402
tr
0.19980601357904945
lv
0.19196865817825662
is
0.14330218068535827
vi
0.13883089770354906
fi
0.13249211356466878
be
0.0782122905027933
eu
0.0782122905027933
uk
0.07094594594594594
reliable
true
passes
true
2
name
"Selvi"
dialogue
"Ji, kal raat ko... main wahan thi, lekin... maine kuchh nahi dekha! Woh log gayab ho gaye!"
detectedLang
"ms"
heavyLang
"tl"
scores
ms
0.425
eu
0.42036290322580644
tl
0.37635574837310193
fi
0.375
fr
0.33983926521239954
cs
0.3321718931475029
en
0.31302270011947436
de
0.28125
sl
0.28125
lv
0.2684478371501272
lt
0.2656449553001277
sk
0.24639580602883354
et
0.22086720867208673
vi
0.21232876712328766
ro
0.203601108033241
yo
0.18555240793201136
ca
0.1726618705035971
no
0.16180758017492713
it
0.15565345080763582
is
0.13273001508295626
pl
0.11809815950920245
reliable
false
passes
false
3
name
"Hunter"
dialogue
"Whoa, slow down. I—I don’t understand. You speak English, right?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.800498753117207
tl
0.627906976744186
no
0.5991983967935872
da
0.5943204868154158
sv
0.51278928136419
de
0.4587280108254398
cs
0.4002998500749625
ro
0.3710691823899371
hr
0.3453355155482815
pl
0.33774834437086093
nl
0.3079584775086505
sk
0.28698752228163993
yo
0.28698752228163993
ca
0.25650557620817843
is
0.25512104283054005
sq
0.250936329588015
it
0.22330097087378642
fr
0.15611814345991562
ms
0.15254237288135594
be
0.14893617021276595
tr
0.14893617021276595
hu
0.14346895074946467
az
0.13606911447084233
et
0.13606911447084233
lt
0.13606911447084233
lv
0.13606911447084233
uk
0.13606911447084233
vi
0.13606911447084233
reliable
true
passes
true
4
name
"Selvi"
dialogue
"Main angrezi nahi bolti! Par... par maine unke chehre dekhe the! Camera mein hai!"
detectedLang
"fr"
heavyLang
"de"
scores
fr
0.5556594948550047
en
0.5235707121364093
de
0.5128205128205129
ro
0.46327683615819204
it
0.44638694638694637
da
0.3528610354223433
tl
0.35197817189631647
sv
0.3475274725274725
lv
0.3384401114206128
is
0.3014705882352941
no
0.2846385542168675
eu
0.2578125
et
0.2554858934169279
fi
0.2554858934169279
nl
0.25196850393700787
vi
0.24841772151898736
ms
0.24000000000000002
yo
0.18384879725085912
ca
0.17677642980935876
es
0.17247386759581881
sq
0.1410488245931284
reliable
false
passes
false
5
name
"Hunter"
dialogue
"Okay. Okay. You—you took pictures? Of the missing people?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8221695317131003
tl
0.7164461247637052
nl
0.604221635883905
no
0.5341614906832298
fr
0.5327102803738317
da
0.4906621392190153
sv
0.45054945054945056
ca
0.44649446494464945
is
0.44547134935304994
de
0.4307400379506641
yo
0.4230769230769231
ms
0.38524590163934425
et
0.35205183585313177
ro
0.336283185840708
lv
0.21671018276762402
cs
0.20634920634920634
fi
0.20634920634920634
sq
0.20634920634920634
az
0.1780821917808219
it
0.1780821917808219
pt
0.1780821917808219
reliable
true
passes
true
6
name
"Selvi"
dialogue
"Haan! Yeh lo, dekhiye!"
detectedLang
"es"
heavyLang
"ber"
scores
es
0.5283018867924528
yo
0.5229007633587787
it
0.5
ca
0.4212962962962963
vi
0.4212962962962963
pt
0.40191387559808617
reliable
false
passes
false
7
name
"Hunter"
dialogue
"—she doesn’t speak English. I’ll need an interpreter. Be there in ten."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8167539267015705
de
0.6179039301310044
tl
0.4980879541108987
ro
0.47761194029850745
nl
0.4414893617021277
ms
0.4101123595505618
sv
0.4006849315068493
it
0.37425506555423127
es
0.36746987951807225
fr
0.3651753325272068
sl
0.3597560975609756
sq
0.3574051407588739
yo
0.3574051407588739
lt
0.3510506798516687
tr
0.34782608695652173
pl
0.34375
hu
0.34210526315789475
et
0.33962264150943394
no
0.3286445012787723
ca
0.3225806451612903
sk
0.31462140992167104
da
0.3119266055045872
pt
0.3037135278514589
eu
0.26160337552742613
cs
0.2510699001426534
vi
0.2467718794835007
hr
0.22794117647058826
az
0.22337278106508876
lv
0.14075286415711946
reliable
true
passes
true
8
name
"Hunter"
dialogue
"Look, I—I don’t know what you’re saying, but I need you to stay here. I’ll be back. Don’t leave, okay?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8278335724533716
tl
0.5932203389830508
yo
0.3576017130620985
cs
0.3435448577680525
lt
0.3174061433447099
pl
0.30313588850174217
hr
0.2982456140350877
no
0.297423887587822
da
0.28825622775800713
sq
0.2805755395683453
sk
0.2537313432835821
et
0.2518703241895262
lv
0.23566878980891717
hu
0.23469387755102045
tr
0.22077922077922074
ca
0.18699186991869918
sv
0.18699186991869918
sl
0.1678224687933426
it
0.16083916083916083
ro
0.13043478260869565
fr
0.12790697674418602
be
0.1044776119402985
az
0.09502262443438914
is
0.09502262443438914
uk
0.09502262443438914
vi
0.09502262443438914
reliable
true
passes
true
9
name
"Selvi"
dialogue
"Kya karun main...?"
detectedLang
"yo"
heavyLang
"tl"
scores
yo
0.5555555555555556
en
0.49748743718592964
fr
0.46808510638297873
de
0.43820224719101125
reliable
false
passes
false