NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-10-07-01M4AV777N63M1S60TW2A3NNEN
Run Details
Model:
Mistral Medium 3.5
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
6.1s
Cost:
$0.004952
Provider:
Mistral
Evaluation summary
Score
Evaluator
Details Link
44.44%
Parse dialogue
(details)
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."
Model response
Messages
Meta
AI
**Voice Sheet:** --- **Selvi:** *(muttering to herself in Hindi, adjusting her camera)* "Yeh kya ho raha hai is shehar mein... itna ajeeb lag raha hai." *(This is what’s happening in this town... it feels so strange.)* *(Hunter approaches, pulling out his notepad.)* **Hunter:** "Ma’am, I’m Detective Hunter. Mind if I ask you a few questions about what you might’ve seen near the old mill last night?" **Selvi:** *(startled, switching to rapid Hindi)* "Arre, aap kaun? Main kya jaanti hoon? Wahan toh... wahan koi nahin tha!" *(Oh no, who are you? What do I know? There was... there was no one there!) *(Her hands tremble slightly as she clutches her camera.)* **Hunter:** *(frowning, leaning in slightly)* "Ma’am, I just need to know if you saw anything unusual. You were out there with your camera, right?" **Selvi:** *(more agitated, still in Hindi)* "Main toh bas photos le rahi thi! Lekin... lekin uske baad... ek aawaaz aayi. Aur phir..." *(I was just taking photos! But... but then... there was a sound. And then...)* *(She trails off, looking around nervously.)* **Hunter:** *(rubbing his temple, frustrated)* "Look, I don’t speak... whatever that is. Slow down, use simple words. Did. You. See. Something?" **Selvi:** *(realizing he doesn’t understand, she tries to gesture, pointing at her camera and then toward the mill, speaking slower but still in Hindi)* "Wahan... ek chaya thi. Lekin... uske baad... koi nahin." *(There... there was a shadow. But... after that... no one.)* *(Hunter sighs, pulling out his phone as it rings. He holds up a finger to Selvi.)* **Hunter:** "Yeah, this is Hunter... Yeah, I’m at the café... No, nothing useful yet." *(He glances at Selvi, who is now staring at her hands.)* "I’ll be there in five." *(He pockets the phone and turns back to Selvi, softer now.)* "Ma’am, I gotta go. But if you remember anything—*anything*—come find me. I’m at the station." **Selvi:** *(nodding rapidly, still in Hindi)* "Haan, han... main sochungi." *(Yes, yes... I’ll think about it.)* *(She watches as Hunter walks away, then whispers to herself.)* "Par aap samajh hi nahin payenge." *(But you wouldn’t understand anyway.)* --- **End Scene.**
created_at
"2026-10-07T09:30:55.111Z"
10/7/2026, 9:30:55 AM
model
"mistralai/mistral-medium-3.5-20260430"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
347
moderation_latency
(null)
generation_time
6080
tokens_prompt
302
tokens_completion
565
native_tokens_prompt
286
native_tokens_completion
603
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
"default"
usage
0.0049515
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1791365455-AniaxmhZi3Qe1qbi6yTC"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1791365455-Ck9QGGKmDgs9eClidjYh"
upstream_id
"1d1385028c8e4828b7572cc0c82306fd"
provider_responses
0
endpoint_id
"d21d316f-d540-4718-b36e-3beff85d0cf9"
id
"1d1385028c8e4828b7572cc0c82306fd"
is_byok
false
latency
347
model_permaslug
"mistralai/mistral-medium-3.5-20260430"
provider_name
"Mistral"
status
200
total_cost
0.0049515
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Mistral"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
44.44%
Parse dialogue
n/a
dialogue
0
name
"Selvi"
dialogue
"Yeh kya ho raha hai is shehar mein... itna ajeeb lag raha hai."
detectedLang
"nl"
heavyLang
"ber"
scores
nl
0.4206773618538324
no
0.39138576779026213
it
0.3879472693032015
de
0.38330170777988615
eu
0.35000000000000003
en
0.3285123966942149
vi
0.3257261410788381
hu
0.32150313152400833
et
0.30257510729613735
ca
0.2696629213483146
yo
0.2696629213483146
sk
0.2545871559633027
cs
0.2459396751740139
sv
0.22248803827751198
is
0.22062350119904073
reliable
false
passes
false
1
name
"Hunter"
dialogue
"Ma’am, I’m Detective Hunter. Mind if I ask you a few questions about what you might’ve seen near the old mill last night?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8081395348837208
tl
0.6148459383753502
fr
0.5166959578207382
it
0.4607843137254902
ca
0.4425675675675676
pt
0.3986880466472303
no
0.3964886613021215
ro
0.39560439560439564
da
0.3906942392909897
sv
0.38478747203579416
nl
0.36587240584166025
sq
0.34575733544805715
cs
0.3193069306930693
yo
0.3193069306930693
es
0.3187448389760529
hr
0.27821522309711283
de
0.2750439367311072
hu
0.2737676056338028
et
0.260752688172043
pl
0.21875
sl
0.207492795389049
tr
0.19980601357904945
sk
0.19668938656280427
ms
0.19512195121951217
lt
0.14948453608247422
is
0.14330218068535827
az
0.13883089770354906
lv
0.13883089770354906
vi
0.13883089770354906
be
0.0782122905027933
eu
0.0782122905027933
fi
0.07094594594594594
uk
0.07094594594594594
reliable
true
passes
true
2
name
"Selvi"
dialogue
"Arre, aap kaun? Main kya jaanti hoon? Wahan toh... wahan koi nahin tha!"
detectedLang
"tl"
heavyLang
"tl"
scores
tl
0.5335820895522388
ms
0.4627507163323783
sq
0.32915921288014316
eu
0.2816091954022989
et
0.258893280632411
it
0.22520661157024793
en
0.20886075949367086
fi
0.19006479481641467
fr
0.19006479481641467
lt
0.19006479481641467
de
0.17218543046357618
lv
0.16666666666666666
cs
0.1515837104072398
hr
0.1515837104072398
ro
0.1515837104072398
sk
0.1515837104072398
sl
0.1515837104072398
tr
0.1515837104072398
reliable
false
passes
false
3
name
"Hunter"
dialogue
"Ma’am, I just need to know if you saw anything unusual. You were out there with your camera, right?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8091020158827124
tl
0.58025520483546
ms
0.4359205776173285
sv
0.4030563514804203
et
0.3955512572533849
no
0.3441762854144806
de
0.34141201264488935
ca
0.3365180467091295
da
0.3365180467091295
cs
0.3343982960596379
sq
0.3329775880469584
yo
0.3228602383531961
it
0.3040089086859688
pl
0.2945823927765237
hr
0.28977272727272724
ro
0.284077892325315
sk
0.2460796139927624
lv
0.22839506172839508
es
0.21972534332084895
lt
0.21085858585858586
fr
0.1935483870967742
sl
0.16219839142091153
pt
0.10968660968660969
nl
0.10841654778887304
be
0.10071942446043164
tr
0.10071942446043164
hu
0.09682080924855492
az
0.09156976744186046
is
0.09156976744186046
uk
0.09156976744186046
vi
0.09156976744186046
reliable
true
passes
true
4
name
"Selvi"
dialogue
"Main toh bas photos le rahi thi! Lekin... lekin uske baad... ek aawaaz aayi. Aur phir..."
detectedLang
"fr"
heavyLang
"tlh"
scores
fr
0.55
en
0.36886395511921455
ro
0.3273542600896861
es
0.3066255778120185
nl
0.2753623188405797
vi
0.256198347107438
de
0.24874791318864775
eu
0.24623115577889448
it
0.24369747899159663
yo
0.21328671328671328
sl
0.20634920634920634
tr
0.199288256227758
ms
0.1818181818181818
hu
0.17883211678832117
fi
0.17279411764705882
is
0.16356877323420074
lt
0.15094339622641512
pt
0.15094339622641512
hi
0.14611005692599618
tl
0.14611005692599618
ca
0.1362763915547025
lv
0.1362763915547025
reliable
false
passes
false
5
name
"Hunter"
dialogue
"Look, I don’t speak... whatever that is. Slow down, use simple words. Did. You. See. Something?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8219056099732859
tl
0.5965030262273033
nl
0.4318181818181818
ca
0.38208032955715754
fr
0.3492407809110629
da
0.33035714285714285
ro
0.2831541218637993
et
0.2797118847539016
no
0.2797118847539016
sv
0.2736077481840194
es
0.2727272727272727
pt
0.27007299270072993
hu
0.269183922046285
yo
0.25650557620817843
hr
0.2537313432835821
sq
0.2490613266583229
cs
0.23371647509578544
is
0.2052980132450331
ms
0.2
pl
0.17355371900826447
it
0.16083916083916083
de
0.13544668587896252
sk
0.10714285714285714
be
0.1044776119402985
tr
0.1044776119402985
sl
0.09774436090225565
az
0.09502262443438914
lt
0.09502262443438914
lv
0.09502262443438914
uk
0.09502262443438914
vi
0.09502262443438914
reliable
true
passes
true
6
name
"Selvi"
dialogue
"Wahan... ek chaya thi. Lekin... uske baad... koi nahin."
detectedLang
"tl"
heavyLang
"tlh"
scores
tl
0.5269286754002911
ms
0.5255474452554745
eu
0.4749596122778676
fi
0.358974358974359
vi
0.3229166666666667
tr
0.2562929061784897
nl
0.23529411764705882
is
0.21307506053268765
reliable
false
passes
false
7
name
"Hunter"
dialogue
"Ma’am, I gotta go. But if you remember anything—anything—come find me. I’m at the station."
detectedLang
"en"
heavyLang
"en"
scores
en
0.798590130916415
tl
0.667590027700831
da
0.5827538247566064
no
0.5756718528995757
sv
0.5468277945619335
it
0.5230524642289348
yo
0.506578947368421
fr
0.48674080410607357
sq
0.46761313220940554
nl
0.4550408719346049
ms
0.44029850746268656
hu
0.3697478991596639
de
0.36507936507936506
pl
0.3311036789297659
et
0.329608938547486
sl
0.3174061433447099
fi
0.3095512082853855
sk
0.30151338766006985
cs
0.2907801418439716
is
0.26560587515299877
hr
0.2518703241895262
ro
0.21773142112125163
ca
0.18699186991869918
lt
0.18699186991869918
tr
0.17695473251028807
az
0.17355371900826447
lv
0.17355371900826447
es
0.1452991452991453
pt
0.12790697674418602
zh
0.1137370753323486
be
0.1044776119402985
uk
0.09502262443438914
vi
0.09502262443438914
reliable
true
passes
true
8
name
"Selvi"
dialogue
"Par aap samajh hi nahin payenge."
detectedLang
"tl"
heavyLang
"tl"
scores
tl
0.655436447166922
da
0.5570866141732284
lv
0.5283018867924528
ca
0.5273109243697479
fr
0.5253164556962026
no
0.460431654676259
sv
0.43467336683417085
eu
0.3951612903225807
et
0.3161094224924012
fi
0.3161094224924012
is
0.3119266055045872
de
0.2524916943521595
en
0.2524916943521595
ms
0.2398648648648649
reliable
true
passes
false