NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-02-20-01KHXQ22AV1ZCF298PT2YQZ390
Run Details
Model:
Mistral Large 3
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
15.4s
Cost:
$0.001249
Provider:
Mistral
Evaluation summary
Score
Evaluator
Details Link
57.14%
Parse dialogue
(details)
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."
Model response
Messages
Meta
AI
**Voice Sheet: Café Conversation** *(Selvi sits at a small corner table in the café, her camera resting in her lap. She flips through the photos she’s taken, her brow furrowed. The bell above the door jingles as Hunter steps inside, scanning the room before his gaze lands on her. He approaches, his expression serious but not unkind.)* **Hunter:** *(clears throat, speaking slowly and clearly)* Excuse me. Mind if I sit for a moment? **Selvi:** *(looks up, startled, then nods hesitantly)* Ji… haan. *(Yes.)* **Hunter:** *(pulls out the chair across from her, sits)* Thanks. I’m Detective Hunter Cole. I’m looking into some… unusual activity around town. *(pauses, watching her reaction)* You’ve been taking photos around Alborn, right? **Selvi:** *(clutches her camera tighter, eyes widening)* Haan… maine liye hain. *(Yes… I took them.)* *(shakes her head, voice trembling)* Lekin… woh jagah… woh jagah achhi nahi hai. *(But… that place… that place is not good.)* **Hunter:** *(frowns, leaning forward slightly)* I’m sorry, I don’t understand. Could you— **Selvi:** *(cuts him off, voice rising slightly)* Woh ped… woh ped kaale the! *(Those trees… those trees were black!)* *(points at her camera)* Main dikha sakti hoon! *(I can show you!)* **Hunter:** *(holds up a hand, trying to calm her)* Whoa, slow down. I don’t speak Hindi. *(gestures to himself, then to her)* English? Do you know any English? **Selvi:** *(shakes her head, frustrated)* Nahi… nahi samajh rahi. *(No… I don’t understand.)* *(taps her camera)* Yeh… important hai. *(This… is important.)* **Hunter:** *(sighs, rubbing his temple)* Okay, look. *(pulls out his phone, opens a translation app, and types slowly)* "What did you see?" **Selvi:** *(reads the screen, then looks up at him, eyes filled with urgency)* Main… maine dekha… *(I… I saw…)* *(takes a deep breath, then points toward the edge of town)* Jungle ke paas. Raat ko. *(Near the woods. At night.)* Woh log… woh log gayab ho gaye. *(Those people… they disappeared.)* **Hunter:** *(stares at her, processing the words)* Disappeared? You saw people disappear? **Selvi:** *(nods rapidly)* Haan! Aur… aur woh awaaz… *(Yes! And… that sound…)* *(shudders)* Bhayanak. *(Terrible.)* **Hunter:** *(phone buzzes—he glances at it, then back at her)* I’ve gotta take this. *(stands abruptly)* But I need to talk to you more. *(points at her, then at the ground)* Stay here, okay? I’ll be back. **Selvi:** *(watches him leave, then murmurs to herself)* Kya kar rahi hoon main? *(What am I doing?)* *(clutches her camera, staring at the photos again, her hands trembling.)* *(Hunter steps outside, answering his phone as the café door swings shut behind him.)*
created_at
"2026-02-20T14:25:31.494Z"
2/20/2026, 2:25:31 PM
model
"mistralai/mistral-large-2512"
1/1/2512, 12:00:00 AM
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
402
moderation_latency
(null)
generation_time
15293
tokens_prompt
315
tokens_completion
728
native_tokens_prompt
274
native_tokens_completion
741
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.0012485
router
(null)
provider_responses
0
endpoint_id
"fa718841-07ea-4b7e-b8a3-6069545c7e6a"
id
"68f9dcce58c64338866a6a9db2c95d86"
is_byok
false
latency
402
model_permaslug
"mistralai/mistral-large-2512"
1/1/2512, 12:00:00 AM
provider_name
"Mistral"
status
200
api_type
"completions"
id
"gen-1771597531-V3F1TZoXqMWLYb8YUkCV"
upstream_id
"68f9dcce58c64338866a6a9db2c95d86"
total_cost
0.0012485
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Mistral"
Evaluation details
Result
Evaluator
Details
Meta Data
57.14%
Parse dialogue
n/a
dialogue
0
name
"Hunter"
dialogue
"Excuse me. Mind if I sit for a moment?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.7608695652173914
no
0.6964679911699779
da
0.6733966745843231
sq
0.6419270833333334
ca
0.6367239101717306
fr
0.5997088791848617
it
0.5955882352941176
pt
0.5919881305637982
ro
0.5919881305637982
hu
0.576271186440678
pl
0.5736434108527132
cs
0.5703125
sv
0.5696400625978091
sk
0.5506535947712418
tl
0.5462046204620462
es
0.5393634840871022
nl
0.5346869712351946
hr
0.533106960950764
et
0.5291095890410958
yo
0.494485294117647
de
0.4294605809128631
az
0.416135881104034
sl
0.39293598233995586
ms
0.3483412322274882
tr
0.3483412322274882
lt
0.34523809523809523
fi
0.3341404358353511
is
0.3341404358353511
lv
0.32598039215686275
vi
0.32598039215686275
be
0.20289855072463767
eu
0.20289855072463767
uk
0.1863905325443787
reliable
true
passes
true
1
name
"Selvi"
dialogue
"Ji… haan."
detectedLang
"lt"
heavyLang
"lt"
scores
lt
0.6932515337423313
cs
0.673202614379085
sl
0.6644295302013423
reliable
false
passes
true
2
name
"Hunter"
dialogue
"Thanks. I’m Detective Hunter Cole. I’m looking into some… unusual activity around town. You’ve been taking photos around Alborn, right?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.7911921032649962
tl
0.582701062215478
fr
0.47883765003158557
nl
0.4148936170212766
pt
0.39692982456140347
ro
0.3692660550458715
ca
0.3644067796610169
de
0.3559718969555035
es
0.3431528662420382
no
0.3136439267886855
da
0.26861702127659576
it
0.26601423487544484
sq
0.25742574257425743
sv
0.2445054945054945
et
0.22169811320754715
cs
0.20212765957446807
ms
0.20135527589545013
sk
0.20135527589545013
tr
0.19825072886297376
sl
0.19275929549902154
fi
0.15123456790123457
vi
0.14948453608247422
lv
0.1397288842544317
pl
0.11385606874328678
lt
0.08839779005524862
hi
0.08536585365853659
yo
0.08231368186874304
is
0.07924107142857142
hr
0.07511210762331838
reliable
true
passes
true
3
name
"Selvi"
dialogue
"Haan… maine liye hain. Lekin… woh jagah… woh jagah achhi nahi hai."
detectedLang
"eu"
heavyLang
"de"
scores
eu
0.5625
et
0.44
fi
0.4233937397034596
fr
0.37275985663082434
en
0.317738791423002
vi
0.30966469428007887
de
0.29577464788732394
ro
0.29577464788732394
it
0.2222222222222222
sv
0.2222222222222222
is
0.2009132420091324
lv
0.2009132420091324
tl
0.1898148148148148
reliable
true
passes
false
4
name
"Hunter"
dialogue
"I’m sorry, I don’t understand. Could you—"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8144977168949772
tl
0.6746746746746748
no
0.576271186440678
da
0.5751633986928104
sv
0.5178041543026707
cs
0.45101351351351354
it
0.3981481481481482
pl
0.385633270321361
de
0.3725868725868726
nl
0.3538767395626242
ro
0.33537832310838445
sk
0.33127572016460904
hr
0.2995689655172413
ca
0.29805615550755943
is
0.29653679653679654
sq
0.2919389978213508
fr
0.2562929061784897
pt
0.23529411764705882
yo
0.2111650485436893
be
0.17721518987341772
tr
0.17721518987341772
hu
0.1709183673469388
az
0.16237113402061853
et
0.16237113402061853
lt
0.16237113402061853
lv
0.16237113402061853
uk
0.16237113402061853
vi
0.16237113402061853
reliable
true
passes
true
5
name
"Selvi"
dialogue
"Woh ped… woh ped kaale the! Main dikha sakti hoon!"
detectedLang
"tl"
heavyLang
"de"
scores
tl
0.5291095890410958
sq
0.5115452930728241
en
0.507168458781362
et
0.45
fr
0.3764172335600907
yo
0.2801047120418848
no
0.25675675675675674
nl
0.233983286908078
da
0.22096317280453256
de
0.22096317280453256
ms
0.22096317280453256
sv
0.22096317280453256
reliable
false
passes
false
6
name
"Hunter"
dialogue
"Whoa, slow down. I don’t speak Hindi. English? Do you know any English?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.7830802603036876
tl
0.6412556053811659
sq
0.45799457994579945
hr
0.4528043775649795
cs
0.441340782122905
ca
0.4038748137108793
pl
0.4020926756352765
no
0.3620414673046252
it
0.35170178282009723
da
0.3453355155482815
sv
0.3442622950819672
sk
0.33774834437086093
vi
0.30313588850174217
yo
0.2920353982300885
ro
0.28825622775800713
is
0.28698752228163993
et
0.28186714542190305
pt
0.2805755395683453
sl
0.23076923076923078
hi
0.16317991631799164
de
0.15254237288135594
ms
0.15254237288135594
be
0.14893617021276595
tr
0.14893617021276595
hu
0.14346895074946467
az
0.13606911447084233
lt
0.13606911447084233
lv
0.13606911447084233
uk
0.13606911447084233
reliable
true
passes
true
7
name
"Selvi"
dialogue
"Nahi… nahi samajh rahi. Yeh… important hai."
detectedLang
"tl"
heavyLang
"tl"
scores
tl
0.5960502692998204
fr
0.5714285714285714
ca
0.5697896749521989
it
0.5673076923076923
en
0.560546875
ro
0.55
no
0.5140388768898488
da
0.49888641425389757
es
0.4668246445497631
pt
0.4668246445497631
eu
0.4230769230769231
vi
0.4109947643979057
sv
0.3951612903225807
et
0.3161094224924012
fi
0.3161094224924012
is
0.3119266055045872
lv
0.30124223602484473
tr
0.26229508196721313
lt
0.2398648648648649
ms
0.2398648648648649
nl
0.2398648648648649
sq
0.22945205479452058
reliable
true
passes
false
8
name
"Hunter"
dialogue
"What did you see?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8475609756097561
et
0.6296296296296297
cs
0.43820224719101125
tl
0.43820224719101125
reliable
true
passes
true
9
name
"Selvi"
dialogue
"Main… maine dekha… Jungle ke paas. Raat ko. Woh log… woh log gayab ho gaye."
detectedLang
"fr"
heavyLang
"de"
scores
fr
0.46808510638297873
en
0.4558258642765685
de
0.45161290322580644
tl
0.4089012517385257
ms
0.3656716417910448
yo
0.34006211180124224
lv
0.33176100628930816
cs
0.32965299684542587
lt
0.3275316455696203
et
0.2772108843537415
fi
0.2772108843537415
ro
0.256993006993007
sl
0.22867513611615245
ca
0.22018348623853207
no
0.20708955223880596
sk
0.20708955223880596
it
0.19962335216572505
eu
0.19811320754716982
reliable
false
passes
false
10
name
"Hunter"
dialogue
"Disappeared? You saw people disappear?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8109243697478992
ms
0.46808510638297873
tl
0.44168734491315137
eu
0.3818681318681319
nl
0.3181818181818182
it
0.27884615384615385
cs
0.25742574257425743
fr
0.2549668874172185
reliable
true
passes
true
11
name
"Selvi"
dialogue
"Haan! Aur… aur woh awaaz… Bhayanak."
detectedLang
"az"
heavyLang
"de"
scores
az
0.36908517350157727
ms
0.3485342019543974
ro
0.3442622950819672
eu
0.3311036789297659
hu
0.3311036789297659
hr
0.29577464788732394
tl
0.29577464788732394
tr
0.2727272727272727
reliable
false
passes
false
12
name
"Hunter"
dialogue
"I’ve gotta take this. But I need to talk to you more. Stay here, okay? I’ll be back."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8099239695878351
tl
0.6550472040668119
yo
0.4128553770086526
hr
0.41212871287128716
cs
0.39797211660329534
it
0.39720812182741116
hu
0.3807040417209909
sl
0.3766404199475065
lt
0.370026525198939
pl
0.3546195652173913
no
0.3484224965706447
da
0.3384401114206128
sq
0.3300423131170663
sv
0.3115942028985507
sk
0.3004418262150221
et
0.2983751846381093
lv
0.2803030303030303
ca
0.22512234910277326
fi
0.1908006814310051
ro
0.1592920353982301
fr
0.15630550621669628
be
0.12844036697247707
tr
0.12844036697247707
az
0.1171003717472119
is
0.1171003717472119
uk
0.1171003717472119
vi
0.1171003717472119
reliable
true
passes
true
13
name
"Selvi"
dialogue
"Kya kar rahi hoon main?"
detectedLang
"sl"
heavyLang
"af"
scores
sl
0.5551601423487544
tr
0.4444444444444444
en
0.44196428571428575
fr
0.4131455399061033
de
0.3842364532019704
reliable
false
passes
false