NC Bench
Overview
About
Tests
Models
Vendors
Run: 2026-02-20-01KHXQ3XSXPEHR3BZFEHC9B7QA
Run Details
Model:
Mistral Large 3
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
14.3s
Cost:
$0.001241
Provider:
Mistral
Evaluation summary
Score
Evaluator
Details Link
50.00%
Parse dialogue
(details)
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."
Model response
Messages
Meta
AI
**Voice Sheet: Café Conversation** *(Selvi sits at a small corner table in the café, her fingers tracing the edges of her camera. The late afternoon light spills through the windows, casting a warm glow over her. She looks up as Hunter approaches, his expression serious but not unkind. He pulls out the chair across from her and sits down.)* **Hunter:** *(leaning forward slightly, voice steady but gentle)* "Excuse me, miss. I’m Detective Hunter Cole. I was hoping I could ask you a few questions about what you might’ve seen around town lately." **Selvi:** *(clutching her camera tighter, eyes wide with unease)* "Mujhe... mujhe samajh nahi aa raha hai. Aap kya keh rahe hain?" *(I... I don’t understand. What are you saying?)* **Hunter:** *(frowning slightly, trying to parse her words before realizing she’s speaking Hindi)* "Uh... I don’t—do you speak English?" **Selvi:** *(shaking her head, voice trembling)* "Nahi. Main sirf Hindi bolti hoon. Par... par maine kuch dekha hai. Kuch... bahut galat." *(No. I only speak Hindi. But... but I saw something. Something... very wrong.)* **Hunter:** *(rubbing his temple, frustrated but trying to stay patient)* "Okay, uh... slow down. I don’t know what you’re saying. Can you—can you show me? Point to something?" **Selvi:** *(nodding quickly, flipping through her camera’s photos before turning the screen toward him. She points at an image—a shadowy figure near the edge of the woods, just beyond the town’s apple orchard. Her finger trembles.)* "Yeh... yeh raat ko tha. Maine socha, shayad koi hai, par... par phir woh gayab ho gaya." *(This... this was at night. I thought maybe someone was there, but... but then they disappeared.)* **Hunter:** *(staring at the photo, jaw tightening. The figure is indistinct, but the location is unmistakable—near where the last disappearance was reported.)* "Damn it. Look, I don’t know what you’re saying, but this..." *(he taps the screen)* "...this is important. Can you take me there? Show me where you took this?" **Selvi:** *(nodding again, but her voice is small, uncertain)* "Haan, lekin... main dar rahi hoon. Wahan kuch hai. Kuch... burai." *(Yes, but... I’m scared. There’s something there. Something... evil.)* **Hunter:** *(standing abruptly as his phone buzzes. He glances at the screen, then back at her, conflicted.)* "I’ve gotta take this. But don’t go anywhere, okay? I’ll be back." *(He hesitates, then points at the photo, then at her, then at himself.)* "You. Me. Later. Got it?" **Selvi:** *(watching him, bewildered but nodding slowly)* "Thik hai. Main yahin hoon." *(Okay. I’ll be here.)* *(Hunter steps away, answering the call with a gruff "Cole." Selvi exhales shakily, her fingers tightening around her camera once more as she glances back at the photo on the screen.)*
created_at
"2026-02-20T14:26:32.393Z"
2/20/2026, 2:26:32 PM
model
"mistralai/mistral-large-2512"
1/1/2512, 12:00:00 AM
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
420
moderation_latency
(null)
generation_time
14254
tokens_prompt
315
tokens_completion
736
native_tokens_prompt
274
native_tokens_completion
736
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.001241
router
(null)
provider_responses
0
endpoint_id
"fa718841-07ea-4b7e-b8a3-6069545c7e6a"
id
"90c7f2198ac4485cba7931b9990e46be"
is_byok
false
latency
420
model_permaslug
"mistralai/mistral-large-2512"
1/1/2512, 12:00:00 AM
provider_name
"Mistral"
status
200
api_type
"completions"
id
"gen-1771597592-xi39DvJPDUvWrMyt3OzA"
upstream_id
"90c7f2198ac4485cba7931b9990e46be"
total_cost
0.001241
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Mistral"
Evaluation details
Result
Evaluator
Details
Meta Data
50.00%
Parse dialogue
n/a
dialogue
0
name
"Hunter"
dialogue
"Excuse me, miss. I’m Detective Hunter Cole. I was hoping I could ask you a few questions about what you might’ve seen around town lately."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8052631578947368
tl
0.5518410852713178
fr
0.5202282157676348
it
0.4590643274853801
nl
0.43494196701282833
pt
0.4325153374233129
ca
0.41455696202531644
ro
0.36860068259385664
no
0.3660041124057573
sq
0.35359888190076866
es
0.34536447275300775
da
0.32580174927113703
de
0.3193524650478293
sv
0.31021625652498136
cs
0.29496951219512196
hr
0.25583266291230894
pl
0.24918831168831165
sl
0.2473555736371033
yo
0.24055829228243022
et
0.2393092105263158
ms
0.23490488006617036
sk
0.23236514522821577
hu
0.19425087108013936
fi
0.18930762489044697
tr
0.18213969938107868
lt
0.13551401869158877
is
0.12982126058325494
az
0.12570888468809074
lv
0.12570888468809074
vi
0.12570888468809074
hi
0.07592407592407592
be
0.07035175879396985
eu
0.07035175879396985
uk
0.06376518218623482
reliable
true
passes
true
1
name
"Selvi"
dialogue
"Mujhe... mujhe samajh nahi aa raha hai. Aap kya keh rahe hain?"
detectedLang
"eu"
heavyLang
"tl"
scores
eu
0.482484076433121
et
0.4298245614035088
no
0.4003690036900369
vi
0.3257261410788381
fi
0.24242424242424243
is
0.2388758782201405
it
0.23529411764705882
lv
0.22985781990521328
tl
0.22985781990521328
da
0.20924574209245742
sv
0.19753086419753088
ms
0.1792929292929293
reliable
false
passes
false
2
name
"Hunter"
dialogue
"Uh... I don’t—do you speak English?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8060512024825446
tl
0.6177370030581039
hr
0.5697074010327022
cs
0.558303886925795
pl
0.5183044315992292
sq
0.500998003992016
no
0.47589098532494756
da
0.4577006507592191
sv
0.45652173913043476
sk
0.44933920704845814
vi
0.410377358490566
yo
0.39759036144578314
ro
0.39320388349514557
pt
0.3842364532019704
ca
0.3556701030927836
sl
0.32432432432432434
it
0.3150684931506849
de
0.22360248447204967
ms
0.22360248447204967
be
0.21875
tr
0.21875
hu
0.21135646687697163
az
0.20127795527156547
et
0.20127795527156547
is
0.20127795527156547
lt
0.20127795527156547
lv
0.20127795527156547
uk
0.20127795527156547
reliable
true
passes
true
3
name
"Selvi"
dialogue
"Nahi. Main sirf Hindi bolti hoon. Par... par maine kuch dekha hai. Kuch... bahut galat."
detectedLang
"tl"
heavyLang
"tl"
scores
tl
0.5410628019323671
fr
0.4808743169398907
et
0.4114002478314746
it
0.4077306733167082
lv
0.40176322418136023
is
0.38946015424164526
ro
0.38551099611901685
en
0.35549525101763907
de
0.32142857142857145
sq
0.28785607196401797
sv
0.26127527216174184
eu
0.2578125
fi
0.2554858934169279
vi
0.24841772151898736
da
0.16373239436619716
hi
0.1410488245931284
es
0.13793103448275862
ms
0.13793103448275862
ca
0.13636363636363635
tr
0.13636363636363635
reliable
false
passes
false
4
name
"Hunter"
dialogue
"Okay, uh... slow down. I don’t know what you’re saying. Can you—can you show me? Point to something?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8083067092651757
tl
0.620253164556962
da
0.39759036144578314
pl
0.3704092339979014
no
0.36507936507936506
cs
0.3435448577680525
fr
0.329608938547486
sq
0.3197278911564626
hr
0.2982456140350877
tr
0.29161747343565525
pt
0.28825622775800713
yo
0.27184466019417475
ca
0.26380368098159507
sl
0.2583436341161928
sk
0.2537313432835821
it
0.24528301886792453
lv
0.23566878980891717
es
0.23076923076923078
lt
0.21773142112125163
ms
0.2125984251968504
nl
0.21156373193166886
et
0.20844327176781002
az
0.1891891891891892
sv
0.18699186991869918
ro
0.13043478260869565
fi
0.1111111111111111
be
0.1044776119402985
hu
0.10044977511244377
is
0.09502262443438914
uk
0.09502262443438914
vi
0.09502262443438914
reliable
true
passes
true
5
name
"Selvi"
dialogue
"Yeh... yeh raat ko tha. Maine socha, shayad koi hai, par... par phir woh gayab ho gaya."
detectedLang
"tl"
heavyLang
"de"
scores
tl
0.4836956521739131
lv
0.4351961950059453
fr
0.4256348246674728
it
0.302496328928047
en
0.2554858934169279
et
0.2554858934169279
fi
0.2554858934169279
vi
0.24841772151898736
de
0.23633440514469453
ro
0.23633440514469453
yo
0.21617161716171615
sl
0.2096505823627288
ca
0.20168067226890754
sq
0.19763513513513514
no
0.18941979522184302
sk
0.18941979522184302
cs
0.18244406196213425
eu
0.1810344827586207
pt
0.1810344827586207
ms
0.1739130434782609
lt
0.16666666666666666
da
0.16373239436619716
sv
0.16373239436619716
reliable
false
passes
false
6
name
"Hunter"
dialogue
"...this is important. Can you take me there? Show me where you took this?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8321342925659472
tl
0.6288441145281017
fr
0.5276653171390013
nl
0.5276653171390013
ca
0.5172413793103449
pt
0.5084269662921348
es
0.460708782742681
sq
0.45567651632970446
it
0.44
ro
0.44
no
0.3955094991364421
de
0.3371212121212121
sl
0.3217054263565891
tr
0.30966469428007887
hu
0.3055555555555556
da
0.2827868852459016
yo
0.25531914893617025
et
0.21348314606741572
is
0.2081447963800905
ms
0.1935483870967742
cs
0.1822429906542056
az
0.18032786885245902
fi
0.1764705882352941
lt
0.16864608076009502
sv
0.1606714628297362
reliable
true
passes
true
7
name
"Selvi"
dialogue
"Haan, lekin... main dar rahi hoon. Wahan kuch hai. Kuch... burai."
detectedLang
"ms"
heavyLang
"et"
scores
ms
0.42781690140845074
fi
0.358974358974359
vi
0.3257261410788381
eu
0.3114406779661017
az
0.2995689655172413
tl
0.2872807017543859
tr
0.2857142857142857
ro
0.282560706401766
lt
0.2793791574279379
lv
0.24418604651162787
it
0.23529411764705882
en
0.23349056603773585
es
0.22248803827751198
pt
0.22248803827751198
fr
0.21307506053268765
is
0.21307506053268765
de
0.1935483870967742
reliable
false
passes
false
8
name
"Hunter"
dialogue
"You. Me. Later. Got it?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.823943661971831
nl
0.6613995485327313
sq
0.609375
tl
0.6
no
0.5481927710843374
fr
0.5192307692307693
pt
0.5145631067961165
de
0.5098039215686274
es
0.40476190476190477
et
0.3877551020408163
da
0.38524590163934425
sl
0.3697478991596639
lv
0.3644067796610169
sv
0.3644067796610169
ms
0.358974358974359
it
0.34782608695652173
cs
0.34210526315789475
hi
0.336283185840708
pl
0.336283185840708
yo
0.336283185840708
fi
0.3333333333333333
reliable
true
passes
true
9
name
"Selvi"
dialogue
"Thik hai. Main yahin hoon."
detectedLang
"vi"
heavyLang
"tl"
scores
vi
0.511400651465798
tl
0.46619217081850534
it
0.39999999999999997
en
0.39759036144578314
fr
0.3697478991596639
de
0.34210526315789475
reliable
false
passes
false