NC Bench
Overview
About
Tests
Models
Vendors
Run: 2026-02-20-01KHXPEN74HM6FG4K98HCMXDXX
Run Details
Model:
Mistral Large 3
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
17.1s
Cost:
$0.001447
Provider:
Mistral
Evaluation summary
Score
Evaluator
Details Link
50.00%
Parse dialogue
(details)
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."
Model response
Messages
Meta
AI
**Voice Sheet: Café Conversation** *(Selvi sits at a small corner table in the café, her fingers tracing the edges of her camera. The late afternoon light spills through the windows, casting a warm glow over her. She looks up as Hunter approaches, his expression serious but not unkind. He pulls out the chair across from her and sits down.)* **Hunter:** *(leaning forward slightly, voice steady but gentle)* "Excuse me, miss. I’m Detective Hunter Cole. I was hoping I could ask you a few questions about what you might’ve seen around town lately." **Selvi:** *(clutching her camera tighter, eyes wide with unease)* "Mujhe... mujhe samajh nahi aa raha hai. Aap kya keh rahe hain?" *(I... I don’t understand. What are you saying?)* **Hunter:** *(frowning slightly, trying to parse her words before realizing she’s speaking Hindi)* "Uh... I don’t—do you speak English?" **Selvi:** *(shaking her head, voice trembling)* "Nahi. Main sirf Hindi bolti hoon. Par... par maine kuch dekha hai. Kuch... bahut galat." *(No. I only speak Hindi. But... but I saw something. Something... very wrong.)* **Hunter:** *(rubbing his temple, frustrated but trying to stay patient)* "Okay, uh... slow down. I don’t know what you’re saying. Can you—can you show me? Point to something?" **Selvi:** *(nodding quickly, flipping through her camera’s photos before turning the screen toward him. She points at an image—a shadowy figure near the edge of the woods, just beyond the town’s apple orchard. Her finger trembles.)* "Yeh... yeh raat ko tha. Maine socha, shayad koi hai, par... par phir woh gayab ho gaya." *(This... this was at night. I thought maybe it was someone, but... but then they disappeared.)* **Hunter:** *(staring at the photo, his jaw tightening. The figure is blurry, but the location is unmistakable—near where the last missing person was last seen.)* "Damn it. Look, I don’t know what you’re saying, but this..." *(he taps the screen)* "...this is important. Can you take me there? To where you took this?" **Selvi:** *(shaking her head, eyes filling with tears)* "Main nahi jaa sakti. Woh jagah... woh jagah bhayanak hai." *(I can’t go. That place... that place is terrifying.)* **Hunter:** *(sighing, running a hand through his hair. He pulls out his phone, opening a translation app and typing slowly.)* "Okay. Okay, just... stay here. I’ll figure this out." *(He holds up the phone, showing her the Hindi translation: "कृपया यहीं रुकिए। मैं इसे समझने की कोशिश करूंगा।")* **Selvi:** *(nodding, wiping her eyes with the back of her hand)* "Theek hai. Main yahin hoon." *(Okay. I’ll be here.)* *(Hunter’s phone rings—sharp and insistent. He glances at the screen, his expression darkening.)* **Hunter:** *(standing abruptly, voice tense)* "I’ve gotta go. But don’t leave, okay? I’ll be back." *(He hesitates, then points at her camera.)* "Keep that safe. And... stay out of the woods." **Selvi:** *(watching him leave, her voice barely a whisper)* "Dhyan rakhna, Detective. Wahan kuch hai... jo humein nahi dekhna chahiye." *(Be careful, Detective. There’s something there... that we shouldn’t see.)* *(Hunter pauses at the door, glancing back at her. He doesn’t understand the words, but the fear in her voice is unmistakable. He gives her a tight nod before stepping out into the fading light.)*
created_at
"2026-02-20T14:14:55.471Z"
2/20/2026, 2:14:55 PM
model
"mistralai/mistral-large-2512"
1/1/2512, 12:00:00 AM
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
399
moderation_latency
(null)
generation_time
17007
tokens_prompt
315
tokens_completion
902
native_tokens_prompt
274
native_tokens_completion
873
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.0014465
router
(null)
provider_responses
0
endpoint_id
"fa718841-07ea-4b7e-b8a3-6069545c7e6a"
id
"11f2b2ac1e4b49e289b23d46ef14721d"
is_byok
false
latency
398
model_permaslug
"mistralai/mistral-large-2512"
1/1/2512, 12:00:00 AM
provider_name
"Mistral"
status
200
api_type
"completions"
id
"gen-1771596895-oJMc90vSS3zJPuxB86aN"
upstream_id
"11f2b2ac1e4b49e289b23d46ef14721d"
total_cost
0.0014465
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Mistral"
Evaluation details
Result
Evaluator
Details
Meta Data
50.00%
Parse dialogue
n/a
dialogue
0
name
"Hunter"
dialogue
"Excuse me, miss. I’m Detective Hunter Cole. I was hoping I could ask you a few questions about what you might’ve seen around town lately."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8052631578947368
tl
0.5518410852713178
fr
0.5202282157676348
it
0.4590643274853801
nl
0.43494196701282833
pt
0.4325153374233129
ca
0.41455696202531644
ro
0.36860068259385664
no
0.3660041124057573
sq
0.35359888190076866
es
0.34536447275300775
da
0.32580174927113703
de
0.3193524650478293
sv
0.31021625652498136
cs
0.29496951219512196
hr
0.25583266291230894
pl
0.24918831168831165
sl
0.2473555736371033
yo
0.24055829228243022
et
0.2393092105263158
ms
0.23490488006617036
sk
0.23236514522821577
hu
0.19425087108013936
fi
0.18930762489044697
tr
0.18213969938107868
lt
0.13551401869158877
is
0.12982126058325494
az
0.12570888468809074
lv
0.12570888468809074
vi
0.12570888468809074
hi
0.07592407592407592
be
0.07035175879396985
eu
0.07035175879396985
uk
0.06376518218623482
reliable
true
passes
true
1
name
"Selvi"
dialogue
"Mujhe... mujhe samajh nahi aa raha hai. Aap kya keh rahe hain?"
detectedLang
"eu"
heavyLang
"tl"
scores
eu
0.482484076433121
et
0.4298245614035088
no
0.4003690036900369
vi
0.3257261410788381
fi
0.24242424242424243
is
0.2388758782201405
it
0.23529411764705882
lv
0.22985781990521328
tl
0.22985781990521328
da
0.20924574209245742
sv
0.19753086419753088
ms
0.1792929292929293
reliable
false
passes
false
2
name
"Hunter"
dialogue
"Uh... I don’t—do you speak English?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8060512024825446
tl
0.6177370030581039
hr
0.5697074010327022
cs
0.558303886925795
pl
0.5183044315992292
sq
0.500998003992016
no
0.47589098532494756
da
0.4577006507592191
sv
0.45652173913043476
sk
0.44933920704845814
vi
0.410377358490566
yo
0.39759036144578314
ro
0.39320388349514557
pt
0.3842364532019704
ca
0.3556701030927836
sl
0.32432432432432434
it
0.3150684931506849
de
0.22360248447204967
ms
0.22360248447204967
be
0.21875
tr
0.21875
hu
0.21135646687697163
az
0.20127795527156547
et
0.20127795527156547
is
0.20127795527156547
lt
0.20127795527156547
lv
0.20127795527156547
uk
0.20127795527156547
reliable
true
passes
true
3
name
"Selvi"
dialogue
"Nahi. Main sirf Hindi bolti hoon. Par... par maine kuch dekha hai. Kuch... bahut galat."
detectedLang
"tl"
heavyLang
"tl"
scores
tl
0.5410628019323671
fr
0.4808743169398907
et
0.4114002478314746
it
0.4077306733167082
lv
0.40176322418136023
is
0.38946015424164526
ro
0.38551099611901685
en
0.35549525101763907
de
0.32142857142857145
sq
0.28785607196401797
sv
0.26127527216174184
eu
0.2578125
fi
0.2554858934169279
vi
0.24841772151898736
da
0.16373239436619716
hi
0.1410488245931284
es
0.13793103448275862
ms
0.13793103448275862
ca
0.13636363636363635
tr
0.13636363636363635
reliable
false
passes
false
4
name
"Hunter"
dialogue
"Okay, uh... slow down. I don’t know what you’re saying. Can you—can you show me? Point to something?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8083067092651757
tl
0.620253164556962
da
0.39759036144578314
pl
0.3704092339979014
no
0.36507936507936506
cs
0.3435448577680525
fr
0.329608938547486
sq
0.3197278911564626
hr
0.2982456140350877
tr
0.29161747343565525
pt
0.28825622775800713
yo
0.27184466019417475
ca
0.26380368098159507
sl
0.2583436341161928
sk
0.2537313432835821
it
0.24528301886792453
lv
0.23566878980891717
es
0.23076923076923078
lt
0.21773142112125163
ms
0.2125984251968504
nl
0.21156373193166886
et
0.20844327176781002
az
0.1891891891891892
sv
0.18699186991869918
ro
0.13043478260869565
fi
0.1111111111111111
be
0.1044776119402985
hu
0.10044977511244377
is
0.09502262443438914
uk
0.09502262443438914
vi
0.09502262443438914
reliable
true
passes
true
5
name
"Selvi"
dialogue
"Yeh... yeh raat ko tha. Maine socha, shayad koi hai, par... par phir woh gayab ho gaya."
detectedLang
"tl"
heavyLang
"de"
scores
tl
0.4836956521739131
lv
0.4351961950059453
fr
0.4256348246674728
it
0.302496328928047
en
0.2554858934169279
et
0.2554858934169279
fi
0.2554858934169279
vi
0.24841772151898736
de
0.23633440514469453
ro
0.23633440514469453
yo
0.21617161716171615
sl
0.2096505823627288
ca
0.20168067226890754
sq
0.19763513513513514
no
0.18941979522184302
sk
0.18941979522184302
cs
0.18244406196213425
eu
0.1810344827586207
pt
0.1810344827586207
ms
0.1739130434782609
lt
0.16666666666666666
da
0.16373239436619716
sv
0.16373239436619716
reliable
false
passes
false
6
name
"Hunter"
dialogue
"...this is important. Can you take me there? To where you took this?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8372849837284984
tl
0.6232508073196985
fr
0.5276653171390013
ca
0.5172413793103449
no
0.4912790697674419
nl
0.4728915662650602
es
0.460708782742681
sq
0.45567651632970446
sl
0.45054945054945056
pt
0.44881889763779526
it
0.44
ro
0.44
yo
0.4233937397034596
da
0.40878378378378377
cs
0.3738819320214669
de
0.3371212121212121
lt
0.3333333333333333
tr
0.30966469428007887
hu
0.3055555555555556
pl
0.27835051546391754
sk
0.2738589211618257
lv
0.2584745762711864
hr
0.24892703862660948
et
0.21348314606741572
is
0.2081447963800905
ms
0.1935483870967742
az
0.18032786885245902
fi
0.1764705882352941
sv
0.1606714628297362
reliable
true
passes
true
7
name
"Selvi"
dialogue
"Main nahi jaa sakti. Woh jagah... woh jagah bhayanak hai."
detectedLang
"eu"
heavyLang
"de"
scores
eu
0.46808510638297873
sq
0.4117647058823529
vi
0.3435448577680525
az
0.2805755395683453
et
0.27184466019417475
ms
0.2628992628992629
it
0.25
sv
0.25
en
0.24812030075187969
hu
0.24812030075187969
fr
0.22680412371134018
hr
0.21875
tl
0.21875
de
0.20634920634920634
tr
0.2
reliable
false
passes
false
8
name
"Hunter"
dialogue
"Okay. Okay, just... stay here. I’ll figure this out."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8076923076923077
tl
0.6183206106870229
sq
0.414519906323185
ca
0.3811881188118812
fr
0.37027707808564225
ro
0.37027707808564225
et
0.28977272727272724
sv
0.28977272727272724
da
0.2163009404388715
de
0.2163009404388715
es
0.2163009404388715
it
0.2163009404388715
no
0.2163009404388715
pt
0.2163009404388715
reliable
true
passes
true
9
name
"Selvi"
dialogue
"Theek hai. Main yahin hoon."
detectedLang
"vi"
heavyLang
"nl"
scores
vi
0.4728915662650602
tl
0.4281045751633987
nl
0.375
it
0.36363636363636365
en
0.3613138686131387
fr
0.3346007604562738
de
0.308300395256917
reliable
false
passes
false
10
name
"Hunter"
dialogue
"Keep that safe. And... stay out of the woods."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8496692723992785
tl
0.7168742921857305
yo
0.5606326889279437
nl
0.45652173913043476
no
0.43052391799544415
is
0.2625368731563422
de
0.2492492492492493
da
0.2378048780487805
fr
0.2378048780487805
ms
0.2378048780487805
sq
0.2378048780487805
sv
0.2378048780487805
reliable
true
passes
true
11
name
"Selvi"
dialogue
"Dhyan rakhna, Detective. Wahan kuch hai... jo humein nahi dekhna chahiye."
detectedLang
"tl"
heavyLang
"tl"
scores
tl
0.4437577255871446
en
0.40318302387267907
it
0.3775933609958506
ca
0.37413073713490963
ro
0.358974358974359
eu
0.3562231759656652
ms
0.35064935064935066
fi
0.3055555555555556
fr
0.3001555209953344
sq
0.29467084639498436
da
0.29245283018867924
es
0.2834394904458599
sl
0.27768860353130015
pt
0.2741935483870968
no
0.2598684210526316
vi
0.25864909390444807
lv
0.20634920634920634
lt
0.19642857142857142
yo
0.16974169741697415
de
0.15730337078651685
nl
0.15413533834586465
cs
0.13793103448275862
hr
0.12959381044487428
sv
0.12959381044487428
reliable
false
passes
false