NC Bench
Overview
About
Tests
Models
Vendors
Run: 2026-02-20-01KHXQ22AV1ZCF298PT2YQZ390
Run Details
Model:
Mistral Large 3
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
15.4s
Cost:
$0.001249
Provider:
Mistral
Evaluation summary
Score
Evaluator
Details Link
100.00%
Parse dialogue
(details)
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."
Model response
Messages
Meta
AI
**Voice Sheet: Café Conversation** *(Selvi sits at a small corner table in the café, her camera resting in her lap. She flips through the photos she’s taken, her brow furrowed. The bell above the door jingles as Hunter steps inside, scanning the room before his gaze lands on her. He approaches, his expression serious but not unkind.)* **Hunter:** *(clears throat, speaking slowly and clearly)* Excuse me. Mind if I sit for a moment? **Selvi:** *(looks up, startled, then nods hesitantly)* Ji… haan. *(Yes.)* **Hunter:** *(pulls out the chair across from her, sits)* Thanks. I’m Detective Hunter Cole. I’m looking into some… unusual activity around town. *(pauses, watching her reaction)* You’ve been taking photos around Alborn, right? **Selvi:** *(clutches her camera tighter, eyes widening)* Haan… maine liye hain. *(Yes… I took them.)* *(shakes her head, voice trembling)* Lekin… woh jagah… woh jagah achhi nahi hai. *(But… that place… that place is not good.)* **Hunter:** *(frowns, leaning forward slightly)* I’m sorry, I don’t understand. Could you— **Selvi:** *(cuts him off, voice rising slightly)* Woh ped… woh ped kaale the! *(Those trees… those trees were black!)* *(points at her camera)* Main dikha sakti hoon! *(I can show you!)* **Hunter:** *(holds up a hand, trying to calm her)* Whoa, slow down. I don’t speak Hindi. *(gestures to himself, then to her)* English? Do you know any English? **Selvi:** *(shakes her head, frustrated)* Nahi… nahi samajh rahi. *(No… I don’t understand.)* *(taps her camera)* Yeh… important hai. *(This… is important.)* **Hunter:** *(sighs, rubbing his temple)* Okay, look. *(pulls out his phone, opens a translation app, and types slowly)* "What did you see?" **Selvi:** *(reads the screen, then looks up at him, eyes filled with urgency)* Main… maine dekha… *(I… I saw…)* *(takes a deep breath, then points toward the edge of town)* Jungle ke paas. Raat ko. *(Near the woods. At night.)* Woh log… woh log gayab ho gaye. *(Those people… they disappeared.)* **Hunter:** *(stares at her, processing the words)* Disappeared? You saw people disappear? **Selvi:** *(nods rapidly)* Haan! Aur… aur woh awaaz… *(Yes! And… that sound…)* *(shudders)* Bhayanak. *(Terrible.)* **Hunter:** *(phone buzzes—he glances at it, then back at her)* I’ve gotta take this. *(stands abruptly)* But I need to talk to you more. *(points at her, then at the ground)* Stay here, okay? I’ll be back. **Selvi:** *(watches him leave, then murmurs to herself)* Kya kar rahi hoon main? *(What am I doing?)* *(clutches her camera, staring at the photos again, her hands trembling.)* *(Hunter steps outside, answering his phone as the café door swings shut behind him.)*
created_at
"2026-02-20T14:25:31.494Z"
2/20/2026, 2:25:31 PM
model
"mistralai/mistral-large-2512"
1/1/2512, 12:00:00 AM
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
402
moderation_latency
(null)
generation_time
15293
tokens_prompt
315
tokens_completion
728
native_tokens_prompt
274
native_tokens_completion
741
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.0012485
router
(null)
provider_responses
0
endpoint_id
"fa718841-07ea-4b7e-b8a3-6069545c7e6a"
id
"68f9dcce58c64338866a6a9db2c95d86"
is_byok
false
latency
402
model_permaslug
"mistralai/mistral-large-2512"
1/1/2512, 12:00:00 AM
provider_name
"Mistral"
status
200
api_type
"completions"
id
"gen-1771597531-V3F1TZoXqMWLYb8YUkCV"
upstream_id
"68f9dcce58c64338866a6a9db2c95d86"
total_cost
0.0012485
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Mistral"
Evaluation details
Result
Evaluator
Details
Meta Data
100.00%
Parse dialogue
n/a
dialogue
0
name
"Hunter"
dialogue
"** Excuse me. Mind if I sit for a moment?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.7608695652173914
no
0.6964679911699779
da
0.6733966745843231
sq
0.6419270833333334
ca
0.6367239101717306
fr
0.5997088791848617
it
0.5955882352941176
pt
0.5919881305637982
ro
0.5919881305637982
hu
0.576271186440678
pl
0.5736434108527132
cs
0.5703125
sv
0.5696400625978091
sk
0.5506535947712418
tl
0.5462046204620462
es
0.5393634840871022
nl
0.5346869712351946
hr
0.533106960950764
et
0.5291095890410958
yo
0.494485294117647
de
0.4294605809128631
az
0.416135881104034
sl
0.39293598233995586
ms
0.3483412322274882
tr
0.3483412322274882
lt
0.34523809523809523
fi
0.3341404358353511
is
0.3341404358353511
lv
0.32598039215686275
vi
0.32598039215686275
be
0.20289855072463767
eu
0.20289855072463767
uk
0.1863905325443787
reliable
true
passes
true
1
name
"Selvi"
dialogue
"**"
detectedLang
""
heavyLang
""
scores
reliable
false
passes
true
2
name
"Hunter"
dialogue
"** You’ve been taking photos around Alborn, right?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.7878787878787878
tl
0.625668449197861
fr
0.48301329394387
de
0.39130434782608703
nl
0.33078393881453155
no
0.3137254901960784
pt
0.3013972055888224
pl
0.2324561403508772
tr
0.19724770642201836
es
0.18604651162790697
fi
0.18604651162790697
lt
0.18604651162790697
hi
0.18032786885245902
da
0.17452830188679244
yo
0.17452830188679244
ca
0.16864608076009502
et
0.16864608076009502
is
0.16864608076009502
lv
0.16864608076009502
sk
0.16864608076009502
sl
0.16864608076009502
sq
0.16864608076009502
sv
0.16864608076009502
reliable
true
passes
true
3
name
"Selvi"
dialogue
"**"
detectedLang
""
heavyLang
""
scores
reliable
false
passes
true
4
name
"Hunter"
dialogue
"** I’m sorry, I don’t understand. Could you—"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8144977168949772
tl
0.6746746746746748
no
0.576271186440678
da
0.5751633986928104
sv
0.5178041543026707
cs
0.45101351351351354
it
0.3981481481481482
pl
0.385633270321361
de
0.3725868725868726
nl
0.3538767395626242
ro
0.33537832310838445
sk
0.33127572016460904
hr
0.2995689655172413
ca
0.29805615550755943
is
0.29653679653679654
sq
0.2919389978213508
fr
0.2562929061784897
pt
0.23529411764705882
yo
0.2111650485436893
be
0.17721518987341772
tr
0.17721518987341772
hu
0.1709183673469388
az
0.16237113402061853
et
0.16237113402061853
lt
0.16237113402061853
lv
0.16237113402061853
uk
0.16237113402061853
vi
0.16237113402061853
reliable
true
passes
true
5
name
"Selvi"
dialogue
"**"
detectedLang
""
heavyLang
""
scores
reliable
false
passes
true
6
name
"Hunter"
dialogue
"** English? Do you know any English?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8293515358361775
cs
0.5844875346260388
hr
0.5614035087719298
pt
0.5098039215686274
pl
0.48805460750853247
ca
0.469964664310954
sk
0.46808510638297873
sl
0.4444444444444444
sq
0.43820224719101125
vi
0.42528735632183906
no
0.35344827586206895
tl
0.34210526315789475
yo
0.34210526315789475
da
0.32432432432432434
de
0.32432432432432434
ms
0.32432432432432434
ro
0.32432432432432434
sv
0.32432432432432434
reliable
true
passes
true
7
name
"Selvi"
dialogue
"**"
detectedLang
""
heavyLang
""
scores
reliable
false
passes
true
8
name
"Hunter"
dialogue
"What did you see?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8475609756097561
et
0.6296296296296297
cs
0.43820224719101125
tl
0.43820224719101125
reliable
true
passes
true
9
name
"Selvi"
dialogue
"**"
detectedLang
""
heavyLang
""
scores
reliable
false
passes
true
10
name
"Hunter"
dialogue
"** Disappeared? You saw people disappear?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8109243697478992
ms
0.46808510638297873
tl
0.44168734491315137
eu
0.3818681318681319
nl
0.3181818181818182
it
0.27884615384615385
cs
0.25742574257425743
fr
0.2549668874172185
reliable
true
passes
true
11
name
"Selvi"
dialogue
"**"
detectedLang
""
heavyLang
""
scores
reliable
false
passes
true
12
name
"Hunter"
dialogue
"** Stay here, okay? I’ll be back."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8076923076923077
tl
0.6354166666666666
hu
0.4006849315068493
lt
0.3902439024390244
yo
0.38596491228070173
sq
0.36363636363636365
reliable
true
passes
true
13
name
"Selvi"
dialogue
"**"
detectedLang
""
heavyLang
""
scores
reliable
false
passes
true