NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-03-18-01KM07ME42MMPC21TNFWMMRJFC
Run Details
Model:
Mistral Small 4 (Reasoning)
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
14.6s
Cost:
$0.000966
Provider:
Mistral
Evaluation summary
Score
Evaluator
Details Link
100.00%
Parse dialogue
(details)
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."
Model response
Messages
Meta
AI
--- **Selvi:** *(glancing up from her camera, sensing someone’s presence but not looking up immediately)* ... ? **Hunter:** *(pulling out the chair across from her and sitting down)* Afternoon. You’re the girl who’s always got that camera around your neck, right? Selvi, isn’t it? **Selvi:** *(looks up, eyes slightly wide, nods slowly)* हाँ... सेल्वी। *(Haan... Selvī.)* *(her gaze shifts to the camera in her hands; fingers tighten around it)* **Hunter:** You know anything about what happened near the old Miller farm last night? **Selvi:** *(sharply looks up, pupils widening; voice low and uneasy)* मिलर वाले खेत में? ... *(grips camera strap, looks down again, mutters)* ...उस रात... मैंने कुछ देखा... **Hunter:** *(leaning forward slightly, tone firm but patient)* What did you see? **Selvi:** (shaking head, voice trembling, speaking rapidly in Hindi) नहीं... बस... लोग गायब हो रहे हैं... और वहाँ... *(gestures vaguely toward the window, in the direction of the Miller farm)* ...अंधेरा थोड़ा... अलग दिखता था... **Hunter:** *(frowning, hands up in a calming gesture)* Slow down. I don’t speak Hindi. You’re talking about the disappearances? **Selvi:** *(nods quickly, eyes darting around the cafe)* हाँ... हाँ... और रात बहुत तेज हवा थी... मुझे लगा... मैंने देखा... **Hunter:** *(pulls out phone, opens notes app)* Okay, okay. Start again. What did you see near the Miller farm last night, Selvi? Was it someone, a light, something? **Selvi:** *(voice drops, eyes locked on Hunter’s face, terrified)* मैं... मैंने एक आदमी देखा... जीन्स और जैकेट पहने... दूर खड़ा था... लेकिन उसका चेहरा... *(shakes head vigorously)* सब कुछ काला लग रहा था! उसके हाथ में कुछ था... चमकता हुआ... **Hunter:** *(immediately alert, sitting up straighter)* A light? A weapon? Describe it. **Selvi:** *(shaking her head, confused)* पता नहीं... चमक... जैसे फ्लैश... उसने मुड़कर मुझे देखा... *(gasps, hands fly to mouth)* और तब... तभी... **Hunter:** What? What happened then? **Selvi:** *(whispers, eyes darting)* मेरे कैमरे का फ्लैश... पूरी रात उसने मेरे कैमरे से उनकी तस्वीरें लीं... *(Hunter pauses, studying her face. She clutches her camera like a lifeline.)* **Hunter:** Hold on. You’re saying someone took pictures of you last night? At the Miller farm? **Selvi:** *(nods slowly, then more vigorously)* हाँ... हाँ... वे हर चीज़ की तस्वीर ले रहे थे... और तब... मैंने उससे पूछा... *(whispers)* उसने जवाब नहीं दिया... **Hunter:** Asked him *what*, Selvi? **Selvi:** *(looks down, voice almost inaudible)* "तुम क्या कर रहे हो?" *(Long pause. Selvi stares at her camera, lips pressed tight. Hunter exhales sharply through his nose, glancing at his watch.)* **Hunter:** Selvi—look at me. I need you to come down to the station. We’ll get an interpreter. You might have seen something critical. **Selvi:** (shakes head rapidly) नहीं... नहीं... मैं... *(looks around anxiously)* मुझे डर लग रहा है... **Hunter:** *(stands up, takes out phone)* Officer Kapoor’s already on his way. She speaks Hindi. Ten minutes, okay? **Selvi:** *(looking down at the camera, voice low and shaky)* ...मुझे मेरी तस्वीरें लेनी हैं... **Hunter:** *(pauses, then softer)* We’ll get them. For now, stay here. Don’t go anywhere. *(He turns to leave, then suddenly stops mid-step, pulls his phone from his pocket—it’s vibrating.)* **Hunter:** *(answering, brisk)* Carson. Yeah. Where? *(He listens, face darkening. A beat. Then, without another word to Selvi, he ends the call and strides toward the door.)* **Hunter:** *(over his shoulder)* Stay put. Kapoor’s on her way. *(Selvi doesn’t look up. She watches his departing back, fingers trembling around her camera.)* --- End scene.
created_at
"2026-03-18T10:25:03.12Z"
3/18/2026, 10:25:03 AM
model
"mistralai/mistral-small-2603"
1/1/2603, 12:00:00 AM
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
358
moderation_latency
(null)
generation_time
14518
tokens_prompt
315
tokens_completion
2009
native_tokens_prompt
286
native_tokens_completion
1538
native_tokens_completion_images
(null)
native_tokens_reasoning
676
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.0009657
router
(null)
provider_responses
0
endpoint_id
"f5ed6283-4e17-457d-98cd-2ec0c318171d"
id
"5f687959f6e94b90a07459afa597d7fb"
is_byok
false
latency
351
model_permaslug
"mistralai/mistral-small-2603"
1/1/2603, 12:00:00 AM
provider_name
"Mistral"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.14.0; linux; x64))"
http_referer
(null)
api_type
"completions"
id
"gen-1773829503-gUoYnnwXE2PIWlAuN837"
upstream_id
"5f687959f6e94b90a07459afa597d7fb"
total_cost
0.0009657
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Mistral"
Evaluation details
Result
Evaluator
Details
Meta Data
100.00%
Parse dialogue
n/a
dialogue
0
name
"Selvi"
dialogue
"... ?"
detectedLang
""
heavyLang
""
scores
reliable
false
passes
true
1
name
"Hunter"
dialogue
"Afternoon. You’re the girl who’s always got that camera around your neck, right? Selvi, isn’t it?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.7979041916167665
tl
0.6720116618075801
da
0.34908389585342336
no
0.3408203125
nl
0.2773019271948608
yo
0.2757510729613734
fr
0.2524916943521595
ms
0.2524916943521595
ca
0.20960187353629978
es
0.2058823529411765
sq
0.19547079856972585
sv
0.19161676646706588
it
0.18967587034813926
ro
0.18967587034813926
de
0.17783191230207065
fi
0.14012738853503184
lv
0.11300919842312747
pt
0.10119840213049268
sk
0.10119840213049268
reliable
true
passes
true
2
name
"Selvi"
dialogue
"हाँ... सेल्वी।"
detectedLang
"hi"
heavyLang
"hi"
scores
hi
0.8991935483870968
mr
0.8986828774062816
reliable
true
passes
true
3
name
"Hunter"
dialogue
"You know anything about what happened near the old Miller farm last night?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8317631224764468
tl
0.6226415094339622
no
0.4298745724059293
da
0.419953596287703
fr
0.4004796163069544
de
0.3403693931398417
nl
0.32523616734143057
sv
0.2907801418439716
yo
0.26578560939794427
ca
0.2636229749631811
sq
0.2625368731563422
et
0.25925925925925924
tr
0.251497005988024
ms
0.2378048780487805
az
0.15110356536502548
hu
0.15110356536502548
is
0.14965986394557826
es
0.14675767918088736
cs
0.13494809688581316
fi
0.13043478260869565
it
0.1087344028520499
reliable
true
passes
true
4
name
"Hunter"
dialogue
"What? What happened then?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8382923673997412
tl
0.4444444444444444
reliable
true
passes
true
5
name
"Hunter"
dialogue
"Hold on. You’re saying someone took pictures of you last night? At the Miller farm?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8232400860743929
tl
0.6676300578034682
da
0.5563271604938271
no
0.5479559748427674
fr
0.5247933884297521
ca
0.43792766373411535
nl
0.4329388560157791
et
0.4261477045908184
de
0.4180161943319838
yo
0.39088983050847464
sv
0.3251173708920188
tr
0.3179122182680902
fi
0.28125
is
0.2353723404255319
es
0.2219215155615697
cs
0.2101648351648352
ro
0.20907840440165062
az
0.13403614457831325
hu
0.13403614457831325
hr
0.13273001508295626
hi
0.1274658573596358
pl
0.1274658573596358
lv
0.12613981762917933
ms
0.11944869831546708
pt
0.11944869831546708
sq
0.11944869831546708
sk
0.11538461538461538
it
0.09591194968553458
reliable
true
passes
true
6
name
"Hunter"
dialogue
"Asked him what, Selvi?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.7652582159624414
da
0.5575221238938053
tr
0.42748091603053434
fi
0.4230769230769231
et
0.4117647058823529
no
0.38271604938271603
ca
0.33920704845814975
sv
0.33920704845814975
reliable
true
passes
true
7
name
"Hunter"
dialogue
"Selvi—look at me. I need you to come down to the station. We’ll get an interpreter. You might have seen something critical."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8123387285948862
da
0.5961635537607269
no
0.5773903856312731
tl
0.5717344753747323
fr
0.5327102803738317
it
0.4978028876333961
yo
0.47950553025374104
de
0.47194719471947194
es
0.4684385382059801
ca
0.464524765729585
ro
0.4528043775649795
sq
0.4448299791811242
pt
0.4405594405594406
sv
0.4156318480642805
ms
0.3925588458618071
et
0.37839937839937837
nl
0.3764614185502728
cs
0.3620414673046252
sl
0.34047815333882936
tr
0.33829611248966085
lv
0.33774834437086093
pl
0.33665008291873966
sk
0.3360995850622407
hr
0.33388842631140714
lt
0.28507596067917784
fi
0.25023430178069356
vi
0.22705314009661837
hu
0.2179863147605083
az
0.19436052366565962
eu
0.18864097363083165
is
0.16926272066458983
zh
0.08779931584948689
be
0.08045977011494253
uk
0.07300115874855156
reliable
true
passes
true
8
name
"Hunter"
dialogue
"Officer Kapoor’s already on his way. She speaks Hindi. Ten minutes, okay?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.7714148219441771
tl
0.6640735502121641
et
0.527363184079602
fr
0.43113772455089816
nl
0.4135802469135802
pl
0.35020519835841313
cs
0.34392265193370164
sk
0.34392265193370164
ca
0.34210526315789475
fi
0.3185078909612626
de
0.3115942028985507
sl
0.2824773413897281
it
0.26242236024844723
es
0.2601246105919003
hi
0.2543171114599686
lt
0.24960505529225907
hr
0.24603174603174602
sq
0.24000000000000002
no
0.23878205128205127
sv
0.23014586709886548
da
0.2263843648208469
hu
0.20833333333333331
is
0.17102966841186737
yo
0.13636363636363635
ro
0.12844036697247707
pt
0.1171003717472119
ms
0.11048689138576778
reliable
true
passes
true