NC Bench
Overview
About
Tests
Models
Vendors
Run: 2026-02-20-01KHXQJN5QSEZ2EPX6RF02BJ0M
Run Details
Model:
Mistral Medium 3.1
Test:
N-Length Sentences
Scenario:
Write sentences with 20 words each
Duration:
4.6s
Cost:
$0.000510
Provider:
Mistral
Evaluation summary
Score
Evaluator
Details Link
33.83%
Matches word count
(details)
Model input
User/Human
Please write the opening scene of a murder mystery where each sentence has exactly 20 words. Please make sure that each sentence has the same length. Only return the opening itself.
Model response
Messages
Meta
AI
The grand estate loomed under storm clouds, its gabled windows watching like hollow eyes filled with forgotten secrets. Detective Harlan Mercer adjusted his coat, the gravel crunching beneath his boots as he approached the wrought-iron gates. A single raven perched on the fence post, its glossy feathers ruffled by the wind that carried whispers of impending doom. Inside, the air smelled of aged leather and lavender, though something metallic lingered just beneath the surface. Lady Whitmore stood by the fireplace, her trembling fingers clutching a monogrammed handkerchief stained with something dark. The butler’s polished shoes clicked against the marble floor as he announced the detective’s arrival with practiced indifference. A shattered teacup lay near the hearth, its delicate fragments scattered like the last remnants of a shattered alibi. Mercer noticed the portrait above the mantel—Sir Reginald’s piercing gaze seemed to follow him, cold and unblinking. The clock in the hallway struck midnight, its brass pendulum swinging like the blade of a guillotine over them all. Footsteps echoed from the upper landing, but when Mercer turned, the staircase stood empty, draped in heavy silence.
created_at
"2026-02-20T14:34:35.072Z"
2/20/2026, 2:34:35 PM
model
"mistralai/mistral-medium-3.1"
3/1/2001, 12:00:00 AM
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
618
moderation_latency
(null)
generation_time
4468
tokens_prompt
46
tokens_completion
320
native_tokens_prompt
39
native_tokens_completion
247
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.0005096
router
(null)
provider_responses
0
endpoint_id
"13c5002b-8c5b-490c-8a5f-52ec0242804f"
id
"7deaf09295174df48807d32e429f41e8"
is_byok
false
latency
618
model_permaslug
"mistralai/mistral-medium-3.1"
3/1/2001, 12:00:00 AM
provider_name
"Mistral"
status
200
api_type
"completions"
id
"gen-1771598075-SJZFuv5DLYzZuFmW74JM"
upstream_id
"7deaf09295174df48807d32e429f41e8"
total_cost
0.0005096
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Mistral"
Evaluation details
Result
Evaluator
Details
Meta Data
33.83%
Matches word count
n/a
neededClean
false
sentences
10
wordCounts
0
18
1
19
2
21
3
17
4
17
5
18
6
19
7
18
8
20
9
18