NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-02-08-01KGZ0G86KAEF5SQ47HA9S6XQN
Run Details
Model:
Writer: Palmyra X5
Test:
N-Length Sentences
Scenario:
Write sentences with 20 words each
Duration:
3.8s
Cost:
$0.001886
Provider:
Amazon Bedrock
Evaluation summary
Score
Evaluator
Details Link
57.86%
Matches word count
(details)
Model input
User/Human
Please write the opening scene of a murder mystery where each sentence has exactly 20 words. Please make sure that each sentence has the same length. Only return the opening itself.
Model response
Messages
Meta
AI
The rain fell hard on cobblestones, echoing through empty streets beneath flickering gas lamps with cracked glass. Detective Arlen March stepped from his carriage, coat damp, boots splashing as he approached the crime scene's chalk outline. A body lay twisted near the alley’s mouth, arms splayed, one hand clutching a torn opera glove stiff with blood. Neighbors peered from windows above, curtains twitching, their faces pale smudges in the dim, rain-blurred lamplight from the square. The constable saluted stiffly, rain dripping off his helmet brim, and stammered, "Found her an hour past, sir, alone." No wallet, no ring, just a single pearl button glinting dull beside her frozen, outstretched fingertips on the wet stone. Her eyes remained open, glassy, reflecting the stormy sky and the silhouette of a crow perched high on a church gargoyle. March knelt slowly, ignoring the cold seep, and noticed a faint perfume beneath the coppery stench of fresh blood on pavement. He murmured, "Same killer—theater district, two weeks prior—the glove, the button... this is no random act of violence but design." Thunder cracked overhead as he stood, water tracing paths down his face like tears, already certain this case would unravel lives.
created_at
"2026-02-08T16:14:10.46552+00:00"
2/8/2026, 4:14:10 PM
model
"writer/palmyra-x5-20250428"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
254
moderation_latency
211
generation_time
3484
tokens_prompt
35
tokens_completion
282
native_tokens_prompt
273
native_tokens_completion
287
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.0018858
router
(null)
provider_responses
0
status
200
is_byok
false
latency
254
endpoint_id
"c684c4e7-1b77-4ca5-9516-7ecc66e2c455"
provider_name
"Amazon Bedrock"
model_permaslug
"writer/palmyra-x5-20250428"
api_type
"completions"
id
"gen-1770567246-BIGv8FIr7PXU1TtKvM5C"
upstream_id
(null)
total_cost
0.0018858
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Amazon Bedrock"
Evaluation details
Result
Evaluator
Details
Meta Data
57.86%
Matches word count
n/a
neededClean
false
sentences
10
wordCounts
0
17
1
19
2
20
3
19
4
19
5
20
6
21
7
21
8
22
9
21