NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-02-08-01KGYX0BN9527RAD04VTGHWATT
Run Details
Model:
Writer: Palmyra X5
Test:
N-Length Sentences
Scenario:
Write sentences with 10 words each
Duration:
16.0s
Cost:
$0.001088
Provider:
Amazon Bedrock
Evaluation summary
Score
Evaluator
Details Link
75.66%
Matches word count
(details)
Model input
User/Human
Please write the opening scene of a murder mystery where each sentence has exactly 10 words. Please make sure that each sentence has the same length. Only return the opening itself.
Model response
Messages
Meta
AI
The rain tapped softly against the library's leaded glass windows. A single oil lamp flickered, casting long, jagged shadows across the floor. Detective Mallory stood frozen, hand hovering over the dead man's wrist. The victim lay sprawled beside a toppled chair, eyes wide. An antique pocket watch rested in his palm, stopped at ten. Blood pooled slowly beneath his chest, soaking into Persian rug fibers. The air smelled sharply of ink, damp paper, and burnt coal. No footprints marred the polished oak except those already known. A half-written letter lay splayed on the desk, addressed to no one. Outside, a clock chimed midnight, though the house had none.
created_at
"2026-02-08T15:13:16.112374+00:00"
2/8/2026, 3:13:16 PM
model
"writer/palmyra-x5-20250428"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
13638
moderation_latency
152
generation_time
15747
tokens_prompt
35
tokens_completion
151
native_tokens_prompt
273
native_tokens_completion
154
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.0010878
router
(null)
provider_responses
0
status
200
is_byok
false
latency
13635
endpoint_id
"c684c4e7-1b77-4ca5-9516-7ecc66e2c455"
provider_name
"Amazon Bedrock"
model_permaslug
"writer/palmyra-x5-20250428"
api_type
"completions"
id
"gen-1770563579-UBdUlLcyskWuYG6FNKLK"
upstream_id
(null)
total_cost
0.0010878
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Amazon Bedrock"
Evaluation details
Result
Evaluator
Details
Meta Data
75.66%
Matches word count
n/a
neededClean
false
sentences
10
wordCounts
0
10
1
12
2
11
3
10
4
11
5
11
6
11
7
10
8
12
9
10