NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-02-08-01KGYYAW7AGTKE17GFJ8D0BZ2Z
Run Details
Model:
Writer: Palmyra X5
Test:
N-Length Sentences
Scenario:
Write sentences with 20 words each
Duration:
11.3s
Cost:
$0.001490
Provider:
Amazon Bedrock
Evaluation summary
Score
Evaluator
Details Link
13.86%
Matches word count
(details)
Model input
User/Human
Please write the opening scene of a murder mystery where each sentence has exactly 20 words. Please make sure that each sentence has the same length. Only return the opening itself.
Model response
Messages
Meta
AI
The rain fell hard on cobblestones, echoing through the silent, empty streets of the ancient seaside town. A lone figure stumbled through the downpour, clutching a bloodied scarf tight against a jagged gash. Gasping for breath, the person reached the grand oak door of a dimly lit manor house. Thunder cracked overhead just as the door creaked open, revealing a butler with wide, startled eyes. Behind him, the grand foyer shimmered with candlelight, shadows stretching like fingers across richly woven Persian rugs. The injured guest collapsed forward, whispering three final words before going still on the polished marble floor. The butler dropped the candlestick, its clatter breaking the silence, and began shouting for the master of the house. Upstairs, a clock struck midnight, each chime reverberating through the halls like a mournful, warning heartbeat. In the study, a pipe smoldered in an ashtray beside a half-finished letter signed ominously with a red “X.”
created_at
"2026-02-08T15:36:24.450726+00:00"
2/8/2026, 3:36:24 PM
model
"writer/palmyra-x5-20250428"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
8245
moderation_latency
170
generation_time
10962
tokens_prompt
35
tokens_completion
216
native_tokens_prompt
273
native_tokens_completion
221
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.0014898
router
(null)
provider_responses
0
status
200
is_byok
false
latency
8244
endpoint_id
"c684c4e7-1b77-4ca5-9516-7ecc66e2c455"
provider_name
"Amazon Bedrock"
model_permaslug
"writer/palmyra-x5-20250428"
api_type
"completions"
id
"gen-1770564972-91Uy2h0BYUlalbWCyym0"
upstream_id
(null)
total_cost
0.0014898
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Amazon Bedrock"
Evaluation details
Result
Evaluator
Details
Meta Data
13.86%
Matches word count
n/a
neededClean
false
sentences
9
wordCounts
0
17
1
16
2
16
3
16
4
17
5
17
6
19
7
16
8
19