NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-10-08-01M4DA0WKQQF8VX8S8TBSE4NPY
Run Details
Model:
Claude Haiku 5.5 (Reasoning, Medium)
Test:
Dialogue tags
Scenario:
Write unattributed dialogue
Duration:
3.8s
Cost:
$0.000198
Provider:
Claude Platform on AWS
Evaluation summary
Score
Evaluator
Details Link
13.53%
Count dialogue tags
(details)
Model input
User/Human
You are an expert novel writer in the cozy mystery genre. Write a scene of about 200 words, with dialogue between two characters. The dialogue should be unattributed, meaning the speaker is not explicitly mentioned. The scene should be set in a small town bakery. Only return the story, nothing else.
Model response
Messages
Meta
AI
"Two sugar cookies and a black coffee, please,"
the woman said
, sliding a crumpled receipt across the counter. "And don't tell me the lemon tarts are sold out again." "Only the last one, and it's yours if you want it." Flour dusted the baker's apron, and a faint tremor shook her hand as she wrapped the cookies in wax paper. "Heard about Walter's shop this morning. Dreadful business." "Dreadful is one word for it. The police think he slipped on that wet floor." "Do they?" The baker set the tart down beside the cookies, then lingered, glancing toward the back door. "Funny. Walter mopped that floor himself every night for thirty years. He never once left it wet." "Maybe he was careless yesterday." "Careless isn't Walter. Precise is Walter. He'd sooner burn the bread than leave a mess." A bell chimed as the door opened. Neither of them looked up. "You knew him better than most,"
the woman said
quietly. "So why are you really closing early today?" The baker's knuckles whitened on the counter. "Because someone's been in my kitchen, too."
created_at
"2026-10-08T08:28:05.121Z"
10/8/2026, 8:28:05 AM
model
"anthropic/claude-haiku-5.5-20261007"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
891
moderation_latency
(null)
generation_time
3737
tokens_prompt
78
tokens_completion
268
native_tokens_prompt
109
native_tokens_completion
375
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"end_turn"
service_tier
"default"
usage
0.0001984
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1791448085-truxeHpYWuls7FlHaW7P"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1791448085-3LARzrmBVu3yLZVe9Ywb"
upstream_id
"msg_011CfpTHkZeE75w56mCM9X3R"
provider_responses
0
endpoint_id
"b6cdf493-3a61-441f-a134-e7944fddb980"
id
"msg_011CfpTHkZeE75w56mCM9X3R"
is_byok
false
latency
886
model_permaslug
"anthropic/claude-haiku-5.5-20261007"
provider_name
"Claude Platform on AWS"
status
200
total_cost
0.0001984
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Claude Platform on AWS"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
13.53%
Count dialogue tags
n/a
neededClean
false
dialogueTags
0
"the woman said"
1
"the woman said quietly"