NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-10-09-01M4FXHCZ2J67TKJFBH1ZMT658
Run Details
Model:
Claude Haiku 5.5 (Reasoning, Low)
Test:
Dialogue tags
Scenario:
Write unattributed dialogue
Duration:
3.8s
Cost:
$0.000226
Provider:
Claude Platform on AWS
Evaluation summary
Score
Evaluator
Details Link
60.65%
Count dialogue tags
(details)
Model input
User/Human
You are an expert novel writer in the cozy mystery genre. Write a scene of about 200 words, with dialogue between two characters. The dialogue should be unattributed, meaning the speaker is not explicitly mentioned. The scene should be set in a small town bakery. Only return the story, nothing else.
Model response
Messages
Meta
AI
“You're late,”
Marjorie said
, not looking up from the flour-dusted counter. “The power went out on Maple Street. Half the town's stuck in their driveways.” The bell above the door jingled as the girl slipped inside, shaking rain from a yellow raincoat. “Did you save me a cinnamon roll?” “I saved you the burnt one. The good ones sold out at six.” “Marjorie, you're a terrible liar.” “And you're a terrible customer.” A pause, the rustle of paper. “Take a look at this, though. Found it tucked inside the sourdough bin this morning.” “A note?” “Read it.” A long silence. The oven timer ticked. “'The recipe is in the wrong hands. Stop baking, or the next batch will be poisoned.' That's not funny.” “Did I say it was funny?” “Who would do this?” “Someone who knows the sourdough starter came from Edna's kitchen. Someone who was at the funeral yesterday.” “You think it's Harold.” “I think Harold has been asking an awful lot of questions about his aunt's will.” “Then we start with Harold.” Another jingle of the bell. “But first, hand over that burnt roll. If I'm going to solve a murder, I need sugar.”
created_at
"2026-10-09T08:47:38.111Z"
10/9/2026, 8:47:38 AM
model
"anthropic/claude-haiku-5.5-20261007"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
3630
moderation_latency
(null)
generation_time
3630
tokens_prompt
78
tokens_completion
312
native_tokens_prompt
109
native_tokens_completion
430
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"end_turn"
service_tier
"default"
usage
0.0002259
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1791535658-7dQkPm2X548DEIJ7C3v6"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1791535658-W5dd3EboSYdgDs1A97dW"
upstream_id
"msg_011CfrNb8dqMDVTZAcBZGoLw"
provider_responses
0
endpoint_id
"b6cdf493-3a61-441f-a134-e7944fddb980"
id
"msg_011CfrNb8dqMDVTZAcBZGoLw"
is_byok
false
latency
755
model_permaslug
"anthropic/claude-haiku-5.5-20261007"
provider_name
"Claude Platform on AWS"
status
200
total_cost
0.0002259
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Claude Platform on AWS"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
60.65%
Count dialogue tags
n/a
neededClean
false
dialogueTags
0
"Marjorie said"