NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-10-09-01M4G1NZAA92KR8Y3ZCT4ZVXNQ
Run Details
Model:
Claude Haiku 5.5 (Reasoning, Low)
Test:
Dialogue tags
Scenario:
Write unattributed dialogue
Duration:
3.7s
Cost:
$0.000214
Provider:
Claude Platform on AWS
Evaluation summary
Score
Evaluator
Details Link
13.53%
Count dialogue tags
(details)
Model input
User/Human
You are an expert novel writer in the cozy mystery genre. Write a scene of about 200 words, with dialogue between two characters. The dialogue should be unattributed, meaning the speaker is not explicitly mentioned. The scene should be set in a small town bakery. Only return the story, nothing else.
Model response
Messages
Meta
AI
"You're late,"
Maggie said
, not looking up from the cinnamon rolls. "The bakery's been open for twenty minutes. Nobody's dying of hunger." "Someone might be dying of something." Maggie slid a tray onto the cooling rack. "Did you see the Hendersons' car outside the church this morning?" "Half of Millbrook saw it. Harold's been parking there since the flood." "Harold doesn't attend services." "Maybe he finally found God." "Or he found the envelope Agnes was hiding in the hymnal box." Maggie wiped her hands on her apron and finally met the other woman's eyes. "She was counting cash last Sunday. Cash, Ruth. Who counts cash in a church basement?" "People with nothing to hide, and people who want you to think so." "Well, I'm not buying the coffee cake story anymore." "Good. Because the coffee cake's gone stale, and so is your theory." "Then why are you still standing in my kitchen?" A long pause. The oven timer ticked. "Because,"
Ruth said
, pulling a crumpled receipt from her coat pocket, "this was tucked under the flour bin, and it's dated the night Agnes died."
created_at
"2026-10-09T10:00:02.315Z"
10/9/2026, 10:00:02 AM
model
"anthropic/claude-haiku-5.5-20261007"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
3482
moderation_latency
(null)
generation_time
3484
tokens_prompt
78
tokens_completion
278
native_tokens_prompt
109
native_tokens_completion
406
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"end_turn"
service_tier
"default"
usage
0.0002139
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1791540002-xiMfRc0gqE3QQtwXhrm0"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1791540002-pVWOVrJi0oKuxfpvisH2"
upstream_id
"msg_011CfrU7MfpzJFijoJTbMG2B"
provider_responses
0
endpoint_id
"b6cdf493-3a61-441f-a134-e7944fddb980"
id
"msg_011CfrU7MfpzJFijoJTbMG2B"
is_byok
false
latency
799
model_permaslug
"anthropic/claude-haiku-5.5-20261007"
provider_name
"Claude Platform on AWS"
status
200
total_cost
0.0002139
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Claude Platform on AWS"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
13.53%
Count dialogue tags
n/a
neededClean
false
dialogueTags
0
"Maggie said"
1
"Ruth said"