NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-10-08-01M4DYQ9G5PQ31Y9Q00VYZ0WZ1
Run Details
Model:
Claude Haiku 5.5 (Reasoning, Low)
Test:
Dialogue tags
Scenario:
Write unattributed dialogue
Duration:
3.8s
Cost:
$0.000233
Provider:
Claude Platform on AWS
Evaluation summary
Score
Evaluator
Details Link
60.65%
Count dialogue tags
(details)
Model input
User/Human
You are an expert novel writer in the cozy mystery genre. Write a scene of about 200 words, with dialogue between two characters. The dialogue should be unattributed, meaning the speaker is not explicitly mentioned. The scene should be set in a small town bakery. Only return the story, nothing else.
Model response
Messages
Meta
AI
“You're late,”
Marjorie said
, not looking up from the proofing dough. “Traffic on Elm. Somebody's parked a hay wagon across the whole street again.” The bell over the door jingled as the second voice stepped inside, shaking rain from a yellow raincoat. “Is that cinnamon I smell, or are you trying to bribe me?” “Both. The good rolls are cooling on the rack. Don't touch the one with the crooked icing, that's Hollis's.” “Hollis is dead, Marjorie.” “Which is exactly why nobody's allowed to touch his roll.” A pause, then the soft scrape of a stool. “You're still keeping it for him?” “I'm keeping it because someone poisoned his coffee with almond extract, and I baked that roll the morning before he died. The police took the coffee cup. They didn't take the roll.” “Marjorie.” “Don't. I know what it sounds like.” Flour puffed as she slapped the dough down. “But he came in every Tuesday for twenty years and never once asked for almond anything. Someone wanted him to think it was an accident.” “Or someone wanted you to think it wasn't.” Marjorie finally turned, wiping her hands slowly on her apron. “Then you'd better eat that crooked roll and tell me what you taste.”
created_at
"2026-10-08T14:29:50.735Z"
10/8/2026, 2:29:50 PM
model
"anthropic/claude-haiku-5.5-20261007"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
771
moderation_latency
(null)
generation_time
3799
tokens_prompt
78
tokens_completion
321
native_tokens_prompt
109
native_tokens_completion
445
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"end_turn"
service_tier
"default"
usage
0.0002334
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1791469790-9oZC2cZq3gm4pktxKirS"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1791469790-z9Lt2AeEnL089UF9pARI"
upstream_id
"msg_011Cfpvsm1X2dWrVgMRDZSbj"
provider_responses
0
endpoint_id
"b6cdf493-3a61-441f-a134-e7944fddb980"
id
"msg_011Cfpvsm1X2dWrVgMRDZSbj"
is_byok
false
latency
771
model_permaslug
"anthropic/claude-haiku-5.5-20261007"
provider_name
"Claude Platform on AWS"
status
200
total_cost
0.0002334
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Claude Platform on AWS"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
60.65%
Count dialogue tags
n/a
neededClean
false
dialogueTags
0
"Marjorie said"