NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-10-09-01M4FZYR0SW8R6BNPB61C4CCBB
Run Details
Model:
Claude Haiku 5.5 (Reasoning, Low)
Test:
Dialogue tags
Scenario:
Write unattributed dialogue
Duration:
3.4s
Cost:
$0.000208
Provider:
Claude Platform on AWS
Evaluation summary
Score
Evaluator
Details Link
13.53%
Count dialogue tags
(details)
Model input
User/Human
You are an expert novel writer in the cozy mystery genre. Write a scene of about 200 words, with dialogue between two characters. The dialogue should be unattributed, meaning the speaker is not explicitly mentioned. The scene should be set in a small town bakery. Only return the story, nothing else.
Model response
Messages
Meta
AI
“Two croissants, one black coffee, and a slice of the lemon thing,”
the woman said
, sliding a crumpled bill across the counter. “Did you bake the lemon thing this morning?” “Same as every morning. Four a.m., before the sun even thinks about showing up.” Flour dusted the baker's forearms. “Why? Something wrong with it?” “Depends. Did you notice the back door was open when you came in?” “Open? No. I locked it last night, same as always. Mrs. Hadley's been after me about the lock since the sugar tins went missing.” “Well, it wasn't locked this morning. And there's a smear of blue frosting on the handle.” “Blue? I don't do blue this week. Only the lemon and the cinnamon swirls.” “Exactly. Someone else was in your kitchen, and they had blue frosting on their fingers.” A long silence. The bell over the door jingled as a child burst in, then backed out again when the room went quiet. “Hand me that cloth,”
the baker said finally
. “And tell me what else you noticed, Dorothy. Because I have a feeling the lemon thing isn't the only thing that's gone sour in this town.”
created_at
"2026-10-09T09:29:52.416Z"
10/9/2026, 9:29:52 AM
model
"anthropic/claude-haiku-5.5-20261007"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
3396
moderation_latency
(null)
generation_time
3396
tokens_prompt
78
tokens_completion
291
native_tokens_prompt
109
native_tokens_completion
395
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"end_turn"
service_tier
"default"
usage
0.0002084
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1791538192-iV60kN5LU3gySKjRMW93"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1791538192-fDPA7pY1s61km1FNl3TV"
upstream_id
"msg_011CfrRowQrpecg9NqBVYP3H"
provider_responses
0
endpoint_id
"b6cdf493-3a61-441f-a134-e7944fddb980"
id
"msg_011CfrRowQrpecg9NqBVYP3H"
is_byok
false
latency
724
model_permaslug
"anthropic/claude-haiku-5.5-20261007"
provider_name
"Claude Platform on AWS"
status
200
total_cost
0.0002084
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Claude Platform on AWS"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
13.53%
Count dialogue tags
n/a
neededClean
false
dialogueTags
0
"the woman said"
1
"the baker said finally"