NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-10-08-01M4DABSAM9RXNGNV1T63X6BVW
Run Details
Model:
Claude Haiku 5.5 (Reasoning, Medium)
Test:
Dialogue tags
Scenario:
Write unattributed dialogue
Duration:
3.2s
Cost:
$0.000209
Provider:
Claude Platform on AWS
Evaluation summary
Score
Evaluator
Details Link
0.03%
Count dialogue tags
(details)
Model input
User/Human
You are an expert novel writer in the cozy mystery genre. Write a scene of about 200 words, with dialogue between two characters. The dialogue should be unattributed, meaning the speaker is not explicitly mentioned. The scene should be set in a small town bakery. Only return the story, nothing else.
Model response
Messages
Meta
AI
"You're out of cinnamon rolls again,"
Mabel said
, peering into the empty glass case. "Somebody bought the last dozen before opening." Thea wiped flour from her hands onto her apron. "Did you see who?" "Gray coat. Hat pulled low. Paid in exact change." "Nobody pays in exact change anymore." "Exactly." Thea reached beneath the counter and pulled out a crumpled receipt, smudged with blueberry jam. "Found this in the register drawer. Someone wrote on the back." "Read it." "'Meet me at the mill after the bell. Bring what you owe.'" Mabel leaned closer. "Who signs a note like that?" "Someone who expected the baker to be too busy to notice." The bell above the door jingled. Both women turned. A man in a gray coat stood in the doorway, hat in hand, eyes fixed on the empty case. "Morning,"
he said
. "Heard you had cinnamon rolls." "We did,"
Thea said slowly
. "Funny thing about those." "Funny,"
Mabel agreed
, sliding the receipt into her pocket. "Sit down. We'll find you something sweet."
created_at
"2026-10-08T08:34:02.203Z"
10/8/2026, 8:34:02 AM
model
"anthropic/claude-haiku-5.5-20261007"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
684
moderation_latency
(null)
generation_time
3192
tokens_prompt
78
tokens_completion
259
native_tokens_prompt
109
native_tokens_completion
396
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"end_turn"
service_tier
"default"
usage
0.0002089
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1791448442-yoaOL0ECTa676py2idiM"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1791448442-CrZoU1Y9zUu0Tx2FxF0p"
upstream_id
"msg_011CfpTk4fYEVtCg3Nze2N4g"
provider_responses
0
endpoint_id
"b6cdf493-3a61-441f-a134-e7944fddb980"
id
"msg_011CfpTk4fYEVtCg3Nze2N4g"
is_byok
false
latency
684
model_permaslug
"anthropic/claude-haiku-5.5-20261007"
provider_name
"Claude Platform on AWS"
status
200
total_cost
0.0002089
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Claude Platform on AWS"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
0.03%
Count dialogue tags
n/a
neededClean
false
dialogueTags
0
"Mabel said"
1
"he said"
2
"Thea said slowly"
3
"Mabel agreed"