NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-10-09-01M4G09TDGSZDAKH7GAVT0HDYX
Run Details
Model:
Claude Haiku 5.5 (Reasoning, Low)
Test:
Dialogue tags
Scenario:
Write unattributed dialogue
Duration:
4.0s
Cost:
$0.000260
Provider:
Claude Platform on AWS
Evaluation summary
Score
Evaluator
Details Link
60.65%
Count dialogue tags
(details)
Model input
User/Human
You are an expert novel writer in the cozy mystery genre. Write a scene of about 200 words, with dialogue between two characters. The dialogue should be unattributed, meaning the speaker is not explicitly mentioned. The scene should be set in a small town bakery. Only return the story, nothing else.
Model response
Messages
Meta
AI
“You're late,”
Marjorie said
, not looking up from the proofing dough. “The cat knocked over my coffee again.” Bea shook rain from her umbrella and set it in the stand by the door. “Did you hear about the Fenwick ledger?” “Everyone heard. Ray Fenwick hasn’t shown his face at the bank since Tuesday.” “Then why was his car parked behind the church at six this morning?” “Maybe he likes the quiet.” “Nobody likes that church quiet, Marjorie.” A timer buzzed. Marjorie pulled out a tray of cinnamon rolls, glossy and steaming, and slid them onto the cooling rack. “Careful with that tone. You sound like you’ve already picked a culprit.” “I’ve picked a suspect. There’s a difference.” “Is there?” Bea leaned across the counter and lowered her voice. “His shoes were wet. Mud on the tread, and the lot was dry.” “Stop it. You’ve been reading those detective novels again.” “Someone has to.” A pause. “Did he buy anything this morning?” “Two loaves of rye and a black coffee. Paid in exact change.” “Exact change. Who does that unless they want to leave no trace?” “Oh, sit down before you wear a hole in my floor.” Bea didn’t sit. She was already staring at the bakery's back window, where a figure in a gray coat stood very still in the alley, watching them both.
created_at
"2026-10-09T09:35:55.319Z"
10/9/2026, 9:35:55 AM
model
"anthropic/claude-haiku-5.5-20261007"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
3995
moderation_latency
(null)
generation_time
3995
tokens_prompt
78
tokens_completion
357
native_tokens_prompt
109
native_tokens_completion
499
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"end_turn"
service_tier
"default"
usage
0.0002604
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1791538555-voPGYwGW5QsKHFGcAa0h"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1791538555-hhMBcpn5IQaDuxLeizPA"
upstream_id
"msg_011CfrSGgwDYcUdhgTS4QtfK"
provider_responses
0
endpoint_id
"b6cdf493-3a61-441f-a134-e7944fddb980"
id
"msg_011CfrSGgwDYcUdhgTS4QtfK"
is_byok
false
latency
748
model_permaslug
"anthropic/claude-haiku-5.5-20261007"
provider_name
"Claude Platform on AWS"
status
200
total_cost
0.0002604
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Claude Platform on AWS"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
60.65%
Count dialogue tags
n/a
neededClean
false
dialogueTags
0
"Marjorie said"