NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-10-09-01M4G0NTVH6D20GPAT7QD3JG8T
Run Details
Model:
Claude Haiku 5.5 (Reasoning, Low)
Test:
Dialogue tags
Scenario:
Write unattributed dialogue
Duration:
3.5s
Cost:
$0.000222
Provider:
Claude Platform on AWS
Evaluation summary
Score
Evaluator
Details Link
1.11%
Count dialogue tags
(details)
Model input
User/Human
You are an expert novel writer in the cozy mystery genre. Write a scene of about 200 words, with dialogue between two characters. The dialogue should be unattributed, meaning the speaker is not explicitly mentioned. The scene should be set in a small town bakery. Only return the story, nothing else.
Model response
Messages
Meta
AI
"You're early,"
Mabel said
, not looking up from the tray of cinnamon rolls. "Nobody's early on a Tuesday." "Couldn't sleep. Kept thinking about the ledger." "Which ledger?" "The one in your back office. The one you told the sheriff you'd never seen." A pause. The rolling pin stopped. "You went through my things?" "I went through the flour bins, which is where you hid the envelope. Cash, Mabel. Three thousand dollars, marked with the bank's stamp." "Keep your voice down. Ruth's due any minute." "Ruth isn't the one who should be nervous." "Fine. Yes. I took it. Harold was going to sell the place out from under us. Nobody would have missed a little." "Harold's dead, Mabel." "I know he's dead. I'm the one who found him, remember?" "That's exactly what I can't stop thinking about. You found him at six, and the oven timer went off at six-fifteen, and you were already frosting." The bell over the door jingled. Neither of them moved. "Morning, ladies,"
a voice called
. "Smells divine in here." "Coffee's fresh, Sheriff,"
Mabel said
, very brightly. "Have a seat. We were just talking."
created_at
"2026-10-09T09:42:28.986Z"
10/9/2026, 9:42:28 AM
model
"anthropic/claude-haiku-5.5-20261007"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
723
moderation_latency
(null)
generation_time
3491
tokens_prompt
78
tokens_completion
283
native_tokens_prompt
109
native_tokens_completion
423
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"end_turn"
service_tier
"default"
usage
0.0002224
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1791538948-X0PB5THgXoOXfRK2amqG"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1791538948-05u6f0HmYmdYKp1pyIi3"
upstream_id
"msg_011CfrSmiBCEHGVdgUvyiTXd"
provider_responses
0
endpoint_id
"b6cdf493-3a61-441f-a134-e7944fddb980"
id
"msg_011CfrSmiBCEHGVdgUvyiTXd"
is_byok
false
latency
723
model_permaslug
"anthropic/claude-haiku-5.5-20261007"
provider_name
"Claude Platform on AWS"
status
200
total_cost
0.0002224
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Claude Platform on AWS"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
1.11%
Count dialogue tags
n/a
neededClean
false
dialogueTags
0
"Mabel said"
1
"a voice called"
2
"Mabel said"