NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-10-08-01M4DZ2F0JV4X5F56H8HP9EY65
Run Details
Model:
Claude Haiku 5.5 (Reasoning, Low)
Test:
Dialogue tags
Scenario:
Write unattributed dialogue
Duration:
3.9s
Cost:
$0.000220
Provider:
Claude Platform on AWS
Evaluation summary
Score
Evaluator
Details Link
60.65%
Count dialogue tags
(details)
Model input
User/Human
You are an expert novel writer in the cozy mystery genre. Write a scene of about 200 words, with dialogue between two characters. The dialogue should be unattributed, meaning the speaker is not explicitly mentioned. The scene should be set in a small town bakery. Only return the story, nothing else.
Model response
Messages
Meta
AI
"You're late,"
Marigold said
, not looking up from the tray of cinnamon rolls. "The sign on Elm Street said Sweet Pea Bakery closed at six. It's six-fifteen." "Then you should have knocked louder. I heard you the first time." "I did knock. Twice. Nobody answered." "Well, I was busy." Flour dusted the counter like fresh snow. "Did you bring the envelope?" "Depends. Did you bake the lemon tarts for Mrs. Petrie's funeral luncheon?" "Of course. They're in the cooler, same as always." "Only they're not. I checked." A pause. The oven timer ticked. "Then someone moved them." "Or someone who knows your kitchen better than you think." "Don't be ridiculous. Only the staff have keys." "Exactly. And the staff is you, me, and that nervous boy who washes dishes." "Tomas wouldn't." "No? Then tell me why there's a smear of blueberry jam on the back door handle, and why it's still warm from the oven." Silence settled between them, thick as frosting. "Fine," came the reply, quieter now. "Pour us both some coffee. And lock the front door. This is going to take a while."
created_at
"2026-10-08T14:35:56.839Z"
10/8/2026, 2:35:56 PM
model
"anthropic/claude-haiku-5.5-20261007"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
849
moderation_latency
(null)
generation_time
3866
tokens_prompt
78
tokens_completion
279
native_tokens_prompt
109
native_tokens_completion
418
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"end_turn"
service_tier
"default"
usage
0.0002199
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1791470156-ZbEyImQ6rU0pArnbYRj8"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1791470156-sb9iLnJNeFxjrvKJ77W1"
upstream_id
"msg_011CfpwLkZykaC9QCbq3uxYe"
provider_responses
0
endpoint_id
"b6cdf493-3a61-441f-a134-e7944fddb980"
id
"msg_011CfpwLkZykaC9QCbq3uxYe"
is_byok
false
latency
849
model_permaslug
"anthropic/claude-haiku-5.5-20261007"
provider_name
"Claude Platform on AWS"
status
200
total_cost
0.0002199
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Claude Platform on AWS"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
60.65%
Count dialogue tags
n/a
neededClean
false
dialogueTags
0
"Marigold said"