NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-10-08-01M4E18MGZ5P31VPVG35V3ZCYZ
Run Details
Model:
Claude Haiku 5.5 (Reasoning, Low)
Test:
Dialogue tags
Scenario:
Write unattributed dialogue
Duration:
3.7s
Cost:
$0.000198
Provider:
Claude Platform on AWS
Evaluation summary
Score
Evaluator
Details Link
60.65%
Count dialogue tags
(details)
Model input
User/Human
You are an expert novel writer in the cozy mystery genre. Write a scene of about 200 words, with dialogue between two characters. The dialogue should be unattributed, meaning the speaker is not explicitly mentioned. The scene should be set in a small town bakery. Only return the story, nothing else.
Model response
Messages
Meta
AI
"You're late,"
Maggie said
, not looking up from the tray of cinnamon rolls. "The rain started early. Half of Elm Street flooded." A pause, then the bell over the door jingled again. "Is that the good flour?" "Is there any other kind? Hand me the sifter." "Here. Did you hear about Walter Finch?" "Everyone's heard. They found him in the back of the hardware store, bread knife still in the drawer where he kept it." "Bread knife? Maggie, that's our knife." "It's the one missing from the rack since Tuesday. I noticed it this morning." "Then someone in this kitchen is lying, or someone was in here after close." "Or someone wants us to think so." A tap of a spoon against the rim of a bowl. "Walter came in every Friday for a cherry turnover. He never once paid in full." "He always left a dollar extra in the jar, though." "Did he? Check the jar, then." A long silence. The oven timer began to tick. "Maggie. The jar's empty." "Then we'd better start asking who else knew Walter liked his turnovers warm."
created_at
"2026-10-08T15:14:16.235Z"
10/8/2026, 3:14:16 PM
model
"anthropic/claude-haiku-5.5-20261007"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
3713
moderation_latency
(null)
generation_time
3713
tokens_prompt
78
tokens_completion
262
native_tokens_prompt
109
native_tokens_completion
374
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"end_turn"
service_tier
"default"
usage
0.0001979
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1791472456-hey0mbQ3noinACqJZ3Zi"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1791472456-qjBdFEBfZgW5lSlNNcNd"
upstream_id
"msg_011CfpzGFErgbsSBBe4wqWLz"
provider_responses
0
endpoint_id
"b6cdf493-3a61-441f-a134-e7944fddb980"
id
"msg_011CfpzGFErgbsSBBe4wqWLz"
is_byok
false
latency
727
model_permaslug
"anthropic/claude-haiku-5.5-20261007"
provider_name
"Claude Platform on AWS"
status
200
total_cost
0.0001979
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Claude Platform on AWS"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
60.65%
Count dialogue tags
n/a
neededClean
false
dialogueTags
0
"Maggie said"