NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-09-29-01M3P2JEYRXJVTYDEGWZGCKCZT
Run Details
Model:
Claude Sonnet 5.5 (Reasoning)
Test:
Dialogue tags
Scenario:
Write 500 words with 70% dialogue
Duration:
18.2s
Cost:
$0.021430
Provider:
Claude Platform on AWS
Evaluation summary
Score
Evaluator
Details Link
0.00%
Matches word count
(details)
0.02%
Dialogue to Total Word Ratio
(details)
0.0101%
Overall
Model input
User/Human
You are a author of comedic heist books. Please write a 500 word scene that has 70% words of dialogue between two thieves named Molly and Bill who are planning to break into a children's party to steal all the presents. Only include the prose of the scene without any markdown or commentary.
Model response
Messages
Meta
AI
Molly crouched behind the hydrangeas with binoculars pressed to her face. Bill sat on an overturned bucket, sipping a juice box. "Where did you get that?" Molly whispered. "Lost and found at the bounce house place. Don't judge me." "We're casing a party, Bill, not attending one." "Technically we're doing both. Walk me through it." Molly lowered the binoculars. "Party starts at two. Twelve kids, one clown, one mother with the eyes of a hawk. The presents are stacked on the picnic table under a unicorn banner." "Unicorns," Bill said gravely. "They always have a guard." "There's no unicorn guard." "There's a guy in a unicorn costume." "That's the clown's brother-in-law. He's on break, and he's terrified of the neighbor's goose." "What goose?" "Don't worry about the goose. Worry about the piñata." "Why would I worry about a piñata?" "Because it's our distraction. At two-fifteen, they blindfold a seven-year-old and hand him a bat. Every adult in that yard will be watching, mostly out of fear. That's when you go in." "Me? Why me?" "Because you're wearing the rabbit costume." Bill stopped mid-sip. "I never agreed to a rabbit costume." "You're holding the rabbit head." "I thought it was a hat! A big, furry, horrifying hat!" "The rabbit is hired entertainment. Nobody questions a rabbit carrying a sack of gifts. They'll assume it's part of the show." "What's the show?" "Rabbit takes presents to the... gift place." "That's not a show, Molly." "It's a bit. Commit to the bit. Meanwhile, I'll be the caterer, swapping the cake for a decoy." "Why are we stealing the cake?" "We're not. I just want the frosting flowers. Those are handmade." Bill sighed. "Fine. Exit strategy?" "The van is parked around the corner, disguised as an ice cream truck." "Nice." "But it plays music, so it looks suspicious if we don't sell ice cream." "So we're selling ice cream." "Only as a cover. Kids will chase us, so we'll need a lot of cones." "So we're actually running an ice cream business." "Bill, focus. Any last questions?" He raised a paw. Somehow he'd already put the rabbit gloves on. "What if a kid cries?" Molly took a long, steady breath. "Then you hand them a cone and tell them the presents went to Rabbit Heaven." "That's dark." "That's the job." "And if the goose comes?" "There is no plan for the goose." "Molly!" "I told you, we don't talk about the goose." Bill stood, pulled the enormous rabbit head over his own, and spoke in a muffled voice. "How do I look?" Molly studied him for a long moment. "Like a nightmare with excellent posture." "Perfect," Bill said. "Let's go steal Christmas in June." "It's a birthday, Bill." "Then let's steal it even harder."
created_at
"2026-09-29T07:55:20.413Z"
9/29/2026, 7:55:20 AM
model
"anthropic/claude-sonnet-5.5-20260928"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
18196
moderation_latency
(null)
generation_time
18196
tokens_prompt
75
tokens_completion
902
native_tokens_prompt
95
native_tokens_completion
2124
native_tokens_completion_images
(null)
native_tokens_reasoning
1059
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"end_turn"
service_tier
"default"
usage
0.02143
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1790668520-qaiaAm5d81PzayeQAqHr"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1790668520-UiFZwX3soVPMgnIGeIQp"
upstream_id
"msg_011CfXNWgCfswDpkQgSwEB6R"
provider_responses
0
endpoint_id
"99aaad94-923b-4fc1-b763-271ed5486f7a"
id
"msg_011CfXNWgCfswDpkQgSwEB6R"
is_byok
false
latency
1748
model_permaslug
"anthropic/claude-sonnet-5.5-20260928"
provider_name
"Claude Platform on AWS"
status
200
total_cost
0.02143
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Claude Platform on AWS"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
0.00%
Matches word count
n/a
neededClean
false
words
460
0.02%
Dialogue to Total Word Ratio
Ratio: 83.05%, Deviation: 13.05%
neededClean
false
wordsTotal
466
wordsDialogue
387
0.0101%