NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2025-02-24-01JMX0JVDV8VC8RXXZDJ1MRV8F
Run Details
Model:
Claude 3.7 Sonnet
Test:
Dialogue tags
Scenario:
Write 200 words with 10% dialogue
Duration:
6.3s
Cost:
$0.004530
Provider:
Anthropic
Evaluation summary
Score
Evaluator
Details Link
2.01%
Matches word count
(details)
0.00%
Dialogue to Total Word Ratio
(details)
1.0058%
Overall
Model input
User/Human
You are a author of comedic heist books. Please write a 200 word scene that has 10% words of dialogue between two thieves named Molly and Bill who are planning to break into a children's party to steal all the presents. Only include the prose of the scene without any markdown or commentary.
Model response
Messages
Meta
AI
The dingy apartment buzzed with nervous energy as Molly paced in front of the corkboard, photos of the GarcĂa residence pinned meticulously beside a child's birthday invitation. "A six-year-old's birthday party? Seriously?" Bill slouched on the threadbare couch, flipping a coin between his fingers. Molly tapped the invitation. "Fifteen kids means thirty presents minimum. Rich neighborhood. Do the math." Bill sighed, catching the coin mid-flip. "We've hit jewelry stores and art galleries, now we're stealing stuffed animals?" "And gaming consoles, tablets, and whatever else bougie parents buy to outdo each other." Molly sketched a crude diagram of the backyard. "We slip in during the clown act. Everyone's distracted." Outside, rain streaked the windows as Bill moved beside her, studying the layout. His fingers traced the penciled route to the gift table. "The things we do when we're broke," he muttered, shaking his head. Molly's lips curled into a smile. "Just think of us as reverse Santa Claus." "In May?" "Nobody expects reverse Santa in May." She tossed him a ski mask. "That's our competitive advantage."
id
"gen-1740435451-AIYn56mePvjUDgqbwjej"
upstream_id
"msg_01YRv7BoT13V3y7ovt5ub7jD"
total_cost
0.00453
cache_discount
(null)
provider_name
"Anthropic"
created_at
"2025-02-24T22:17:37.987455+00:00"
2/24/2025, 10:17:37 PM
model
"anthropic/claude-3-7-sonnet-20250219:beta"
app_id
182717
streamed
true
cancelled
false
latency
362
moderation_latency
(null)
generation_time
5369
tokens_prompt
68
tokens_completion
241
native_tokens_prompt
75
native_tokens_completion
287
native_tokens_reasoning
0
num_media_prompt
(null)
num_media_completion
(null)
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.00453
Evaluation details
Result
Evaluator
Details
Meta Data
2.01%
Matches word count
n/a
neededClean
false
words
175
0.00%
Dialogue to Total Word Ratio
Ratio: 44.94%, Deviation: 34.94%
neededClean
false
wordsTotal
178
wordsDialogue
80
1.0058%