NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2024-07-19-01J35T5JJ3NTKJV2MJWSTKTKT1
Run Details
Model:
Claude 3.5 Sonnet
Test:
Dialogue tags
Scenario:
Write 200 words with 10% dialogue
Duration:
24.7s
Cost:
$0.004800
Provider:
Anthropic
Evaluation summary
Score
Evaluator
Details Link
27.17%
Matches word count
(details)
58.17%
Dialogue to Total Word Ratio
(details)
42.6696%
Overall
Model input
User/Human
You are a author of comedic heist books. Please write a 200 word scene that has 10% words of dialogue between two thieves named Molly and Bill who are planning to break into a children's party to steal all the presents. Only include the prose of the scene without any markdown or commentary.
Model response
Messages
Meta
AI
Molly and Bill huddled behind a cluster of balloons, eyeing the mountain of colorfully wrapped presents across the backyard. The sound of children's laughter and off-key singing drifted through the air, punctuated by the occasional pop of a party favor. "You sure about this, Molly?" Bill whispered, fidgeting with his fake mustache. Molly rolled her eyes. "Of course I'm sure. It's foolproof." They watched as a clown stumbled past, juggling rubber chickens and eliciting squeals of delight from the young partygoers. "But what if we get caught?" Bill's voice quivered. "We won't," Molly hissed. "Now shut up and act natural." The pair inched closer to their target, ducking behind a table laden with half-eaten cake and melting ice cream. Molly's eyes gleamed as she surveyed the stack of gifts, mentally calculating their potential value. "On three," she muttered. "One... two..." Suddenly, a small boy appeared before them, chocolate smeared across his face. He stared at the duo with wide eyes. "Are you the backup clowns?" he asked innocently. Molly and Bill exchanged panicked glances, their carefully laid plans crumbling around them.
id
"gen-YWMd0WxKLS2x32hmZYX5OT6NPhMq"
total_cost
0.0048
upstream_id
"msg_01AdGjxELteTsTNy1RxoyBJ3"
created_at
"2024-07-19T15:36:26.754231+00:00"
7/19/2024, 3:36:26 PM
model
"anthropic/claude-3.5-sonnet:beta"
app_id
182717
streamed
false
cancelled
false
provider_name
"Anthropic"
latency
24625
moderation_latency
(null)
generation_time
0
finish_reason
"end_turn"
tokens_prompt
68
tokens_completion
253
native_tokens_prompt
75
native_tokens_completion
305
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.0048
Evaluation details
Result
Evaluator
Details
Meta Data
27.17%
Matches word count
n/a
neededClean
false
words
181
58.17%
Dialogue to Total Word Ratio
Ratio: 18.58%, Deviation: 8.58%
neededClean
false
wordsTotal
183
wordsDialogue
34
42.6696%