NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2024-11-04-01JBW8KQ5H8GK5XR8HG6FCMEZY
Run Details
Model:
Claude 3.5 Haiku
Test:
Dialogue tags
Scenario:
Write 200 words with 50% dialogue
Duration:
4.5s
Cost:
$0.001216
Evaluation summary
Score
Evaluator
Details Link
3.62%
Matches word count
(details)
1.63%
Dialogue to Total Word Ratio
(details)
2.6251%
Overall
Model input
User/Human
You are a author of comedic heist books. Please write a 200 word scene that has 50% words of dialogue between two thieves named Molly and Bill who are planning to break into a children's party to steal all the presents. Only include the prose of the scene without any markdown or commentary.
Model response
Messages
Meta
AI
Molly leaned back in the rickety kitchen chair, twirling a lockpick between her fingers. Bill adjusted his tactical vest, covered in cartoon unicorn patches. "You really think this is going to work?" Bill asked, skeptical. Molly grinned. "Birthday parties are the ultimate score. Parents are distracted, kids are hyped on sugar, and presents are just sitting there unwrapped." Bill scratched his beard. "We're stealing from a six-year-old's birthday party. This feels wrong." "Wrong? These are top-tier designer toys. That Lego set alone is worth three grand on the black market," Molly countered. "Who buys stolen Lego sets?" Bill muttered. "Collectors. Scalpers. People with more money than sense." She pulled out a detailed floor plan. "We'll enter through the back door during the pinata moment. Maximum chaos, minimum resistance." Bill sighed. "I used to be a professional safe cracker. Now I'm doing kiddie party heists." "Think of it as diversifying our criminal portfolio," Molly winked. He rolled his eyes. "That's one way to put it." The plan was ridiculous. It was also probably going to work perfectly.
total_cost
0.001216
Evaluation details
Result
Evaluator
Details
Meta Data
3.62%
Matches word count
n/a
neededClean
false
words
176
1.63%
Dialogue to Total Word Ratio
Ratio: 64.25%, Deviation: 14.25%
neededClean
false
wordsTotal
179
wordsDialogue
115
2.6251%