NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2024-11-04-01JBW8TBX1ZZMDNPSX2HYJD52T
Run Details
Model:
Claude 3.5 Haiku
Test:
Dialogue tags
Scenario:
Write 200 words with 90% dialogue
Duration:
4.3s
Cost:
$0.001268
Evaluation summary
Score
Evaluator
Details Link
0.08%
Matches word count
(details)
38.47%
Dialogue to Total Word Ratio
(details)
19.2770%
Overall
Model input
User/Human
You are a author of comedic heist books. Please write a 200 word scene that has 90% words of dialogue between two thieves named Molly and Bill who are planning to break into a children's party to steal all the presents. Only include the prose of the scene without any markdown or commentary.
Model response
Messages
Meta
AI
"I'm telling you, Bill, this is the easiest score we've ever planned," Molly whispered, spreading out a crude sketch of the child's birthday party layout. Bill scratched his beard. "A kids' party? Really?" "Think about it. Distracted parents, piles of wrapped gifts, chaos everywhere," she grinned. "Those presents are practically begging to be lifted." "We're stealing from a bunch of eight-year-olds?" Bill raised an eyebrow. "Not stealing. Redistributing," Molly winked. "Besides, these look like upper-middle-class gifts. Probably electronics, collector's items, maybe some vintage stuff parents buy for investment." Bill sighed. "I can't believe we're discussing this seriously." "The cake will be a perfect distraction. Kids go nuts for cake. While everyone's singing 'Happy Birthday', we slip in, grab the gifts, and vanish." "And if we get caught?" "We're wearing party-appropriate disguises. I'll be a distant aunt, you're the family photographer." Bill shook his head. "This is the most ridiculous heist we've ever planned." Molly smirked. "That's what makes it brilliant." "Fine," Bill muttered. "But I get first pick of the loot."
total_cost
0.001268
Evaluation details
Result
Evaluator
Details
Meta Data
0.08%
Matches word count
n/a
neededClean
false
words
171
38.47%
Dialogue to Total Word Ratio
Ratio: 80.11%, Deviation: 9.89%
neededClean
false
wordsTotal
176
wordsDialogue
141
19.2770%