NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2024-11-04-01JBW8TT3SZ07VK6VHKYDYGVVT
Run Details
Model:
Claude 3.5 Haiku
Test:
Dialogue tags
Scenario:
Write 200 words with 50% dialogue
Duration:
4.2s
Cost:
$0.001240
Evaluation summary
Score
Evaluator
Details Link
0.01%
Matches word count
(details)
99.99%
Dialogue to Total Word Ratio
(details)
50.0021%
Overall
Model input
User/Human
You are a author of comedic heist books. Please write a 200 word scene that has 50% words of dialogue between two thieves named Molly and Bill who are planning to break into a children's party to steal all the presents. Only include the prose of the scene without any markdown or commentary.
Model response
Messages
Meta
AI
Molly spread out the blueprints of the suburban house across the kitchen table, her finger tracing the layout with surgical precision. Bill leaned back in his chair, sipping coffee and raising an eyebrow. "A kids' birthday party? Really?" Bill asked, a smirk playing at the corner of his mouth. Molly rolled her eyes. "Don't underestimate the haul. These upper-middle-class parents go nuts with gifts." "How are we getting past the parents?" "Bouncy castle distraction," she said, tapping a point on the diagram. "While everyone's watching little Timmy do backflips, we'll slip inside." Bill chuckled. "You're saying we're going to rob a bunch of six-year-olds?" "Not rob. Redistribute expensive toys to a more deserving cause. Us." Molly winked. "Classy," Bill muttered. "What's the exit strategy?" "Dressed as party entertainers. Magician and balloon artist. Complete with fake mustaches." Bill took another swig of coffee. "This is either brilliance or complete madness." "Why not both?" Molly grinned, sliding a detailed costume sketch across the table. The plan was ridiculous. It was perfect.
total_cost
0.00124
Evaluation details
Result
Evaluator
Details
Meta Data
0.01%
Matches word count
n/a
neededClean
false
words
169
99.99%
Dialogue to Total Word Ratio
Ratio: 50.87%, Deviation: 0.87%
neededClean
false
wordsTotal
173
wordsDialogue
88
50.0021%