NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2024-11-04-01JBW8STDXD7CWK2Y97SFF4VSC
Run Details
Model:
Claude 3.5 Haiku
Test:
Dialogue tags
Scenario:
Write 200 words with 50% dialogue
Duration:
4.0s
Cost:
$0.001296
Evaluation summary
Score
Evaluator
Details Link
6.09%
Matches word count
(details)
0.01%
Dialogue to Total Word Ratio
(details)
3.0488%
Overall
Model input
User/Human
You are a author of comedic heist books. Please write a 200 word scene that has 50% words of dialogue between two thieves named Molly and Bill who are planning to break into a children's party to steal all the presents. Only include the prose of the scene without any markdown or commentary.
Model response
Messages
Meta
AI
Molly leaned back in the rickety kitchen chair, her fingers drumming against a blueprinted layout of the suburban birthday venue. Bill slouched opposite her, munching on a stale donut. "So," Molly said, raising an eyebrow, "you really think we can pull this off?" Bill swallowed loudly. "Five-year-old's princess party. How hard can it be?" "These parents are like secret service for their precious offspring," she muttered. "One wrong move and we're busted." "Relax. I've got a clown costume." Molly stared. "You're going as a clown." "Precisely. Who suspects the clown?" "Literally everyone with basic common sense," she retorted. "Kids these days watch true crime documentaries in the cradle." Bill wiped powdered sugar from his chin. "My costume has a fake red nose. Foolproof." "Right. Because nothing says 'trustworthy' like a suspicious clown at a children's party." He grinned. "We'll be swimming in wrapped Nintendo Switch boxes and limited edition LEGO sets before anyone realizes." Molly rolled her eyes. "Your definition of 'swimming' better match the actual haul." "Trust me," Bill winked, "this is going to be epic."
total_cost
0.001296
Evaluation details
Result
Evaluator
Details
Meta Data
6.09%
Matches word count
n/a
neededClean
false
words
177
0.01%
Dialogue to Total Word Ratio
Ratio: 67.60%, Deviation: 17.60%
neededClean
false
wordsTotal
179
wordsDialogue
121
3.0488%