NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2024-11-04-01JBW8WH034TPYB3WECP5GA7VK
Run Details
Model:
Claude 3.5 Haiku
Test:
Dialogue tags
Scenario:
Write 200 words with 90% dialogue
Duration:
5.0s
Cost:
$0.001224
Evaluation summary
Score
Evaluator
Details Link
0.00%
Matches word count
(details)
0.00%
Dialogue to Total Word Ratio
(details)
0.0000%
Overall
Model input
User/Human
You are a author of comedic heist books. Please write a 200 word scene that has 90% words of dialogue between two thieves named Molly and Bill who are planning to break into a children's party to steal all the presents. Only include the prose of the scene without any markdown or commentary.
Model response
Messages
Meta
AI
"Seriously, Bill? A kids' birthday party?" "Don't judge, Molly. Birthday presents are basically un-marked cash." "We look like pedophiles in this scenario." "We look like party entertainers. Big difference." "You brought a clown costume." "Exactly. Professional cover." Molly rolled her eyes and spread the floor plan across the dashboard. Red marker traced potential entry points, her fingernail tapping a back window. "Security system?" "Parents always disable it during parties. Too many guests." "How many kids?" "Twelve. Third-grade sugar monsters." "Your intel?" "My cousin's a elementary school janitor. Whole family's at the community center for some fundraiser." "The presents?" Bill grinned, pulling out a folded photograph. "Wrapped. Stacked. Right by the dining room. One grab-and-go operation." "Minimum thirty grand in toys and electronics," Molly calculated. "Plus whatever cash is in the cards." She adjusted her fake mustache. "This is the most ridiculous heist we've ever planned." "That's why it'll work." The clown van rolled silently toward suburban paradise, packed with zipties and oversized shoes.
total_cost
0.001224
Evaluation details
Result
Evaluator
Details
Meta Data
0.00%
Matches word count
n/a
neededClean
false
words
163
0.00%
Dialogue to Total Word Ratio
Ratio: 68.67%, Deviation: 21.33%
neededClean
false
wordsTotal
166
wordsDialogue
114
0.0000%