NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2024-07-24-01J3K1VJY8HVH9SSSDDA801X2F
Run Details
Model:
Mistral Large 2
Test:
Dialogue tags
Scenario:
Write 200 words with 10% dialogue
Duration:
6.4s
Cost:
$0.001920
Evaluation summary
Score
Evaluator
Details Link
27.17%
Matches word count
(details)
0.00%
Dialogue to Total Word Ratio
(details)
13.5829%
Overall
Model input
User/Human
You are a author of comedic heist books. Please write a 200 word scene that has 10% words of dialogue between two thieves named Molly and Bill who are planning to break into a children's party to steal all the presents. Only include the prose of the scene without any markdown or commentary.
Model response
Messages
Meta
AI
Molly and Bill huddled over a hastily sketched map of the party layout, their heads barely visible behind the steering wheel of their beat-up van. The sun hung low, casting a warm glow over the suburban neighborhood, their target a cheerful house with balloons tethered to the mailbox. "Alright, Bill," Molly whispered, her eyes scanning the map. "You'll be the lookout. There's a bounce house near the fence. Hide there and keep an eye on the parents." Bill scratched his stubbled chin, squinting at the map. "And what'll you be doing, Molly?" "I'll be the one stuffing my bag with presents," she replied, a mischievous grin spreading across her face. "We need to be quick. In and out before the cake's cut." Bill raised an eyebrow. "And if a kid catches you?" Molly chuckled, patting her pocket. "I've got a handful of candy canes for diversions. Now let's go make some kids cry." Bill sighed, shaking his head. "You're terrible, Molly." "And you love it," she shot back, opening the van door. "Now come on, we've got a party to crash."
total_cost
0.00192
Evaluation details
Result
Evaluator
Details
Meta Data
27.17%
Matches word count
n/a
neededClean
false
words
181
0.00%
Dialogue to Total Word Ratio
Ratio: 47.80%, Deviation: 37.80%
neededClean
false
wordsTotal
182
wordsDialogue
87
13.5829%