NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2024-07-24-01J3K1HPVEGQTG1KECA6TMDH6R
Run Details
Model:
Mistral Large 2
Test:
Dialogue tags
Scenario:
Write 200 words with 90% dialogue
Duration:
7.5s
Cost:
$0.001800
Evaluation summary
Score
Evaluator
Details Link
0.00%
Matches word count
(details)
47.55%
Dialogue to Total Word Ratio
(details)
23.7731%
Overall
Model input
User/Human
You are a author of comedic heist books. Please write a 200 word scene that has 90% words of dialogue between two thieves named Molly and Bill who are planning to break into a children's party to steal all the presents. Only include the prose of the scene without any markdown or commentary.
Model response
Messages
Meta
AI
Molly, sprawled on the couch, glanced at the party invitation. "Bill, this is genius. Who plans a kid's party at the Mayor's mansion? Presents galore!" Bill, polishing his glasses, smirked. "Exactly, Molly. Rich kids mean expensive toys. We'll be in and out, quick as a magic trick." "But Bill," Molly frowned, "kids? Really?" "Think of it as... redistributing wealth. Besides, we'll leave them something fun in return." Molly raised an eyebrow. "Like what? A 'Sorry we robbed you' note?" Bill chuckled, "Better. I've got a bag of whoopee cushions and joy buzzers. They'll think it's all part of the party games." Molly laughed, "You're terrible. I love it. Alright, what's the plan?" "Dress as clowns, blend in, swap the gifts, and vanish. Easy peasy." Molly grimaced. "Clowns, Bill? Really?" "Hey, it's not a party until someone's scared of the clowns."
total_cost
0.0018
Evaluation details
Result
Evaluator
Details
Meta Data
0.00%
Matches word count
n/a
neededClean
false
words
140
47.55%
Dialogue to Total Word Ratio
Ratio: 80.71%, Deviation: 9.29%
neededClean
false
wordsTotal
140
wordsDialogue
113
23.7731%