NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2024-10-16-01JAB55KKGHQJBN9X1GDYQWRKF
Run Details
Model:
Ministral 3B
Test:
Dialogue tags
Scenario:
Write 200 words with 90% dialogue
Duration:
1.4s
Cost:
$0.000011
Evaluation summary
Score
Evaluator
Details Link
0.00%
Matches word count
(details)
30.28%
Dialogue to Total Word Ratio
(details)
15.1413%
Overall
Model input
User/Human
You are a author of comedic heist books. Please write a 200 word scene that has 90% words of dialogue between two thieves named Molly and Bill who are planning to break into a children's party to steal all the presents. Only include the prose of the scene without any markdown or commentary.
Model response
Messages
Meta
AI
Bill, adjusting his glasses, looked at the invitation. "Aren't you afraid of the kids, Molly? They might cry and stuff." Molly smirked, "Oh, Bill, you're so dramatic. Besides, we're not here for the presents. We're here for the presents." Bill raised an eyebrow. "Then why are we breaking into a children's party? They're just little kids." Molly grinned, "Exactly. They won't expect it. And besides, who's gonna cry when they see us with their presents?" Bill sighed, "You're right. But what about the parents? Won't they be pissed?" Molly chuckled, "Pissed? Oh, Bill. You always think too much. We'll be in and out before they even notice." Bill nodded, adjusting his gloves. "Alright, let's do this. But if anyone cries, it's on you, Molly." Molly laughed. "Deal. Now, let's get these presents."
total_cost
0.0000112
Evaluation details
Result
Evaluator
Details
Meta Data
0.00%
Matches word count
n/a
neededClean
false
words
132
30.28%
Dialogue to Total Word Ratio
Ratio: 79.55%, Deviation: 10.45%
neededClean
false
wordsTotal
132
wordsDialogue
105
15.1413%