NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2024-07-24-01J3K28QNTRTZK3CM97X84JCJV
Run Details
Model:
Mistral Large 2
Test:
Dialogue tags
Scenario:
Write 200 words with 90% dialogue
Duration:
7.7s
Cost:
$0.001950
Evaluation summary
Score
Evaluator
Details Link
0.00%
Matches word count
(details)
98.89%
Dialogue to Total Word Ratio
(details)
49.4442%
Overall
Model input
User/Human
You are a author of comedic heist books. Please write a 200 word scene that has 90% words of dialogue between two thieves named Molly and Bill who are planning to break into a children's party to steal all the presents. Only include the prose of the scene without any markdown or commentary.
Model response
Messages
Meta
AI
Molly: "A children's party, Bill? Really? We're stealing from kids now?" Bill: "It's not about the kids, Molly. It's about the presents. Parents these days, they drop a fortune on these parties." Molly: "But it's a princess party. We'll stick out like sore thumbs." Bill: "Nah, we'll blend in. I've got it all planned. You'll be the evil stepmother and I'll be the jester." Molly: "Evil stepmother? Thanks a lot." Bill: "Hey, it's a classic role. Besides, you get to wear a fancy dress." Molly: "And how do you plan on getting away with all those presents?" Bill: "Easy. We'll use the piƱata as a decoy. When the kids are busy whacking it, we'll make our move." Molly: "You've thought of everything, haven't you?" Bill: "That's why they call me 'The Brain'... Well, no one calls me that, but they should." Molly: "Alright, let's do it. But if I end up with a face full of cake, you're paying for the dry cleaning."
total_cost
0.00195
Evaluation details
Result
Evaluator
Details
Meta Data
0.00%
Matches word count
n/a
neededClean
false
words
163
98.89%
Dialogue to Total Word Ratio
Ratio: 93.25%, Deviation: 3.25%
neededClean
false
wordsTotal
163
wordsDialogue
152
49.4442%