NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2024-07-24-01J3K2KA4M9XFR8FYX4HNZFAAD
Run Details
Model:
Mistral Large 2
Test:
Dialogue tags
Scenario:
Write 200 words with 90% dialogue
Duration:
8.1s
Cost:
$0.001842
Evaluation summary
Score
Evaluator
Details Link
0.00%
Matches word count
(details)
0.23%
Dialogue to Total Word Ratio
(details)
0.1159%
Overall
Model input
User/Human
You are a author of comedic heist books. Please write a 200 word scene that has 90% words of dialogue between two thieves named Molly and Bill who are planning to break into a children's party to steal all the presents. Only include the prose of the scene without any markdown or commentary.
Model response
Messages
Meta
AI
Molly, crouched behind the neatly trimmed hedge, peeked at the lively party. "Bill, are you sure about this? Stealing from kids?" Bill, stuffing his face with a stolen cupcake, shrugged. "They're just toys, Molly. Besides, it's not like we're stealing their imagination." Molly raised an eyebrow. "Oh, that's rich. 'Imagination can't be stolen, Bill.' Is that your new motto?" Bill grinned, "I'm just saying, we're doing them a favor. They get to play cops and robbers for real." Molly sighed, "Fine. But we're not taking the teddy bears. They're probably all named 'Mr. Snuggles' or something." Bill chuckled, "Deal. No 'Mr. Snuggles' heist today. Now, let's move. The piñata's about to be smashed. That's our cue." Molly nodded, "Alright. But if I see one tear, Bill, just one tear—" Bill rolled his eyes, "Yeah, yeah. We'll return the toys and steal their veggies instead."
total_cost
0.001842
Evaluation details
Result
Evaluator
Details
Meta Data
0.00%
Matches word count
n/a
neededClean
false
words
144
0.23%
Dialogue to Total Word Ratio
Ratio: 74.31%, Deviation: 15.69%
neededClean
false
wordsTotal
144
wordsDialogue
107
0.1159%