NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2024-07-24-01J3K26VY0G935RKRBZN4Y1QT3
Run Details
Model:
Mistral Large 2
Test:
Dialogue tags
Scenario:
Write 200 words with 50% dialogue
Duration:
6.5s
Cost:
$0.001830
Evaluation summary
Score
Evaluator
Details Link
0.00%
Matches word count
(details)
1.81%
Dialogue to Total Word Ratio
(details)
0.9067%
Overall
Model input
User/Human
You are a author of comedic heist books. Please write a 200 word scene that has 50% words of dialogue between two thieves named Molly and Bill who are planning to break into a children's party to steal all the presents. Only include the prose of the scene without any markdown or commentary.
Model response
Messages
Meta
AI
Molly, stuffed into a tiny pink polka-dotted car, scowled at the oversized clown head resting on Bill's lap. "You sure about this, Bill? A children's party?" Bill adjusted the fake red nose, grinning. "Molly, my dear, it's genius. Who suspects a clown and his lovely assistant?" "But stealing presents? That's low, even for us." Molly sighed, flicking a stray pompom on her costume. "Think of it as... redistributing joy." Bill chuckled, patting the clown head. "Besides, these are no ordinary presents. Diamond-crusted yo-yos, solid gold building blocks—these kids are loaded!" Molly raised an eyebrow. "And how do you plan to carry out these 'redistributions' without causing a riot?" Bill's grin widened. "Easy. We replace them with identical, but considerably less valuable, replicas. The kiddies are none the wiser, and we make off like bandits. Literally." Molly rolled her eyes but couldn't suppress a smirk. "Only you, Bill, could turn a kids' party into a heist."
total_cost
0.00183
Evaluation details
Result
Evaluator
Details
Meta Data
0.00%
Matches word count
n/a
neededClean
false
words
156
1.81%
Dialogue to Total Word Ratio
Ratio: 64.15%, Deviation: 14.15%
neededClean
false
wordsTotal
159
wordsDialogue
102
0.9067%