Run: 2024-10-16-01JAB3X8990Q9WFZAB8MJGPCZG

Run Details

Model:: Ministral 8B
Test:: Dialogue tags
Scenario:: Write 200 words with 90% dialogue
Duration:: 2.6s
Cost:: $0.000034

Evaluation summary

Score	Evaluator	Details Link
2.01%	Matches word count	(details)
99.03%	Dialogue to Total Word Ratio	(details)
50.5203%	Overall

Model input

User/Human

You are a author of comedic heist books.

Please write a 200 word scene that has 90% words of dialogue between two thieves named Molly and Bill who are planning to break into a children's party to steal all the presents.

Only include the prose of the scene without any markdown or commentary.

Model response

Molly: "Bill, you're sure this is the perfect target?"

Bill: "Absolutely, Mol. It's a little kid's party. They'll be too busy with cake and games to notice us."

Molly: "But what about the parents?"

Bill: "They'll be dealing with their own types of chaos. Besides, we've got the Mothman's Cloak. We'll be invisible as ghosts."

Molly: "And if we get caught?"

Bill: "Then we'll play it off as a prank. 'It's just a bit of harmless fun, officers!'"

Molly: "And if we get spotted before we're gone?"

Bill: "Then we'll improvise. I'll be the crying child, you'll be the concerned parent. We'll blend right in."

Molly: "You know, for a heist, this plan is surprisingly... wholesome."

Bill: "Well, it's not like we're going to hurt anyone, Mol. Just take some stuff and run. Besides, we're doing it for the greater good. Think about all the presents going to good homes."

Molly: "Alright, Bill. Let's do this. But if I see one more toy car, I'm out."

Bill: "Deal. Now let's go make some magic happen."

Evaluation details

Result

Evaluator

Details

Meta Data

2.01%

Matches word count

n/a

neededClean	false
words	175

99.03%

Dialogue to Total Word Ratio

Ratio: 93.14%, Deviation: 3.14%

neededClean	false
wordsTotal	175
wordsDialogue	163

50.5203%