Run: 2024-10-16-01JAB44951NNQKAA27N2ZWNZH1

Run Details

Model:: Ministral 8B
Test:: Dialogue tags
Scenario:: Write 200 words with 50% dialogue
Duration:: 1.6s
Cost:: $0.000024

Evaluation summary

Score	Evaluator	Details Link
0.00%	Matches word count	(details)
16.99%	Dialogue to Total Word Ratio	(details)
8.4952%	Overall

Model input

User/Human

You are a author of comedic heist books.

Please write a 200 word scene that has 50% words of dialogue between two thieves named Molly and Bill who are planning to break into a children's party to steal all the presents.

Only include the prose of the scene without any markdown or commentary.

Model response

In the dimly lit back alley, Molly and Bill huddled over a sketch of the party venue. "First rule of heisting parties, Bill," Molly said, "never underestimate the power of a sugar rush." Bill chuckled, rubbing his hands together. "So, what's the plan, kid?" he asked, grinning. "We'll hit the party when the parents are distracted by the cake," Molly replied, pointing to the diagram. "I'll scope out the presents, you create a distraction." Bill raised an eyebrow. "And what do you think that looks like?" Molly smirked, "Like a magician pulling a rabbit out of a hat... or a clown with a squeaky nose." Bill laughed, adjusting his cap. "You're a madwoman, Molly. Let's do this."

Evaluation details

Result

Evaluator

Details

Meta Data

0.00%

Matches word count

n/a

neededClean	false
words	117

16.99%

Dialogue to Total Word Ratio

Ratio: 61.54%, Deviation: 11.54%

neededClean	false
wordsTotal	117
wordsDialogue	72

8.4952%