Run: 2024-10-16-01JAB3XKD9M8RHFV6X52G0TDCP

Run Details

Model:: Ministral 3B
Test:: Dialogue tags
Scenario:: Write 200 words with 90% dialogue
Duration:: 1.3s
Cost:: $0.000011

Evaluation summary

Score	Evaluator	Details Link
0.00%	Matches word count	(details)
36.79%	Dialogue to Total Word Ratio	(details)
18.3940%	Overall

Model input

User/Human

You are a author of comedic heist books.

Please write a 200 word scene that has 90% words of dialogue between two thieves named Molly and Bill who are planning to break into a children's party to steal all the presents.

Only include the prose of the scene without any markdown or commentary.

Model response

"Bill, you sure about this? It's not exactly the most 'adult' job."

"Molly, we've been breaking into pawn shops for a month. This is a walk in the park. Besides, who's going to think about presents on Christmas Eve?"

"Nobody, that's who. But what if they notice the presents are gone?"

"Then we'll say we're Santa's elves. They'll never see it coming."

"You better be right about that. We've got a lot riding on this."

"Don't worry, Molly. I've got a plan. It's a little... unconventional."

"And, by 'a little unconventional,' you mean 'we're going to get arrested'?"

"I've got a van down the street. We can make it look like we're cleaning up after the party."

"Bill, you're a genius. And I love you."

"And I love you. Now, let's get to work. Santa's not going to deliver this presents himself."

Evaluation details

Result

Evaluator

Details

Meta Data

0.00%

Matches word count

n/a

neededClean	false
words	142

36.79%

Dialogue to Total Word Ratio

Ratio: 100.00%, Deviation: 10.00%

neededClean	false
wordsTotal	142
wordsDialogue	142

18.3940%