Run: 2024-10-01-01J94RFZXPS3H9M2PS6CHHFACH

Run Details

Model:: Rocinante 12B
Test:: Dialogue tags
Scenario:: Write 200 words with 50% dialogue
Duration:: 8.5s
Cost:: $0.000115
Provider:: Infermatic

Evaluation summary

Score	Evaluator	Details Link
0.00%	Matches word count	(details)
0.00%	Dialogue to Total Word Ratio	(details)
0.0000%	Overall

Model input

User/Human

You are a author of comedic heist books.

Please write a 200 word scene that has 50% words of dialogue between two thieves named Molly and Bill who are planning to break into a children's party to steal all the presents.

Only include the prose of the scene without any markdown or commentary.

Model response

Molly smirked. "Alright, let's get kid-napped with presents."

Bill shrugged. "That was bad, but whatever. I Survey the building. One way in, one way out. Easy peasy, lemon squeezy."

Molly rolled her eyes. "The squeezy was unnecessary. But yeah, looks straightforward." She pulled out a pair of clippers. "I'll take care of the lock, you keep watch."

Bill nodded and turned to admire Molly's steely hands intriguingly snip slice. "You ever think about using those for better things?"

"Like what, making jewelry? Cutting flowers? No Bill, these scissors help me steal. Sticky fingers make the world spin." She grinned as metal popped.

Bill sighed. "Why's everything gotta be a metaphor with you?"

Molly winked. "Because pulling off heists is all the art I need. Now let's rock 'n' roll."

Evaluation details

Result

Evaluator

Details

Meta Data

0.00%

Matches word count

n/a

neededClean	false
words	129

0.00%

Dialogue to Total Word Ratio

Ratio: 72.31%, Deviation: 22.31%

neededClean	false
wordsTotal	130
wordsDialogue	94

0.0000%

id	"gen-1727810503-bZkfqSKb4zfjU4WfysTE"
total_cost	0.0001145
upstream_id	"chatcmpl-a87e43e6-4ac5-4fc5-9455-83c3d207a304"
created_at	"2024-10-01T19:21:51.283836+00:00" 10/1/2024, 7:21:51 PM
model	"thedrummer/rocinante-12b"
app_id	182717
streamed	true
cancelled	false
provider_name	"Infermatic"
latency	145
moderation_latency	(null)
generation_time	7707
finish_reason	"stop"
tokens_prompt	67
tokens_completion	193
native_tokens_prompt	72
native_tokens_completion	193
native_tokens_reasoning	(null)
num_media_prompt	(null)
num_media_completion	(null)
origin	"https://ncbench.com/"
usage	0.0001145