Run: 2024-10-01-01J94RHCTAD6C9BNARC7458DZP

Run Details

Model:: Rocinante 12B
Test:: Dialogue tags
Scenario:: Write 200 words with 10% dialogue
Duration:: 11.5s
Cost:: $0.000136
Provider:: Infermatic

Evaluation summary

Score	Evaluator	Details Link
0.00%	Matches word count	(details)
90.23%	Dialogue to Total Word Ratio	(details)
45.1145%	Overall

Model input

User/Human

You are a author of comedic heist books.

Please write a 200 word scene that has 10% words of dialogue between two thieves named Molly and Bill who are planning to break into a children's party to steal all the presents.

Only include the prose of the scene without any markdown or commentary.

Model response

Molly adjusted her mouse ears, scanning the unmarked street near the community center. " infectThe place should be hopping by now. You got the goods, Bill?"

Bill patted his oversized sash pocket, filled with empty boxes and gift wrap, ready to swap. He popped his head up, pausing at the sight. "Enterance is round the back. Slick."

They entered the festive madness, Molly sidestepping as a clown juggled pins. Bill nodded at her encouragingly. "Duck. Drink." He winked, then gave chase to a toddler wielding green balloons. Molly snorted, then got lost in playtime. The kid never stood a chance.

They met up at the gift exchange table, facial hair removed and bags bulging with unopened presents. "Ta-da!" Molly twirled. Bill tipped his hat. "Wanna gatecrash that pinata?"

They city were away, their satsuma reputation now adorning city under the auger of each plastic present. It was their most successful heist yet, boosted by the unknowing hands of the littlest thieves. Kiddocracy, what could be easier?

Evaluation details

Result

Evaluator

Details

Meta Data

0.00%

Matches word count

n/a

neededClean	false
words	165

90.23%

Dialogue to Total Word Ratio

Ratio: 15.66%, Deviation: 5.66%

neededClean	false
wordsTotal	166
wordsDialogue	26

45.1145%

id	"gen-1727810548-a3KYGtyR2rxZy3GhyxpC"
total_cost	0.000136
upstream_id	"chatcmpl-b06edcdb-0d2f-4df3-b850-8b9f9b44db67"
created_at	"2024-10-01T19:22:40.355138+00:00" 10/1/2024, 7:22:40 PM
model	"thedrummer/rocinante-12b"
app_id	182717
streamed	true
cancelled	false
provider_name	"Infermatic"
latency	1041
moderation_latency	(null)
generation_time	10174
finish_reason	"stop"
tokens_prompt	67
tokens_completion	236
native_tokens_prompt	72
native_tokens_completion	236
native_tokens_reasoning	(null)
num_media_prompt	(null)
num_media_completion	(null)
origin	"https://ncbench.com/"
usage	0.000136