Model

Gemma 2 27B

Test

Dialogue tags

Scenario

Write 200 words with 90% dialogue

Run ID

2024-07-19-01J35SZ8WZRBMSHXT1CMG0HE65

Model input

User/Human
You are a author of comedic heist books. Please write a 200 word scene that has 90% words of dialogue between two thieves named Molly and Bill who are planning to break into a children's party to steal all the presents. Only include the prose of the scene without any markdown or commentary.

Model response

AI
"Are you sure about this, Bill? Stealing from kids?" Molly scrunched up her nose. "Seems a bit low, even for us." "Kids? Molly, they'll be fine. They get a sugar rush, bounce off the walls for an hour, then forget it ever happened. Besides, those presents are practically begging to be liberated." "Liberated? They're wrapped in Scooby-Doo paper!" Bill pulled a crumpled photo from his pocket. "Look, limited edition, signed Captain Comet action figures. These things are worth a fortune on the black market." "Fine, but if I'm tackling a seven-year-old holding a rubber chicken, I'm blaming you." "Deal. Now, we need a diversion. I was thinking... a clown?" Molly shuddered. "Don't even joke about clowns. Remember what happened last time?" “That was one time! The balloons were faulty, it wasn't my fault!” "They were helium-filled, Bill. You let go of the bouquet and they flew away. Five hundred helium balloons, Bill!" "Alright, alright! How about a magician? With doves? A disappearing act?" Molly sighed. "Fine. Just make sure he doesn't disappear with the loot. And no more clowns.”
id"gen-HMu6zJQXq77CpNn4nusAhLYjcDXO" 
total_cost0.0002556
upstream_id"8a5bc3d986cd24df-SJC" 
created_at"2024-07-19T15:32:44.81731+00:00" Friday, July 19th, 2024 at 3:32:44 PM GMT+00:00
model"google/gemma-2-27b-it" 
app_id182717
streamedfalse
cancelledfalse
provider_name"Together" 
latency9000
moderation_latency(null)
generation_time116
finish_reason"stop" 
tokens_prompt80
tokens_completion265
native_tokens_prompt75
native_tokens_completion280
num_media_prompt(null)
num_media_completion(null)
origin"https://ncbench.com/" 
usage0.0002556

Evaluation details

Result Evaluator Details Meta Data
43.3783% Matches word count n/a
neededCleanfalse
words183
99.9975% Dialogue to Total Word Ratio
Ratio: 90.71%, Deviation: 0.71%
neededCleanfalse
wordsTotal183
wordsDialogue166
71.6879%