Model

Gemma 2 27B

Test

Dialogue tags

Scenario

Write 200 words with 90% dialogue

Run ID

2024-07-19-01J35SJQK2YWTH7X47V11SV6TF

Model input

User/Human
You are a author of comedic heist books. Please write a 200 word scene that has 90% words of dialogue between two thieves named Molly and Bill who are planning to break into a children's party to steal all the presents. Only include the prose of the scene without any markdown or commentary.

Model response

AI
"Seriously, Bill, a children's party?" "Don't underestimate the power of a plush unicorn, Molly. Those things are gold." "Gold-plated, maybe. I still think this is ridiculous. Can't we just hit the jewelry store again? At least those diamonds don't sob when you nick them." "Diamonds don't offer free cake either. Plus, think of the loot! Action figures, dolls, bouncy castles... we could empty out a toy store with this haul!" "And face a horde of screaming toddlers? I'd rather fight a dragon." "Relax, we'll be in and out before their sugar highs kick in. Besides, nobody suspects a middle-aged couple dressed as clowns." "You’re going as a clown?" "Yep. You can be the sad one." "Oh, for crying out loud, Bill. Fine. But I'm keeping the pointy shoes."
id"gen-lWb8wu7Jvq7XpX0ZyajihF8UPFy2" 
total_cost0.00020016
upstream_id"8a5bb9d186e39435-SJC" 
created_at"2024-07-19T15:25:50.355177+00:00" Friday, July 19th, 2024 at 3:25:50 PM GMT+00:00
model"google/gemma-2-27b-it" 
app_id182717
streamedfalse
cancelledfalse
provider_name"Together" 
latency5572
moderation_latency(null)
generation_time0
finish_reason"stop" 
tokens_prompt80
tokens_completion184
native_tokens_prompt75
native_tokens_completion203
num_media_prompt(null)
num_media_completion(null)
origin"https://ncbench.com/" 
usage0.00020016

Evaluation details

Result Evaluator Details Meta Data
0.0000% Matches word count n/a
neededCleanfalse
words130
36.7879% Dialogue to Total Word Ratio
Ratio: 100.00%, Deviation: 10.00%
neededCleanfalse
wordsTotal130
wordsDialogue130
18.3940%