Model

Gemma 2 27B

Test

Dialogue tags

Scenario

Write 200 words with 90% dialogue

Run ID

2024-07-19-01J35STXN3TR3PJW6M3W0ER78V

Model input

User/Human
You are a author of comedic heist books. Please write a 200 word scene that has 90% words of dialogue between two thieves named Molly and Bill who are planning to break into a children's party to steal all the presents. Only include the prose of the scene without any markdown or commentary.

Model response

AI
“Are you sure this is even legal?” Bill asked, eyes wide as he surveyed the bouncy castle looming like a polka-dotted behemoth. Molly, already slipping a lockpick into her purse, shrugged. “It’s a grey area, Bill. Technically, they’re gifts, so they’re not exactly ‘belonging’ to the birthday boy.” "But they're for HIM! These kids are already sugared up on cake and balloons, and we’re gonna swoop in and nick their presents?” “Look, Bill, do you want to be eating ramen for the rest of the month, or do you want a diamond-encrusted pony on your front lawn? Pick your poison." Bill shuddered. "I hate when you get like this." "Like what? Ambitious? A boss? Visionary?" Bill pointed at the castle again. “Like you’re about to make a bouncy castle a weapon.” Molly’s grin widened. “Think of it as… redistribution of wealth. Plus, this castle's got one hell of a climbing wall. Consider it a bonus training day.” Bill sighed. “Fine. But if I wake up with a tiara stuck to my face, I’m blaming you.”
id"gen-u4iMn8MO2eRa0ecgDOR03BhuoDJH" 
total_cost0.0002448
upstream_id"8a5bc05ed53515b0-SJC" 
created_at"2024-07-19T15:30:22.548068+00:00" Friday, July 19th, 2024 at 3:30:22 PM GMT+00:00
model"google/gemma-2-27b-it" 
app_id182717
streamedfalse
cancelledfalse
provider_name"Together" 
latency9411
moderation_latency(null)
generation_time0
finish_reason"stop" 
tokens_prompt80
tokens_completion256
native_tokens_prompt75
native_tokens_completion265
num_media_prompt(null)
num_media_completion(null)
origin"https://ncbench.com/" 
usage0.0002448

Evaluation details

Result Evaluator Details Meta Data
6.0907% Matches word count n/a
neededCleanfalse
words177
17.7253% Dialogue to Total Word Ratio
Ratio: 78.53%, Deviation: 11.47%
neededCleanfalse
wordsTotal177
wordsDialogue139
11.9080%