Model

Gemma 2 27B

Test

Dialogue tags

Scenario

Write 200 words with 90% dialogue

Run ID

2024-07-19-01J35T2NXVR5QYX1DP81QC78ZY

Model input

User/Human
You are a author of comedic heist books. Please write a 200 word scene that has 90% words of dialogue between two thieves named Molly and Bill who are planning to break into a children's party to steal all the presents. Only include the prose of the scene without any markdown or commentary.

Model response

AI
"Okay, so you're sure these presents are actually worth something, right?" Bill nervously tugged at his elf hat, the green tinsel itchy on his forehead. "Bill, it's a six-year-old's birthday party hosted by a hedge fund manager's wife. Those aren't My Little Ponies under that tree. Think diamond-encrusted playsets and solid gold building blocks." Molly grinned, adjusting her sparkly reindeer antlers. "And you think we can get away with this? In these ridiculous outfits?" "Relax, they'll assume we're just...enthusiastic entertainment. Don't forget, you're a former circus clown." "That was one summer! And my career as a mime ended prematurely due to an unfortunate incident with a pigeon." "Exactly! Unpredictability is our greatest asset. Besides, who'd suspect Santa's little helpers?" Molly winked, already picking the lock on the back door with a practiced hand. "Alright, but if a kid asks for my autograph, I'm out." "Deal. Now shush, I hear tiny angels singing 'Happy Birthday'."
id"gen-LNAISQWBCABarwzEXLGxP2EI9auX" 
total_cost0.00023328
upstream_id"8a5bc693b17f15a2-SJC" 
created_at"2024-07-19T15:34:32.090155+00:00" Friday, July 19th, 2024 at 3:34:32 PM GMT+00:00
model"google/gemma-2-27b-it" 
app_id182717
streamedfalse
cancelledfalse
provider_name"Together" 
latency4712
moderation_latency(null)
generation_time0
finish_reason"stop" 
tokens_prompt80
tokens_completion234
native_tokens_prompt75
native_tokens_completion249
num_media_prompt(null)
num_media_completion(null)
origin"https://ncbench.com/" 
usage0.00023328

Evaluation details

Result Evaluator Details Meta Data
0.0000% Matches word count n/a
neededCleanfalse
words157
10.1911% Dialogue to Total Word Ratio
Ratio: 77.71%, Deviation: 12.29%
neededCleanfalse
wordsTotal157
wordsDialogue122
5.0955%