NC Bench
Overview
About
Tests
Models
Model
Gemma 2 27B
Test
Dialogue tags
Scenario
Write 200 words with 90% dialogue
Run ID
2024-07-19-01J35SZ8WZRBMSHXT1CMG0HE65
Model input
User/Human
You are a author of comedic heist books. Please write a 200 word scene that has 90% words of dialogue between two thieves named Molly and Bill who are planning to break into a children's party to steal all the presents. Only include the prose of the scene without any markdown or commentary.
Model response
Messages
Meta
AI
"Are you sure about this, Bill? Stealing from kids?" Molly scrunched up her nose. "Seems a bit low, even for us." "Kids? Molly, they'll be fine. They get a sugar rush, bounce off the walls for an hour, then forget it ever happened. Besides, those presents are practically begging to be liberated." "Liberated? They're wrapped in Scooby-Doo paper!" Bill pulled a crumpled photo from his pocket. "Look, limited edition, signed Captain Comet action figures. These things are worth a fortune on the black market." "Fine, but if I'm tackling a seven-year-old holding a rubber chicken, I'm blaming you." "Deal. Now, we need a diversion. I was thinking... a clown?" Molly shuddered. "Don't even joke about clowns. Remember what happened last time?" “That was one time! The balloons were faulty, it wasn't my fault!” "They were helium-filled, Bill. You let go of the bouquet and they flew away. Five hundred helium balloons, Bill!" "Alright, alright! How about a magician? With doves? A disappearing act?" Molly sighed. "Fine. Just make sure he doesn't disappear with the loot. And no more clowns.”
id
"gen-HMu6zJQXq77CpNn4nusAhLYjcDXO"
total_cost
0.0002556
upstream_id
"8a5bc3d986cd24df-SJC"
created_at
"2024-07-19T15:32:44.81731+00:00"
Friday, July 19th, 2024 at 3:32:44 PM GMT+00:00
model
"google/gemma-2-27b-it"
app_id
182717
streamed
false
cancelled
false
provider_name
"Together"
latency
9000
moderation_latency
(null)
generation_time
116
finish_reason
"stop"
tokens_prompt
80
tokens_completion
265
native_tokens_prompt
75
native_tokens_completion
280
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.0002556
Evaluation details
Result
Evaluator
Details
Meta Data
43.3783%
Matches word count
n/a
neededClean
false
words
183
99.9975%
Dialogue to Total Word Ratio
Ratio: 90.71%, Deviation: 0.71%
neededClean
false
wordsTotal
183
wordsDialogue
166
71.6879%