NC Bench
Overview
About
Tests
Models
Model
Gemma 2 27B
Test
Dialogue tags
Scenario
Write 200 words with 50% dialogue
Run ID
2024-07-19-01J35TCW266V12T73Z1ZFXWSVK
Model input
User/Human
You are a author of comedic heist books. Please write a 200 word scene that has 50% words of dialogue between two thieves named Molly and Bill who are planning to break into a children's party to steal all the presents. Only include the prose of the scene without any markdown or commentary.
Model response
Messages
Meta
AI
Molly chewed on the candy necklace snagged from a kid’s goodie bag. “Are you sure about this, Bill? It seems...rotten.” Bill rummaged through the bouncy castle, emerging with a deflated plastic sword. "Don't be daft, Mol. We're not stealing from children. We're redistributing wealth. These kids are drowning in presents. It's practically a social injustice." He brandished the sword. "Besides, look at the loot!” Molly eyed the half-eaten cake and leaky piñata. "That’s not exactly El Dorado, Bill.” “Patience, grasshopper. The real treasures are upstairs, in the wardrobe. I saw it when I posed as the entertainment. A mountain of shiny, glittering things.” Molly snorted. “You mean the dads? Because I’m picturing a lot of socks and belts.” Bill scoffed, adjusting his pirate eye-patch. “No, you doubting Thomas, toys. Enough to make Scrooge McDuck jealous. So, here’s the plan...” He laid out his ludicrous scheme, his voice growing more animated with each detail. Molly listened, skepticism painted across her face. This was going to be a long night.
id
"gen-Out250WVVDzJTr100x5G1CDLjhqo"
total_cost
0.00024192
upstream_id
"8a5bcebaa5c915ac-SJC"
created_at
"2024-07-19T15:40:06.656005+00:00"
Friday, July 19th, 2024 at 3:40:06 PM GMT+00:00
model
"google/gemma-2-27b-it"
app_id
182717
streamed
false
cancelled
false
provider_name
"Together"
latency
5387
moderation_latency
(null)
generation_time
0
finish_reason
"stop"
tokens_prompt
80
tokens_completion
262
native_tokens_prompt
75
native_tokens_completion
261
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.00024192
Evaluation details
Result
Evaluator
Details
Meta Data
0.0304%
Matches word count
n/a
neededClean
false
words
170
88.7160%
Dialogue to Total Word Ratio
Ratio: 55.88%, Deviation: 5.88%
neededClean
false
wordsTotal
170
wordsDialogue
95
44.3732%