NC Bench
Overview
About
Tests
Models
Model
Gemma 2 27B
Test
Dialogue tags
Scenario
Write 200 words with 90% dialogue
Run ID
2024-07-19-01J35T2NXVR5QYX1DP81QC78ZY
Model input
User/Human
You are a author of comedic heist books. Please write a 200 word scene that has 90% words of dialogue between two thieves named Molly and Bill who are planning to break into a children's party to steal all the presents. Only include the prose of the scene without any markdown or commentary.
Model response
Messages
Meta
AI
"Okay, so you're sure these presents are actually worth something, right?" Bill nervously tugged at his elf hat, the green tinsel itchy on his forehead. "Bill, it's a six-year-old's birthday party hosted by a hedge fund manager's wife. Those aren't My Little Ponies under that tree. Think diamond-encrusted playsets and solid gold building blocks." Molly grinned, adjusting her sparkly reindeer antlers. "And you think we can get away with this? In these ridiculous outfits?" "Relax, they'll assume we're just...enthusiastic entertainment. Don't forget, you're a former circus clown." "That was one summer! And my career as a mime ended prematurely due to an unfortunate incident with a pigeon." "Exactly! Unpredictability is our greatest asset. Besides, who'd suspect Santa's little helpers?" Molly winked, already picking the lock on the back door with a practiced hand. "Alright, but if a kid asks for my autograph, I'm out." "Deal. Now shush, I hear tiny angels singing 'Happy Birthday'."
id
"gen-LNAISQWBCABarwzEXLGxP2EI9auX"
total_cost
0.00023328
upstream_id
"8a5bc693b17f15a2-SJC"
created_at
"2024-07-19T15:34:32.090155+00:00"
Friday, July 19th, 2024 at 3:34:32 PM GMT+00:00
model
"google/gemma-2-27b-it"
app_id
182717
streamed
false
cancelled
false
provider_name
"Together"
latency
4712
moderation_latency
(null)
generation_time
0
finish_reason
"stop"
tokens_prompt
80
tokens_completion
234
native_tokens_prompt
75
native_tokens_completion
249
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.00023328
Evaluation details
Result
Evaluator
Details
Meta Data
0.0000%
Matches word count
n/a
neededClean
false
words
157
10.1911%
Dialogue to Total Word Ratio
Ratio: 77.71%, Deviation: 12.29%
neededClean
false
wordsTotal
157
wordsDialogue
122
5.0955%