NC Bench
Overview
About
Tests
Models
Model
Gemma 2 27B
Test
Dialogue tags
Scenario
Write unattributed dialogue
Run ID
2024-07-14-01J2SKDYMX7MM7Z20X6FCFBEHA
Model input
User/Human
You are an expert novel writer in the cozy mystery genre. Write a scene of about 200 words, with dialogue between two characters. The dialogue should be unattributed, meaning the speaker is not explicitly mentioned. The scene should be set in a small town bakery. Only return the story, nothing else.
Model response
Messages
Meta
AI
"Morning, Biscuit. The usual?" "You know it. And hold the cinnamon on the cinnamon swirls this time, there was a whole lot on that last batch. Nearly choked on it while crossing the street." “Right, right, the great cinnamon incident of 2022. I don’t know how you managed to explain those almond sprinkles to Mrs. Henderson at the library. She was already suspicious of us after the lemon poppyseed issue.” “Let’s just say I have a sensitive nose and a bag of evidence is inescapable.” “Well, I hope they don’t find those crumbs in your alibi." "Anyway, black coffee, extra strong. “You alright, Beatrice? You seem tense." "Morning, Clara. I am. No one knows about this nickname but me, and maybe…just maybe…the ones who did the most atrocious thing. Miserable cappuccinos with seemingly incriminating sprinkles." "Remember, you’re getting a croissant, right?" "Right. But they won't find even the tiniest bit of flour on me.” “It’s not the blueberries, is it?" "Good heavens, no! There weren’t any in the first place, you know that’s ridiculous.”
id
"gen-6e0di8nSHEBDqS4Tu2OaGtA5zNOR"
total_cost
0.0000945
upstream_id
"cmpl-5d8875933dc342309e0ef7500938f34d"
created_at
"2024-07-14T21:47:32.897564+00:00"
Sunday, July 14th, 2024 at 9:47:32 PM GMT+00:00
model
"google/gemma-2-27b-it"
app_id
182717
streamed
false
cancelled
false
provider_name
"DeepInfra"
latency
8881
moderation_latency
(null)
generation_time
0
finish_reason
"stop"
tokens_prompt
81
tokens_completion
261
native_tokens_prompt
76
native_tokens_completion
274
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.0000945
Evaluation details
Result
Evaluator
Details
Meta Data
13.5335%
Count dialogue tags
n/a
neededClean
false
dialogueTags
0
"You seem Clara."
1
"Miserable cappuccinos with seemingly incriminating you’re getting a croissant,"