NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2024-07-14-01J2SKDYMQ1NATP8HQJN5N7JHT
Run Details
Model:
Claude 3.5 Sonnet
Test:
Dialogue tags
Scenario:
Write unattributed dialogue
Duration:
5.7s
Cost:
$0.004716
Provider:
Anthropic
Evaluation summary
Score
Evaluator
Details Link
100.00%
Count dialogue tags
(details)
Model input
User/Human
You are an expert novel writer in the cozy mystery genre. Write a scene of about 200 words, with dialogue between two characters. The dialogue should be unattributed, meaning the speaker is not explicitly mentioned. The scene should be set in a small town bakery. Only return the story, nothing else.
Model response
Messages
Meta
AI
The bell above the door tinkled as a gust of autumn air swept into Sweetie Pie's Bakery. The aroma of cinnamon and freshly baked bread filled the cozy space. "Well, if it isn't Nancy Drew herself! What brings you sniffing around my humble establishment today?" "Very funny, Marge. I'm just here for my usual blueberry muffin and a coffee. Although, now that you mention it, I did hear some interesting gossip about old Mr. Peterson's missing antique watch." "Oh, honey, you don't want to go digging into that mess. That cranky old coot probably just misplaced it and forgot." "Maybe, but it's been in his family for generations. He seemed pretty upset when I ran into him at the post office yesterday." "Well, I suppose if anyone can crack the case, it's you. Just don't go getting yourself into trouble again. I'm running out of free cookies to bribe Officer Jenkins with when he comes looking for you." "Your concern is touching, Marge. Now, about that muffin..." "Coming right up, detective. Just promise me you'll be careful, okay?" "Always am. It's not like trouble follows me around or anything." "Keep telling yourself that, dear. Keep telling yourself that."
id
"gen-IN5CBwytLploktZHa0Khv38gCnkU"
total_cost
0.004716
upstream_id
"msg_01UDq2BEodZ4Gd8oWavngs6v"
created_at
"2024-07-14T21:47:29.021777+00:00"
7/14/2024, 9:47:29 PM
model
"anthropic/claude-3.5-sonnet:beta"
app_id
182717
streamed
false
cancelled
false
provider_name
"Anthropic"
latency
5218
moderation_latency
(null)
generation_time
0
finish_reason
"end_turn"
tokens_prompt
69
tokens_completion
263
native_tokens_prompt
77
native_tokens_completion
299
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.004716
Evaluation details
Result
Evaluator
Details
Meta Data
100.00%
Count dialogue tags
n/a
neededClean
false
dialogueTags
(empty)