NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2024-07-14-01J2SKDYMRRWC3D6D3GFJ9C00Y
Run Details
Model:
Claude 3 Haiku
Test:
Dialogue tags
Scenario:
Write unattributed dialogue
Duration:
3.5s
Cost:
$0.000414
Provider:
Anthropic
Evaluation summary
Score
Evaluator
Details Link
100.00%
Count dialogue tags
(details)
Model input
User/Human
You are an expert novel writer in the cozy mystery genre. Write a scene of about 200 words, with dialogue between two characters. The dialogue should be unattributed, meaning the speaker is not explicitly mentioned. The scene should be set in a small town bakery. Only return the story, nothing else.
Model response
Messages
Meta
AI
The chime of the bell over the bakery door announced a new arrival as Amelia stepped inside, the scent of freshly baked bread and pastries enveloping her. "Ah, Amelia, so good to see you. What can I get for you today?" "Good morning, James. I'll take a dozen of your famous chocolate croissants, please. Those are always a hit at the book club meeting." "Excellent choice. I just pulled a fresh batch from the oven." "Wonderful. And how have you been? I haven't seen you around town much lately." "Quite busy, actually. The bakery has been busier than ever, and I've been working on expanding the menu. But I'm not complaining - it's a good problem to have." "I'm glad to hear it. Small businesses like yours are the heart and soul of our community." "That they are. Speaking of which, I heard there was a new mystery author who just moved to town. Have you had a chance to meet her yet?" "As a matter of fact, I have. She's a delightful woman, and her books are absolutely captivating. I can't wait to discuss the latest one with the book club." "Wonderful. Well, here are your croissants, all packaged up and ready to go. Enjoy the meeting, Amelia." "Thank you, James. Have a wonderful day."
id
"gen-vIMAKQC7v5Q4FUy1soRtYpwwXkGW"
total_cost
0.00041425
upstream_id
"msg_01EpqHgWW4AAASz92GmxbeXi"
created_at
"2024-07-14T21:47:26.769183+00:00"
7/14/2024, 9:47:26 PM
model
"anthropic/claude-3-haiku:beta"
app_id
182717
streamed
false
cancelled
false
provider_name
"Anthropic"
latency
2702
moderation_latency
(null)
generation_time
0
finish_reason
"end_turn"
tokens_prompt
69
tokens_completion
282
native_tokens_prompt
77
native_tokens_completion
316
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.00041425
Evaluation details
Result
Evaluator
Details
Meta Data
100.00%
Count dialogue tags
n/a
neededClean
false
dialogueTags
(empty)