NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2024-07-23-01J3G81PGCRJ6HMFG4775978YG
Run Details
Model:
Llama 3.1 8B
Test:
Dialogue tags
Scenario:
Write unattributed dialogue
Duration:
1.1s
Cost:
$0.000060
Provider:
Fireworks
Evaluation summary
Score
Evaluator
Details Link
100.00%
Count dialogue tags
(details)
Model input
User/Human
You are an expert novel writer in the cozy mystery genre. Write a scene of about 200 words, with dialogue between two characters. The dialogue should be unattributed, meaning the speaker is not explicitly mentioned. The scene should be set in a small town bakery. Only return the story, nothing else.
Model response
Messages
Meta
AI
The scent of freshly baked croissants wafted through the small town bakery, mingling with the hum of conversation. Behind the counter, a tray of golden brown scones cooled on a rack, releasing a gentle aroma that made mouths water. "I'm telling you, it's not a burglary that's the concern. It's the gossip mill spinning into overdrive." A soft clink of silverware on a ceramic plate accompanied the words. "Ah, you mean the Langley's drama again? Their niece is dating the wrong person for their taste, of course." A patron placed an order, "May I have a loaf of whole wheat bread, please?" "That's just the tip of the iceberg. There's whispers of infidelity, and now Mrs. Langley's threatening to cut Agnes off from the family charity. I heard it straight from her mouth, sipping tea at the Village Circle yesterday." "Infidelity, you say? Which Langley's involved this time?" The bakery owner, hands moving swiftly as she wrapped a generous slice of quiche, asked the question without looking up.
id
"gen-Xs3GEpimPE2slS5gnbRonC3grEv2"
total_cost
0.0000598
upstream_id
"ddec427c-285f-4c61-867a-049045a55b73"
created_at
"2024-07-23T16:51:00.6556+00:00"
7/23/2024, 4:51:00 PM
model
"meta-llama/llama-3.1-8b-instruct"
app_id
182717
streamed
false
cancelled
false
provider_name
"Fireworks"
latency
923
moderation_latency
(null)
generation_time
0
finish_reason
"stop"
tokens_prompt
103
tokens_completion
226
native_tokens_prompt
71
native_tokens_completion
228
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.0000598
Evaluation details
Result
Evaluator
Details
Meta Data
100.00%
Count dialogue tags
n/a
neededClean
false
dialogueTags
(empty)