NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2024-10-16-01JAB4QJNKBJ6DXZ1M2TDQ53QJ
Run Details
Model:
Ministral 8B
Test:
Dialogue tags
Scenario:
Write unattributed dialogue
Duration:
2.0s
Cost:
$0.000028
Evaluation summary
Score
Evaluator
Details Link
0.00%
Count dialogue tags
(details)
Model input
User/Human
You are an expert novel writer in the cozy mystery genre. Write a scene of about 200 words, with dialogue between two characters. The dialogue should be unattributed, meaning the speaker is not explicitly mentioned. The scene should be set in a small town bakery. Only return the story, nothing else.
Model response
Messages
Meta
AI
The bell above the door chimed as the rain-soaked customer stepped inside. The scent of fresh bread and warm cinnamon filled the air. "What's good today, Marie?"
the customer asked
, shaking off their umbrella. "The blueberry muffins are still warm,"
Marie replied
, slicing a loaf of bread with practiced ease. "They're my favorite,"
the customer confessed
, "But I'll try something new. What's that?" They pointed to a small, intriguing tart on the counter. "Oh, that's my latest experiment,"
Marie said
with a smile. "It's a lemon-poppy seed tart. I think you'll like it." The customer picked it up, examining it curiously. "And what's that?"
they asked
, pointing to a small, peculiar sign on the counter. "Oh, that's just my little secret,"
Marie replied
with a twinkle in her eye. "Maybe when you come back next time, I'll tell you." The customer grinned, "Deal. I'll be back."
total_cost
0.000028400000000000003
Evaluation details
Result
Evaluator
Details
Meta Data
0.00%
Count dialogue tags
n/a
neededClean
false
dialogueTags
0
"the customer asked"
1
"Marie replied"
2
"the customer confessed"
3
"Marie said"
4
"they asked"
5
"Marie replied"