NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2024-07-18-01J33SZGEVHNT286JY0D6DKNV3
Run Details
Model:
Mistral NeMO
Test:
Dialogue tags
Scenario:
Write unattributed dialogue
Duration:
2.8s
Cost:
$0.000037
Evaluation summary
Score
Evaluator
Details Link
60.65%
Count dialogue tags
(details)
Model input
User/Human
You are an expert novel writer in the cozy mystery genre. Write a scene of about 200 words, with dialogue between two characters. The dialogue should be unattributed, meaning the speaker is not explicitly mentioned. The scene should be set in a small town bakery. Only return the story, nothing else.
Model response
Messages
Meta
AI
"Morning, Martha. Usual?" The aroma of fresh bread wafted through the air as the bell above the door chimed. "Morning, dear. Yes, please. Any news on the old mill?" Martha's hands, dusted with flour, kneaded the dough on the counter. "Still closed. Sheriff's been poking around, though. Heard they found something odd in there." The barista poured steaming coffee into a mug. "Odd? Like what?" Martha paused, eyebrows raised. "Don't know. But it's got him buzzing like a bee in a bottle."
The barista chuckled
, sliding the coffee across the counter. "Here you go." Martha took a sip, her eyes thoughtful. "Well, I hope it's nothing too disturbing. We've had enough of that in this town."
total_cost
0.000036899999999999996
Evaluation details
Result
Evaluator
Details
Meta Data
60.65%
Count dialogue tags
n/a
neededClean
false
dialogueTags
0
"The barista chuckled"