NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2024-07-19-01J35T6Z7MGAA0AJFX81MBAWTK
Run Details
Model:
Mistral NeMO
Test:
Dialogue tags
Scenario:
Write 200 words with 90% dialogue
Duration:
3.4s
Cost:
$0.000042
Evaluation summary
Score
Evaluator
Details Link
0.00%
Matches word count
(details)
99.62%
Dialogue to Total Word Ratio
(details)
49.8109%
Overall
Model input
User/Human
You are a author of comedic heist books. Please write a 200 word scene that has 90% words of dialogue between two thieves named Molly and Bill who are planning to break into a children's party to steal all the presents. Only include the prose of the scene without any markdown or commentary.
Model response
Messages
Meta
AI
Molly: "Bill, are you sure about this? It's a kids' party." Bill: "Molly, it's not like we're robbing a bank. They're just presents." Molly: "But... kids. They'll be devastated." Bill: "They'll get over it. Besides, we need the cash, and these presents are just gathering dust under a tree." Molly: "I don't know, Bill. It feels wrong." Bill: "Since when do you have a conscience? We've stolen from the rich, the poor, even that one time from the blind man." Molly: "He wasn't blind, Bill. He was just really, really good at poker." Bill: "Exactly! And this is easier than poker. We dress up, sneak in, grab the presents, and leave. No one gets hurt." Molly: "Fine. But if we get caught, I'm blaming you." Bill: "Deal. Now, let's go steal some Christmas."
total_cost
0.00004215
Evaluation details
Result
Evaluator
Details
Meta Data
0.00%
Matches word count
n/a
neededClean
false
words
133
99.62%
Dialogue to Total Word Ratio
Ratio: 92.48%, Deviation: 2.48%
neededClean
false
wordsTotal
133
wordsDialogue
123
49.8109%