NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2024-07-19-01J35SJXYZW7PN34NBFQBTCGV5
Run Details
Model:
Mistral NeMO
Test:
Dialogue tags
Scenario:
Write 200 words with 50% dialogue
Duration:
2.5s
Cost:
$0.000033
Evaluation summary
Score
Evaluator
Details Link
0.00%
Matches word count
(details)
0.73%
Dialogue to Total Word Ratio
(details)
0.3648%
Overall
Model input
User/Human
You are a author of comedic heist books. Please write a 200 word scene that has 50% words of dialogue between two thieves named Molly and Bill who are planning to break into a children's party to steal all the presents. Only include the prose of the scene without any markdown or commentary.
Model response
Messages
Meta
AI
Molly and Bill huddled in the alley, eyeing the brightly lit house. "You sure about this, Molly?" Bill asked, adjusting his clown nose. "It's just kids' stuff, Bill. They won't miss a few toys," Molly replied, checking her bag of tricks. "But the noise, the chaos... It's not like our usual gigs," Bill persisted. Molly grinned, "Exactly, Bill. It's a challenge. Besides, who doesn't love a good heist with a side of cotton candy?" Bill sighed, "Alright, but if we get caught, I'm blaming you." Molly laughed, "Deal. Now, let's go steal some Christmas."
total_cost
0.000032699999999999995
Evaluation details
Result
Evaluator
Details
Meta Data
0.00%
Matches word count
n/a
neededClean
false
words
94
0.73%
Dialogue to Total Word Ratio
Ratio: 64.89%, Deviation: 14.89%
neededClean
false
wordsTotal
94
wordsDialogue
61
0.3648%