NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2024-08-26-01J68DHH4ER98QC283F1D0XTYJ
Run Details
Model:
Hermes 3 405B
Test:
Dialogue tags
Scenario:
Write 200 words with 50% dialogue
Duration:
23.0s
Cost:
$0.000000
Provider:
Lambda
Evaluation summary
Score
Evaluator
Details Link
43.38%
Matches word count
(details)
64.30%
Dialogue to Total Word Ratio
(details)
53.8374%
Overall
Model input
User/Human
You are a author of comedic heist books. Please write a 200 word scene that has 50% words of dialogue between two thieves named Molly and Bill who are planning to break into a children's party to steal all the presents. Only include the prose of the scene without any markdown or commentary.
Model response
Messages
Meta
AI
Molly and Bill sat hunched over a colorful, cartoon-filled map of the party venue, their eyes gleaming with mischievous excitement. "Okay, so here's the plan," Molly began, her finger tracing the map. "I'll create a distraction by setting off the fireworks early." Bill nodded, a sly grin spreading across his face. "And while you're doing that, I'll sneak in through the back entrance wearing my clown disguise." "Perfect!" Molly exclaimed. "The kids will be so distracted by the fireworks, they won't even notice you swiping the presents from under their noses." "Just one question," Bill interjected, scratching his head. "What do we do if a kid catches me in the act?" Molly smirked, reaching into her bag and pulling out a giant bag of candy. "Easy. Bribe them with sweets and make a run for it!" The two thieves burst into laughter, their eyes twinkling with anticipation. "This is going to be the heist of the century!" Bill chuckled. Molly grinned, rubbing her hands together. "Let's just hope the birthday boy doesn't have a meltdown when he realizes all his presents are gone!"
id
"gen-wLwWNCZTMz7m0WVGlUcaQF6Xz2RU"
total_cost
0
upstream_id
"chatcmpl-047d9555-0e6e-4a6b-92bc-2f6a4ae3b184"
created_at
"2024-08-26T22:40:34.152139+00:00"
8/26/2024, 10:40:34 PM
model
"nousresearch/hermes-3-llama-3.1-405b"
app_id
182717
streamed
true
cancelled
false
provider_name
"Lambda"
latency
9025
moderation_latency
(null)
generation_time
13883
finish_reason
"stop"
tokens_prompt
67
tokens_completion
245
native_tokens_prompt
83
native_tokens_completion
245
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0
Evaluation details
Result
Evaluator
Details
Meta Data
43.38%
Matches word count
n/a
neededClean
false
words
183
64.30%
Dialogue to Total Word Ratio
Ratio: 58.15%, Deviation: 8.15%
neededClean
false
wordsTotal
184
wordsDialogue
107
53.8374%