NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2024-08-26-01J68D27E6GWAEJFSYXBHH6H6K
Run Details
Model:
Hermes 3 405B
Test:
Dialogue tags
Scenario:
Write 200 words with 50% dialogue
Duration:
14.7s
Cost:
$0.000000
Provider:
Lambda
Evaluation summary
Score
Evaluator
Details Link
75.16%
Matches word count
(details)
95.82%
Dialogue to Total Word Ratio
(details)
85.4883%
Overall
Model input
User/Human
You are a author of comedic heist books. Please write a 200 word scene that has 50% words of dialogue between two thieves named Molly and Bill who are planning to break into a children's party to steal all the presents. Only include the prose of the scene without any markdown or commentary.
Model response
Messages
Meta
AI
Molly and Bill sat hunched over a table, studying a crudely drawn map of the party venue. "Okay, so here's the plan," Molly began, her eyes gleaming with mischief. "You create a distraction by setting off the fire alarm, and while everyone's running around like headless chickens, I'll sneak in and grab the presents." Bill scratched his head, looking skeptical. "But won't the kids be upset when they see their gifts disappearing?" Molly waved a dismissive hand. "Nah, they'll be too busy crying over the ruined cake and the clowns fighting each other." "Clowns fighting?" Bill raised an eyebrow. Molly grinned. "Yeah, I hired a couple of actors to dress up as clowns and start a brawl. It'll be chaos!" Bill chuckled, shaking his head. "You've really thought of everything, haven't you?" "Of course! I'm the mastermind, remember?" Molly puffed out her chest proudly. "Now, let's go over the escape route one more time..." The two thieves leaned in closer, their whispers filled with excitement and anticipation as they finalized their plan to pull off the most daring heist of their careers: the great children's party caper.
id
"gen-iFKIcgEsnkTlLUgciQ2FPRKTMxiC"
total_cost
0
upstream_id
"chatcmpl-e0b11e79-5890-4b98-b53c-71549828dff0"
created_at
"2024-08-26T22:32:04.415289+00:00"
8/26/2024, 10:32:04 PM
model
"nousresearch/hermes-3-llama-3.1-405b"
app_id
182717
streamed
true
cancelled
false
provider_name
"Lambda"
latency
2742
moderation_latency
(null)
generation_time
11875
finish_reason
"stop"
tokens_prompt
67
tokens_completion
257
native_tokens_prompt
83
native_tokens_completion
258
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0
Evaluation details
Result
Evaluator
Details
Meta Data
75.16%
Matches word count
n/a
neededClean
false
words
187
95.82%
Dialogue to Total Word Ratio
Ratio: 54.55%, Deviation: 4.55%
neededClean
false
wordsTotal
187
wordsDialogue
102
85.4883%