NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2024-08-27-01J69Q9ME1VVS8VARXH0JXSJ4D
Run Details
Model:
Hermes 3 405B
Test:
Dialogue tags
Scenario:
Write 200 words with 10% dialogue
Duration:
10.4s
Cost:
$0.000000
Provider:
Lambda
Evaluation summary
Score
Evaluator
Details Link
68.10%
Matches word count
(details)
0.00%
Dialogue to Total Word Ratio
(details)
34.0511%
Overall
Model input
User/Human
You are a author of comedic heist books. Please write a 200 word scene that has 10% words of dialogue between two thieves named Molly and Bill who are planning to break into a children's party to steal all the presents. Only include the prose of the scene without any markdown or commentary.
Model response
Messages
Meta
AI
Molly and Bill, clad in black from head to toe, crouched behind a large inflatable bounce house, their eyes fixed on the festivities before them. The sound of children's laughter and the aroma of buttery popcorn filled the air. "Alright, Bill, here's the plan," Molly whispered, pulling out a crudely drawn map. "You'll create a distraction by setting off the firecrackers near the petting zoo. While everyone's attention is diverted, I'll sneak into the tent and snatch the presents." Bill nodded, a mischievous glint in his eye. "And then?" "We'll meet back at the getaway car and make our escape before anyone realizes what's happened," Molly replied with a smirk. "Sounds like a solid plan," Bill said, pulling out a pack of firecrackers from his pocket. "But what if someone spots us?" Molly grinned, reaching into her own pocket and producing two brightly colored party hats. "That's where these come in. If anyone sees us, we'll just blend in with the crowd and pretend to be part of the entertainment." Bill chuckled, placing the party hat on his head. "Molly, you're a genius. Let's do this!"
id
"gen-imszAQ6Km2Iv83PuRF4MjdNtwStQ"
total_cost
0
upstream_id
"chatcmpl-9d57cee7-9040-4823-a717-c4add6ce532f"
created_at
"2024-08-27T10:50:02.935745+00:00"
8/27/2024, 10:50:02 AM
model
"nousresearch/hermes-3-llama-3.1-405b"
app_id
182717
streamed
true
cancelled
false
provider_name
"Lambda"
latency
1211
moderation_latency
(null)
generation_time
8989
finish_reason
"stop"
tokens_prompt
67
tokens_completion
251
native_tokens_prompt
83
native_tokens_completion
252
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0
Evaluation details
Result
Evaluator
Details
Meta Data
68.10%
Matches word count
n/a
neededClean
false
words
186
0.00%
Dialogue to Total Word Ratio
Ratio: 49.46%, Deviation: 39.46%
neededClean
false
wordsTotal
186
wordsDialogue
92
34.0511%