NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2024-08-27-01J69T1765BAWSW282X93HEM4J
Run Details
Model:
Hermes 3 405B
Test:
Dialogue tags
Scenario:
Write 200 words with 10% dialogue
Duration:
13.0s
Cost:
$0.000000
Provider:
Lambda
Evaluation summary
Score
Evaluator
Details Link
99.92%
Matches word count
(details)
0.00%
Dialogue to Total Word Ratio
(details)
49.9595%
Overall
Model input
User/Human
You are a author of comedic heist books. Please write a 200 word scene that has 10% words of dialogue between two thieves named Molly and Bill who are planning to break into a children's party to steal all the presents. Only include the prose of the scene without any markdown or commentary.
Model response
Messages
Meta
AI
Molly and Bill sat hunched over a table, studying the blueprint of the community center where the children's party was to take place. "Okay, so here's the plan," Molly began, tracing her finger along the map. "You'll enter through the back door, disguised as a clown. That should give you access to the main hall where the presents will be kept." Bill nodded, a mischievous glint in his eye. "And what about you?" "I'll be keeping watch from across the street, ready to signal you if anything goes wrong." She paused, then added with a smirk, "And maybe I'll swipe a slice of birthday cake while I'm at it." Bill chuckled. "Just don't get caught with your hand in the cookie jar... or the cake box, in this case." "Don't worry about me," Molly retorted. "You just focus on grabbing those presents and getting out of there before anyone realizes what's happening." With a final review of their plan, Molly and Bill set off, determined to pull off the most unconventional heist of their careers. As they approached the community center, the sound of children's laughter filled the air, unaware that their presents were about to disappear.
id
"gen-WlNKHhq8Owp9H0u6BGhlTdSVKXa8"
total_cost
0
upstream_id
"chatcmpl-8eea2f5b-de7d-4fb7-b8ba-0c36d3019b50"
created_at
"2024-08-27T11:37:55.523246+00:00"
8/27/2024, 11:37:55 AM
model
"nousresearch/hermes-3-llama-3.1-405b"
app_id
182717
streamed
true
cancelled
false
provider_name
"Lambda"
latency
930
moderation_latency
(null)
generation_time
11868
finish_reason
"stop"
tokens_prompt
67
tokens_completion
250
native_tokens_prompt
83
native_tokens_completion
251
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0
Evaluation details
Result
Evaluator
Details
Meta Data
99.92%
Matches word count
n/a
neededClean
false
words
197
0.00%
Dialogue to Total Word Ratio
Ratio: 51.78%, Deviation: 41.78%
neededClean
false
wordsTotal
197
wordsDialogue
102
49.9595%