NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2024-07-23-01J3G80CG9VZHEVAKZTTNP50TN
Run Details
Model:
Llama 3.1 70B
Test:
Dialogue tags
Scenario:
Write 200 words with 10% dialogue
Duration:
3.6s
Cost:
$0.000328
Provider:
Fireworks
Evaluation summary
Score
Evaluator
Details Link
90.48%
Matches word count
(details)
0.00%
Dialogue to Total Word Ratio
(details)
45.2419%
Overall
Model input
User/Human
You are a author of comedic heist books. Please write a 200 word scene that has 10% words of dialogue between two thieves named Molly and Bill who are planning to break into a children's party to steal all the presents. Only include the prose of the scene without any markdown or commentary.
Model response
Messages
Meta
AI
Molly adjusted her black jumpsuit, her eyes scanning the party venue from across the street. Bill, her trusted partner-in-crime, fidgeted beside her, clutching a crumpled-up blueprint of the building. The sound of children's laughter and tinny music filled the air, accompanied by the scent of sugary treats and fresh balloons. "Okay, so the diaper duty station is on the left, and the goody bag stash is right behind the piƱata," Bill said, tracing his finger over the crude map. Molly raised an eyebrow. "You think we need to worry about the diaper duty station?" "Hey, you never know what kind of valuable assets are hiding in a diaper bin," Bill replied, his grin mischievous. Molly rolled her eyes. "You're thinking about the great diaper- cum- diamond-heist of 2018, aren't you?" Bill shrugged. "Hey, that was a real thing. I saw it on a documentary." Molly snorted, shaking her head. "Focus, Bill. We need to get in, grab the presents, and get out before the clown starts making balloon animals." Bill's eyes widened. "Right, right. The Clown Threat Level is high today. Let's get moving." As they set off across the street, Molly adjusted her utility belt, a spring in her step. This was going to be a piece of cake.
id
"gen-FXR1UIvZumXSAGITk7pGgaocwLWB"
total_cost
0.0003276
upstream_id
"e5a3d4fc-670c-4850-b87a-55281afda589"
created_at
"2024-07-23T16:50:20.060136+00:00"
7/23/2024, 4:50:20 PM
model
"meta-llama/llama-3.1-70b-instruct"
app_id
182717
streamed
false
cancelled
false
provider_name
"Fireworks"
latency
3438
moderation_latency
(null)
generation_time
0
finish_reason
"stop"
tokens_prompt
102
tokens_completion
292
native_tokens_prompt
70
native_tokens_completion
294
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.0003276
Evaluation details
Result
Evaluator
Details
Meta Data
90.48%
Matches word count
n/a
neededClean
false
words
210
0.00%
Dialogue to Total Word Ratio
Ratio: 48.13%, Deviation: 38.13%
neededClean
false
wordsTotal
214
wordsDialogue
103
45.2419%