NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2024-07-23-01J3G8030EH6R4KGXN649G8ZPS
Run Details
Model:
Llama 3.1 70B
Test:
Dialogue tags
Scenario:
Write 200 words with 50% dialogue
Duration:
3.3s
Cost:
$0.000292
Provider:
Fireworks
Evaluation summary
Score
Evaluator
Details Link
3.62%
Matches word count
(details)
63.74%
Dialogue to Total Word Ratio
(details)
33.6810%
Overall
Model input
User/Human
You are a author of comedic heist books. Please write a 200 word scene that has 50% words of dialogue between two thieves named Molly and Bill who are planning to break into a children's party to steal all the presents. Only include the prose of the scene without any markdown or commentary.
Model response
Messages
Meta
AI
Molly and Bill huddled over a messy map of the party venue, a gazebo in a local park. The smell of freshly cut grass wafted through the air, mingling with the scent of deceit. "Alright, we're in through the west entrance, near the ball pit," Molly said, tracing the route with a stubby pencil. "We've got to move fast, before the piñata explodes." Bill snorted. "Why's it gotta be a piñata? Can't they just have a boring old cake like everyone else?" Molly shot him a withering glance. "You're not getting paid to criticize the party planning, Bill. Just focus on the presents." "Presents, right. So, what's the signal?" Bill asked, eyes darting back to the map. "When the kid in the Spider-Man suit starts doing the chicken dance, that's our cue. We slip in, grab the loot, and slip out." "Mmm...loot," Bill murmured, his eyes lighting up with excitement. "I've got my eye on a shiny new Lego set." "And I'll be after that obscenely large stuffed unicorn," Molly added, her voice dripping with avarice.
id
"gen-i7DdInOHwR27AhxC6IG4J6yw4whV"
total_cost
0.0002916
upstream_id
"5cec9f7a-b3f7-4e2a-8a61-538ecced5af4"
created_at
"2024-07-23T16:50:10.086879+00:00"
7/23/2024, 4:50:10 PM
model
"meta-llama/llama-3.1-70b-instruct"
app_id
182717
streamed
false
cancelled
false
provider_name
"Fireworks"
latency
3142
moderation_latency
(null)
generation_time
0
finish_reason
"stop"
tokens_prompt
102
tokens_completion
252
native_tokens_prompt
70
native_tokens_completion
254
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.0002916
Evaluation details
Result
Evaluator
Details
Meta Data
3.62%
Matches word count
n/a
neededClean
false
words
176
63.74%
Dialogue to Total Word Ratio
Ratio: 58.19%, Deviation: 8.19%
neededClean
false
wordsTotal
177
wordsDialogue
103
33.6810%