NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2024-07-23-01J3G7ZDF5PWWX1D0D49TYNHT0
Run Details
Model:
Llama 3.1 70B
Test:
Dialogue tags
Scenario:
Write 200 words with 10% dialogue
Duration:
4.5s
Cost:
$0.000297
Provider:
Fireworks
Evaluation summary
Score
Evaluator
Details Link
68.10%
Matches word count
(details)
0.00%
Dialogue to Total Word Ratio
(details)
34.0511%
Overall
Model input
User/Human
You are a author of comedic heist books. Please write a 200 word scene that has 10% words of dialogue between two thieves named Molly and Bill who are planning to break into a children's party to steal all the presents. Only include the prose of the scene without any markdown or commentary.
Model response
Messages
Meta
AI
Molly and Bill sat in their cramped, dingy apartment, surrounded by maps and blueprints of their latest mark: the birthday party of little Timmy Jenkins. The air was thick with excitement and the faint scent of desperation. Molly, her pixie cut a mess of tangles, leaned forward, her eyes scanning the security plan. Bill, his goatee neatly trimmed, nodded along as he sipped a lukewarm coffee. "Okay, so we've got the party clown watching the front door, and the catering staff is too busy gossiping to notice anything," Molly said, tapping her pen on the map. "Yeah, and the parents are too busy trying to impress each other with their organic quinoa salad to care about the presents," Bill added, chuckling. Molly's eyes sparkled with mirth. "I mean, who brings quinoa to a kids' party? It's like they're trying to make us steal the presents." Bill snorted, spitting coffee onto his shirt. "Amateurs." Molly grinned, her teeth glinting with mischief. "Alright, so we're set. In, grab the loot, and out before the cake is cut." Bill high-fived her, leaving a faint coffee stain on her hand.
id
"gen-zRqUFlKXm6uXmyZjuGX9n4icnMf1"
total_cost
0.000297
upstream_id
"f0fa8be3-c94f-40b2-9390-7e13e0e837cc"
created_at
"2024-07-23T16:49:49.161706+00:00"
7/23/2024, 4:49:49 PM
model
"meta-llama/llama-3.1-70b-instruct"
app_id
182717
streamed
false
cancelled
false
provider_name
"Fireworks"
latency
3978
moderation_latency
(null)
generation_time
0
finish_reason
"stop"
tokens_prompt
102
tokens_completion
258
native_tokens_prompt
70
native_tokens_completion
260
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.000297
Evaluation details
Result
Evaluator
Details
Meta Data
68.10%
Matches word count
n/a
neededClean
false
words
186
0.00%
Dialogue to Total Word Ratio
Ratio: 42.25%, Deviation: 32.25%
neededClean
false
wordsTotal
187
wordsDialogue
79
34.0511%