NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2024-10-16-01JABHXGYVWF9FXYG9RWFMRZN4
Run Details
Model:
Llama 3.1 Nemotron 70B
Test:
Dialogue tags
Scenario:
Write 200 words with 90% dialogue
Duration:
11.2s
Cost:
$0.000121
Provider:
DeepInfra
Evaluation summary
Score
Evaluator
Details Link
0.00%
Matches word count
(details)
99.09%
Dialogue to Total Word Ratio
(details)
49.5432%
Overall
Model input
User/Human
You are a author of comedic heist books. Please write a 200 word scene that has 90% words of dialogue between two thieves named Molly and Bill who are planning to break into a children's party to steal all the presents. Only include the prose of the scene without any markdown or commentary.
Model response
Messages
Meta
AI
"I'm telling you, Bill, this is the score of a lifetime," Molly said, eyes shining with excitement as she pored over the party invitation. "Two hundred sugared-up kids, and their parents too distracted to notice us swapping the loot." "Loot?" Bill raised an eyebrow. "You mean the Tea Set of Sparkles and the Deluxe Nerf Blaster of Doom?" "Exactly! Those things retail for a pretty penny. And have you seen the RSVP list? The Smiths are coming – their kid's always getting the latest gadgets." "Okay, but how do we get past the bounce house and the pinata-filled gauntlet of doom?" Molly snorted. "Please, we've infiltrated tighter security at the Museum of Questionable Taxidermy. I've got a plan. We dress as –" "Clowns?" Bill's face fell. "You can't be serious." "Dead serious. We'll blend right in with the entertainment. Who suspects a clown?" "I do. I suspect all clowns. This is a terrible idea, Molly." "Nonsense! It's genius. Now, let's get to work on those exaggerated pantaloons..."
id
"gen-1729112228-5sGS9hQAoSZpIa607Sw4"
upstream_id
"cmpl-RltAjxIyX15IhU5v2FwA9AzU"
total_cost
0.00012125
cache_discount
(null)
created_at
"2024-10-16T20:57:20.769401+00:00"
10/16/2024, 8:57:20 PM
model
"nvidia/llama-3.1-nemotron-70b-instruct"
app_id
182717
streamed
true
cancelled
false
provider_name
"DeepInfra"
latency
71
moderation_latency
(null)
generation_time
10898
finish_reason
"stop"
tokens_prompt
102
tokens_completion
241
native_tokens_prompt
71
native_tokens_completion
241
native_tokens_reasoning
(null)
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.00012125
Evaluation details
Result
Evaluator
Details
Meta Data
0.00%
Matches word count
n/a
neededClean
false
words
166
99.09%
Dialogue to Total Word Ratio
Ratio: 86.90%, Deviation: 3.10%
neededClean
false
wordsTotal
168
wordsDialogue
146
49.5432%