NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2024-09-20-01J88198Y74EE160GZ3FJXJVZW
Run Details
Model:
Qwen 2.5 72B
Test:
Dialogue tags
Scenario:
Write 200 words with 90% dialogue
Duration:
10.4s
Cost:
$0.000135
Provider:
Hyperbolic
Evaluation summary
Score
Evaluator
Details Link
0.08%
Matches word count
(details)
100.00%
Dialogue to Total Word Ratio
(details)
50.0415%
Overall
Model input
User/Human
You are a author of comedic heist books. Please write a 200 word scene that has 90% words of dialogue between two thieves named Molly and Bill who are planning to break into a children's party to steal all the presents. Only include the prose of the scene without any markdown or commentary.
Model response
Messages
Meta
AI
"Bill, are you sure this is a good idea?" Molly whispered, eyeing the bouncy castle in the backyard. "Of course, it’s a goldmine, Molly. Think of all the gifts!" Bill’s eyes gleamed with mischief. "But what if we get caught? It’s a kids’ party." "Come on, when have we ever been caught? Besides, it’s foolproof. We go in, grab the loot, and out we come. Simple." "Simple? Bill, there are clowns and face painters and a bouncy castle. It’s a circus in there." "Exactly! The more chaos, the easier our job. We’ll blend in." "Blend in? In these getups?" "Hey, you’re the one who picked out the pirate and superhero outfits. I said we’d be incognito, not invisible." "Fine, but if we end up in jail for stealing from kids, I’m blaming you." "Deal. Now let’s get this over with. I’ve got plans for all those action figures and board games." Molly sighed. "Alright, but remember, no touching the cake. That’s just low." "Who are you, my mother? Let’s do this."
id
"gen-EjX00sevJMoi6nvEquVxsAwWsaZG"
total_cost
0.0001352
upstream_id
"chat-0afc989b50fe47ee9e0abf7052c5fddd"
created_at
"2024-09-20T15:37:31.426032+00:00"
9/20/2024, 3:37:31 PM
model
"qwen/qwen-2.5-72b-instruct"
app_id
182717
streamed
true
cancelled
false
provider_name
"Hyperbolic"
latency
155
moderation_latency
(null)
generation_time
9747
finish_reason
"stop"
tokens_prompt
78
tokens_completion
253
native_tokens_prompt
83
native_tokens_completion
255
native_tokens_reasoning
(null)
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.0001352
Evaluation details
Result
Evaluator
Details
Meta Data
0.08%
Matches word count
n/a
neededClean
false
words
171
100.00%
Dialogue to Total Word Ratio
Ratio: 90.64%, Deviation: 0.64%
neededClean
false
wordsTotal
171
wordsDialogue
155
50.0415%