NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2024-09-20-01J881H2CHET55QB2Q0F3J1V03
Run Details
Model:
Cohere Command R+ (Aug. 2024)
Test:
Dialogue tags
Scenario:
Write 200 words with 50% dialogue
Duration:
7.7s
Cost:
$0.003488
Provider:
Cohere
Evaluation summary
Score
Evaluator
Details Link
9.61%
Matches word count
(details)
63.32%
Dialogue to Total Word Ratio
(details)
36.4617%
Overall
Model input
User/Human
You are a author of comedic heist books. Please write a 200 word scene that has 50% words of dialogue between two thieves named Molly and Bill who are planning to break into a children's party to steal all the presents. Only include the prose of the scene without any markdown or commentary.
Model response
Messages
Meta
AI
The dimly lit café was their usual meeting spot, a private booth tucked away in the corner, offering a strategic view of the entrance. Molly, her curly hair tied up in a bright scarf, slid into the seat across from Bill, her longtime partner-in-crime. She fidgeted with the handle of her cup, her eyes sparkling with excitement. "So, Bill," Molly whispered, leaning forward, "we're really doing this. Breaking into a bunch of sugar-high kids' party to pinch their gifts. It's brilliant!" "Madness, pure madness," Bill chuckled, his voice deep and gravelly. "But that's why it might just work. When the client mentioned this job, I thought he was winding me up. Steal from a bunch of kids, of all things. But the payoff... it's huge." "Oh, I love it when they're generous! And it's not like these kids will miss the presents," Molly giggled. "I mean, remember that time we—" "Shh! Keep your voice down, Molly. Don't remind me of the casino fiasco. We got lucky there. Kids are different. Unpredictable." Bill's eyes darted around the room, his brows furrowed. Molly rolled her eyes. "Relax, will ya? It's just a bit of fun. And we're professionals, remember?" Bill smiled, unable to suppress a sense of anticipation. "Aye, that we are. And we're about to give these kids a lesson they won't forget."
id
"gen-95miy9QhROu4OJcIYIDWBq1WvfHJ"
total_cost
0.0034875
upstream_id
"3bf92c89-dc29-4cd1-ac79-c95df76fdb31"
created_at
"2024-09-20T15:41:44.495618+00:00"
9/20/2024, 3:41:44 PM
model
"cohere/command-r-plus-08-2024"
app_id
182717
streamed
true
cancelled
false
provider_name
"Cohere"
latency
61
moderation_latency
(null)
generation_time
7375
finish_reason
"COMPLETE"
tokens_prompt
68
tokens_completion
317
native_tokens_prompt
67
native_tokens_completion
332
native_tokens_reasoning
(null)
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.0034875
Evaluation details
Result
Evaluator
Details
Meta Data
9.61%
Matches word count
n/a
neededClean
false
words
222
63.32%
Dialogue to Total Word Ratio
Ratio: 58.22%, Deviation: 8.22%
neededClean
false
wordsTotal
225
wordsDialogue
131
36.4617%