Run: 2024-09-20-01J881BFW8AZZWJFSDJR4WPY7X

Run Details

Model:: Cohere Command R+ (Aug. 2024)
Test:: N-Length Sentences
Scenario:: Write sentences with 20 words each
Duration:: 2.7s
Cost:: $0.001272
Provider:: Cohere

Evaluation summary

Score	Evaluator	Details Link
0.24%	Matches word count	(details)

Model input

User/Human

Please write the opening scene of a murder mystery where each sentence has exactly 20 words.
Please make sure that each sentence has the same length. Only return the opening itself.

Model response

Detective John had a penchant for piecing together the most perplexing puzzles and cryptic cases.
He always relished the most impenetrable investigations: seemingly unsolvable conundrums that baffled even the savviest detectives.
As he stepped into the dimly-lit alley, a chill coursed through him, the kind that foretold dread.
An eerie silence enveloped the scene where bloodstains were the telltale sign of something unspeakably sinister.
An elderly man lay motionless, an unmistakable air of fatality shrouding him in a foreboding aura.

Evaluation details

Result

Evaluator

Details

Meta Data

0.24%

Matches word count

n/a

neededClean

false

sentences

wordCounts

0	15
1	16
2	17
3	16
4	16

id	"gen-MlkdIuyKuV0cHRGwba65v36Rxsqr"
total_cost	0.0012725
upstream_id	"c326c3ac-b186-49eb-8976-bec6893e0365"
created_at	"2024-09-20T15:38:36.999678+00:00" 9/20/2024, 3:38:36 PM
model	"cohere/command-r-plus-08-2024"
app_id	182717
streamed	true
cancelled	false
provider_name	"Cohere"
latency	66
moderation_latency	(null)
generation_time	2367
finish_reason	"COMPLETE"
tokens_prompt	42
tokens_completion	124
native_tokens_prompt	37
native_tokens_completion	118
native_tokens_reasoning	(null)
num_media_prompt	(null)
num_media_completion	(null)
origin	"https://ncbench.com/"
usage	0.0012725