Run: 2024-09-20-01J88194MWBG3B4C484AK1PY78

Run Details

Model:: Cohere Command R+ (Aug. 2024)
Test:: N-Length Sentences
Scenario:: Write sentences with 10 words each
Duration:: 1.8s
Cost:: $0.000833
Provider:: Cohere

Evaluation summary

Score	Evaluator	Details Link
94.82%	Matches word count	(details)

Model input

User/Human

Please write the opening scene of a murder mystery where each sentence has exactly 10 words.
Please make sure that each sentence has the same length. Only return the opening itself.

Model response

As the sun painted Sydney's skyline in shades of amber,
a jogger stumbled upon an unnerving sight by the wharf.
Determined to assist, he dialed emergency services with trembling fingers.
Investigation launched, detectives deeming this waterfront location a crime scene.
Forensic team, equipped with protective gear, arrived promptly for evidence collection.

Evaluation details

Result

Evaluator

Details

Meta Data

94.82%

Matches word count

n/a

neededClean

false

sentences

wordCounts

0	10
1	10
2	10
3	10
4	11

id	"gen-swSUtPTrOzpj3X7IrGgGCQKyT98i"
total_cost	0.0008325
upstream_id	"0a2d028f-a37e-4d9e-9132-d3a4b4c46eb8"
created_at	"2024-09-20T15:37:18.833199+00:00" 9/20/2024, 3:37:18 PM
model	"cohere/command-r-plus-08-2024"
app_id	182717
streamed	true
cancelled	false
provider_name	"Cohere"
latency	62
moderation_latency	(null)
generation_time	1522
finish_reason	"COMPLETE"
tokens_prompt	42
tokens_completion	69
native_tokens_prompt	37
native_tokens_completion	74
native_tokens_reasoning	(null)
num_media_prompt	(null)
num_media_completion	(null)
origin	"https://ncbench.com/"
usage	0.0008325