Run: 2024-09-20-01J881NRJ4TZ4HW30ZT7YNS6G7

Run Details

Model:
Cohere Command R+ (Aug. 2024)
Test:
N-Length Sentences
Scenario:
Write sentences with 20 words each
Duration:
2.8s
Cost:
$0.001032
Provider:
Cohere

Evaluation summary

Score Evaluator
Details Link
18.82% Matches word count (details)

Model input

User/Human
Please write the opening scene of a murder mystery where each sentence has exactly 20 words. Please make sure that each sentence has the same length. Only return the opening itself.

Model response

AI
As the clock struck midnight, Detective James entered the dimly lit ballroom, his footsteps echoing ominously on the empty dance floor. James's gaze, sharp as ever, surveyed the lavish room, every detail holding a potential clue in his mind. Amidst the deserted tables, a solitary figure lay motionless, adorned in shimmering evening wear. With methodical precision, he approached, now aware of the faintest scent of gunpowder lingering in the air.
id"gen-ZQURWyu5QkOy7AyUgUOfR82QlYba"
total_cost0.0010325
upstream_id"783900d4-56ca-4a6e-9132-fe0c8819322b"
created_at"2024-09-20T15:44:13.306545+00:00" 9/20/2024, 3:44:13 PM
model"cohere/command-r-plus-08-2024"
app_id182717
streamedtrue
cancelledfalse
provider_name"Cohere"
latency66
moderation_latency(null)
generation_time2461
finish_reason"COMPLETE"
tokens_prompt42
tokens_completion95
native_tokens_prompt37
native_tokens_completion94
native_tokens_reasoning(null)
num_media_prompt(null)
num_media_completion(null)
origin"https://ncbench.com/"
usage0.0010325

Evaluation details

Result Evaluator Details Meta Data
18.82% Matches word count n/a
neededCleanfalse
sentences4
wordCounts
021
118
214
317