Run: 2024-09-20-01J881B85QV4DNRXCVKJTR1XTB

Run Details

Model:
Cohere Command R+ (Aug. 2024)
Test:
N-Length Sentences
Scenario:
Write sentences with 10 words each
Duration:
2.0s
Cost:
$0.000953
Provider:
Cohere

Evaluation summary

Score Evaluator
Details Link
58.94% Matches word count (details)

Model input

User/Human
Please write the opening scene of a murder mystery where each sentence has exactly 10 words. Please make sure that each sentence has the same length. Only return the opening itself.

Model response

AI
Several friends reunite for a weekend trip to their hometown. On Friday night, they gather at an old cottage. After a fun-filled evening, they retire to their bedrooms. Awakening the next morning, they find James missing. A search ensues, leading to a gruesome discovery. Inside the woodshed, James lies dead, his face pale. Panic erupts as they realize this is murder.
id"gen-hFRpXjvwcVmRaLjZrf22GpWJxVer"
total_cost0.0009525
upstream_id"f8fc0f5c-525f-4c95-9174-20bc04d6f2c1"
created_at"2024-09-20T15:38:28.09708+00:00" 9/20/2024, 3:38:28 PM
model"cohere/command-r-plus-08-2024"
app_id182717
streamedtrue
cancelledfalse
provider_name"Cohere"
latency64
moderation_latency(null)
generation_time1808
finish_reason"COMPLETE"
tokens_prompt42
tokens_completion81
native_tokens_prompt37
native_tokens_completion86
native_tokens_reasoning(null)
num_media_prompt(null)
num_media_completion(null)
origin"https://ncbench.com/"
usage0.0009525

Evaluation details

Result Evaluator Details Meta Data
58.94% Matches word count n/a
neededCleanfalse
sentences7
wordCounts
010
19
29
38
48
59
68