Run: 2024-09-20-01J881K44X8VED3VQXMS57G5PQ

Run Details

Model:
Cohere Command R+ (Aug. 2024)
Test:
N-Length Sentences
Scenario:
Write sentences with 5 words each
Duration:
1.8s
Cost:
$0.000660
Provider:
Cohere

Evaluation summary

Score Evaluator
Details Link
81.57% Matches word count (details)

Model input

User/Human
Please write the opening scene of a murder mystery where each sentence has exactly 5 words. Please make sure that each sentence has the same length. Only return the opening itself.

Model response

AI
A quiet town, an eerie mist. Bridge over river, an abandoned car. Outside, on the bench, a man. Not moving; bone-chilling silence surrounds. Police arrive promptly, avoiding any disruption. At nightfall, they inspect with caution.
id"gen-rSxkNgGtNthTW2d1mLl4svWrI0eE"
total_cost0.00066
upstream_id"f8508a85-26ad-4eb1-b53f-2dbd720142e0"
created_at"2024-09-20T15:42:46.154427+00:00" 9/20/2024, 3:42:46 PM
model"cohere/command-r-plus-08-2024"
app_id182717
streamedtrue
cancelledfalse
provider_name"Cohere"
latency70
moderation_latency(null)
generation_time1558
finish_reason"COMPLETE"
tokens_prompt42
tokens_completion51
native_tokens_prompt36
native_tokens_completion57
native_tokens_reasoning(null)
num_media_prompt(null)
num_media_completion(null)
origin"https://ncbench.com/"
usage0.00066

Evaluation details

Result Evaluator Details Meta Data
81.57% Matches word count n/a
neededCleanfalse
sentences6
wordCounts
06
16
26
35
46
56