Run: 2024-09-20-01J881FHKN337EM627JK5D6125

Run Details

Model:
Cohere Command R+ (Aug. 2024)
Test:
N-Length Sentences
Scenario:
Write sentences with 5 words each
Duration:
1.0s
Cost:
$0.000510
Provider:
Cohere

Evaluation summary

Score Evaluator
Details Link
36.31% Matches word count (details)

Model input

User/Human
Please write the opening scene of a murder mystery where each sentence has exactly 5 words. Please make sure that each sentence has the same length. Only return the opening itself.

Model response

AI
Inspector Kline was tasked with an urgent case. Despite his experience, an odd feeling lingered. A wealthy heiress, Emily Wilde, murdered. Found strangled in her mansion. Red lipstick everywhere.
id"gen-qYpt6yxPLTrFzNoPzEXM2tzuIHZ4"
total_cost0.00051
upstream_id"d44de4ab-23cc-4d8e-858d-838b24196adb"
created_at"2024-09-20T15:40:47.84022+00:00" 9/20/2024, 3:40:47 PM
model"cohere/command-r-plus-08-2024"
app_id182717
streamedtrue
cancelledfalse
provider_name"Cohere"
latency66
moderation_latency(null)
generation_time762
finish_reason"COMPLETE"
tokens_prompt42
tokens_completion41
native_tokens_prompt36
native_tokens_completion42
native_tokens_reasoning(null)
num_media_prompt(null)
num_media_completion(null)
origin"https://ncbench.com/"
usage0.00051

Evaluation details

Result Evaluator Details Meta Data
36.31% Matches word count n/a
neededCleanfalse
sentences5
wordCounts
08
17
26
35
43