Run: 2024-09-20-01J881FT1951FZBW8Q36RTS1WD

Run Details

Model:
Cohere Command R+ (Aug. 2024)
Test:
N-Length Sentences
Scenario:
Write sentences with 10 words each
Duration:
1.3s
Cost:
$0.000753
Provider:
Cohere

Evaluation summary

Score Evaluator
Details Link
56.16% Matches word count (details)

Model input

User/Human
Please write the opening scene of a murder mystery where each sentence has exactly 10 words. Please make sure that each sentence has the same length. Only return the opening itself.

Model response

AI
Detective Jules strode into the dimly lit ballroom, music abruptly ceased. Mystery here, starkly still: enraptured by the orchestra's sudden slumber. Attention turns toward her: orchestrated with her fascinating, alluring confidence. Jules nodded, contemplated quietly. Then exclaimed: “Why has the music stopped?”
id"gen-2yt4z37mDr0kOyYf9w2ppd0xgiLn"
total_cost0.0007525
upstream_id"64157e08-0018-4bd4-b4e0-dfafafd7f914"
created_at"2024-09-20T15:40:56.75821+00:00" 9/20/2024, 3:40:56 PM
model"cohere/command-r-plus-08-2024"
app_id182717
streamedtrue
cancelledfalse
provider_name"Cohere"
latency77
moderation_latency(null)
generation_time1107
finish_reason"COMPLETE"
tokens_prompt42
tokens_completion67
native_tokens_prompt37
native_tokens_completion66
native_tokens_reasoning(null)
num_media_prompt(null)
num_media_completion(null)
origin"https://ncbench.com/"
usage0.0007525

Evaluation details

Result Evaluator Details Meta Data
56.16% Matches word count n/a
neededCleanfalse
sentences5
wordCounts
011
110
210
34
47