Run: 2024-09-20-01J881K92507D4HG7QD2CBX3VG

Run Details

Model:
Cohere Command R+ (Aug. 2024)
Test:
N-Length Sentences
Scenario:
Write sentences with 5 words each
Duration:
3.4s
Cost:
$0.000440
Provider:
Cohere

Evaluation summary

Score Evaluator
Details Link
88.94% Matches word count (details)

Model input

User/Human
Please write the opening scene of a murder mystery where each sentence has exactly 5 words. Please make sure that each sentence has the same length. Only return the opening itself.

Model response

AI
He checked the dark woods. Suspensefully, he walked down the path. The detective saw strange scratches. Who would have been so close?
id"gen-h2Rt7NaUFtJldEr9aFmOROtWRuWi"
total_cost0.00044
upstream_id"a97e35be-2b9a-490d-9fa0-b5d5c1fb43e8"
created_at"2024-09-20T15:42:52.486721+00:00" 9/20/2024, 3:42:52 PM
model"cohere/command-r-plus-08-2024"
app_id182717
streamedtrue
cancelledfalse
provider_name"Cohere"
latency80
moderation_latency(null)
generation_time3141
finish_reason"COMPLETE"
tokens_prompt42
tokens_completion32
native_tokens_prompt36
native_tokens_completion35
native_tokens_reasoning(null)
num_media_prompt(null)
num_media_completion(null)
origin"https://ncbench.com/"
usage0.00044

Evaluation details

Result Evaluator Details Meta Data
88.94% Matches word count n/a
neededCleanfalse
sentences4
wordCounts
05
16
25
36