Run: 2024-09-20-01J881HC5Z70ZC7EDNW0CJ7P5S

Run Details

Model:
Cohere Command R+ (Aug. 2024)
Test:
N-Length Sentences
Scenario:
Write sentences with 10 words each
Duration:
909ms
Cost:
$0.000423
Provider:
Cohere

Evaluation summary

Score Evaluator
Details Link
18.42% Matches word count (details)

Model input

User/Human
Please write the opening scene of a murder mystery where each sentence has exactly 10 words. Please make sure that each sentence has the same length. Only return the opening itself.

Model response

AI
On a tranquil Sunday morning, an eccentric socialite's mansion falls eerily silent. Body discovered, an enigmatic guest, the luxurious dining room becomes a crime scene.
id"gen-b0RBcBFgVQBFDchlY5hG6udlAl8r"
total_cost0.0004225
upstream_id"620f6141-31e9-4920-854e-c47ffcd92692"
created_at"2024-09-20T15:41:47.668041+00:00" 9/20/2024, 3:41:47 PM
model"cohere/command-r-plus-08-2024"
app_id182717
streamedtrue
cancelledfalse
provider_name"Cohere"
latency69
moderation_latency(null)
generation_time692
finish_reason"COMPLETE"
tokens_prompt42
tokens_completion34
native_tokens_prompt37
native_tokens_completion33
native_tokens_reasoning(null)
num_media_prompt(null)
num_media_completion(null)
origin"https://ncbench.com/"
usage0.0004225

Evaluation details

Result Evaluator Details Meta Data
18.42% Matches word count n/a
neededCleanfalse
sentences2
wordCounts
012
113