Run: 2024-09-20-01J881C96F6ZQS36HVSE1HE3XN

Run Details

Model:
Cohere Command R+ (Aug. 2024)
Test:
N-Length Sentences
Scenario:
Write sentences with 5 words each
Duration:
963ms
Cost:
$0.000490
Provider:
Cohere

Evaluation summary

Score Evaluator
Details Link
75.58% Matches word count (details)

Model input

User/Human
Please write the opening scene of a murder mystery where each sentence has exactly 5 words. Please make sure that each sentence has the same length. Only return the opening itself.

Model response

AI
"She found him dead. Lying next to the fountain. Police were called, and then, everyone started whispering. The old clock chimed midnight. Who could have done this?"
id"gen-4io5ZHcTVENckTNMWR2YLSOSCZCS"
total_cost0.00049
upstream_id"c610f04e-87e7-4ee0-8e09-e69dc52c0c98"
created_at"2024-09-20T15:39:00.821926+00:00" 9/20/2024, 3:39:00 PM
model"cohere/command-r-plus-08-2024"
app_id182717
streamedtrue
cancelledfalse
provider_name"Cohere"
latency67
moderation_latency(null)
generation_time714
finish_reason"COMPLETE"
tokens_prompt42
tokens_completion37
native_tokens_prompt36
native_tokens_completion40
native_tokens_reasoning(null)
num_media_prompt(null)
num_media_completion(null)
origin"https://ncbench.com/"
usage0.00049

Evaluation details

Result Evaluator Details Meta Data
75.58% Matches word count n/a
neededCleanfalse
sentences5
wordCounts
04
15
28
35
45