Run: 2024-07-14-01J2SC65HVERNMZHKR8WQHH7SX

Run Details

Model:
Claude 3 Haiku
Test:
N-Length Sentences
Scenario:
Write sentences with 20 words each
Duration:
2.7s
Cost:
$0.000117
Provider:
Anthropic

Evaluation summary

Score Evaluator
Details Link
15.16% Matches word count (details)

Model input

User/Human
Please write the opening scene of a murder mystery where each sentence has exactly 20 words. Please make sure that each sentence has the same length. Only return the opening itself.

Model response

AI
The rain pattered against the windowpane, casting long shadows across the dimly lit study. Detective Harrington stepped through the doorway, his gaze sweeping the room. Scattered papers and overturned furniture suggested a struggle, and the lifeless body of the wealthy businessman lay motionless on the floor. Harrington approached cautiously, noting the fatal gunshot wound.
id"gen-SPl6KRMcy6ODy0ac6vPpurKKWlw2"
total_cost0.00011725
upstream_id"msg_01C7rEcHuK4Aq8mfJ4QpK8UD"
created_at"2024-07-14T19:40:50.398023+00:00" 7/14/2024, 7:40:50 PM
model"anthropic/claude-3-haiku:beta"
app_id182717
streamedfalse
cancelledfalse
provider_name"Anthropic"
latency837
moderation_latency(null)
generation_time0
finish_reason"end_turn"
tokens_prompt42
tokens_completion70
native_tokens_prompt44
native_tokens_completion85
num_media_prompt(null)
num_media_completion(null)
origin"https://ncbench.com/"
usage0.00011725

Evaluation details

Result Evaluator Details Meta Data
15.16% Matches word count n/a
neededCleanfalse
sentences4
wordCounts
014
111
221
38