Run: 2024-07-14-01J2SC65HTGF9FJH0SKS3TQFPH

Run Details

Model:
Claude 3 Haiku
Test:
N-Length Sentences
Scenario:
Write sentences with 5 words each
Duration:
2.6s
Cost:
$0.000083
Provider:
Anthropic

Evaluation summary

Score Evaluator
Details Link
47.09% Matches word count (details)

Model input

User/Human
Please write the opening scene of a murder mystery where each sentence has exactly 5 words. Please make sure that each sentence has the same length. Only return the opening itself.

Model response

AI
The heavy rain battered the windowpanes. Shadows crept across the dimly lit room. A lone figure sat silently, contemplating. Tension hung thick in the air. Suddenly, a loud crash echoed through the silence.
id"gen-4hrSeYG95KOydRppk5hZkJ4AuNyI"
total_cost0.0000835
upstream_id"msg_017MUEKJ94zDEomtReaS2G7Q"
created_at"2024-07-14T19:40:49.894522+00:00" 7/14/2024, 7:40:49 PM
model"anthropic/claude-3-haiku:beta"
app_id182717
streamedfalse
cancelledfalse
provider_name"Anthropic"
latency626
moderation_latency(null)
generation_time0
finish_reason"end_turn"
tokens_prompt42
tokens_completion46
native_tokens_prompt44
native_tokens_completion58
num_media_prompt(null)
num_media_completion(null)
origin"https://ncbench.com/"
usage0.0000835

Evaluation details

Result Evaluator Details Meta Data
47.09% Matches word count n/a
neededCleanfalse
sentences5
wordCounts
06
17
26
36
48