Run: 2024-07-14-01J2SC65HVAAY4609DK5ZHT6C6

Run Details

Model:: Claude 3 Haiku
Test:: N-Length Sentences
Scenario:: Write sentences with 20 words each
Duration:: 2.7s
Cost:: $0.000169
Provider:: Anthropic

Evaluation summary

Score	Evaluator	Details Link
0.02%	Matches word count	(details)

Model input

User/Human

Please write the opening scene of a murder mystery where each sentence has exactly 20 words.
Please make sure that each sentence has the same length. Only return the opening itself.

Model response

The rain poured down the misted windows, casting a gloomy pall over the dimly lit study. Detective Amelia Sinclair stepped inside, her keen eyes scanning the room.

A single drop of crimson stained the plush carpet, leading her towards the ornate armchair where a lifeless form lay slumped, a strangled gasp forever etched upon the victim's face.

Kneeling beside the body, Sinclair felt a chill run down her spine, the weight of the impending investigation already weighing heavily on her shoulders.

Evaluation details

Result

Evaluator

Details

Meta Data

0.02%

Matches word count

n/a

neededClean

false

sentences

wordCounts

0	16
1	11
2	30
3	24

id	"gen-gJmWrXnvTEJ0Luuukwt7Oi1pkdZo"
total_cost	0.0001685
upstream_id	"msg_018mUgUSsrWYM2CBzmMGRqWw"
created_at	"2024-07-14T19:40:50.54191+00:00" 7/14/2024, 7:40:50 PM
model	"anthropic/claude-3-haiku:beta"
app_id	182717
streamed	false
cancelled	false
provider_name	"Anthropic"
latency	1197
moderation_latency	(null)
generation_time	0
finish_reason	"end_turn"
tokens_prompt	42
tokens_completion	104
native_tokens_prompt	44
native_tokens_completion	126
num_media_prompt	(null)
num_media_completion	(null)
origin	"https://ncbench.com/"
usage	0.0001685