Run: 2024-08-26-01J68CZB8C48YG4ZTYDDPEDEGQ

Run Details

Model:: Hermes 3 405B
Test:: N-Length Sentences
Scenario:: Write sentences with 10 words each
Duration:: 18.7s
Cost:: $0.000000
Provider:: Lambda

Evaluation summary

Score	Evaluator	Details Link
84.45%	Matches word count	(details)

Model input

User/Human

Please write the opening scene of a murder mystery where each sentence has exactly 10 words.
Please make sure that each sentence has the same length. Only return the opening itself.

Model response

The night was dark and stormy, with rain pouring down. Detective Sarah Johnson arrived at the crime scene, her heart pounding. She stepped out of her car and surveyed the area. The victim lay motionless on the ground, blood pooling around him. Sarah knelt beside the body, examining the wounds carefully. She noticed a small piece of paper clutched in his hand. Carefully, she extracted the note and read its cryptic message. "Find the truth before it's too late," it said. Sarah stood up, determined to unravel the mystery before her. With a deep breath, she began her investigation into the murder.

Evaluation details

Result

Evaluator

Details

Meta Data

84.45%

Matches word count

n/a

neededClean

false

sentences

wordCounts

0	10
1	11
2	10
3	11
4	9
5	11
6	10
7	9
8	10
9	11

id	"gen-hQUKNVYG7aYLnpOGcloMH4GsT1IH"
total_cost	0
upstream_id	"chatcmpl-7223c294-a9f0-4f8e-a363-5d9c80fcdd5e"
created_at	"2024-08-26T22:30:33.835711+00:00" 8/26/2024, 10:30:33 PM
model	"nousresearch/hermes-3-llama-3.1-405b"
app_id	182717
streamed	true
cancelled	false
provider_name	"Lambda"
latency	5750
moderation_latency	(null)
generation_time	12459
finish_reason	"stop"
tokens_prompt	41
tokens_completion	129
native_tokens_prompt	57
native_tokens_completion	130
num_media_prompt	(null)
num_media_completion	(null)
origin	"https://ncbench.com/"
usage	0