Run: 2024-08-26-01J68D22E0F6TS8EBP815J4S9C

Run Details

Model:: Hermes 3 405B
Test:: N-Length Sentences
Scenario:: Write sentences with 10 words each
Duration:: 13.2s
Cost:: $0.000000
Provider:: Lambda

Evaluation summary

Score	Evaluator	Details Link
92.22%	Matches word count	(details)

Model input

User/Human

Please write the opening scene of a murder mystery where each sentence has exactly 10 words.
Please make sure that each sentence has the same length. Only return the opening itself.

Model response

The night was dark and stormy, with rain pouring down. Detective Johnson arrived at the crime scene, his heart pounding. The victim lay lifeless on the floor, blood pooling around. The room was in disarray, signs of a struggle evident. Johnson kneeled beside the body, examining the fatal wound. He stood up, surveying the room for potential clues. A shattered vase, a torn curtain, and a dropped earring. The detective's mind raced, piecing together the possible scenario. He called for his team to start processing the scene. Johnson knew that every detail mattered in solving the case.

Evaluation details

Result

Evaluator

Details

Meta Data

92.22%

Matches word count

n/a

neededClean

false

sentences

wordCounts

0	10
1	10
2	10
3	10
4	9
5	9
6	10
7	9
8	10
9	10

id	"gen-4399122DkiAWfqXyOwQnGps0xQym"
total_cost	0
upstream_id	"chatcmpl-a6c7b2c4-c7fc-474a-b52f-c5544912dd17"
created_at	"2024-08-26T22:31:57.70535+00:00" 8/26/2024, 10:31:57 PM
model	"nousresearch/hermes-3-llama-3.1-405b"
app_id	182717
streamed	true
cancelled	false
provider_name	"Lambda"
latency	7919
moderation_latency	(null)
generation_time	5232
finish_reason	"stop"
tokens_prompt	41
tokens_completion	124
native_tokens_prompt	57
native_tokens_completion	125
num_media_prompt	(null)
num_media_completion	(null)
origin	"https://ncbench.com/"
usage	0