Run: 2024-08-26-01J68DF3ETCVY6X6PSGDGFM1NK

Run Details

Model:: Hermes 3 70B
Test:: N-Length Sentences
Scenario:: Write sentences with 10 words each
Duration:: 3.9s
Cost:: $0.000050
Provider:: Hyperbolic

Evaluation summary

Score	Evaluator	Details Link
57.00%	Matches word count	(details)

Model input

User/Human

Please write the opening scene of a murder mystery where each sentence has exactly 10 words.
Please make sure that each sentence has the same length. Only return the opening itself.

Model response

The body lay cold on the floor, blood pooling around it. Detective Johnson arrived on the scene, surveying the grisly sight before him. He noticed a strange symbol carved into the victim's chest. The room was eerily silent, save for the hum of the fluorescent lights. Johnson knew this was only the beginning of a perplexing case.

Evaluation details

Result

Evaluator

Details

Meta Data

57.00%

Matches word count

n/a

neededClean

false

sentences

wordCounts

0	11
1	12
2	10
3	13
4	11

id	"gen-lXIsbf2uvPj6We9YOLLA3VnzwnST"
total_cost	0.0000496
upstream_id	"chat-8c100bad38a6491f99abe9da4e94e905"
created_at	"2024-08-26T22:38:55.452519+00:00" 8/26/2024, 10:38:55 PM
model	"nousresearch/hermes-3-llama-3.1-70b"
app_id	182717
streamed	true
cancelled	false
provider_name	"Hyperbolic"
latency	1405
moderation_latency	(null)
generation_time	2435
finish_reason	"stop"
tokens_prompt	49
tokens_completion	70
native_tokens_prompt	52
native_tokens_completion	72
num_media_prompt	(null)
num_media_completion	(null)
origin	"https://ncbench.com/"
usage	0.0000496