Run: 2024-08-26-01J68D1ZKCFKWXTA5MZRANRFK5

Run Details

Model:: Hermes 3 70B
Test:: N-Length Sentences
Scenario:: Write sentences with 10 words each
Duration:: 7.3s
Cost:: $0.000067
Provider:: Hyperbolic

Evaluation summary

Score	Evaluator	Details Link
80.72%	Matches word count	(details)

Model input

User/Human

Please write the opening scene of a murder mystery where each sentence has exactly 10 words.
Please make sure that each sentence has the same length. Only return the opening itself.

Model response

The storm raged outside, casting eerie shadows across the room. Detective Johnson arrived at the mansion, his trench coat drenched. The butler ushered him inside, his face pale with fear. In the study, the body lay motionless, a gaping wound. Blood pooled around the victim, dark and slick. The detective knelt beside the corpse, examining the scene. Clues littered the room, each one a tantalizing puzzle. He would solve this case, no matter the cost. The game was afoot, and the killer would pay.

Evaluation details

Result

Evaluator

Details

Meta Data

80.72%

Matches word count

n/a

neededClean

false

sentences

wordCounts

0	10
1	10
2	10
3	10
4	8
5	9
6	9
7	9
8	9

id	"gen-5DXboPOb5OvBMsuiyLMziqLvsfOO"
total_cost	0.0000668
upstream_id	"chat-e3e40f1bfafe4881b4a51ecad136f694"
created_at	"2024-08-26T22:31:48.888497+00:00" 8/26/2024, 10:31:48 PM
model	"nousresearch/hermes-3-llama-3.1-70b"
app_id	182717
streamed	true
cancelled	false
provider_name	"Hyperbolic"
latency	626
moderation_latency	(null)
generation_time	5841
finish_reason	"stop"
tokens_prompt	49
tokens_completion	113
native_tokens_prompt	52
native_tokens_completion	115
num_media_prompt	(null)
num_media_completion	(null)
origin	"https://ncbench.com/"
usage	0.0000668