Run: 2024-08-26-01J68CZJM7M324DDEXB6JE3QP4

Run Details

Model:: Hermes 3 70B
Test:: N-Length Sentences
Scenario:: Write sentences with 10 words each
Duration:: 4.5s
Cost:: $0.000057
Provider:: Hyperbolic

Evaluation summary

Score	Evaluator	Details Link
41.07%	Matches word count	(details)

Model input

User/Human

Please write the opening scene of a murder mystery where each sentence has exactly 10 words.
Please make sure that each sentence has the same length. Only return the opening itself.

Model response

The body lay face down on the floor, blood pooling around it. Detective Johnson entered the room, his eyes scanning the scene. He knelt beside the victim, checking for a pulse. There was none; the man was dead. Johnson stood up, pulling out a notepad. He began jotting down observations and details. The room was cluttered with papers and books. A shattered lamp lay nearby, its bulb flickering erratically.

Evaluation details

Result

Evaluator

Details

Meta Data

41.07%

Matches word count

n/a

neededClean

false

sentences

wordCounts

0	12
1	10
2	9
3	7
4	7
5	7
6	8
7	9

id	"gen-Qg7QV1tbiJOaBxzl0XopixRCWcaV"
total_cost	0.0000572
upstream_id	"chat-14ba445f92dd4d6abe81511120b53804"
created_at	"2024-08-26T22:30:27.256956+00:00" 8/26/2024, 10:30:27 PM
model	"nousresearch/hermes-3-llama-3.1-70b"
app_id	182717
streamed	true
cancelled	false
provider_name	"Hyperbolic"
latency	37
moderation_latency	(null)
generation_time	4406
finish_reason	"stop"
tokens_prompt	49
tokens_completion	89
native_tokens_prompt	52
native_tokens_completion	91
num_media_prompt	(null)
num_media_completion	(null)
origin	"https://ncbench.com/"
usage	0.0000572