Run: 2024-08-26-01J68D00M73B8YFB9P10M0TZ03

Run Details

Model:: Hermes 3 70B
Test:: N-Length Sentences
Scenario:: Write sentences with 20 words each
Duration:: 5.5s
Cost:: $0.000067
Provider:: Hyperbolic

Evaluation summary

Score	Evaluator	Details Link
0.39%	Matches word count	(details)

Model input

User/Human

Please write the opening scene of a murder mystery where each sentence has exactly 20 words.
Please make sure that each sentence has the same length. Only return the opening itself.

Model response

The sun rose over the sleepy town of Millfield, casting a warm glow on the quaint streets. Detective Olivia Hartwell received an urgent call from the station, her heart raced as she listened. She quickly dressed and rushed to the crime scene, a sense of dread washing over her. The body lay in a pool of blood, a cryptic note clutched in the victim's hand. Olivia carefully examined the scene, her mind already working to unravel the mystery. She knew this case would test her skills like never before, and failure was not an option.

Evaluation details

Result

Evaluator

Details

Meta Data

0.39%

Matches word count

n/a

neededClean

false

sentences

wordCounts

0	17
1	16
2	16
3	16
4	13
5	17

id	"gen-JOypAz5ndozuY2iafNUBkRj9iMm1"
total_cost	0.0000668
upstream_id	"chat-4dcd3945faaa4ca9a0c65242cd1516f4"
created_at	"2024-08-26T22:30:42.534759+00:00" 8/26/2024, 10:30:42 PM
model	"nousresearch/hermes-3-llama-3.1-70b"
app_id	182717
streamed	true
cancelled	false
provider_name	"Hyperbolic"
latency	255
moderation_latency	(null)
generation_time	5131
finish_reason	"stop"
tokens_prompt	49
tokens_completion	113
native_tokens_prompt	52
native_tokens_completion	115
num_media_prompt	(null)
num_media_completion	(null)
origin	"https://ncbench.com/"
usage	0.0000668