Run: 2024-08-26-01J68D6ZHYRHNDBSQVJQTQKM6N

Run Details

Model:: Hermes 3 405B
Test:: N-Length Sentences
Scenario:: Write sentences with 5 words each
Duration:: 12.0s
Cost:: $0.000000
Provider:: Lambda

Evaluation summary

Score	Evaluator	Details Link
84.52%	Matches word count	(details)

Model input

User/Human

Please write the opening scene of a murder mystery where each sentence has exactly 5 words.
Please make sure that each sentence has the same length. Only return the opening itself.

Model response

The night was cold and dark. A scream echoed through the mist. Detective Larson arrived at the scene. The victim lay motionless, bloodied. A knife protruded from his back. Larson surveyed the area carefully. Footprints led away from the body. He followed them into the shadows. The killer was still out there. Larson vowed to find them.

Evaluation details

Result

Evaluator

Details

Meta Data

84.52%

Matches word count

n/a

neededClean

false

sentences

wordCounts

0	6
1	6
2	6
3	5
4	6
5	5
6	6
7	6
8	6
9	5

id	"gen-SYTcArGpffa0psbv66aHscoKwcsX"
total_cost	0
upstream_id	"chatcmpl-73d54049-4522-44fc-a57b-2f186c695d3a"
created_at	"2024-08-26T22:34:37.369408+00:00" 8/26/2024, 10:34:37 PM
model	"nousresearch/hermes-3-llama-3.1-405b"
app_id	182717
streamed	true
cancelled	false
provider_name	"Lambda"
latency	4760
moderation_latency	(null)
generation_time	7187
finish_reason	"stop"
tokens_prompt	41
tokens_completion	72
native_tokens_prompt	57
native_tokens_completion	73
num_media_prompt	(null)
num_media_completion	(null)
origin	"https://ncbench.com/"
usage	0