Run: 2024-08-27-01J69Q9287T0FM2WVPEW1HQTAN

Run Details

Model:
Hermes 3 405B
Test:
N-Length Sentences
Scenario:
Write sentences with 5 words each
Duration:
3.6s
Cost:
$0.000000
Provider:
Lambda

Evaluation summary

Score Evaluator
Details Link
68.89% Matches word count (details)

Model input

User/Human
Please write the opening scene of a murder mystery where each sentence has exactly 5 words. Please make sure that each sentence has the same length. Only return the opening itself.

Model response

AI
The clock struck midnight. Rain pounded the windows. A scream pierced the night. Detective Johnson woke with a start. He grabbed his gun and ran. The scene was gruesome. Blood splattered the walls. The victim lay motionless on the floor. Johnson surveyed the room carefully. He noticed a clue. A cigarette butt lay near the body. The killer had made a mistake.
id"gen-pHd0IhgCgc2OvwYkL5Jg9ooYJJOw"
total_cost0
upstream_id"chatcmpl-d3ddbe57-e297-42c4-bdf6-b40f6ec9dcfe"
created_at"2024-08-27T10:49:37.560429+00:00" 8/27/2024, 10:49:37 AM
model"nousresearch/hermes-3-llama-3.1-405b"
app_id182717
streamedtrue
cancelledfalse
provider_name"Lambda"
latency980
moderation_latency(null)
generation_time2533
finish_reason"stop"
tokens_prompt41
tokens_completion76
native_tokens_prompt57
native_tokens_completion77
num_media_prompt(null)
num_media_completion(null)
origin"https://ncbench.com/"
usage0

Evaluation details

Result Evaluator Details Meta Data
68.89% Matches word count n/a
neededCleanfalse
sentences12
wordCounts
04
14
25
36
46
54
64
77
85
94
107
116