Run: 2024-08-26-01J68D1NCNMCEBW7D1SK8TR6KP

Run Details

Model:
Hermes 3 405B
Test:
N-Length Sentences
Scenario:
Write sentences with 5 words each
Duration:
7.8s
Cost:
$0.000000
Provider:
Lambda

Evaluation summary

Score Evaluator
Details Link
80.09% Matches word count (details)

Model input

User/Human
Please write the opening scene of a murder mystery where each sentence has exactly 5 words. Please make sure that each sentence has the same length. Only return the opening itself.

Model response

AI
The clock struck midnight. The scream echoed loudly. The body lay lifeless. The detective arrived promptly. The investigation began swiftly. The clues were scarce. The tension mounted quickly. The suspects were questioned thoroughly. The alibis seemed shaky. The truth remained hidden.
id"gen-2BGHFpkGlBRibLfgt0vYk8gTU5Q5"
total_cost0
upstream_id"chatcmpl-10c7486b-0f7a-48c7-9d91-bfa4eb5a2d6a"
created_at"2024-08-26T22:31:38.874884+00:00" 8/26/2024, 10:31:38 PM
model"nousresearch/hermes-3-llama-3.1-405b"
app_id182717
streamedtrue
cancelledfalse
provider_name"Lambda"
latency1914
moderation_latency(null)
generation_time5776
finish_reason"stop"
tokens_prompt41
tokens_completion54
native_tokens_prompt57
native_tokens_completion55
num_media_prompt(null)
num_media_completion(null)
origin"https://ncbench.com/"
usage0

Evaluation details

Result Evaluator Details Meta Data
80.09% Matches word count n/a
neededCleanfalse
sentences10
wordCounts
04
14
24
34
44
54
64
75
84
94