Run: 2024-08-26-01J68DED4MFW8TG62VM17G9HAJ

Run Details

Model:
Hermes 3 405B
Test:
N-Length Sentences
Scenario:
Write sentences with 20 words each
Duration:
21.0s
Cost:
$0.000000
Provider:
Lambda

Evaluation summary

Score Evaluator
Details Link
20.47% Matches word count (details)

Model input

User/Human
Please write the opening scene of a murder mystery where each sentence has exactly 20 words. Please make sure that each sentence has the same length. Only return the opening itself.

Model response

AI
The night was dark and stormy, with rain pounding against the windows of the old, Victorian mansion. Inside, the guests had gathered for a dinner party, unaware of the tragedy that was about to unfold. The host, Lord Ashcroft, stood at the head of the table, his eyes darting nervously around the room. As the clock struck eight, a bloodcurdling scream echoed through the halls, sending a chill down everyone's spine. The guests rushed to the source of the sound, only to find Lord Ashcroft's body lying in a pool of blood.
id"gen-S5PRxLBietBuYspJdDoQNSuQcJaY"
total_cost0
upstream_id"chatcmpl-65aacada-72ab-44f0-8be2-e1714099cf8b"
created_at"2024-08-26T22:38:49.692743+00:00" 8/26/2024, 10:38:49 PM
model"nousresearch/hermes-3-llama-3.1-405b"
app_id182717
streamedtrue
cancelledfalse
provider_name"Lambda"
latency8820
moderation_latency(null)
generation_time12141
finish_reason"stop"
tokens_prompt41
tokens_completion116
native_tokens_prompt57
native_tokens_completion117
num_media_prompt(null)
num_media_completion(null)
origin"https://ncbench.com/"
usage0

Evaluation details

Result Evaluator Details Meta Data
20.47% Matches word count n/a
neededCleanfalse
sentences5
wordCounts
017
118
218
318
421