Run: 2024-08-26-01J68DB3ZPC47EF4Q3BP73GH62

Run Details

Model:
Hermes 3 405B
Test:
N-Length Sentences
Scenario:
Write sentences with 5 words each
Duration:
7.6s
Cost:
$0.000000
Provider:
Lambda

Evaluation summary

Score Evaluator
Details Link
86.73% Matches word count (details)

Model input

User/Human
Please write the opening scene of a murder mystery where each sentence has exactly 5 words. Please make sure that each sentence has the same length. Only return the opening itself.

Model response

AI
The night was dark and stormy. Detective Johnson arrived at the scene. A body lay on the floor. Blood pooled around the victim's head. The room was in disarray. Furniture was overturned and broken. The killer had left no traces. Johnson surveyed the gruesome sight. He took careful notes and pictures. The investigation had just begun.
id"gen-b2YwLD8y1CzvMRh082RYSTcEccqN"
total_cost0
upstream_id"chatcmpl-6c8a70b6-7334-47e3-8e67-c4890bc2d265"
created_at"2024-08-26T22:36:48.544579+00:00" 8/26/2024, 10:36:48 PM
model"nousresearch/hermes-3-llama-3.1-405b"
app_id182717
streamedtrue
cancelledfalse
provider_name"Lambda"
latency3041
moderation_latency(null)
generation_time4441
finish_reason"stop"
tokens_prompt41
tokens_completion71
native_tokens_prompt57
native_tokens_completion72
num_media_prompt(null)
num_media_completion(null)
origin"https://ncbench.com/"
usage0

Evaluation details

Result Evaluator Details Meta Data
86.73% Matches word count n/a
neededCleanfalse
sentences10
wordCounts
06
16
26
36
45
55
66
75
86
95