Run: 2024-09-20-01J881BMC0AEPZ957N2F8QCXAN

Run Details

Model:
Qwen 2.5 72B
Test:
N-Length Sentences
Scenario:
Write sentences with 20 words each
Duration:
2.5s
Cost:
$0.000036
Provider:
Hyperbolic

Evaluation summary

Score Evaluator
Details Link
60.65% Matches word count (details)

Model input

User/Human
Please write the opening scene of a murder mystery where each sentence has exactly 20 words. Please make sure that each sentence has the same length. Only return the opening itself.

Model response

AI
The heavy, oak door creaked open, revealing a dimly lit room, where silence hung thick, heavy, ominous, foreboding, terrifying.
id"gen-v89omZQyKcle5ZmtLJs9U8dSaGWC"
total_cost0.0000356
upstream_id"chat-0f5b584ece264ad68e9f7558e4697440"
created_at"2024-09-20T15:38:41.22281+00:00" 9/20/2024, 3:38:41 PM
model"qwen/qwen-2.5-72b-instruct"
app_id182717
streamedtrue
cancelledfalse
provider_name"Hyperbolic"
latency509
moderation_latency(null)
generation_time1878
finish_reason"stop"
tokens_prompt52
tokens_completion32
native_tokens_prompt55
native_tokens_completion34
native_tokens_reasoning(null)
num_media_prompt(null)
num_media_completion(null)
origin"https://ncbench.com/"
usage0.0000356

Evaluation details

Result Evaluator Details Meta Data
60.65% Matches word count n/a
neededCleanfalse
sentences1
wordCounts
019