Run: 2024-09-20-01J881JGKWN5EJXV4N4FYB7QWE

Run Details

Model:
Qwen 2.5 72B
Test:
N-Length Sentences
Scenario:
Write sentences with 20 words each
Duration:
1.3s
Cost:
$0.000035
Provider:
Hyperbolic

Evaluation summary

Score Evaluator
Details Link
60.65% Matches word count (details)

Model input

User/Human
Please write the opening scene of a murder mystery where each sentence has exactly 20 words. Please make sure that each sentence has the same length. Only return the opening itself.

Model response

AI
The storm raged outside, lightning flashed, thunder roared, and the old mansion creaked under the fierce, relentless assault of nature's fury.
id"gen-DLT1j4zlXBEwXznByoqNCxzGBqvn"
total_cost0.0000352
upstream_id"chat-2b9d3ed781e748cbb2b5f657e602f1aa"
created_at"2024-09-20T15:42:25.40423+00:00" 9/20/2024, 3:42:25 PM
model"qwen/qwen-2.5-72b-instruct"
app_id182717
streamedtrue
cancelledfalse
provider_name"Hyperbolic"
latency300
moderation_latency(null)
generation_time855
finish_reason"stop"
tokens_prompt52
tokens_completion31
native_tokens_prompt55
native_tokens_completion33
native_tokens_reasoning(null)
num_media_prompt(null)
num_media_completion(null)
origin"https://ncbench.com/"
usage0.0000352

Evaluation details

Result Evaluator Details Meta Data
60.65% Matches word count n/a
neededCleanfalse
sentences1
wordCounts
021