Run: 2024-09-20-01J881H5811CVAQ3418PQW34RP

Run Details

Model:: Qwen 2.5 72B
Test:: N-Length Sentences
Scenario:: Write sentences with 10 words each
Duration:: 4.3s
Cost:: $0.000086
Provider:: Hyperbolic

Evaluation summary

Score	Evaluator	Details Link
92.22%	Matches word count	(details)

Model input

User/Human

Please write the opening scene of a murder mystery where each sentence has exactly 10 words.
Please make sure that each sentence has the same length. Only return the opening itself.

Model response

Thunder roared, lightning flashed, as old mansion creaked ominously nearby. 
Detective Jane arrived, her senses alert, greeted by eerie silence. 
Rain poured relentlessly, obscuring visibility, drenching her from head. 
Grimacing, she pushed heavy gate, noticing ominous shadows stirring within. 
Heart pounding, nerves taut, she stepped cautiously onto cobbled pathway. 
Suddenly, a chill swept through air, sending shivers down. 
Reaching front door, she knocked thrice, sound echoing eerily around. 
No answer came, despite her insistent, repeated, fearful knocking there. 
Unsheathing her flashlight, beam cut through darkness, revealing ancient hall. 
Determined, Detective Jane entered, senses heightened, anticipating unseen peril.

Evaluation details

Result

Evaluator

Details

Meta Data

92.22%

Matches word count

n/a

neededClean

false

sentences

wordCounts

0	10
1	10
2	9
3	10
4	10
5	9
6	10
7	10
8	10
9	9

id	"gen-Z96ZB7Z6Ta0KBn0BUZB5JN9L8aq1"
total_cost	0.000086
upstream_id	"chat-34fb1917fc934e68bb325ec3ad7e6cec"
created_at	"2024-09-20T15:41:44.144078+00:00" 9/20/2024, 3:41:44 PM
model	"qwen/qwen-2.5-72b-instruct"
app_id	182717
streamed	true
cancelled	false
provider_name	"Hyperbolic"
latency	471
moderation_latency	(null)
generation_time	3686
finish_reason	"stop"
tokens_prompt	52
tokens_completion	158
native_tokens_prompt	55
native_tokens_completion	160
native_tokens_reasoning	(null)
num_media_prompt	(null)
num_media_completion	(null)
origin	"https://ncbench.com/"
usage	0.000086