Run: 2024-07-23-01J3G81D2C6W9PNVGYTESYJDDX

Run Details

Model:: Llama 3.1 8B
Test:: N-Length Sentences
Scenario:: Write sentences with 20 words each
Duration:: 2.0s
Cost:: $0.000030
Provider:: Fireworks

Evaluation summary

Score	Evaluator	Details Link
24.50%	Matches word count	(details)

Model input

User/Human

Please write the opening scene of a murder mystery where each sentence has exactly 20 words.
Please make sure that each sentence has the same length. Only return the opening itself.

Model response

Sunset cast a golden glow over the picturesque village of Ravenswood, nestled in the rolling hills of England yesterday.
The annual summer festival had just wrapped up, and the sound of laughter still lingered in the air unfortunately.
People were still chatting and socializing, but the atmosphere had begun to grow increasingly awkward noticeably somehow.
A faint cry echoed through the streets, piercing the evening calm with its shrill desperation instantly.
A figure stumbled into the town square, blood-soaked and gasping for breath with incredible urgency suddenly.

Evaluation details

Result

Evaluator

Details

Meta Data

24.50%

Matches word count

n/a

neededClean

false

sentences

wordCounts

0	19
1	19
2	17
3	16
4	16

id	"gen-1yrM7ts55F773V1YQU5S8fvHhWQo"
total_cost	0.0000302
upstream_id	"b30aebfd-7f98-41ee-80ff-f1241c758d30"
created_at	"2024-07-23T16:50:51.915227+00:00" 7/23/2024, 4:50:51 PM
model	"meta-llama/llama-3.1-8b-instruct"
app_id	182717
streamed	false
cancelled	false
provider_name	"Fireworks"
latency	420
moderation_latency	(null)
generation_time	0
finish_reason	"stop"
tokens_prompt	76
tokens_completion	105
native_tokens_prompt	44
native_tokens_completion	107
num_media_prompt	(null)
num_media_completion	(null)
origin	"https://ncbench.com/"
usage	0.0000302