Run: 2024-07-23-01J3G825M4JZZAJ29WZQK5FMGH

Run Details

Model:: Llama 3.1 8B
Test:: N-Length Sentences
Scenario:: Write sentences with 20 words each
Duration:: 603ms
Cost:: $0.000026
Provider:: Fireworks

Evaluation summary

Score	Evaluator	Details Link
73.77%	Matches word count	(details)

Model input

User/Human

Please write the opening scene of a murder mystery where each sentence has exactly 20 words.
Please make sure that each sentence has the same length. Only return the opening itself.

Model response

Here is the opening scene with each sentence having exactly 20 words:

Detective Jameson stepped out of the rain and into the warm glow of the precinct's fluorescent office lighting instantly.
A mixture of fatigue and intrigue played on his ruggedly handsome face as he began to investigate the case further.
Rumors of a high-profile murder had been circulating for hours, and Jameson was not one to miss the excitement.

Evaluation details

Result

Evaluator

Details

Meta Data

73.77%

Matches word count

n/a

neededClean

true

sentences

wordCounts

0	19
1	20
2	19

id	"gen-Zm2bZ4ekoJ5EU5mpqUFzBgJ0l4uZ"
total_cost	0.000026
upstream_id	"9d5bde8f-2bdb-42de-acca-3cfaa249061a"
created_at	"2024-07-23T16:51:15.705918+00:00" 7/23/2024, 4:51:15 PM
model	"meta-llama/llama-3.1-8b-instruct"
app_id	182717
streamed	false
cancelled	false
provider_name	"Fireworks"
latency	420
moderation_latency	(null)
generation_time	0
finish_reason	"stop"
tokens_prompt	76
tokens_completion	84
native_tokens_prompt	44
native_tokens_completion	86
num_media_prompt	(null)
num_media_completion	(null)
origin	"https://ncbench.com/"
usage	0.000026