Run: 2024-07-23-01J3G82A8DDRXH5BG524R261EM

Run Details

Model:: Llama 3.1 8B
Test:: N-Length Sentences
Scenario:: Write sentences with 10 words each
Duration:: 750ms
Cost:: $0.000033
Provider:: Fireworks

Evaluation summary

Score	Evaluator	Details Link
100.00%	Matches word count	(details)

Model input

User/Human

Please write the opening scene of a murder mystery where each sentence has exactly 10 words.
Please make sure that each sentence has the same length. Only return the opening itself.

Model response

Detective Jameson stood outside the mansion with a puzzled expression.
Snowflakes fell gently around him as he surveyed the grounds.
The windows of the mansion were dark and unpainted wooden.
A chill ran down Jameson's spine as he descended steps.
The sound of his boots echoed through the stillness below.
The front door creaked open with a heavy iron hinges.
A butler stood in the doorway with a somber look.
Jameson's eyes locked onto the butler's face with interest sparking.
"Good evening, sir," the butler said with a formal tone.

Evaluation details

Result

Evaluator

Details

Meta Data

100.00%

Matches word count

n/a

neededClean

false

sentences

wordCounts

0	10
1	10
2	10
3	10
4	10
5	10
6	10
7	10
8	10

id	"gen-CCduQHl8CF0Aq0EAAUdPSaN8j9dZ"
total_cost	0.000033
upstream_id	"98f7c9e5-a3ed-43d2-b65d-ac775d56f350"
created_at	"2024-07-23T16:51:20.437663+00:00" 7/23/2024, 4:51:20 PM
model	"meta-llama/llama-3.1-8b-instruct"
app_id	182717
streamed	false
cancelled	false
provider_name	"Fireworks"
latency	560
moderation_latency	(null)
generation_time	0
finish_reason	"stop"
tokens_prompt	76
tokens_completion	119
native_tokens_prompt	44
native_tokens_completion	121
num_media_prompt	(null)
num_media_completion	(null)
origin	"https://ncbench.com/"
usage	0.000033