Run: 2024-07-23-01J3G8163SFWMJPVV53QPZ8E9N

Run Details

Model:: Llama 3.1 8B
Test:: N-Length Sentences
Scenario:: Write sentences with 5 words each
Duration:: 556ms
Cost:: $0.000027
Provider:: Fireworks

Evaluation summary

Score	Evaluator	Details Link
100.00%	Matches word count	(details)

Model input

User/Human

Please write the opening scene of a murder mystery where each sentence has exactly 5 words.
Please make sure that each sentence has the same length. Only return the opening itself.

Model response

Dark and stormy night arrived.
Heavy rain pounded the pavement.
Flashlight shone in the darkness.
Sound of footsteps came closer.
Detective Jameson felt a chill.
He hurried home quickly outside.
Front door creaked loudly open.
A gust of wind followed.
His heart rate increased suddenly.
He stepped inside feeling relieved.
Banging noise came from upstairs.
He climbed up slowly creaking.
A faint smell of smoke.

Evaluation details

Result

Evaluator

Details

Meta Data

100.00%

Matches word count

n/a

neededClean

false

sentences

wordCounts

0	5
1	5
2	5
3	5
4	5
5	5
6	5
7	5
8	5
9	5
10	5
11	5
12	5

id	"gen-K7fTTJnL1mh0ny0r4PD5r5N0g4xy"
total_cost	0.0000268
upstream_id	"52073f77-41ea-44bb-b57a-f02ef1509c3e"
created_at	"2024-07-23T16:50:43.218279+00:00" 7/23/2024, 4:50:43 PM
model	"meta-llama/llama-3.1-8b-instruct"
app_id	182717
streamed	false
cancelled	false
provider_name	"Fireworks"
latency	422
moderation_latency	(null)
generation_time	0
finish_reason	"stop"
tokens_prompt	76
tokens_completion	88
native_tokens_prompt	44
native_tokens_completion	90
num_media_prompt	(null)
num_media_completion	(null)
origin	"https://ncbench.com/"
usage	0.0000268