NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2024-07-23-01J3G80WDESB51CWDV56DSDMDY
Run Details
Model:
Llama 3.1 8B
Test:
N-Length Sentences
Scenario:
Write sentences with 20 words each
Duration:
975ms
Cost:
$0.000041
Provider:
Fireworks
Evaluation summary
Score
Evaluator
Details Link
32.95%
Matches word count
(details)
Model input
User/Human
Please write the opening scene of a murder mystery where each sentence has exactly 20 words. Please make sure that each sentence has the same length. Only return the opening itself.
Model response
Messages
Meta
AI
Detective Jameson stood outside the luxurious mansion, its sprawling gardens hidden behind dense shrubs and tall oak trees very early morning. Police sirens echoed through the quiet streets, growing louder as they responded to the frantic call from the local constable yesterday. A chill ran down Jameson's spine as he gazed up at the mansion's facade, its grandeur seeming almost sinister somehow tonight. He checked his watch, a silver Omega on his left wrist, noting the exact time as he received the call several days. With a sense of foreboding, Jameson stepped forward, his eyes fixed on the entrance, a large wooden door with heavy iron hinges always. The detective's eyes widened slightly as he saw the swarm of police officers already gathered, their faces serious and somber expressions a given.
id
"gen-DZnbEvKc2rb6gSdstUpLBmVpjTVL"
total_cost
0.0000414
upstream_id
"67d4a67d-8509-4985-ba32-c3cc823267dc"
created_at
"2024-07-23T16:50:33.77016+00:00"
7/23/2024, 4:50:33 PM
model
"meta-llama/llama-3.1-8b-instruct"
app_id
182717
streamed
false
cancelled
false
provider_name
"Fireworks"
latency
850
moderation_latency
(null)
generation_time
0
finish_reason
"stop"
tokens_prompt
76
tokens_completion
161
native_tokens_prompt
44
native_tokens_completion
163
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.0000414
Evaluation details
Result
Evaluator
Details
Meta Data
32.95%
Matches word count
n/a
neededClean
false
sentences
6
wordCounts
0
21
1
21
2
21
3
22
4
23
5
23