NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2024-07-23-01J3G812JC5RN2M88YDGHJ2CKG
Run Details
Model:
Llama 3.1 8B
Test:
N-Length Sentences
Scenario:
Write sentences with 20 words each
Duration:
987ms
Cost:
$0.000038
Provider:
Fireworks
Evaluation summary
Score
Evaluator
Details Link
44.95%
Matches word count
(details)
Model input
User/Human
Please write the opening scene of a murder mystery where each sentence has exactly 20 words. Please make sure that each sentence has the same length. Only return the opening itself.
Model response
Messages
Meta
AI
The small town of Ravenswood was bathed in an eerie orange light on a gray autumn morning slowly unfolding. Detective Jameson stood outside the local diner, where a scream had shattered the peaceful quiet atmosphere suddenly erupting. A sea of reporters and camera crews crowded the sidewalk, all vying for a glimpse of the gruesome crime scene ahead. Chief Watson, a stout man with a bushy mustache, briefed Jameson on the situation with a grave expression etched. The victim, local business owner Richard Langley, had been found dead in his office, a single bullet wound to his chest. A peculiar letter opener lay nearby, partially covered in blood, as if left there deliberately for emphasis somehow.
id
"gen-Pb1eGcxkkcPYwMN69EdxuWTa7pqe"
total_cost
0.0000376
upstream_id
"c105be8d-3535-474d-ba6b-fcd4fd98f9b4"
created_at
"2024-07-23T16:50:40.162445+00:00"
7/23/2024, 4:50:40 PM
model
"meta-llama/llama-3.1-8b-instruct"
app_id
182717
streamed
false
cancelled
false
provider_name
"Fireworks"
latency
833
moderation_latency
(null)
generation_time
0
finish_reason
"stop"
tokens_prompt
76
tokens_completion
142
native_tokens_prompt
44
native_tokens_completion
144
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.0000376
Evaluation details
Result
Evaluator
Details
Meta Data
44.95%
Matches word count
n/a
neededClean
false
sentences
6
wordCounts
0
19
1
18
2
21
3
19
4
21
5
18