NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2024-07-23-01J3G7ZRQVJEXKVF27HNN1JJPX
Run Details
Model:
Llama 3.1 8B
Test:
N-Length Sentences
Scenario:
Write sentences with 20 words each
Duration:
674ms
Cost:
$0.000033
Provider:
Fireworks
Evaluation summary
Score
Evaluator
Details Link
27.41%
Matches word count
(details)
Model input
User/Human
Please write the opening scene of a murder mystery where each sentence has exactly 20 words. Please make sure that each sentence has the same length. Only return the opening itself.
Model response
Messages
Meta
AI
Detective Jameson stood outside the opulent mansion, surrounded by thick fog and unanswered questions slowly unfolding slowly. The sound of sirens echoed through the mist-shrouded streets, growing louder with every passing anxious second relentlessly. A chill ran down his spine as he gazed up at the foreboding mansion's Gothic architecture looming ominously nearby. The locals whispered about the doomed Ross family, their dark secrets hidden behind closed doors and locked windows. As he stepped onto the porch, the heavy wooden door creaked open, revealing a butler staring blankly ahead motionlessly.
id
"gen-OasBupJ6JT0KEP1GRGTa99li3xiK"
total_cost
0.0000326
upstream_id
"6e79c1aa-4412-4598-b157-cc353c212ff1"
created_at
"2024-07-23T16:49:56.910514+00:00"
7/23/2024, 4:49:56 PM
model
"meta-llama/llama-3.1-8b-instruct"
app_id
182717
streamed
false
cancelled
false
provider_name
"Fireworks"
latency
567
moderation_latency
(null)
generation_time
0
finish_reason
"stop"
tokens_prompt
76
tokens_completion
117
native_tokens_prompt
44
native_tokens_completion
119
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.0000326
Evaluation details
Result
Evaluator
Details
Meta Data
27.41%
Matches word count
n/a
neededClean
false
sentences
5
wordCounts
0
17
1
17
2
19
3
18
4
19