NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2024-07-23-01J3G80N23549R0R4PNVWBDVY4
Run Details
Model:
Llama 3.1 8B
Test:
N-Length Sentences
Scenario:
Write sentences with 20 words each
Duration:
731ms
Cost:
$0.000035
Provider:
Fireworks
Evaluation summary
Score
Evaluator
Details Link
4.89%
Matches word count
(details)
Model input
User/Human
Please write the opening scene of a murder mystery where each sentence has exactly 20 words. Please make sure that each sentence has the same length. Only return the opening itself.
Model response
Messages
Meta
AI
Detective Jameson sat at his desk, sipping cold coffee, staring blankly at the stack of untouched files nearby. A chill crept up his spine, fueled by the ominous air that seemed to settle in quiet days. Grisly details of the morning's previous murder still lingered in his mind like an unwelcome, lingering guest. Sounds of murmuring colleagues and clattering keyboards filled the sterile silence of the precinct's fluorescent-lit layout. The sound of a cop hovering at the edge of conversation made him look up slowly. Someone new stood in the doorway, her piercing green eyes scanning the chaotic scene with curiosity, determination.
id
"gen-ZaIF5z8KUXcWjXJ7JjQYejyaOWnb"
total_cost
0.000035
upstream_id
"4360cb69-df83-41f4-9fe8-a38b6ae8ce87"
created_at
"2024-07-23T16:50:26.014123+00:00"
7/23/2024, 4:50:26 PM
model
"meta-llama/llama-3.1-8b-instruct"
app_id
182717
streamed
false
cancelled
false
provider_name
"Fireworks"
latency
588
moderation_latency
(null)
generation_time
0
finish_reason
"stop"
tokens_prompt
76
tokens_completion
129
native_tokens_prompt
44
native_tokens_completion
131
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.000035
Evaluation details
Result
Evaluator
Details
Meta Data
4.89%
Matches word count
n/a
neededClean
false
sentences
6
wordCounts
0
18
1
18
2
17
3
16
4
16
5
17