NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2024-07-23-01J3G8222QW9SGM7YRVHG8XNTQ
Run Details
Model:
Llama 3.1 8B
Test:
N-Length Sentences
Scenario:
Write sentences with 10 words each
Duration:
769ms
Cost:
$0.000029
Provider:
Fireworks
Evaluation summary
Score
Evaluator
Details Link
76.96%
Matches word count
(details)
Model input
User/Human
Please write the opening scene of a murder mystery where each sentence has exactly 10 words. Please make sure that each sentence has the same length. Only return the opening itself.
Model response
Messages
Meta
AI
Detective Jameson sat at his desk thinking deeply always. City officials had just notified him of the murder. Last night's brutal homicide sent shockwaves through the community quickly. Popular restaurant owner Jack Harris was found dead outside. Several witnesses reported hearing nothing unusual that evening reportedly. Forensic team arrived soon to collect evidence carefully downstairs. Jameson poured himself a cup of coffee slowly black. His eyes scanned the crime scene methodically again always. The victim's body was found with no visible signs.
id
"gen-iDlnJD1jrCHaOxxPOzsEVVIFkKe1"
total_cost
0.000029
upstream_id
"4301b0cd-73ea-4ecc-b007-3c037569a450"
created_at
"2024-07-23T16:51:12.074366+00:00"
7/23/2024, 4:51:12 PM
model
"meta-llama/llama-3.1-8b-instruct"
app_id
182717
streamed
false
cancelled
false
provider_name
"Fireworks"
latency
634
moderation_latency
(null)
generation_time
0
finish_reason
"stop"
tokens_prompt
76
tokens_completion
99
native_tokens_prompt
44
native_tokens_completion
101
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.000029
Evaluation details
Result
Evaluator
Details
Meta Data
76.96%
Matches word count
n/a
neededClean
false
sentences
9
wordCounts
0
9
1
9
2
10
3
9
4
9
5
9
6
9
7
9
8
9