NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2024-07-23-01J3G7ZRZF812XMB7RCBHV3PK5
Run Details
Model:
Llama 3.1 8B
Test:
N-Length Sentences
Scenario:
Write sentences with 10 words each
Duration:
718ms
Cost:
$0.000034
Provider:
Fireworks
Evaluation summary
Score
Evaluator
Details Link
100.00%
Matches word count
(details)
Model input
User/Human
Please write the opening scene of a murder mystery where each sentence has exactly 10 words. Please make sure that each sentence has the same length. Only return the opening itself.
Model response
Messages
Meta
AI
Detective Jameson stood outside the mansion on a cold morning. A wealthy businessman lay dead on the marble floor inside. Police officers were already canvassing the property with great care. The victim's wife stood nearby, her eyes filled with tears. A group of guests was being questioned by the others. Mrs. Jenkins, a maid, had been the first to find. The body was still warm to the touch, she said. The murder had happened sometime after 10 o'clock last night. Jameson's eyes moved to the victim, a tall man there. A cigar had been clamped between his clenched teeth so.
id
"gen-M2xp6ZXtJvrS38GAOxwSBQ4D8an1"
total_cost
0.0000344
upstream_id
"2f2cab4f-c177-4146-bbaf-c35f46ea8cf1"
created_at
"2024-07-23T16:49:57.179226+00:00"
7/23/2024, 4:49:57 PM
model
"meta-llama/llama-3.1-8b-instruct"
app_id
182717
streamed
false
cancelled
false
provider_name
"Fireworks"
latency
537
moderation_latency
(null)
generation_time
0
finish_reason
"stop"
tokens_prompt
76
tokens_completion
126
native_tokens_prompt
44
native_tokens_completion
128
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.0000344
Evaluation details
Result
Evaluator
Details
Meta Data
100.00%
Matches word count
n/a
neededClean
false
sentences
10
wordCounts
0
10
1
10
2
10
3
10
4
10
5
10
6
10
7
10
8
10
9
10