NC Bench
Overview
About
Tests
Models
Model
Llama 3.2 11B (Vision)
Test
N-Length Sentences
Scenario
Write sentences with 20 words each
Run ID
2024-09-26-01J8PZ393S230FCKP2MXAEC3T4
Model input
User/Human
Please write the opening scene of a murder mystery where each sentence has exactly 20 words. Please make sure that each sentence has the same length. Only return the opening itself.
Model response
Messages
Meta
AI
Detective Jameson stepped out of the rain and into the warm restaurant, shaking the water from his dark trenchcoat thoroughly. A soft spattering of applause greeted him from the patrons, who eyed him with a mixture of curiosity and concern obviously. The maƮtre d' rushed to intercept him, his face etched with worry and his hands fluttering in distress visibly. "Please, Detective Jameson, I'm glad you're here," he said, his voice barely above a whisper of desperation now. "What's happened?" Jameson asked, his eyes scanning the room for any signs of trouble or panic immediately. A loud, anguished cry pierced the air, followed by a faint sound of weeping and sniffles ensuing rapidly.
id
"gen-HTmHSwhR4SGSf2X1BePen86BqGrN"
total_cost
0.0000388
upstream_id
"74d84e4b-702b-4fad-a166-288fd9079f7e"
created_at
"2024-09-26T10:47:45.642983+00:00"
Thursday, September 26th, 2024 at 10:47:45 AM GMT+00:00
model
"meta-llama/llama-3.2-11b-vision-instruct"
app_id
182717
streamed
true
cancelled
false
provider_name
"Fireworks"
latency
171
moderation_latency
(null)
generation_time
1210
finish_reason
"stop"
tokens_prompt
42
tokens_completion
148
native_tokens_prompt
45
native_tokens_completion
149
native_tokens_reasoning
(null)
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.0000388
Evaluation details
Result
Evaluator
Details
Meta Data
41.5807%
Matches word count
n/a
neededClean
false
sentences
6
wordCounts
0
20
1
21
2
19
3
18
4
17
5
18