NC Bench
Overview
About
Tests
Models
Model
Gemma 2 27B
Test
N-Length Sentences
Scenario
Write sentences with 10 words each
Run ID
2024-07-14-01J2SC65J5QS1JHBZJZYVZ9FHE
Model input
User/Human
Please write the opening scene of a murder mystery where each sentence has exactly 10 words. Please make sure that each sentence has the same length. Only return the opening itself.
Model response
Messages
Meta
AI
The rain hammered against the library windows. Professor Elmhurst sat slumped in his chair. His lifeless eyes stared blankly at a shelf. Dust covered the ancient, leather-bound volumes. A single book lay open upon the floor. Inspector Davies pushed aside the heavy velvet rope. "The scene is secure," he announced to the room. His assistant grimaced, "Not quite, sir, look!" It was a perfect warp-in-the-middle-of-a-sentence, "Clean up the pattern!" A single splash of pink in the middle. The silence in the room thickened with suspense. The victim was the heir to a fortune. Davies choked back a sigh, knuckles white. On the bookshelf, a single glove gleamed.
id
"gen-SP1TT7MO5QabkY0AC6wDIJ9uu99r"
total_cost
0.00005805
upstream_id
"cmpl-39411c60a9424c25a59250db3dc99ea1"
created_at
"2024-07-14T19:40:56.073559+00:00"
Sunday, July 14th, 2024 at 7:40:56 PM GMT+00:00
model
"google/gemma-2-27b-it"
app_id
182717
streamed
false
cancelled
false
provider_name
"DeepInfra"
latency
6258
moderation_latency
(null)
generation_time
0
finish_reason
"stop"
tokens_prompt
54
tokens_completion
154
native_tokens_prompt
46
native_tokens_completion
169
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.00005805
Evaluation details
Result
Evaluator
Details
Meta Data
21.0841%
Matches word count
n/a
neededClean
false
sentences
14
wordCounts
0
7
1
7
2
8
3
7
4
8
5
8
6
9
7
7
8
15
9
8
10
8
11
8
12
7
13
7