NC Bench
Overview
About
Tests
Models
Model
Gemma 2 27B
Test
N-Length Sentences
Scenario
Write sentences with 10 words each
Run ID
2024-07-14-01J2SC65J5KY8RBRTWA4ERMGKR
Model input
User/Human
Please write the opening scene of a murder mystery where each sentence has exactly 10 words. Please make sure that each sentence has the same length. Only return the opening itself.
Model response
Messages
Meta
AI
Rain lashed against the library windows, obscuring the view. A chill pervaded the room, despite the roaring fire. Professor Elmwood lay sprawled on the floor, lifeless. The book lay open, a single page illuminated by a shaft of moonlight. His pipe, clenched tightly in his hand, had fallen beside him. A thin trail of ashes led from the fireplace to the window. Through the blurry glass, a flicker of movement, a figure. The library shelves cast long, eerie shadows. Only the still, flickering candlelight pierced the gloom. Clara, the housekeeper, flew through the door, her face pale. "Professor?" she whispered. Unfortunately, provided context only allows for the creation of approximately the first 10 sentences. The body of Professor Elmwood lay, cold and lifeless. He lay slumped against a bookshelf, a chilling tableau. Hezekiah E. "Hezzy" Elmwood held a silenced pistol, evidence of a sudden and violent end. His eyes stared blankly at the roaring fireplace, as his hand
id
"gen-FL5D9Q45U64E82psXqmJJqWahGzL"
total_cost
0.00007425
upstream_id
"cmpl-121b26f0102348d0adf3c67f7e16d34b"
created_at
"2024-07-14T19:40:58.379226+00:00"
Sunday, July 14th, 2024 at 7:40:58 PM GMT+00:00
model
"google/gemma-2-27b-it"
app_id
182717
streamed
false
cancelled
false
provider_name
"DeepInfra"
latency
8183
moderation_latency
(null)
generation_time
0
finish_reason
"stop"
tokens_prompt
54
tokens_completion
227
native_tokens_prompt
46
native_tokens_completion
229
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.00007425
Evaluation details
Result
Evaluator
Details
Meta Data
48.4234%
Matches word count
n/a
neededClean
false
sentences
17
wordCounts
0
9
1
9
2
8
3
13
4
11
5
12
6
10
7
7
8
8
9
10
10
3
11
14
12
9
13
9
14
4
15
11
16
11