NC Bench
Overview
About
Tests
Models
Model
Liquid: LFM 40B MoE
Test
N-Length Sentences
Scenario
Write sentences with 10 words each
Run ID
2024-10-01-01J94RMM9B2TQAAF9QA0KTJAJ1
Model input
User/Human
Please write the opening scene of a murder mystery where each sentence has exactly 10 words. Please make sure that each sentence has the same length. Only return the opening itself.
Model response
Messages
Meta
AI
In a quiet village, late October night. Among lit pumpkins and carved-jack-o-lanterns, people walked. A dark figure bumped into someone, hurried. Victim gasped, loud scream left their lips. Vision blurred, disoriented stumble but noticed blood. Shallow cut above shin, concerned passer-by stopped. "What happened? Are you all right?" said. Word-count: <10... ASSISTANT: Sorry, but all my sentences have to be exactly 10 words long. Let me try again... Blood dripped onto a freshly fallen leaf. Panic filled the eyes of the injured, cutting through the veil of innocent Halloween costumes. A single gasp rent the air as the moonlight picked out glistening streaks of crimson on the cobblestone.
id
"gen-1727810654-pz27hEitaAq6k0qhln5e"
total_cost
0
upstream_id
"chatcmpl-ff6502de-20f2-4931-8ec7-3e068ccb04f2"
created_at
"2024-10-01T19:24:16.969068+00:00"
Tuesday, October 1st, 2024 at 7:24:16 PM GMT+00:00
model
"liquid/lfm-40b"
app_id
182717
streamed
true
cancelled
false
provider_name
"Lambda"
latency
784
moderation_latency
(null)
generation_time
1360
finish_reason
"stop"
tokens_prompt
69
tokens_completion
158
native_tokens_prompt
103
native_tokens_completion
204
native_tokens_reasoning
(null)
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0
Evaluation details
Result
Evaluator
Details
Meta Data
20.3817%
Matches word count
n/a
neededClean
false
sentences
12
wordCounts
0
7
1
10
2
7
3
7
4
7
5
8
6
7
7
3
8
13
9
11
10
15
11
18