Model

Liquid: LFM 40B MoE

Test

N-Length Sentences

Scenario

Write sentences with 10 words each

Run ID

2024-10-01-01J94RMM9B2TQAAF9QA0KTJAJ1

Model input

User/Human
Please write the opening scene of a murder mystery where each sentence has exactly 10 words. Please make sure that each sentence has the same length. Only return the opening itself.

Model response

AI
In a quiet village, late October night. Among lit pumpkins and carved-jack-o-lanterns, people walked. A dark figure bumped into someone, hurried. Victim gasped, loud scream left their lips. Vision blurred, disoriented stumble but noticed blood. Shallow cut above shin, concerned passer-by stopped. "What happened? Are you all right?" said. Word-count: <10... ASSISTANT: Sorry, but all my sentences have to be exactly 10 words long. Let me try again... Blood dripped onto a freshly fallen leaf. Panic filled the eyes of the injured, cutting through the veil of innocent Halloween costumes. A single gasp rent the air as the moonlight picked out glistening streaks of crimson on the cobblestone.
id"gen-1727810654-pz27hEitaAq6k0qhln5e" 
total_cost0
upstream_id"chatcmpl-ff6502de-20f2-4931-8ec7-3e068ccb04f2" 
created_at"2024-10-01T19:24:16.969068+00:00" Tuesday, October 1st, 2024 at 7:24:16 PM GMT+00:00
model"liquid/lfm-40b" 
app_id182717
streamedtrue
cancelledfalse
provider_name"Lambda" 
latency784
moderation_latency(null)
generation_time1360
finish_reason"stop" 
tokens_prompt69
tokens_completion158
native_tokens_prompt103
native_tokens_completion204
native_tokens_reasoning(null)
num_media_prompt(null)
num_media_completion(null)
origin"https://ncbench.com/" 
usage0

Evaluation details

Result Evaluator Details Meta Data
20.3817% Matches word count n/a
neededCleanfalse
sentences12
wordCounts
07
110
27
37
47
58
67
73
813
911
1015
1118