NC Bench
Overview
About
Tests
Models
Model
Liquid: LFM 40B MoE
Test
N-Length Sentences
Scenario
Write sentences with 20 words each
Run ID
2024-10-01-01J94RKNEVGZECH567FDGXEA3M
Model input
User/Human
Please write the opening scene of a murder mystery where each sentence has exactly 20 words. Please make sure that each sentence has the same length. Only return the opening itself.
Model response
Messages
Meta
AI
CITY Read the opening below! SENIOR CITIZEN: JAMIE WALKED DOWN GHOSTLY STREETS. 1997 HIT-MAN TARGETED DRUG-RUNNER. JAMIE INTERVIEWED IN 1960s DRAWING. ODDLY, WHISKEY TAINTED AIR SCARED OFF ATTACKERS. RESIDENTS claimed 1990s CALIFORNIA transitions suddenly. EMPTY BOTTLE found near VICTIM'S feet. HOMELESS woman watched closely breathed out. Police arrived randomly WRENCH slumping outside grenade. FINALLY, POLICE ASK: WHO KILLED JAMIE?
id
"gen-1727810623-Y5fyyySh6BvdeQvQ3NTe"
total_cost
0
upstream_id
"chatcmpl-e33b1d62-df10-4f8d-950b-d86a86949408"
created_at
"2024-10-01T19:23:51.272586+00:00"
Tuesday, October 1st, 2024 at 7:23:51 PM GMT+00:00
model
"liquid/lfm-40b"
app_id
182717
streamed
true
cancelled
false
provider_name
"Lambda"
latency
5899
moderation_latency
(null)
generation_time
2083
finish_reason
"stop"
tokens_prompt
69
tokens_completion
133
native_tokens_prompt
103
native_tokens_completion
127
native_tokens_reasoning
(null)
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0
Evaluation details
Result
Evaluator
Details
Meta Data
0.0000%
Matches word count
n/a
neededClean
false
sentences
10
wordCounts
0
5
1
7
2
6
3
5
4
7
5
6
6
6
7
6
8
7
9
6