Model

Liquid: LFM 40B MoE

Test

Language Comprehension

Scenario

Friend got new kittens (Tagalog)

Run ID

2024-10-01-01J94REMZJKJAP9H4Q971PTA14

Model input

User/Human
I need your help. I want to congratulate my friend on her new babies, but how many are there? Here's what she said: Ang pusa ko ay kakapanganak lang nang limang kuting.

Model response

AI
I understand that your friend is going to give birth to five kittens. Is this correct?
id"gen-1727810458-Kj93dlZGTTqkNIC0gxhQ" 
total_cost0
upstream_id"chatcmpl-783c21b1-48ce-4879-b354-8225fc013ab8" 
created_at"2024-10-01T19:21:21.289329+00:00" Tuesday, October 1st, 2024 at 7:21:21 PM GMT+00:00
model"liquid/lfm-40b" 
app_id182717
streamedtrue
cancelledfalse
provider_name"Lambda" 
latency19901
moderation_latency(null)
generation_time2491
finish_reason"stop" 
tokens_prompt79
tokens_completion18
native_tokens_prompt99
native_tokens_completion21
native_tokens_reasoning(null)
num_media_prompt(null)
num_media_completion(null)
origin"https://ncbench.com/" 
usage0

Evaluation details

Result Evaluator Details Meta Data
Pass Contains a count of nouns
5 of: kitten, kittens
 n/a