NC Bench
Overview
About
Tests
Models
Model
Liquid: LFM 40B MoE
Test
Language Comprehension
Scenario
Asking for directions (Dutch)
Run ID
2024-10-01-01J94RRAF9RJXVWXP0RFXPBRKF
Model input
User/Human
I need your help. I'm in a new city and I need to find the nearest grocery store. I asked a local and they said: Beneden aan de weg is een grote kruising. Ga dan linksaf bij het kanaal. Deze oude kerk moet aan de rechterkant liggen, tegenover de markt. De supermarkt ligt er direct achter. What is next to the grocery store? Return the result as your last paragraph, like this: LOCATION: [answer]
Model response
Messages
Meta
AI
BENEDEN AAN DE WEG FROM: ASSISTANT The local's directions led you to a large intersection, where you should take a left at the canal. Look for the old church on your right. Its location is opposite a market street, and your grocery store will be just behind it. As for what's next to the grocery store, I do not have that information. However, you can see the church and the market from the store. I hope this information was helpful, and I'm always here to help if you have more questions.
id
"gen-1727810775-OoFGdNruOlROs3CF0J6m"
total_cost
0
upstream_id
"chatcmpl-4f18cd78-4fe7-417e-9c1f-a52feefa6360"
created_at
"2024-10-01T19:26:17.145125+00:00"
Tuesday, October 1st, 2024 at 7:26:17 PM GMT+00:00
model
"liquid/lfm-40b"
app_id
182717
streamed
true
cancelled
false
provider_name
"Lambda"
latency
229
moderation_latency
(null)
generation_time
943
finish_reason
"stop"
tokens_prompt
141
tokens_completion
115
native_tokens_prompt
167
native_tokens_completion
144
native_tokens_reasoning
(null)
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0
Evaluation details
Result
Evaluator
Details
Meta Data
Fail
Matches Regex
/^Location:(.+)church(.*)$/im
n/a