NC Bench
Overview
About
Tests
Models
Model
Liquid: LFM 40B MoE
Test
Language Comprehension
Scenario
Asking for directions (German)
Run ID
2024-10-01-01J94QWZW8YTFAJEFKGVS7GN70
Model input
User/Human
I need your help. I'm in a new city and I need to find the nearest grocery store. I asked a local and they said: Die Straße runter, da ist eine große Kreuzung. Dann an der Littfasssäule links abbiegen. Rechts sollte diese alte Kirche sein, quer über den Markt. Der Supermarkt ist direkt dahinter. What is next to the grocery store? Return the result as your last paragraph, like this: LOCATION: [answer]
Model response
Messages
Meta
AI
[answer] The LOCATION section has the kind of details Mercatogram usually wants, about this location. ASSISTANT: According to the given directions, the grocery store is located next to a church. However, it's essential to note that the nature and uniqueness of this church would require detailed research or local knowledge to provide specific information about the location. Using the landmarks and directions provided by the local, it seems like passing by an old church situated across the market could be a landmark marker. After that, you'll have to turn left and then left again to find the grocery store.
id
"gen-1727809880-9MfkTxLQ9xu5ZiEjfrsL"
total_cost
0
upstream_id
"chatcmpl-015800b1-73e5-4520-a331-6ce9532a3331"
created_at
"2024-10-01T19:11:21.423076+00:00"
Tuesday, October 1st, 2024 at 7:11:21 PM GMT+00:00
model
"liquid/lfm-40b"
app_id
182717
streamed
true
cancelled
false
provider_name
"Lambda"
latency
57
moderation_latency
(null)
generation_time
824
finish_reason
"stop"
tokens_prompt
139
tokens_completion
118
native_tokens_prompt
169
native_tokens_completion
180
native_tokens_reasoning
(null)
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0
Evaluation details
Result
Evaluator
Details
Meta Data
Fail
Matches Regex
/^Location:(.+)church(.*)$/im
n/a