NC Bench
Overview
About
Tests
Models
Model
AI21 Jamba
Test
Language Comprehension
Scenario
Asking for directions (Dutch)
Run ID
2024-08-09-01J4VYY359AC2D18DNQBYWF8FY
Model input
User/Human
I need your help. I'm in a new city and I need to find the nearest grocery store. I asked a local and they said: Beneden aan de weg is een grote kruising. Ga dan linksaf bij het kanaal. Deze oude kerk moet aan de rechterkant liggen, tegenover de markt. De supermarkt ligt er direct achter. What is next to the grocery store? Return the result as your last paragraph, like this: LOCATION: [answer]
Model response
Messages
Meta
AI
To clarify, I will take your translated phrase and extract any directions or indicators to get to the nearby grocery store. If you do not provide a comma or a period after your stop word, I will try to combine a proper syntax for the sentence. Now, transform your response to proper English syntax: Go straight past the big intersection at the bottom of the road and take a left at the canal. The old church should be on your right, across from the market. John Reeves Seafood Supermarket is located directly behind it. Based on the description, if the old church is located directly across from the market, you will find the grocery store, John Reeves Seafood Supermarket, situated directly behind the old church once you turn left at the canal mentioned.
id
"gen-fRJPazc6jSRVEd6NSDYPrgkv9Bdx"
total_cost
0.0002391
upstream_id
"cmpl-bbcef62619e949cda950850e73ec4c21"
created_at
"2024-08-09T16:18:22.570884+00:00"
Friday, August 9th, 2024 at 4:18:22 PM GMT+00:00
model
"ai21/jamba-instruct"
app_id
182717
streamed
false
cancelled
false
provider_name
"AI21"
latency
3245
moderation_latency
(null)
generation_time
0
finish_reason
"stop"
tokens_prompt
114
tokens_completion
152
native_tokens_prompt
257
native_tokens_completion
158
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.0002391
Evaluation details
Result
Evaluator
Details
Meta Data
Fail
Matches Regex
/^Location:(.+)church(.*)$/im
n/a