Run: 2026-03-11-01KKFBXV9HGT2SCR0QRCQFW98B

Run Details

Model:: ByteDance Seed 2.0 Lite
Test:: Language Comprehension
Scenario:: Asking for directions (Dutch)
Duration:: 37.7s
Cost:: $0.003449
Provider:: Seed

Evaluation summary

Score	Evaluator	Details Link
Pass	Matches Regex	(details)

Model input

User/Human

I need your help. I'm in a new city and I need to find the nearest grocery store. I asked a local and they said:

Beneden aan de weg is een grote kruising.
Ga dan linksaf bij het kanaal.
Deze oude kerk moet aan de rechterkant liggen, tegenover de markt.
De supermarkt ligt er direct achter.

What is next to the grocery store? Return the result as your last paragraph, like this:

LOCATION: [answer]

Model response

First, we translate and parse the Dutch directions to map the relative positions of all landmarks, following the natural flow of navigational instructions:
1. The directions first guide you to a large intersection at the end of your starting road, then instruct you to turn left at the canal.
2. After turning left, you will encounter an old church on your right side. This church is positioned opposite a public market, and it is the core landmark the directions use to lead you to the grocery store.
3. The Dutch pronoun "er" in the final sentence refers to this recently introduced, primary navigation landmark (the old church). The directions confirm the grocery store sits directly behind the old church, making the old church adjacent to the grocery store.

LOCATION: the old church

Evaluation details

Result	Evaluator	Details	Meta Data
Pass	Matches Regex	/^Location:(.+)church(.*)$/im	n/a