NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-03-03-01KJTZ64ZFZS24N5SC11Z3KT5B
Run Details
Model:
ByteDance Seed 2.0 Mini
Test:
Language Comprehension
Scenario:
Asking for directions (German)
Duration:
1m 42s
Cost:
$0.001770
Provider:
Seed
Evaluation summary
Score
Evaluator
Details Link
Pass
Matches Regex
(details)
Model input
User/Human
I need your help. I'm in a new city and I need to find the nearest grocery store. I asked a local and they said: Die Straße runter, da ist eine große Kreuzung. Dann an der Littfasssäule links abbiegen. Rechts sollte diese alte Kirche sein, quer über den Markt. Der Supermarkt ist direkt dahinter. What is next to the grocery store? Return the result as your last paragraph, like this: LOCATION: [answer]
Model response
Messages
Meta
AI
First, let’s translate and break down each of the local’s directions step by step to map the route: 1. *Die Straße runter, da ist eine große Kreuzung.* = Go down the current street, you will arrive at a large intersection. 2. *Dann an der Littfasssäule links abbiegen.* = Turn left at the Littfasssäule, a named local landmark likely a stone column or monument. 3. *Rechts sollte diese alte Kirche sein, quer über den Markt.* = On your right, you will see this old church, which sits across the market square (the implied full grammar here is *die alte Kirche, die quer über den Markt ist*). 4. *Der Supermarkt ist direkt dahinter.* = The supermarket is right behind that old church, where *dahinter* directly refers to the old church as the most relevant recent noun before the final clause. From this, we can confirm the grocery store sits directly adjacent to the rear of the old church, making the old church the immediate neighboring landmark next to the supermarket. LOCATION: The old church
created_at
"2026-03-03T23:05:32.411Z"
3/3/2026, 11:05:32 PM
model
"bytedance-seed/seed-2.0-mini-20260224"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
515
moderation_latency
(null)
generation_time
101822
tokens_prompt
112
tokens_completion
4776
native_tokens_prompt
139
native_tokens_completion
4391
native_tokens_completion_images
(null)
native_tokens_reasoning
4160
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.0017703
router
(null)
provider_responses
0
endpoint_id
"9265aa87-9657-4d40-b9d7-2a70318e57d9"
id
"021772579132530904c389cfd819598df3df498c1c52189980157"
is_byok
false
latency
515
model_permaslug
"bytedance-seed/seed-2.0-mini-20260224"
provider_name
"Seed"
status
200
api_type
"completions"
id
"gen-1772579132-AYlWng1W8pcrpQRCxRRY"
upstream_id
"021772579132530904c389cfd819598df3df498c1c52189980157"
total_cost
0.0017703
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Seed"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Matches Regex
/^Location:(.+)church(.*)$/im
n/a