NC Bench
Overview
About
Tests
Models
Vendors
Run: 2026-02-16-01KHM5D81RAXWQ6X20AQCJ9EN6
Run Details
Model:
DeepSeek V3.2
Test:
Language Comprehension
Scenario:
Asking for directions (German)
Duration:
4.6s
Cost:
$0.000103
Provider:
Novita
Model input
User/Human
I need your help. I'm in a new city and I need to find the nearest grocery store. I asked a local and they said: Die Straße runter, da ist eine große Kreuzung. Dann an der Littfasssäule links abbiegen. Rechts sollte diese alte Kirche sein, quer über den Markt. Der Supermarkt ist direkt dahinter. What is next to the grocery store? Return the result as your last paragraph, like this: LOCATION: [answer]
Model response
Messages
Meta
AI
First, let’s break down the directions in English: 1. *Die Straße runter, da ist eine große Kreuzung.* → Go down the street, there is a large intersection. 2. *Dann an der Litfaßsäule links abbiegen.* → Then turn left at the advertising column (Litfaßsäule). 3. *Rechts sollte diese alte Kirche sein, quer über den Markt.* → On the right, there should be an old church, across the market. 4. *Der Supermarkt ist direkt dahinter.* → The supermarket is directly behind it. The key here is “directly behind it” — “it” refers to the *alte Kirche* (old church). So the supermarket is right behind the old church. That means the old church is next to the grocery store. LOCATION: the old church
created_at
"2026-02-16T21:23:58.759262+00:00"
2/16/2026, 9:23:58 PM
model
"deepseek/deepseek-v3.2-20251201"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
1121
moderation_latency
(null)
generation_time
4586
tokens_prompt
112
tokens_completion
199
native_tokens_prompt
107
native_tokens_completion
186
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.000103183
router
(null)
provider_responses
0
id
"4f0ff8514f889584a5c9a81f940126a0"
status
200
is_byok
false
latency
1121
endpoint_id
"8a5fb6d3-ef71-4958-af54-269ffa3a3c6e"
provider_name
"Novita"
model_permaslug
"deepseek/deepseek-v3.2-20251201"
api_type
"completions"
id
"gen-1771277033-rXOx5fZAC6ehhWtj3xHw"
upstream_id
"4f0ff8514f889584a5c9a81f940126a0"
total_cost
0.000103183
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Novita"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Matches Regex
/^Location:(.+)church(.*)$/im
n/a