NC Bench
Overview
About
Tests
Models
Vendors
Run: 2026-02-16-01KHM5HHW34H4T6V237388QVWB
Run Details
Model:
DeepSeek V3 (2024-12-26)
Test:
Language Writing
Scenario:
Character dialogue (German) in a story
Duration:
18.0s
Cost:
$0.000779
Provider:
Novita
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Melanie"> Melanie is a 30-year old college student on a study abroad program. Born in Germany, she is fluent in German and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of German, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Melanie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in German, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Melanie and Hunter as a voice sheet: Melanie: "..." Hunter: "..."
Model response
Messages
Meta
AI
**Voice Sheet: Café Conversation** **Melanie:** *(flipping through photos on her camera, looking troubled)* "Das ist nicht möglich... Warum ist das passiert?" *(That’s not possible… Why did this happen?)* **Hunter:** *(approaching, standing beside her table)* "Excuse me, ma’am. Mind if I ask you a few questions?" **Melanie:** *(startled, looks up, confused)* "Entschuldigung… Ich verstehe nicht. Sprechen Sie Deutsch?" *(Sorry… I don’t understand. Do you speak German?)* **Hunter:** *(frustrated, rubbing his temple)* "Great. No German. Uh…" *(points to her camera, then gestures around vaguely)* "You take pictures here? In town?" **Melanie:** *(nods slowly, still uneasy)* "Ja, ich fotografiere die Landschaft. Aber gestern… etwas Seltsames." *(Yes, I photograph the landscape. But yesterday… something strange.)* **Hunter:** *(leaning in, trying to piece it together)* "Strange? What happened?" **Melanie:** *(shows him a photo on her camera—a blurry figure in the woods)* "Ich habe das gesehen. Und dann… war es weg." *(I saw this. And then… it was gone.)* **Hunter:** *(squints at the photo, tense)* "Where was this? Can you show me?" **Melanie:** *(points toward the edge of town)* "Dort, hinter den Bäumen. Es war… unheimlich." *(There, behind the trees. It was… eerie.)* **Hunter:** *(about to ask more when his phone rings, checks it—urgent call)* "Damn. I gotta go." *(pulls out a card, slides it to her)* "If you remember anything else—or find someone who speaks English—call me." **Melanie:** *(picks up the card, still confused)* "Ich verstehe nicht… aber danke." *(I don’t understand… but thanks.)* **Hunter:** *(already walking away, muttering)* "Yeah, this is gonna be a problem." *(exits the café, phone to ear)* **Melanie:** *(stares at the card, then back at her camera, whispering)* "Was ist hier los?" *(What’s going on here?)*
created_at
"2026-02-16T21:26:33.320545+00:00"
2/16/2026, 9:26:33 PM
model
"deepseek/deepseek-chat-v3"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
1116
moderation_latency
(null)
generation_time
17905
tokens_prompt
319
tokens_completion
511
native_tokens_prompt
266
native_tokens_completion
517
native_tokens_completion_images
0
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.0007785
router
(null)
provider_responses
0
id
"bf7943bd157a4f9b521da0d2fac91956"
status
200
is_byok
false
latency
1116
endpoint_id
"cefb5a1e-9fea-4496-9a64-4e1b11a7cc8c"
provider_name
"Novita"
model_permaslug
"deepseek/deepseek-chat-v3"
api_type
"completions"
id
"gen-1771277174-H0BRq5Fry42zyAEeySXh"
upstream_id
"bf7943bd157a4f9b521da0d2fac91956"
total_cost
0.0007785
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Novita"
Evaluation details
Result
Evaluator
Details
Meta Data
84.6154%
Parse dialogue
n/a
dialogue
0
name
"Melanie"
dialogue
"Das ist nicht möglich... Warum ist das passiert?"
languages
deu
1
eng
0.6884609160058262
passes
true
1
name
"Hunter"
dialogue
"Excuse me, ma’am. Mind if I ask you a few questions?"
languages
eng
1
deu
0.6018942865872288
passes
true
2
name
"Melanie"
dialogue
"Entschuldigung… Ich verstehe nicht. Sprechen Sie Deutsch?"
languages
deu
1
eng
0.4580318379160637
passes
true
3
name
"Hunter"
dialogue
"You take pictures here? In town?"
languages
eng
1
deu
0.556420233463035
passes
true
4
name
"Melanie"
dialogue
"Ja, ich fotografiere die Landschaft. Aber gestern… etwas Seltsames."
languages
deu
1
eng
0.5341085271317829
passes
true
5
name
"Hunter"
dialogue
"Strange? What happened?"
languages
deu
1
eng
0.8969372873116188
6
name
"Melanie"
dialogue
"Ich habe das gesehen. Und dann… war es weg."
languages
deu
1
eng
0.4338537387017255
passes
true
7
name
"Hunter"
dialogue
"Where was this? Can you show me?"
languages
eng
1
deu
0.3695652173913043
passes
true
8
name
"Melanie"
dialogue
"Dort, hinter den Bäumen. Es war… unheimlich."
languages
deu
1
eng
0.6718346253229974
passes
true
9
name
"Hunter"
dialogue
"If you remember anything else—or find someone who speaks English—call me."
languages
eng
1
deu
0.6025311025311025
passes
true
10
name
"Melanie"
dialogue
"Ich verstehe nicht… aber danke."
languages
deu
1
eng
0.49815602836879436
passes
true
11
name
"Hunter"
dialogue
"Yeah, this is gonna be a problem."
languages
eng
1
deu
0.43861184018664334
passes
true
12
name
"Melanie"
dialogue
"Was ist hier los?"
languages
eng
1
deu
0.9050279329608939