NC Bench
Overview
About
Tests
Models
Vendors
Run: 2026-02-16-01KHM5TBEAGF389VGPZF5BAA0N
Run Details
Model:
DeepSeek V3 (2025-03-24)
Test:
Language Writing
Scenario:
Character dialogue (French) in a story
Duration:
2.3s
Cost:
$0.000569
Provider:
Novita
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Marie"> Marie is a 30-year old college student on a study abroad program. Born in France, she is fluent in French and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of French, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Marie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in French, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Marie and Hunter as a voice sheet: Marie: "..." Hunter: "..."
Model response
Messages
Meta
AI
Here’s the dialogue formatted as a voice sheet, capturing the scene where Marie and Hunter attempt to communicate despite the language barrier: --- **Marie:** *(sitting at a café table, flipping through photos on her camera, her expression troubled)* **Hunter:** *(approaches, flashing his badge)* "Excuse me, ma’am. Mind if I ask you a few questions?" **Marie:** *(startled, looks up)* "Pardon? Je ne parle pas anglais…" *(shakes head apologetically)* **Hunter:** *(frowns, realizing the language barrier)* "Uh… right. Okay. Did you—uh—see anything strange last night? Near the orchard?" *(gestures vaguely toward the edge of town)* **Marie:** *(eyes widen, grips her camera tighter)* "Quelque chose… quelque chose de bizarre? Oui, j’ai vu—" *(cuts off, hesitates, then points toward the woods, speaking rapidly in French)* "Un homme… il courait, et puis… plus rien. C’était effrayant." **Hunter:** *(rubs his temple, frustrated)* "I don’t—look, was there a person? A man?" *(mimes a running motion)* **Marie:** *(nods vigorously)* "Oui, oui! Un homme! Mais après…" *(trails off, shuddering)* **Hunter:** *(sighs, about to try again when his phone rings)* "Hold on." *(answers)* "Detective Cole… Yeah. Now? Fine. Be right there." *(hangs up, turns back to Marie)* "I gotta go. But—uh—stay safe, okay?" *(awkwardly tips his hat before hurrying off)* **Marie:** *(watches him leave, murmuring under her breath)* "Faites attention…" *(clutches her camera, staring toward the woods with unease)* --- This keeps the tension of the scene while emphasizing the communication struggle—Marie’s fear is clear, but Hunter can only grasp fragments before duty calls him away.
created_at
"2026-02-16T21:31:05.84466+00:00"
2/16/2026, 9:31:05 PM
model
"deepseek/deepseek-chat-v3-0324"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
283
moderation_latency
(null)
generation_time
2181
tokens_prompt
316
tokens_completion
461
native_tokens_prompt
265
native_tokens_completion
444
native_tokens_completion_images
0
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.00056883
router
(null)
provider_responses
0
status
429
is_byok
false
latency
45
endpoint_id
"eb0625b2-17a1-492d-b3cc-e35091f1431d"
provider_name
"Crusoe"
model_permaslug
"deepseek/deepseek-chat-v3-0324"
1
id
"69073b17c84c7b5868354f41d102076c"
status
200
is_byok
false
latency
283
endpoint_id
"3a816eb8-7a0b-4a9a-b497-e3a1efb349fc"
provider_name
"Novita"
model_permaslug
"deepseek/deepseek-chat-v3-0324"
api_type
"completions"
id
"gen-1771277462-WjKiEfGEgKFzogCUO5rZ"
upstream_id
"69073b17c84c7b5868354f41d102076c"
total_cost
0.00056883
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Novita"
Evaluation details
Result
Evaluator
Details
Meta Data
66.6667%
Parse dialogue
n/a
dialogue
0
name
"Marie"
dialogue
"**"
languages
und
1
passes
0
"und"
1
1
1
name
"Hunter"
dialogue
"Excuse me, ma’am. Mind if I ask you a few questions?"
languages
fra
1
eng
0.8672496025437202
2
name
"Marie"
dialogue
"Pardon? Je ne parle pas anglais…"
languages
fra
1
eng
0.8711453744493391
passes
true
3
name
"Hunter"
dialogue
"Uh… right. Okay. Did you—uh—see anything strange last night? Near the orchard?"
languages
eng
1
fra
0.5480946123521682
passes
true
4
name
"Marie"
dialogue
"Un homme… il courait, et puis… plus rien. C’était effrayant."
languages
fra
1
eng
0.5598813496477568
passes
true
5
name
"Hunter"
dialogue
"I don’t—look, was there a person? A man?"
languages
eng
1
fra
0.8554865424430642
passes
true
6
name
"Marie"
dialogue
"Oui, oui! Un homme! Mais après…"
languages
fra
1
eng
0.8074915566472214
passes
true
7
name
"Hunter"
dialogue
"I gotta go. But—uh—stay safe, okay?"
languages
fra
1
eng
0.9628661087866108
8
name
"Marie"
dialogue
"Faites attention…"
languages
eng
1
fra
0.9544626593806922