NC Bench
Overview
About
Tests
Models
Vendors
Run: 2026-02-16-01KHM5C35PF5QAYN7C7E2FEDGY
Run Details
Model:
DeepSeek V3 (2024-12-26)
Test:
Language Writing
Scenario:
Character dialogue (French) in a story
Duration:
27.2s
Cost:
$0.000810
Provider:
DeepInfra
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Marie"> Marie is a 30-year old college student on a study abroad program. Born in France, she is fluent in French and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of French, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Marie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in French, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Marie and Hunter as a voice sheet: Marie: "..." Hunter: "..."
Model response
Messages
Meta
AI
**Voice Sheet:** **Location:** A cozy café in Alborn, MN. Soft chatter and the aroma of coffee fill the air. Marie sits at a corner table, her camera resting on the table in front of her. She scrolls through her photos, lost in thought. **Hunter enters the café, spots Marie, and approaches her table.** Hunter: “Excuse me, miss. Mind if I ask you a few questions?” **Marie looks up, startled, and nods hesitantly.** Marie: “Oui… bien sûr.” (“Yes… of course.”) Hunter: “I’m Detective Hunter. I’m investigating that recent incident—the missing person case. Were you around town square yesterday evening?” **Marie furrows her brow, clearly unsettled by the question.** Marie: “Oui, j’étais là… J’ai pris des photos du coucher de soleil. Mais… quelque chose de bizarre s’est passé.” (“Yes, I was there… I was taking photos of the sunset. But… something strange happened.”) Hunter: “Wait, uh… I don’t speak French. Can you slow down? Or… maybe use some English?” **Marie shakes her head, frustrated, and tries to gesture instead.** Marie: “Je ne parle pas anglais. Désolée.” (“I don’t speak English. Sorry.”) Hunter: “Ah, great. This is going well.” **He runs a hand through his hair, thinking.** “Okay, let’s try this. Did you… see anything? Suspicious? Strange? Yesterday?” **Marie nods vigorously, her expression anxious.** Marie: “Oui, oui! J’ai vu une personne… elle a disparu près de l’arbre. Juste là!” (“Yes, yes! I saw a person… they disappeared near the tree. Right there!”) **Hunter squints, trying to piece together her meaning.** Hunter: “Disappeared? Near the tree? What tree?” **Marie points toward the window, gesturing toward the town square.** Marie: “L’arbre, là-bas! Une femme… elle était là, puis elle n’était plus là!” (“The tree, over there! A woman… she was there, and then she wasn’t!”) Hunter: “Okay, okay. You saw a woman near the tree, and then she… vanished?” **Marie nods emphatically.** Marie: “Oui! C’est ça! J’ai essayé de prendre une photo, mais… rien.” (“Yes! That’s it! I tried to take a photo, but… nothing.”) Hunter: “Huh.” **He pulls out a notebook and scribbles something down.** “This might be useful… if I could understand what you’re saying.” **Marie sighs, clearly frustrated.** Marie: “Je ne sais pas comment vous expliquer. C’est vraiment bizarre.” (“I don’t know how to explain it to you. It’s really strange.”) Hunter: “Yeah, I’m getting that vibe.” **Just then, Hunter’s phone rings.** Hunter: “Hold on a sec.” **He answers the call.** “Hunter speaking.” **He listens for a moment, his expression darkening.** “Got it. I’ll be there in ten.” **He hangs up and glances back at Marie.** Hunter: “Listen, I’ve gotta go. But… uh… stay safe, okay? And…” **He gestures to her camera.** “Keep taking pictures. Might help.” **Marie nods, still looking troubled.** Marie: “D’accord. Faites attention.” (“Okay. Be careful.”) **Hunter gives her a quick nod and hurries out of the café, leaving Marie alone with her camera and her uneasy thoughts.** **End Scene.**
created_at
"2026-02-16T21:23:43.79671+00:00"
2/16/2026, 9:23:43 PM
model
"deepseek/deepseek-chat-v3"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
314
moderation_latency
(null)
generation_time
27203
tokens_prompt
316
tokens_completion
924
native_tokens_prompt
262
native_tokens_completion
816
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.00081008
router
(null)
provider_responses
0
id
"chatcmpl-R1F0a6MaWzGZsrps0gpuGNRi"
status
200
is_byok
false
latency
53
endpoint_id
"5294d55f-9012-496b-8f22-8cc919432dcd"
provider_name
"DeepInfra"
model_permaslug
"deepseek/deepseek-chat-v3"
api_type
"completions"
id
"gen-1771276995-bouwcZ5QLZZJ0tcD76UY"
upstream_id
"chatcmpl-R1F0a6MaWzGZsrps0gpuGNRi"
total_cost
0.00081008
cache_discount
(null)
upstream_inference_cost
0
provider_name
"DeepInfra"
Evaluation details
Result
Evaluator
Details
Meta Data
83.3333%
Parse dialogue
n/a
dialogue
0
name
"Hunter"
dialogue
"“Excuse me, miss. Mind if I ask you a few questions?”"
languages
fra
1
eng
0.8236228813559322
1
name
"Marie"
dialogue
"“Oui… bien sûr.”"
languages
fra
1
eng
0.25790754257907544
passes
true
2
name
"Hunter"
dialogue
"“I’m Detective Hunter. I’m investigating that recent incident—the missing person case. Were you around town square yesterday evening?”"
languages
eng
1
fra
0.7756132756132756
passes
true
3
name
"Marie"
dialogue
"“Oui, j’étais là… J’ai pris des photos du coucher de soleil. Mais… quelque chose de bizarre s’est passé.”"
languages
fra
1
eng
0.6506975789905622
passes
true
4
name
"Hunter"
dialogue
"“Wait, uh… I don’t speak French. Can you slow down? Or… maybe use some English?”"
languages
eng
1
fra
0.8060856111397627
passes
true
5
name
"Marie"
dialogue
"“Je ne parle pas anglais. Désolée.”"
languages
fra
1
eng
0.8039573820395738
passes
true
6
name
"Hunter"
dialogue
"“Ah, great. This is going well.”"
languages
eng
1
fra
0.37063857801184985
passes
true
7
name
"Marie"
dialogue
"“Oui, oui! J’ai vu une personne… elle a disparu près de l’arbre. Juste là!”"
languages
fra
1
eng
0.5315056378509839
passes
true
8
name
"Hunter"
dialogue
"“Disappeared? Near the tree? What tree?”"
languages
eng
1
fra
0.6281459731543624
passes
true
9
name
"Marie"
dialogue
"“L’arbre, là-bas! Une femme… elle était là, puis elle n’était plus là!”"
languages
fra
1
eng
0.7475295251867919
passes
true
10
name
"Hunter"
dialogue
"“Okay, okay. You saw a woman near the tree, and then she… vanished?”"
languages
eng
1
fra
0.7007448517598949
passes
true
11
name
"Marie"
dialogue
"“Oui! C’est ça! J’ai essayé de prendre une photo, mais… rien.”"
languages
fra
1
eng
0.778360655737705
passes
true
12
name
"Hunter"
dialogue
"“Huh.”"
languages
eng
0
fra
0
13
name
"Marie"
dialogue
"“Je ne sais pas comment vous expliquer. C’est vraiment bizarre.”"
languages
fra
1
eng
0.69013424914143
passes
true
14
name
"Hunter"
dialogue
"“Yeah, I’m getting that vibe.”"
languages
eng
1
fra
0.36757512229210343
passes
true
15
name
"Hunter"
dialogue
"“Hold on a sec.”"
languages
eng
1
fra
0.75825946817083
passes
true
16
name
"Hunter"
dialogue
"“Listen, I’ve gotta go. But… uh… stay safe, okay? And…”"
languages
eng
1
fra
0.7922829581993569
passes
true
17
name
"Marie"
dialogue
"“D’accord. Faites attention.”"
languages
eng
1
fra
0.9117889530090684