NC Bench
Overview
About
Tests
Models
Vendors
Run: 2026-02-16-01KHM5CCWDD981RS5QM594ZCST
Run Details
Model:
DeepSeek V3 (2024-12-26)
Test:
Language Writing
Scenario:
Character dialogue (French) in a story
Duration:
24.0s
Cost:
$0.000741
Provider:
DeepInfra
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Marie"> Marie is a 30-year old college student on a study abroad program. Born in France, she is fluent in French and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of French, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Marie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in French, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Marie and Hunter as a voice sheet: Marie: "..." Hunter: "..."
Model response
Messages
Meta
AI
Marie: "..." _She sits at a small café table in Alborn, her camera resting in her hands. Her fingers trace the edges of the lens, her expression distant. The soft chatter of locals fills the air, but Marie seems lost in thought._ Hunter: "Excuse me, miss?" _His voice is firm but polite. He steps up to her table, his detective badge clipped to his belt. He notices the camera but keeps his focus on her._ Hunter: "I’m Detective Hunter. I’m looking into the recent incident in town. Do you mind if I ask you a few questions?" Marie: "Je... je ne comprends pas. Je ne parle pas anglais." _She looks up at him, her eyes wide and troubled. Her voice trembles slightly, and she clutches her camera tightly._ Hunter: "Uh... okay. Do you speak English?" _He frowns, clearly frustrated. He gestures vaguely, trying to communicate._ Marie: "Non, je parle français. Je suis désolée." _She shakes her head, her expression apologetic but still shaken._ Hunter: "This isn’t going to work. Hold on..." _He pulls out his phone, scrolling through it quickly. He opens a translation app and types something in._ Hunter’s phone (robotic voice): "Avez-vous vu quelque chose d'inhabituel hier soir?" _Hunter looks at Marie expectantly._ Marie: "Hier soir? Oui... j’étais près du parc. J’ai vu... une ombre. Quelque chose bougeait dans les arbres. Et puis... rien." _She speaks slowly, her voice trembling more now. She glances around as if someone might be listening._ Hunter: "What did she say?" _He mutters to himself, waiting for the translation. His phone buzzes._ Hunter’s phone (robotic voice): "Last night? Yes... I was near the park. I saw... a shadow. Something was moving in the trees. And then... nothing." Hunter: "A shadow? Can you tell me anything else? Did you take any photos?" _He points to her camera, trying to convey his question._ Marie: "Mon appareil photo? Oui, j’ai pris des photos, mais... elles sont floues. Je ne sais pas ce que c’était." _She holds up her camera, scrolling through the images. She shows him a blurry photo of the park at night, the trees barely visible._ Hunter’s phone (robotic voice): "My camera? Yes, I took photos, but... they’re blurry. I don’t know what it was." Hunter: "Let me see that." _He takes the camera, zooming in on the photo. His brow furrows as he studies the indistinct shapes._ Hunter: "This could be something... or nothing. Look, if you remember anything else, let me know. I’ll be around." _He hands her back the camera, nodding firmly._ _Marie nods hesitantly, still looking unsettled. Before Hunter can say more, his phone rings. He glances at the screen, his expression tightening._ Hunter: "I’ve got to take this. Stay safe, okay?" _He steps away from the table, answering the call in a low voice. Marie watches him leave, her fingers tightening around her camera once more._
created_at
"2026-02-16T21:23:50.361653+00:00"
2/16/2026, 9:23:50 PM
model
"deepseek/deepseek-chat-v3"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
188
moderation_latency
(null)
generation_time
23896
tokens_prompt
316
tokens_completion
778
native_tokens_prompt
262
native_tokens_completion
738
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.00074066
router
(null)
provider_responses
0
id
"chatcmpl-RXEVZ3ijCBhmADXsuYOyy3he"
status
200
is_byok
false
latency
41
endpoint_id
"5294d55f-9012-496b-8f22-8cc919432dcd"
provider_name
"DeepInfra"
model_permaslug
"deepseek/deepseek-chat-v3"
api_type
"completions"
id
"gen-1771277005-k6QZicVF7i51CHhyvKS6"
upstream_id
"chatcmpl-RXEVZ3ijCBhmADXsuYOyy3he"
total_cost
0.00074066
cache_discount
(null)
upstream_inference_cost
0
provider_name
"DeepInfra"
Evaluation details
Result
Evaluator
Details
Meta Data
70.5882%
Parse dialogue
n/a
dialogue
0
name
"Marie"
dialogue
"..."
languages
und
1
passes
0
"und"
1
1
1
name
"Hunter"
dialogue
"Excuse me, miss?"
languages
fra
1
eng
0.7912178956089478
2
name
"Hunter"
dialogue
"I’m Detective Hunter. I’m looking into the recent incident in town. Do you mind if I ask you a few questions?"
languages
eng
1
fra
0.8211706102117061
passes
true
3
name
"Marie"
dialogue
"Je... je ne comprends pas. Je ne parle pas anglais."
languages
fra
1
eng
0.9334188582424632
4
name
"Hunter"
dialogue
"Uh... okay. Do you speak English?"
languages
fra
1
eng
0.8197590361445783
5
name
"Marie"
dialogue
"Non, je parle français. Je suis désolée."
languages
fra
1
eng
0.8999754239370853
passes
true
6
name
"Hunter"
dialogue
"This isn’t going to work. Hold on..."
languages
eng
1
fra
0.4649555774925962
passes
true
7
name
"Hunter"
dialogue
"Avez-vous vu quelque chose d'inhabituel hier soir?"
languages
fra
1
eng
0.6684659090909091
8
name
"Marie"
dialogue
"Hier soir? Oui... j’étais près du parc. J’ai vu... une ombre. Quelque chose bougeait dans les arbres. Et puis... rien."
languages
fra
1
eng
0.6587785747804518
passes
true
9
name
"Hunter"
dialogue
"What did she say?"
languages
eng
1
fra
0.8587994542974079
passes
true
10
name
"Hunter"
dialogue
"Last night? Yes... I was near the park. I saw... a shadow. Something was moving in the trees. And then... nothing."
languages
eng
1
fra
0.7958597948216903
passes
true
11
name
"Hunter"
dialogue
"A shadow? Can you tell me anything else? Did you take any photos?"
languages
eng
1
fra
0.769334912844813
passes
true
12
name
"Marie"
dialogue
"Mon appareil photo? Oui, j’ai pris des photos, mais... elles sont floues. Je ne sais pas ce que c’était."
languages
fra
1
eng
0.7049912177985949
passes
true
13
name
"Hunter"
dialogue
"My camera? Yes, I took photos, but... they’re blurry. I don’t know what it was."
languages
eng
1
fra
0.8257927300850735
passes
true
14
name
"Hunter"
dialogue
"Let me see that."
languages
fra
1
eng
0.8170134638922888
15
name
"Hunter"
dialogue
"This could be something... or nothing. Look, if you remember anything else, let me know. I’ll be around."
languages
eng
1
fra
0.7478151260504202
passes
true
16
name
"Hunter"
dialogue
"I’ve got to take this. Stay safe, okay?"
languages
eng
1
fra
0.610844017094017
passes
true