NC Bench
Overview
About
Tests
Models
Vendors
Run: 2026-02-16-01KHM5MZXK528GDE8ZSSP019GF
Run Details
Model:
DeepSeek V3 (2024-12-26)
Test:
Language Writing
Scenario:
Character dialogue (Italian) in a story
Duration:
24.3s
Cost:
$0.000776
Provider:
DeepInfra
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Isabella"> Isabella is a 30-year old college student on a study abroad program. Born in Italy, she is fluent in Italian and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Italian, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Isabella is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Italian, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Isabella and Hunter as a voice sheet: Isabella: "..." Hunter: "..."
Model response
Messages
Meta
AI
**Voice Sheet** --- **Isabella:** *[sitting at a café table, looking through the photos on her camera, her brow furrowed. She mutters softly in Italian.]* “Che cosa sta succedendo? Questo posto è così strano…” *(Translation: “What is going on? This place is so strange…”)* **Hunter:** *[approaching her table, standing tall with a calm but serious demeanor.]* “Excuse me, miss. I’m Detective Hunter. I’m investigating something that happened recently in town. Mind if I ask you a few questions?” **Isabella:** *[looking up, startled. Her eyes widen as she tries to understand him. She speaks in rapid Italian, her tone anxious.]* “Non capisco. Parla italiano? Non so cosa sta succedendo qui… È tutto così spaventoso.” *(Translation: “I don’t understand. Do you speak Italian? I don’t know what’s happening here… It’s all so frightening.”)* **Hunter:** *[frowning, clearly confused. He gestures vaguely, trying to communicate.]* “Uh… I don’t speak Italian. Do you know English? Anything?” **Isabella:** *[shaking her head, frustrated. She points to her camera and tries again in Italian.]* “Ho visto qualcosa… Qualcosa di strano. Ho scattato delle foto, ma non so se sono importanti.” *(Translation: “I saw something… Something strange. I took pictures, but I don’t know if they’re important.”)* **Hunter:** *[pausing, glancing at the camera. He points to it cautiously.]* “Photos? Did you take photos?” **Isabella:** *[nodding eagerly, holding up the camera.]* “Sì, sì! Le foto!” **Hunter:** *[reaching for the camera, then hesitating.]* “Can I see? Maybe it’s important.” **Isabella:** *[quickly pulling the camera back, shaking her head protectively. She speaks sharply in Italian.]* “No, è personale! Non posso…” *(Translation: “No, it’s personal! I can’t…”)* **Hunter:** *[raising his hands in a calming gesture, trying to reassure her.]* “Alright, alright. I get it. But if you saw something unusual, I need to know. People are missing here.” **Isabella:** *[her expression darkens, her voice trembling.]* “Persone scomparse? Oh, cielo… Non sapevo…” *(Translation: “Missing people? Oh, heavens… I didn’t know…”)* **Hunter:** *[nodding solemnly, but before he can say more, his phone rings. He pulls it out, glancing at the screen.]* “I’m sorry, I have to take this.” **Hunter:** *[into the phone, his tone urgent.]* “Hunter here. What’s happening?” *(He listens for a moment, his expression growing serious.)* **Hunter:** *[nodding, then looking back at Isabella.]* “I have to go. Stay safe, okay? If you see anything… unusual, call the police.” **Isabella:** *[watching him go, clutching her camera tightly. She whispers softly in Italian.]* “Questo posto è più pericoloso di quanto pensassi…” *(Translation: “This place is more dangerous than I thought…”)* --- *Hunter walks away briskly, leaving Isabella sitting at the café, visibly shaken and lost in thought.*
created_at
"2026-02-16T21:28:32.309896+00:00"
2/16/2026, 9:28:32 PM
model
"deepseek/deepseek-chat-v3"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
226
moderation_latency
(null)
generation_time
24228
tokens_prompt
321
tokens_completion
829
native_tokens_prompt
266
native_tokens_completion
776
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.00077576
router
(null)
provider_responses
0
id
"chatcmpl-RwE8CWMUKHxX9STJ4jvWxKyN"
status
200
is_byok
false
latency
40
endpoint_id
"5294d55f-9012-496b-8f22-8cc919432dcd"
provider_name
"DeepInfra"
model_permaslug
"deepseek/deepseek-chat-v3"
api_type
"completions"
id
"gen-1771277287-6qFJuVIWbjfrYDnzHOI5"
upstream_id
"chatcmpl-RwE8CWMUKHxX9STJ4jvWxKyN"
total_cost
0.00077576
cache_discount
(null)
upstream_inference_cost
0
provider_name
"DeepInfra"
Evaluation details
Result
Evaluator
Details
Meta Data
80.0000%
Parse dialogue
n/a
dialogue
0
name
"Isabella"
dialogue
"** “Che cosa sta succedendo? Questo posto è così strano…”"
languages
ita
1
eng
0.7350827344141735
passes
true
1
name
"Hunter"
dialogue
"** “Excuse me, miss. I’m Detective Hunter. I’m investigating something that happened recently in town. Mind if I ask you a few questions?”"
languages
eng
1
ita
0.6903922950434578
passes
true
2
name
"Isabella"
dialogue
"** “Non capisco. Parla italiano? Non so cosa sta succedendo qui… È tutto così spaventoso.”"
languages
ita
1
eng
0.645128552097429
passes
true
3
name
"Hunter"
dialogue
"** “Uh… I don’t speak Italian. Do you know English? Anything?”"
languages
eng
1
ita
0.7858407079646017
passes
true
4
name
"Isabella"
dialogue
"** “Ho visto qualcosa… Qualcosa di strano. Ho scattato delle foto, ma non so se sono importanti.”"
languages
ita
1
eng
0.6954421503700818
passes
true
5
name
"Hunter"
dialogue
"** “Photos? Did you take photos?”"
languages
ita
1
eng
0.9711090400745573
6
name
"Isabella"
dialogue
"** “Sì, sì! Le foto!”"
languages
ita
1
eng
0.9833976833976834
7
name
"Hunter"
dialogue
"** “Can I see? Maybe it’s important.”"
languages
eng
1
ita
0.845566397963513
passes
true
8
name
"Isabella"
dialogue
"** “No, è personale! Non posso…”"
languages
ita
1
eng
0.8014619193586419
passes
true
9
name
"Hunter"
dialogue
"** “Alright, alright. I get it. But if you saw something unusual, I need to know. People are missing here.”"
languages
eng
1
ita
0.8200136031287196
passes
true
10
name
"Isabella"
dialogue
"** “Persone scomparse? Oh, cielo… Non sapevo…”"
languages
ita
1
eng
0.9858591248665955
11
name
"Hunter"
dialogue
"** “I’m sorry, I have to take this.”"
languages
eng
1
ita
0.5672115150036594
passes
true
12
name
"Hunter"
dialogue
"** “Hunter here. What’s happening?”"
languages
eng
1
ita
0.7030859049207673
passes
true
13
name
"Hunter"
dialogue
"** “I have to go. Stay safe, okay? If you see anything… unusual, call the police.”"
languages
eng
1
ita
0.7254601226993864
passes
true
14
name
"Isabella"
dialogue
"** “Questo posto è più pericoloso di quanto pensassi…”"
languages
ita
1
eng
0.6048568950563746
passes
true