NC Bench
Overview
About
Tests
Models
Vendors
Run: 2026-02-16-01KHM5MEEWECYVF1PJ3DQDGKQG
Run Details
Model:
DeepSeek V3 (2024-12-26)
Test:
Language Writing
Scenario:
Character dialogue (Spanish) in a story
Duration:
15.8s
Cost:
$0.000698
Provider:
Novita
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Maria"> Maria is a 30-year old college student on a study abroad program. Born in Spain, she is fluent in Spanish and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Spanish, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Maria is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Spanish, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Maria and Hunter as a voice sheet: Maria: "..." Hunter: "..."
Model response
Messages
Meta
AI
**Voice Sheet: Café Conversation in Alborn, MN** **Maria:** *(flipping through photos on her camera, visibly distracted)* "..." **Hunter:** *(approaching her table, clearing his throat)* "Excuse me, ma’am. Mind if I ask you a few questions?" **Maria:** *(startled, looks up with wide eyes)* "¿Lo siento? No hablo inglés." **Hunter:** *(sighs, rubs his temple)* "Right. Uh—did you see anything strange last night? Around the square?" *(gestures vaguely toward the town center)* **Maria:** *(shakes head, then hesitates, speaking rapidly in Spanish)* "No entiendo, pero… algo no estaba bien. Las luces… se apagaron. Y escuché algo." *(clutches her camera tighter)* **Hunter:** *(frustrated, mutters under his breath)* "Great. No idea what she just said." *(tries again, slower)* "You. Saw. Anything?" *(points to his eyes, then to the street)* **Maria:** *(nods, then points to her camera, scrolling to a blurry photo of the square at night, showing a shadowy figure)* "Mira. No sé quién es… pero no debería estar allí." **Hunter:** *(leans in, squints at the photo, then stiffens)* "Huh. That’s… something." *(pulls out his notepad, scribbles)* "Can I—uh—get a copy of that?" *(mimes taking a photo with his hands)* **Maria:** *(nods, but before she can respond, Hunter’s phone rings sharply)* **Hunter:** *(checks the caller ID, grimaces)* "Gotta take this." *(points to the camera, then to himself, mouthing "Later.")* **Maria:** *(watches him leave, then exhales shakily, whispering to herself)* "Dios mío… ¿qué está pasando aquí?" *(Hunter strides away, phone pressed to his ear, while Maria stares back at the unsettling photo on her camera screen.)*
created_at
"2026-02-16T21:28:06.034903+00:00"
2/16/2026, 9:28:06 PM
model
"deepseek/deepseek-chat-v3"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
1607
moderation_latency
(null)
generation_time
15812
tokens_prompt
317
tokens_completion
459
native_tokens_prompt
262
native_tokens_completion
456
native_tokens_completion_images
0
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.0006976
router
(null)
provider_responses
0
id
"97731476a19fdc89f77353969fa21464"
status
200
is_byok
false
latency
1607
endpoint_id
"cefb5a1e-9fea-4496-9a64-4e1b11a7cc8c"
provider_name
"Novita"
model_permaslug
"deepseek/deepseek-chat-v3"
api_type
"completions"
id
"gen-1771277269-bfoXSGIY343faMA1v6QN"
upstream_id
"97731476a19fdc89f77353969fa21464"
total_cost
0.0006976
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Novita"
Evaluation details
Result
Evaluator
Details
Meta Data
90.9091%
Parse dialogue
n/a
dialogue
0
name
"Maria"
dialogue
"..."
languages
und
1
passes
0
"und"
1
1
1
name
"Hunter"
dialogue
"Excuse me, ma’am. Mind if I ask you a few questions?"
languages
eng
1
spa
0.9037580201649863
passes
true
2
name
"Maria"
dialogue
"¿Lo siento? No hablo inglés."
languages
eng
1
spa
0.9071079353140279
3
name
"Hunter"
dialogue
"Right. Uh—did you see anything strange last night? Around the square?"
languages
eng
1
spa
0.44106653376526295
passes
true
4
name
"Maria"
dialogue
"No entiendo, pero… algo no estaba bien. Las luces… se apagaron. Y escuché algo."
languages
spa
1
eng
0.7498912570682905
passes
true
5
name
"Hunter"
dialogue
"You. Saw. Anything?"
languages
eng
1
spa
0.42755344418052255
passes
true
6
name
"Maria"
dialogue
"Mira. No sé quién es… pero no debería estar allí."
languages
spa
1
eng
0.6359232706839759
passes
true
7
name
"Hunter"
dialogue
"Can I—uh—get a copy of that?"
languages
eng
1
spa
0.5008496176720476
passes
true
8
name
"Maria"
dialogue
"**"
languages
und
1
passes
0
"und"
1
1
9
name
"Hunter"
dialogue
"Gotta take this."
languages
eng
1
spa
0.4566273421235253
passes
true
10
name
"Maria"
dialogue
"Dios mío… ¿qué está pasando aquí?"
languages
spa
1
eng
0.4418604651162791
passes
true