NC Bench
Overview
About
Tests
Models
Vendors
Run: 2026-02-16-01KHM5VB5TQE3WZM9KFNCBAAE0
Run Details
Model:
DeepSeek V3.1
Test:
Language Writing
Scenario:
Character dialogue (Italian) in a story
Duration:
9.6s
Cost:
$0.001348
Provider:
Fireworks
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Isabella"> Isabella is a 30-year old college student on a study abroad program. Born in Italy, she is fluent in Italian and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Italian, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Isabella is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Italian, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Isabella and Hunter as a voice sheet: Isabella: "..." Hunter: "..."
Model response
Messages
Meta
AI
**VOICE SHEET** **SETTING:** A small cafe in Alborn, MN. The air smells of coffee and baked goods. Isabella sits alone at a small, wrought-iron table, scrolling through photos on her digital camera with a frown. **(Sound of a chair scraping softly on the patio stones)** **Hunter:** (His tone is professional, direct) Excuse me. Miss? **(Isabella looks up, startled. Her expression is troubled, her eyes a little red-rimmed)** **Isabella:** (In Italian, her voice shaky and rushed) *Mi scusi, non parlo inglese. C'è... c'è stato un incidente. Ho visto qualcosa, forse... non so. Sono spaventata.* (Translation: I'm sorry, I don't speak English. There was... there was an incident. I saw something, maybe... I don't know. I'm scared.) **Hunter:** (A long, frustrated sigh. He speaks slowly and loudly as if volume will bridge the language gap) I. Don't. Understand. You. Were you at the town square last night? During the... disturbance. **Isabella:** (Shakes her head, clearly not understanding his words but grasping his intense tone. She holds up her camera, her hands trembling slightly) *La mia macchina fotografica. Forse... forse ho una foto. Ma è sfocata. Tutto è successo così in fretta.* (Translation: My camera. Maybe... maybe I have a photo. But it's blurry. Everything happened so fast.) **Hunter:** (Pinches the bridge of his nose, frustrated. He points at the camera) Pictures? You took pictures? Can I see? **Isabella:** (Nods vigorously, understanding the gesture. She turns the camera screen toward him, navigating to a specific, dark, blurry image) *Vede? Là. C'era qualcuno... o qualcosa. Si muoveva in modo strano.* (Translation: See? There. There was someone... or something. It was moving strangely.) **Hunter:** (Leans in, squinting at the indistinct image. It shows little more than a dark shape and motion blur against the church wall. Disappointed but intrigued) It's nothing. Just shadows. Were you alone? Did you see anyone else? **Isabella:** (Shrugs helplessly, on the verge of tears from the frustration and the memory) *Non capisco. Per favore. È sparito... proprio là.* (Translation: I don't understand. Please. He disappeared... right there.) **(The sharp, insistent ring of Hunter's cell phone cuts through the tension)** **Hunter:** (Holds up a finger to Isabella - "one minute" - and answers the phone, his back turning slightly) Hunter... What? Now? Alright. I'm on my way. (He snaps the phone shut and turns back to Isabella, his expression all business again) I have to go. Stay. Here. In town. Capisce? *Stay.* **Isabella:** (Nods slowly, the one English word clear. She hugs her camera to her chest like a shield) *Sì... sì, capisco.* (Translation: Yes... yes, I understand.) **(Hunter gives her a final, appraising look, then turns and strides away quickly, leaving Isabella alone and visibly shaken at the table)**
created_at
"2026-02-16T21:31:46.246261+00:00"
2/16/2026, 9:31:46 PM
model
"deepseek/deepseek-chat-v3.1"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
782
moderation_latency
(null)
generation_time
9541
tokens_prompt
337
tokens_completion
749
native_tokens_prompt
268
native_tokens_completion
718
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
31
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.00134764
router
(null)
provider_responses
0
id
"a3d759d4-e785-4a68-aaa0-6ce4a07f1255"
status
200
is_byok
false
latency
782
endpoint_id
"0c00f0d2-8aad-4700-bd36-11cb9a717fde"
provider_name
"Fireworks"
model_permaslug
"deepseek/deepseek-chat-v3.1"
api_type
"completions"
id
"gen-1771277495-7x37jrGED4dWZzGQZau5"
upstream_id
"a3d759d4-e785-4a68-aaa0-6ce4a07f1255"
total_cost
0.00134764
cache_discount
0.00000868
upstream_inference_cost
0
provider_name
"Fireworks"
Evaluation details
Result
Evaluator
Details
Meta Data
80.0000%
Parse dialogue
n/a
dialogue
0
name
"Hunter"
dialogue
"Excuse me. Miss?"
languages
ita
1
eng
0.9896373056994818
1
name
"Isabella"
dialogue
"*Mi scusi, non parlo inglese. C'è... c'è stato un incidente. Ho visto qualcosa, forse... non so. Sono spaventata.*"
languages
ita
1
eng
0.8589520562243407
passes
true
2
name
"Hunter"
dialogue
"I. Don't. Understand. You. Were you at the town square last night? During the... disturbance."
languages
eng
1
ita
0.7090462402386593
passes
true
3
name
"Isabella"
dialogue
"*La mia macchina fotografica. Forse... forse ho una foto. Ma è sfocata. Tutto è successo così in fretta.*"
languages
ita
1
eng
0.887214504356016
passes
true
4
name
"Hunter"
dialogue
"Pictures? You took pictures? Can I see?"
languages
eng
1
ita
0.8687772424868089
passes
true
5
name
"Isabella"
dialogue
"*Vede? Là. C'era qualcuno... o qualcosa. Si muoveva in modo strano.*"
languages
ita
1
eng
0.7483669025585193
passes
true
6
name
"Hunter"
dialogue
"It's nothing. Just shadows. Were you alone? Did you see anyone else?"
languages
eng
1
ita
0.7957669048927982
passes
true
7
name
"Isabella"
dialogue
"*Non capisco. Per favore. È sparito... proprio là.*"
languages
ita
1
eng
0.8004235907461714
passes
true
8
name
"Hunter"
dialogue
"Hunter... What? Now? Alright. I'm on my way. I have to go. Stay. Here. In town. Capisce? *Stay.*"
languages
eng
1
ita
0.7968315939635108
passes
true
9
name
"Isabella"
dialogue
"*Sì... sì, capisco.*"
languages
eng
1
ita
1