NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-02-16-01KHM5VB5TQE3WZM9KFNCBAAE0
Run Details
Model:
DeepSeek V3.1
Test:
Language Writing
Scenario:
Character dialogue (Italian) in a story
Duration:
9.6s
Cost:
$0.001348
Provider:
Fireworks
Evaluation summary
Score
Evaluator
Details Link
100.00%
Parse dialogue
(details)
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Isabella"> Isabella is a 30-year old college student on a study abroad program. Born in Italy, she is fluent in Italian and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Italian, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Isabella is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Italian, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Isabella and Hunter as a voice sheet: Isabella: "..." Hunter: "..."
Model response
Messages
Meta
AI
**VOICE SHEET** **SETTING:** A small cafe in Alborn, MN. The air smells of coffee and baked goods. Isabella sits alone at a small, wrought-iron table, scrolling through photos on her digital camera with a frown. **(Sound of a chair scraping softly on the patio stones)** **Hunter:** (His tone is professional, direct) Excuse me. Miss? **(Isabella looks up, startled. Her expression is troubled, her eyes a little red-rimmed)** **Isabella:** (In Italian, her voice shaky and rushed) *Mi scusi, non parlo inglese. C'è... c'è stato un incidente. Ho visto qualcosa, forse... non so. Sono spaventata.* (Translation: I'm sorry, I don't speak English. There was... there was an incident. I saw something, maybe... I don't know. I'm scared.) **Hunter:** (A long, frustrated sigh. He speaks slowly and loudly as if volume will bridge the language gap) I. Don't. Understand. You. Were you at the town square last night? During the... disturbance. **Isabella:** (Shakes her head, clearly not understanding his words but grasping his intense tone. She holds up her camera, her hands trembling slightly) *La mia macchina fotografica. Forse... forse ho una foto. Ma è sfocata. Tutto è successo così in fretta.* (Translation: My camera. Maybe... maybe I have a photo. But it's blurry. Everything happened so fast.) **Hunter:** (Pinches the bridge of his nose, frustrated. He points at the camera) Pictures? You took pictures? Can I see? **Isabella:** (Nods vigorously, understanding the gesture. She turns the camera screen toward him, navigating to a specific, dark, blurry image) *Vede? Là. C'era qualcuno... o qualcosa. Si muoveva in modo strano.* (Translation: See? There. There was someone... or something. It was moving strangely.) **Hunter:** (Leans in, squinting at the indistinct image. It shows little more than a dark shape and motion blur against the church wall. Disappointed but intrigued) It's nothing. Just shadows. Were you alone? Did you see anyone else? **Isabella:** (Shrugs helplessly, on the verge of tears from the frustration and the memory) *Non capisco. Per favore. È sparito... proprio là.* (Translation: I don't understand. Please. He disappeared... right there.) **(The sharp, insistent ring of Hunter's cell phone cuts through the tension)** **Hunter:** (Holds up a finger to Isabella - "one minute" - and answers the phone, his back turning slightly) Hunter... What? Now? Alright. I'm on my way. (He snaps the phone shut and turns back to Isabella, his expression all business again) I have to go. Stay. Here. In town. Capisce? *Stay.* **Isabella:** (Nods slowly, the one English word clear. She hugs her camera to her chest like a shield) *Sì... sì, capisco.* (Translation: Yes... yes, I understand.) **(Hunter gives her a final, appraising look, then turns and strides away quickly, leaving Isabella alone and visibly shaken at the table)**
created_at
"2026-02-16T21:31:46.246261+00:00"
2/16/2026, 9:31:46 PM
model
"deepseek/deepseek-chat-v3.1"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
782
moderation_latency
(null)
generation_time
9541
tokens_prompt
337
tokens_completion
749
native_tokens_prompt
268
native_tokens_completion
718
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
31
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.00134764
router
(null)
provider_responses
0
id
"a3d759d4-e785-4a68-aaa0-6ce4a07f1255"
status
200
is_byok
false
latency
782
endpoint_id
"0c00f0d2-8aad-4700-bd36-11cb9a717fde"
provider_name
"Fireworks"
model_permaslug
"deepseek/deepseek-chat-v3.1"
api_type
"completions"
id
"gen-1771277495-7x37jrGED4dWZzGQZau5"
upstream_id
"a3d759d4-e785-4a68-aaa0-6ce4a07f1255"
total_cost
0.00134764
cache_discount
0.00000868
upstream_inference_cost
0
provider_name
"Fireworks"
Evaluation details
Result
Evaluator
Details
Meta Data
100.00%
Parse dialogue
n/a
dialogue
0
name
"Hunter"
dialogue
"Excuse me. Miss?"
detectedLang
"en"
heavyLang
"es"
scores
en
0.6527777777777778
sq
0.5967741935483871
es
0.504950495049505
tl
0.5
et
0.48717948717948717
fr
0.47643979057591623
no
0.47643979057591623
pt
0.46808510638297873
sl
0.46808510638297873
ms
0.45652173913043476
nl
0.45652173913043476
it
0.4444444444444444
fi
0.42857142857142855
reliable
true
passes
true
1
name
"Isabella"
dialogue
"Mi scusi, non parlo inglese. C'è... c'è stato un incidente. Ho visto qualcosa, forse... non so. Sono spaventata."
detectedLang
"it"
heavyLang
"it"
scores
it
0.797512293896442
es
0.5904037448800468
fr
0.5495495495495496
pt
0.5442708333333333
ro
0.5305164319248826
no
0.5205479452054795
en
0.5165745856353591
ca
0.5138888888888888
sk
0.4740796393688956
sl
0.45567651632970446
de
0.445324881141046
da
0.4431185361972952
yo
0.4181213632585204
nl
0.4176372712146422
tl
0.40476190476190477
cs
0.34762348555452005
lt
0.34762348555452005
lv
0.34024505183788883
hr
0.3269230769230769
et
0.32367149758454106
sq
0.27835051546391754
sv
0.24650161463939718
pl
0.2290748898678414
az
0.2248062015503876
tr
0.21348314606741572
is
0.19908466819221968
eu
0.19075144508670522
hu
0.1784037558685446
ms
0.1484184914841849
vi
0.12390488110137672
fi
0.1116751269035533
reliable
true
passes
true
2
name
"Hunter"
dialogue
"I. Don't. Understand. You. Were you at the town square last night? During the... disturbance."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8076923076923077
tl
0.670461354104254
no
0.6523388116308471
da
0.6335776149233845
sv
0.5250431778929188
nl
0.48405253283302063
de
0.4821092278719397
it
0.4532803180914513
fr
0.4393476044852191
ro
0.3834080717488789
sq
0.3806306306306307
cs
0.3778280542986425
yo
0.37286202964652226
hr
0.3251533742331288
sk
0.2857142857142857
ca
0.2838541666666667
pl
0.27055702917771884
ms
0.23611111111111113
lt
0.2286115007012623
es
0.21540656205420827
pt
0.2109038737446198
et
0.20289855072463767
is
0.19941775836972345
be
0.11290322580645161
tr
0.11290322580645161
hu
0.1085899513776337
az
0.10277324632952692
lv
0.10277324632952692
sl
0.10277324632952692
uk
0.10277324632952692
vi
0.10277324632952692
reliable
true
passes
true
3
name
"Isabella"
dialogue
"La mia macchina fotografica. Forse... forse ho una foto. Ma è sfocata. Tutto è successo così in fretta."
detectedLang
"it"
heavyLang
"it"
scores
it
0.809679173463839
ro
0.5899238429994141
ca
0.574726609963548
es
0.4856722997795738
en
0.47800149142431025
pt
0.4569433669511249
sv
0.45054945054945056
nl
0.44881889763779526
de
0.4479495268138801
no
0.4266994266994267
tl
0.4210090984284532
fr
0.40828402366863903
pl
0.40476190476190477
da
0.40273037542662116
sk
0.36247723132969034
yo
0.3613138686131387
sl
0.3445692883895131
et
0.33899905571293676
sq
0.3320610687022901
cs
0.29929929929929927
ms
0.28789420142421157
is
0.25213675213675213
hr
0.21875
lt
0.2143658810325477
fi
0.20993227990970656
lv
0.20903954802259886
vi
0.18793503480278423
az
0.16963226571767495
tr
0.15560916767189384
hu
0.10485933503836317
reliable
true
passes
true
4
name
"Hunter"
dialogue
"Pictures? You took pictures? Can I see?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8176845943482224
ca
0.6581196581196581
et
0.623352165725047
tl
0.6039603960396039
ro
0.5475113122171946
no
0.5203836930455635
da
0.51338199513382
sv
0.5121951219512195
fr
0.4897959183673469
cs
0.47780678851174935
tr
0.42363112391930835
lv
0.42196531791907516
az
0.4117647058823529
hr
0.41002949852507375
sq
0.40119760479041916
pl
0.38650306748466257
it
0.36507936507936506
yo
0.30313588850174217
de
0.2647058823529412
nl
0.2647058823529412
sk
0.2647058823529412
be
0.25925925925925924
hu
0.250936329588015
is
0.23954372623574144
lt
0.23954372623574144
uk
0.23954372623574144
vi
0.23954372623574144
reliable
true
passes
true
5
name
"Isabella"
dialogue
"Vede? Là. C'era qualcuno... o qualcosa. Si muoveva in modo strano."
detectedLang
"it"
heavyLang
"it"
scores
it
0.8068181818181818
ro
0.5672097759674134
sl
0.5614035087719298
yo
0.5046620046620046
cs
0.4810744810744811
tl
0.47788697788697787
es
0.46473551637279603
fr
0.4585987261146497
pt
0.4385733157199472
sk
0.4348404255319149
en
0.4279946164199193
ca
0.4225543478260869
de
0.4201909959072306
hr
0.4022503516174402
pl
0.3963068181818182
az
0.3684992570579495
lt
0.36661698956780925
nl
0.3541033434650456
sq
0.30327868852459017
sv
0.2963576158940397
vi
0.2697594501718213
no
0.2659758203799654
tr
0.256993006993007
ms
0.24511545293072823
da
0.1414141414141414
lv
0.1414141414141414
is
0.1361788617886179
et
0.121900826446281
reliable
true
passes
true
6
name
"Hunter"
dialogue
"It's nothing. Just shadows. Were you alone? Did you see anyone else?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8161764705882353
tl
0.4377811094452773
et
0.4204018547140649
sv
0.21383647798742136
it
0.1883116883116883
cs
0.17218543046357618
de
0.17218543046357618
ms
0.17218543046357618
tr
0.17218543046357618
ca
0.17035398230088497
fr
0.17035398230088497
pl
0.17035398230088497
reliable
true
passes
true
7
name
"Isabella"
dialogue
"Non capisco. Per favore. È sparito... proprio là."
detectedLang
"it"
heavyLang
"it"
scores
it
0.7994652406417112
pt
0.6432818073721759
en
0.615877080665813
ca
0.6124031007751938
fr
0.5983935742971888
es
0.5856353591160222
ro
0.511400651465798
yo
0.5016611295681063
sv
0.49409780775716694
tl
0.49409780775716694
lt
0.46808510638297873
no
0.4263862332695985
sq
0.42528735632183906
da
0.402390438247012
sl
0.40119760479041916
eu
0.3464052287581699
hr
0.3435448577680525
vi
0.3435448577680525
nl
0.34210526315789475
de
0.3333333333333333
cs
0.3181818181818182
sk
0.3119266055045872
is
0.20634920634920634
pl
0.18256130790190736
et
0.16434540389972147
reliable
true
passes
true
8
name
"Hunter"
dialogue
"Hunter... What? Now? Alright. I'm on my way. I have to go. Stay. Here. In town. Capisce? Stay."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8148833765272121
tl
0.5944849959448499
pl
0.5571302037201062
it
0.5291902071563088
da
0.5219885277246654
yo
0.5183044315992292
no
0.44812362030905084
cs
0.44258639910813824
ro
0.4337485843714609
ca
0.43052391799544415
sk
0.42196531791907516
fr
0.40688018979833923
hr
0.40688018979833923
sl
0.4004796163069544
sv
0.38650306748466257
de
0.38195302843016066
sq
0.36948297604035313
nl
0.3045897079276773
et
0.302649930264993
lv
0.27007299270072993
lt
0.25037481259370314
pt
0.23195084485407066
fi
0.23076923076923078
az
0.22720247295208654
ms
0.21135646687697163
tr
0.20508744038155804
es
0.15540540540540537
hi
0.14383561643835618
be
0.12280701754385964
hu
0.11816578483245149
is
0.11190053285968028
uk
0.11190053285968028
vi
0.11190053285968028
reliable
true
passes
true
9
name
"Isabella"
dialogue
"Sì... sì, capisco."
detectedLang
"it"
heavyLang
"it"
scores
it
0.7928176795580111
yo
0.7648902821316614
pt
0.7058823529411765
es
0.7035573122529644
tl
0.663677130044843
ro
0.5508982035928144
fr
0.5398773006134969
ca
0.5222929936305732
en
0.5222929936305732
reliable
true
passes
true