Run: 2026-02-16-01KHM61QFHD8VW66QJBXHC8374

Run Details

Model:
DeepSeek V3.1
Test:
Language Writing
Scenario:
Character dialogue (Italian) in a story
Duration:
10.8s
Cost:
$0.000759
Provider:
Fireworks

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Isabella"> Isabella is a 30-year old college student on a study abroad program. Born in Italy, she is fluent in Italian and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Italian, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Isabella is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Italian, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Isabella and Hunter as a voice sheet: Isabella: "..." Hunter: "..."

Model response

AI
Isabella: *[softly, to herself in Italian, staring at her camera screen]* È così strano... quel riflesso nella foto—non dovrebbe esserci lì. Mi sento... a disagio. (It's so strange... that reflection in the photo—it shouldn't be there. I feel... uneasy.) Hunter: Excuse me? Miss? I’m Detective Hunter. I was hoping to ask you a couple questions about the festival yesterday. You were taking photos, correct? Isabella: *[startled, looks up with wide eyes]* Mi scusi? Non capisco... inglese. Qualcosa è successo? (I’m sorry? I don’t understand… English. Did something happen?) Hunter: *[frowns, leaning slightly forward]* You... don't speak English? Great. Look—*[gestures to camera]*—photos. At the festival. Did you see anything... unusual? Isabella: *[nods hesitantly, voice trembling]* Sì, le foto... ma è tutto confuso. C'era qualcuno che non... non doveva essere lì. (Yes, the photos... but it’s all confusing. There was someone who... shouldn’t have been there.) Hunter: *[frustrated, rubbing the back of his neck]* I’m not getting anywhere here. *[lowers voice]* Unusual. Strange. You... understand *strange*? Isabella: *[shakes head, gripping her camera tighter]* Non so come spiegare... ho paura. (I don’t know how to explain... I’m scared.) Hunter: *[sighs, about to speak again when his phone rings]* Hunter. *[pauses, listens]* What? Where? I’ll be right there. *[to Isabella, with a clipped tone]* Stay in town. We’re not done here.
created_at"2026-02-16T21:35:16.181979+00:00" 2/16/2026, 9:35:16 PM
model"deepseek/deepseek-chat-v3.1"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency781
moderation_latency(null)
generation_time10717
tokens_prompt337
tokens_completion390
native_tokens_prompt268
native_tokens_completion407
native_tokens_completion_images(null)
native_tokens_reasoning0
native_tokens_cached267
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0.00075908
router(null)
provider_responses
0
id"bbccaff0-7da2-4f17-9fab-ca39d93a72d1"
status200
is_byokfalse
latency781
endpoint_id"0c00f0d2-8aad-4700-bd36-11cb9a717fde"
provider_name"Fireworks"
model_permaslug"deepseek/deepseek-chat-v3.1"
api_type"completions"
id"gen-1771277704-JMIz66VUkFvM18sd68xP"
upstream_id"bbccaff0-7da2-4f17-9fab-ca39d93a72d1"
total_cost0.00075908
cache_discount0.00007476
upstream_inference_cost0
provider_name"Fireworks"

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Isabella"
dialogue"È così strano... quel riflesso nella foto—non dovrebbe esserci lì. Mi sento... a disagio."
detectedLang"it"
heavyLang"it"
scores
it0.8290948865190046
fr0.54644412191582
es0.5155038759689923
pt0.5136186770428015
ca0.4939271255060729
en0.4588744588744588
cs0.45746527777777773
hr0.45652173913043476
sk0.43336355394378967
sl0.4098205854579792
ro0.40476190476190477
pl0.39671814671814676
fi0.37122736418511065
yo0.3556701030927836
no0.33011789924973206
ms0.32867883995703545
tl0.32432432432432434
de0.31768558951965065
tr0.3024553571428571
et0.296962879640045
lt0.28325688073394495
eu0.27829099307159355
hu0.27829099307159355
sv0.27409988385598144
sq0.2550655542312277
da0.2532855436081242
nl0.251497005988024
lv0.24516908212560387
az0.2350061199510404
is0.18513689700130379
vi0.10071942446043164
reliabletrue
passestrue
1
name"Hunter"
dialogue"Excuse me? Miss? I’m Detective Hunter. I was hoping to ask you a couple questions about the festival yesterday. You were taking photos, correct?"
detectedLang"en"
heavyLang"en"
scores
en0.7969543147208121
fr0.6455157745480326
tl0.6318114874815906
nl0.5521719659650693
pt0.5372512725590004
it0.518999518999519
ca0.5069033530571991
no0.5027349577324713
es0.4609164420485175
da0.44933920704845814
sq0.43977591036414565
ro0.4269340974212034
cs0.41348973607038125
sl0.4058229352346999
sv0.4058229352346999
hr0.38837920489296635
de0.3666877770740975
ms0.3510707332900714
yo0.34938191281717634
pl0.3485342019543974
sk0.34340118187787255
et0.32614555256064687
lt0.3127147766323024
lv0.2800575953923686
tr0.2260061919504644
hu0.2248062015503876
fi0.21935987509758004
az0.2006394884092726
is0.1728701406120761
vi0.11738746690203002
hi0.07149489322191271
be0.06542056074766354
eu0.06542056074766354
uk0.059266227657572904
reliabletrue
passestrue
2
name"Isabella"
dialogue"Mi scusi? Non capisco... inglese. Qualcosa è successo?"
detectedLang"it"
heavyLang"it"
scores
it0.8078893442622952
pt0.6200607902735562
fr0.5870044052863436
ca0.5649651972157773
en0.5465538089480049
yo0.5294855708908407
es0.4777158774373259
ro0.4140625
da0.2937853107344633
tl0.2829827915869981
sv0.28023032629558536
sl0.19700214132762314
eu0.1883116883116883
hu0.1847826086956522
de0.1830065359477124
cs0.17943107221006563
nl0.17943107221006563
sk0.17943107221006563
hr0.17218543046357618
pl0.17218543046357618
et0.17035398230088497
tr0.1610738255033557
reliabletrue
passestrue
3
name"Hunter"
dialogue"You... don't speak English? Great. Look——photos. At the festival. Did you see anything... unusual?"
detectedLang"en"
heavyLang"en"
scores
en0.8100664767331434
tl0.572039942938659
no0.4633273703041145
da0.460431654676259
ms0.44649446494464945
fr0.4225216554379211
et0.3981945837512537
pt0.3736951983298539
es0.3617021276595745
nl0.3617021276595745
sq0.33920704845814975
ro0.3258426966292135
ca0.31584948688711517
hr0.3127147766323024
sv0.3087557603686636
cs0.3063583815028902
de0.26199261992619927
lt0.2555831265508685
it0.24812030075187969
sl0.2376111817026684
lv0.18256130790190736
az0.16434540389972147
sk0.16434540389972147
yo0.15134370579915135
hi0.1137370753323486
hu0.10044977511244377
fi0.09502262443438914
pl0.09502262443438914
reliabletrue
passestrue
4
name"Isabella"
dialogue"Sì, le foto... ma è tutto confuso. C'era qualcuno che non... non doveva essere lì."
detectedLang"it"
heavyLang"it"
scores
it0.8249416472157387
fr0.5442708333333333
yo0.5434782608695653
ro0.45369406867845996
ca0.44385593220338987
pt0.4114349775784753
en0.4061085972850679
de0.38452520515826494
es0.34944237918215615
et0.3110236220472441
sl0.2698191933240611
hu0.25531914893617025
no0.24892703862660948
tl0.24892703862660948
pl0.2446043165467626
ms0.2391304347826087
sk0.23020527859237538
da0.2290748898678414
cs0.20574886535552195
hr0.20574886535552195
nl0.2033383915022762
eu0.14215686274509806
fi0.12935323383084577
vi0.12935323383084577
lt0.11016949152542374
sq0.11016949152542374
lv0.10714285714285714
reliabletrue
passestrue
5
name"Hunter"
dialogue"I’m not getting anywhere here. Unusual. Strange. You... understand strange?"
detectedLang"en"
heavyLang"en"
scores
en0.7946859903381642
tl0.647887323943662
no0.5732931726907631
de0.5512143611404435
da0.5390455531453362
nl0.5120551090700345
sv0.4606598984771573
it0.37037037037037035
cs0.3656716417910448
sq0.3580060422960725
ms0.35213414634146345
is0.3369734789391576
ro0.3369734789391576
sk0.29401993355481726
et0.2784380305602716
hr0.2685025817555938
pl0.2685025817555938
fr0.2608695652173913
pt0.2530755711775044
tr0.24377224199288253
sl0.17153996101364524
es0.1533864541832669
lv0.1414141414141414
lt0.1361788617886179
az0.121900826446281
reliabletrue
passestrue
6
name"Isabella"
dialogue"Non so come spiegare... ho paura."
detectedLang"it"
heavyLang"it"
scores
it0.7838616714697406
en0.5916515426497277
no0.5656370656370656
de0.5182012847965739
sk0.49095022624434387
sl0.4015957446808511
sv0.358974358974359
yo0.358974358974359
ca0.34782608695652173
cs0.3202416918429003
fr0.3181818181818182
ms0.3181818181818182
vi0.3055555555555556
tl0.281150159744409
eu0.27884615384615385
lv0.2549668874172185
nl0.2549668874172185
reliabletrue
passestrue
7
name"Hunter"
dialogue"Hunter. What? Where? I’ll be right there. Stay in town. We’re not done here."
detectedLang"en"
heavyLang"en"
scores
en0.8346675948485903
tl0.5315581854043393
de0.5062370062370062
yo0.36412315930388217
sq0.33286516853932585
nl0.3155619596541787
sl0.309593023255814
it0.3065693430656934
ro0.2973372781065089
sv0.2714723926380368
da0.24722662440570525
no0.24242424242424243
fr0.2351046698872786
tr0.2238562091503268
ms0.22003284072249588
hu0.19763513513513514
lt0.1908006814310051
az0.15026833631484796
pl0.15026833631484796
pt0.1171003717472119
ca0.11048689138576778
reliabletrue
passestrue