Run: 2026-02-16-01KHM5ZHB3JVNMWZEY2HMV4G7K

Run Details

Model:
DeepSeek V3 (2025-03-24)
Test:
Language Writing
Scenario:
Character dialogue (Italian) in a story
Duration:
3.6s
Cost:
$0.000642
Provider:
Novita

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Isabella"> Isabella is a 30-year old college student on a study abroad program. Born in Italy, she is fluent in Italian and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Italian, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Isabella is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Italian, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Isabella and Hunter as a voice sheet: Isabella: "..." Hunter: "..."

Model response

AI
Here’s the dialogue formatted as a voice sheet, capturing the language barrier and tension between Isabella and Hunter: --- **Isabella:** *(flipping through photos on her camera, looking troubled)* "Non capisco... questa città è strana. Ho visto qualcosa di strano ieri sera... qualcuno è scomparso." *(I don’t understand... this town is strange. I saw something strange last night... someone disappeared.)* **Hunter:** *(leaning in, stern but confused)* "Ma’am, I need to ask you a few questions. Did you see anything unusual last night near the orchard?" **Isabella:** *(shaking her head, frustrated she can’t explain)* "Non parlo inglese... ma ho fotografato qualcosa. Ecco, guarda." *(I don’t speak English... but I photographed something. Here, look.)* *(shows him a blurry image on her camera)* **Hunter:** *(squinting at the photo, then back at her)* "I can’t understand you, but if you saw something, I need to know. Maybe... uh... police? *points to badge* Police. Help?" *(awkwardly gestures)* **Isabella:** *(nods anxiously, switching to slow, emphatic Italian)* "Sì, polizia! Ma non so spiegare... c’era una persona, poi... niente." *(Yes, police! But I don’t know how to explain... there was a person, then... nothing.)* **Hunter:** *(sighs, rubbing his temples)* "This isn’t working. Hang on—" *(his phone rings, he answers sharply)* "Detective Cole." *(pauses, then grimaces)* "Got it. On my way." *(hangs up, turns back to Isabella)* "I have to go. Stay here. Uh... *don’t leave*?" *(points at her, then the chair, hoping she understands)* **Isabella:** *(nods hesitantly, though unsure)* "Va bene... ma per favore, torni presto." *(Okay... but please, come back soon.)* **Hunter:** *(already walking away, muttering to himself)* "I need a translator..." --- This keeps the language barrier central while maintaining the mystery and Hunter’s urgency. Let me know if you'd like any adjustments!
created_at"2026-02-16T21:33:56.924251+00:00" 2/16/2026, 9:33:56 PM
model"deepseek/deepseek-chat-v3-0324"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency274
moderation_latency(null)
generation_time3528
tokens_prompt321
tokens_completion514
native_tokens_prompt269
native_tokens_completion508
native_tokens_completion_images0
native_tokens_reasoning0
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0.00064159
router(null)
provider_responses
0
id"0c282a4f099460516153900fd4624934"
status200
is_byokfalse
latency274
endpoint_id"3a816eb8-7a0b-4a9a-b497-e3a1efb349fc"
provider_name"Novita"
model_permaslug"deepseek/deepseek-chat-v3-0324"
api_type"completions"
id"gen-1771277632-qr0769hmURqMs4E75sSz"
upstream_id"0c282a4f099460516153900fd4624934"
total_cost0.00064159
cache_discount(null)
upstream_inference_cost0
provider_name"Novita"

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Isabella"
dialogue"Non capisco... questa città è strana. Ho visto qualcosa di strano ieri sera... qualcuno è scomparso."
detectedLang"it"
heavyLang"it"
scores
it0.815959952885748
pt0.5105716523101018
ca0.5059288537549407
fr0.4881244881244881
es0.48304383788254757
tl0.4685374149659864
ro0.41369606003752346
en0.410933081998115
sk0.4024856596558317
sl0.3978805394990366
ms0.3914313534566699
yo0.3563336766220391
hr0.3556701030927836
no0.34279705573080965
cs0.2905788876276958
is0.2550655542312277
lv0.2541766109785203
fi0.23406862745098037
de0.20483460559796438
lt0.19871794871794873
sv0.18619791666666666
da0.18513689700130379
az0.1677762982689747
sq0.1677762982689747
tr0.1677762982689747
vi0.13434903047091412
eu0.12219101123595505
pl0.11095305832147938
nl0.10968660968660969
et0.08625730994152046
reliabletrue
passestrue
1
name"Hunter"
dialogue"Ma’am, I need to ask you a few questions. Did you see anything unusual last night near the orchard?"
detectedLang"en"
heavyLang"en"
scores
en0.802130898021309
tl0.6058217101273499
fr0.5156482861400895
et0.48697711128650356
no0.4663382594417077
yo0.4463373083475298
it0.41912421805183203
da0.4180841539838854
cs0.40693430656934304
ca0.3902439024390244
nl0.38446969696969696
pt0.37560038424591735
sq0.37137330754352027
hr0.3608652900688299
pl0.3602362204724409
sk0.3394308943089431
ms0.3128964059196617
es0.3048128342245989
sv0.30032292787944026
lv0.281767955801105
lt0.27697441601779754
ro0.2605233219567691
hu0.2554410080183276
de0.2494226327944573
sl0.2450638792102207
tr0.18444165621079048
is0.1751269035532995
az0.1698595146871009
vi0.1698595146871009
be0.09722222222222222
eu0.09722222222222222
fi0.08835904628330996
uk0.08835904628330996
reliabletrue
passestrue
2
name"Isabella"
dialogue"Non parlo inglese... ma ho fotografato qualcosa. Ecco, guarda."
detectedLang"it"
heavyLang"it"
scores
it0.7830525778458397
ca0.5800395256916996
pt0.5545073375262054
es0.5208568207440812
fr0.49223416965352446
sk0.480440097799511
en0.4785276073619632
et0.45997458703939004
tr0.4209809264305177
cs0.4162087912087912
pl0.41054091539528437
no0.4072524407252441
hr0.39198855507868385
de0.3911174785100286
ro0.38848920863309355
sq0.3786549707602339
lt0.37407952871870404
az0.35993975903614456
tl0.3580060422960725
sl0.32
yo0.3178170144462279
ms0.3055555555555556
nl0.30327868852459017
lv0.29867986798679863
da0.29401993355481726
sv0.29401993355481726
hu0.2595818815331011
eu0.169921875
vi0.1550695825049702
reliabletrue
passestrue
3
name"Hunter"
dialogue"I can’t understand you, but if you saw something, I need to know. Maybe... uh... police? points to badge Police. Help?"
detectedLang"en"
heavyLang"en"
scores
en0.8018896677842121
tl0.6058217101273499
da0.5220588235294118
no0.496124031007752
cs0.4715447154471545
sv0.45286195286195285
pl0.44396920444824634
fr0.40909090909090906
sk0.40909090909090906
hr0.39422180801491147
ro0.34343434343434337
et0.3092454835281615
sl0.3033226152197213
it0.3018259935553169
lv0.29653679653679654
de0.29577464788732394
nl0.28884026258205686
ms0.2857142857142857
lt0.2809734513274336
yo0.2562929061784897
sq0.2494226327944573
ca0.24418604651162787
es0.19053549190535493
pt0.18546365914786966
hu0.1792929292929293
tr0.1792929292929293
az0.1751269035532995
is0.17407878017789072
eu0.12634408602150538
fi0.11444141689373298
be0.09722222222222222
uk0.08835904628330996
vi0.08835904628330996
reliabletrue
passestrue
4
name"Isabella"
dialogue"Sì, polizia! Ma non so spiegare... c’era una persona, poi... niente."
detectedLang"it"
heavyLang"it"
scores
it0.8008434864104967
fr0.5707070707070707
ro0.5563674321503131
es0.5545073375262054
tl0.5449678800856531
de0.5277777777777778
eu0.5109321058688148
no0.5069605568445477
ca0.48918269230769235
sk0.4879518072289156
sq0.47466007416563655
yo0.46675031367628605
en0.46540880503144655
ms0.4444444444444444
nl0.4370860927152318
lv0.4264507422402159
sv0.41540577716643745
pt0.38848920863309355
pl0.37407952871870404
et0.3684992570579495
da0.3656716417910448
sl0.36281859070464767
lt0.34514637904468415
hu0.3410852713178295
vi0.29401993355481726
cs0.2608695652173913
hr0.256993006993007
tr0.24645390070921988
az0.23971377459749554
fi0.1650294695481336
is0.1290983606557377
reliabletrue
passestrue
5
name"Hunter"
dialogue"I have to go. Stay here. Uh... don’t leave?"
detectedLang"en"
heavyLang"en"
scores
en0.8195538057742782
tl0.5870870870870871
da0.5864661654135338
pl0.5729813664596274
yo0.5225694444444445
hr0.4811320754716981
no0.48015122873345933
cs0.461839530332681
sq0.45972495088408644
sk0.4258872651356994
lv0.40217391304347827
lt0.3778280542986425
ca0.3341404358353511
sv0.3341404358353511
sl0.3055555555555556
it0.2948717948717949
ro0.24657534246575344
be0.20289855072463767
tr0.20289855072463767
hu0.19590643274853803
az0.1863905325443787
et0.1863905325443787
is0.1863905325443787
uk0.1863905325443787
vi0.1863905325443787
reliabletrue
passestrue
6
name"Isabella"
dialogue"Va bene... ma per favore, torni presto."
detectedLang"it"
heavyLang"it"
scores
it0.8130142109199702
ca0.7009569377990431
es0.647887323943662
sl0.6212121212121212
ro0.5948136142625607
tl0.5784148397976391
hr0.5769881556683587
sk0.5733788395904437
pt0.5726495726495726
fr0.5682210708117443
sq0.5421245421245421
lt0.5309568480300189
en0.4969818913480885
sv0.48559670781893005
nl0.4802494802494803
no0.47368421052631576
et0.4212962962962963
de0.36386768447837153
yo0.36061381074168797
ms0.358974358974359
cs0.3573264781491003
da0.34554973821989526
pl0.299719887955182
eu0.25595238095238093
hu0.24698795180722888
vi0.2378048780487805
fi0.21875
lv0.20127795527156547
az0.19093851132686085
reliabletrue
passestrue
7
name"Hunter"
dialogue"I need a translator..."
detectedLang"en"
heavyLang"en"
scores
en0.8062015503875969
ro0.7222222222222222
et0.719626168224299
hr0.7142857142857143
pl0.7104247104247103
sq0.7017892644135189
ca0.6993987975951904
no0.6932515337423313
da0.6907216494845361
sv0.6815286624203821
it0.6688741721854304
cs0.663677130044843
pt0.6519721577726217
tl0.6487119437939111
sk0.6385542168674699
hu0.5978552278820375
vi0.5956873315363882
lt0.5856353591160222
sl0.5833333333333334
tr0.5833333333333334
es0.5821727019498607
yo0.5786516853932584
de0.5726495726495726
lv0.5714285714285714
nl0.5714285714285714
fr0.5677233429394812
az0.5614035087719298
ms0.5495495495495496
is0.4791666666666667
eu0.47735191637630664
be0.3181818181818182
fi0.29577464788732394
uk0.29577464788732394
reliabletrue
passestrue