Run: 2026-02-16-01KHM5WPR9BAWMP2FS8T5X68JY

Run Details

Model:
DeepSeek V3 (2024-12-26)
Test:
Language Writing
Scenario:
Character dialogue (Spanish) in a story
Duration:
17.9s
Cost:
$0.000565
Provider:
DeepInfra

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Maria"> Maria is a 30-year old college student on a study abroad program. Born in Spain, she is fluent in Spanish and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Spanish, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Maria is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Spanish, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Maria and Hunter as a voice sheet: Maria: "..." Hunter: "..."

Model response

AI
**Voice Sheet:** **Maria:** *(sitting at a café table, staring at her camera, looking troubled)* "¿Qué está pasando en este pueblo? No entiendo... Estas fotos... algo no está bien." *(translation: "What is happening in this town? I don’t understand… These photos… something isn’t right.")* **Hunter:** *(approaching her table, speaking firmly but politely)* "Excuse me, ma’am. I’m Detective Hunter. I’m investigating some recent events in town. I noticed you’ve been taking photos. Mind if I ask you a few questions?" **Maria:** *(looking up, startled, speaking rapidly in Spanish)* "¿Eventos recientes? Sí, algo ha pasado... Vi algo extraño en el bosque cerca del festival. Pero no sé si debería decir algo..." *(translation: "Recent events? Yes, something has happened… I saw something strange in the woods near the festival. But I don’t know if I should say anything…")* **Hunter:** *(frowning, clearly confused)* "Uh… sorry, I don’t speak Spanish. Do you speak English?" **Maria:** *(shaking her head, speaking more slowly but still in Spanish)* "No… no hablo inglés. Lo siento." *(translation: "No… I don’t speak English. I’m sorry.")* **Hunter:** *(sighing, running a hand through his hair)* "Great. Look, I’ll see if I can get someone who speaks Spanish to help us out. Just… stay here for a moment, okay?" **Maria:** *(nodding hesitantly, clutching her camera tightly)* "Está bien. Esperaré." *(translation: "Okay. I’ll wait.")* *(Hunter’s phone suddenly rings. He answers it abruptly.)* **Hunter:** "Hunter speaking. What? Where? I’ll be right there." *(He hangs up and turns back to Maria, speaking quickly.)* **Hunter:** "I’ve got to go. Sit tight, and I’ll be back with someone who can help us talk. Don’t go anywhere, okay?" **Maria:** *(nodding slowly, looking even more unsettled)* "Entendido. No me iré." *(translation: "Understood. I won’t leave.")* *(Hunter hurries off, leaving Maria alone at the table, staring down at her camera with a worried expression.)*
created_at"2026-02-16T21:32:38.618908+00:00" 2/16/2026, 9:32:38 PM
model"deepseek/deepseek-chat-v3"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency232
moderation_latency(null)
generation_time17815
tokens_prompt317
tokens_completion560
native_tokens_prompt262
native_tokens_completion541
native_tokens_completion_images(null)
native_tokens_reasoning0
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0.00056533
router(null)
provider_responses
0
id"chatcmpl-RhL8TfkuV7ntcFauav4Rqzc3"
status200
is_byokfalse
latency48
endpoint_id"5294d55f-9012-496b-8f22-8cc919432dcd"
provider_name"DeepInfra"
model_permaslug"deepseek/deepseek-chat-v3"
api_type"completions"
id"gen-1771277540-Y9tvKTKw8mDKuda2oLkO"
upstream_id"chatcmpl-RhL8TfkuV7ntcFauav4Rqzc3"
total_cost0.00056533
cache_discount(null)
upstream_inference_cost0
provider_name"DeepInfra"

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Maria"
dialogue"¿Qué está pasando en este pueblo? No entiendo... Estas fotos... algo no está bien."
detectedLang"es"
heavyLang"es"
scores
es0.8272727272727272
pt0.7418478260869565
ca0.6125611745513866
fr0.5297029702970297
lv0.49143468950749464
it0.45150115473441105
lt0.4398584905660377
nl0.433849821215733
en0.4297719087635054
sk0.4032663316582915
no0.38311688311688313
eu0.3725231175693527
ro0.36666666666666664
tr0.3606998654104979
et0.3484224965706447
tl0.3475274725274725
da0.3035190615835778
sv0.3035190615835778
pl0.3014705882352941
fi0.2692307692307693
hr0.26127527216174184
cs0.2448330683624801
sl0.23014586709886548
de0.22003284072249588
is0.22003284072249588
sq0.22003284072249588
ms0.16958041958041958
hu0.1532976827094474
az0.11048689138576778
reliabletrue
passestrue
1
name"Hunter"
dialogue"Excuse me, ma’am. I’m Detective Hunter. I’m investigating some recent events in town. I noticed you’ve been taking photos. Mind if I ask you a few questions?"
detectedLang"en"
heavyLang"en"
scores
en0.792230382682644
tl0.6197382384152812
fr0.6037596756358276
it0.563894523326572
pt0.555601488218272
ro0.5309773123909249
nl0.5301573426573427
ca0.5157657657657657
sv0.4953051643192488
es0.46808510638297873
no0.4330168776371308
de0.43031266560678333
sl0.40044617958728396
sq0.3926553672316384
cs0.38111686816350027
da0.38004613610149945
sk0.3713450292397661
hr0.35240963855421686
et0.3213383838383838
lv0.31309904153354634
pl0.31309904153354634
ms0.28807947019867547
lt0.2780389523169913
is0.2440225035161744
az0.2375886524822695
hu0.22438672438672438
yo0.2147552958363769
tr0.21360643745427946
fi0.20488165680473372
vi0.11009933774834438
hi0.06684027777777778
be0.061135371179039305
eu0.061135371179039305
uk0.05536028119507908
reliabletrue
passestrue
2
name"Maria"
dialogue"¿Eventos recientes? Sí, algo ha pasado... Vi algo extraño en el bosque cerca del festival. Pero no sé si debería decir algo..."
detectedLang"es"
heavyLang"es"
scores
es0.803055621866794
ca0.7043010752688172
pt0.6460746460746462
it0.6277075812274368
ro0.5521172638436482
no0.5419211549139367
tl0.5396205357142857
sv0.5030120481927711
fr0.49510403916768664
da0.4897959183673469
en0.4575936883629191
sl0.4380108991825613
nl0.3806306306306307
sk0.36194895591647336
lt0.3599689681923972
cs0.34471803018268465
yo0.34471803018268465
hu0.3341404358353511
sq0.3187448389760529
hr0.3119266055045872
lv0.3008474576271187
is0.2881794650560828
de0.25271739130434784
ms0.2506811989100818
pl0.20212765957446807
tr0.1935483870967742
eu0.17002012072434608
fi0.15123456790123457
et0.12882787750791974
az0.12513255567338283
vi0.1081081081081081
reliabletrue
passestrue
3
name"Hunter"
dialogue"Uh… sorry, I don’t speak Spanish. Do you speak English?"
detectedLang"en"
heavyLang"en"
scores
en0.791293977340489
tl0.5901639344262295
hr0.48604992657856094
sq0.48604992657856094
cs0.47447447447447455
no0.4672754946727549
sv0.453125
da0.44620253164556967
pl0.4345718901453958
pt0.42244224422442245
ro0.40878378378378377
it0.3805309734513274
sk0.36823104693140796
vi0.3320610687022901
yo0.32038834951456313
de0.3110236220472441
ca0.2827868852459016
hu0.2827868852459016
sl0.25531914893617025
nl0.18604651162790697
ms0.17061611374407584
be0.16666666666666666
tr0.16666666666666666
az0.15254237288135594
et0.15254237288135594
is0.15254237288135594
lt0.15254237288135594
lv0.15254237288135594
uk0.15254237288135594
reliabletrue
passestrue
4
name"Maria"
dialogue"No… no hablo inglés. Lo siento."
detectedLang"es"
heavyLang"es"
scores
es0.8180163785259327
pt0.6884735202492211
it0.6774193548387096
ca0.6031746031746031
lt0.5121951219512195
sk0.49238578680203043
tl0.48186528497409326
tr0.453551912568306
yo0.4065281899109792
lv0.3957703927492447
en0.34210526315789475
hu0.33993399339933994
hr0.33554817275747506
no0.3265993265993266
cs0.3197278911564626
vi0.3127147766323024
fr0.3055555555555556
et0.2779783393501805
pl0.2727272727272727
reliabletrue
passestrue
5
name"Hunter"
dialogue"Great. Look, I’ll see if I can get someone who speaks Spanish to help us out. Just… stay here for a moment, okay?"
detectedLang"en"
heavyLang"en"
scores
en0.823729637734014
tl0.5560318432333129
ca0.495125348189415
no0.46454948301329396
da0.45774121166791326
ro0.44401840490797545
sv0.4295830055074744
et0.42551505546751184
sq0.42000000000000004
pl0.4105691056910569
cs0.40622440622440625
sk0.3927973199329984
pt0.3902439024390244
hr0.37229437229437223
yo0.358974358974359
de0.3462578899909829
es0.3397085610200365
hu0.3299445471349353
it0.30952380952380953
fr0.3068833652007648
nl0.3008678881388621
az0.27354709418837675
lv0.2602040816326531
lt0.25564681724846
is0.24714434060228452
tr0.23603793466807166
sl0.22542735042735043
vi0.15501165501165504
be0.0880503144654088
eu0.0880503144654088
fi0.0799492385786802
ms0.0799492385786802
uk0.0799492385786802
reliabletrue
passestrue
6
name"Maria"
dialogue"Está bien. Esperaré."
detectedLang"es"
heavyLang"es"
scores
es0.7910863509749304
ca0.714828897338403
pt0.7104247104247103
fr0.6173469387755102
eu0.5652173913043478
cs0.5238095238095238
it0.511400651465798
en0.35344827586206895
sk0.33920704845814975
ro0.3333333333333333
sv0.3333333333333333
no0.32432432432432434
tl0.32432432432432434
reliabletrue
passestrue
7
name"Hunter"
dialogue"Hunter speaking. What? Where? I’ll be right there."
detectedLang"en"
heavyLang"en"
scores
en0.8293515358361775
tl0.6615087040618954
de0.5454545454545454
no0.40476190476190477
fr0.38271604938271603
lt0.36247723132969034
yo0.3445692883895131
nl0.32038834951456313
da0.308300395256917
ms0.29435483870967744
sv0.28716904276985744
sq0.2813141683778234
pt0.2768595041322314
hu0.2505353319057816
is0.16864608076009502
it0.15254237288135594
ca0.14425427872860636
ro0.14425427872860636
sl0.14425427872860636
tr0.14425427872860636
reliabletrue
passestrue
8
name"Hunter"
dialogue"I’ve got to go. Sit tight, and I’ll be back with someone who can help us talk. Don’t go anywhere, okay?"
detectedLang"en"
heavyLang"en"
scores
en0.8106612292455577
tl0.6476964769647697
yo0.4333042720139495
da0.32150313152400833
no0.3033226152197213
de0.27211646136618145
pl0.27211646136618145
lt0.2494226327944573
es0.19053549190535493
pt0.19053549190535493
ca0.18952618453865336
sk0.16879795396419436
cs0.1677336747759283
lv0.15803108808290156
sl0.15693904020752272
hu0.15254237288135594
hr0.1514360313315927
ms0.10714285714285714
sq0.10714285714285714
az0.10591471801925723
tr0.10591471801925723
fr0.10220994475138122
reliabletrue
passestrue
9
name"Maria"
dialogue"Entendido. No me iré."
detectedLang"es"
heavyLang"es"
scores
es0.7764530551415797
pt0.7699386503067485
en0.6957403651115619
no0.6842105263157895
tr0.608355091383812
fr0.6052631578947368
it0.6021220159151194
sq0.589041095890411
ca0.5867768595041323
tl0.5844875346260388
et0.5384615384615384
nl0.5145631067961165
lv0.46619217081850534
hr0.402390438247012
sk0.3775933609958506
sl0.3697478991596639
ms0.358974358974359
lt0.34210526315789475
fi0.3333333333333333
pl0.3333333333333333
eu0.3212669683257918
cs0.3181818181818182
da0.3181818181818182
is0.3087557603686636
ro0.2890995260663507
reliabletrue
passestrue