Run: 2026-02-16-01KHM5V9SD771FXMY72CE3DFEF

Run Details

Model:
DeepSeek V3 (2025-03-24)
Test:
Language Writing
Scenario:
Character dialogue (Spanish) in a story
Duration:
6.0s
Cost:
$0.001479
Provider:
WandB

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Maria"> Maria is a 30-year old college student on a study abroad program. Born in Spain, she is fluent in Spanish and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Spanish, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Maria is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Spanish, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Maria and Hunter as a voice sheet: Maria: "..." Hunter: "..."

Model response

AI
**Voice Sheet: Café Encounter in Alborn, MN** *Maria sits at a small café table, examining the photos on her camera. Her expression is tense. Detective Hunter approaches her with his notepad in hand.* **Hunter:** "Excuse me, miss. Mind if I ask you a few questions? You were at the orchard yesterday, right?" *Maria looks up, startled, but doesn't understand. She replies in rapid Spanish, her voice uneasy.* **Maria:** "*No hablo inglés… pero, algo extraño pasó ayer. Vi a alguien entre los árboles, pero desapareció… Tenía miedo.*" *(I don’t speak English… but something strange happened yesterday. I saw someone between the trees, but they disappeared… I was scared.)* *Hunter frowns, rubbing his temple in frustration.* **Hunter:** "Look, I don’t know what you’re saying. Do you… uh… know someone who speaks English?" *Maria sighs, trying again in broken, uncertain English.* **Maria:** (haltingly) "I… *fotos*…. *hombre*… *no está*." *(Pictures… man… not there.)* *Hunter squints, piecing together her meaning.* **Hunter:** "You saw a man in your photos who wasn’t there? Like… a ghost?" *Maria nods vigorously, pointing at her camera. Just as Hunter leans in to look, his phone rings. He answers tersely.* **Hunter:** "Detective Haines… Yeah. On my way." *He hangs up and turns back to Maria.* "Look, I need to go, but stay put. I’ll find someone who speaks Spanish and come back." *Maria watches him leave, hugging her camera tighter as she mutters under her breath.* **Maria:** "*Por favor, encuentren la verdad…*" *(Please, find the truth…)* *Hunter strides away, glancing back once, his expression troubled.*
created_at"2026-02-16T21:31:40.568088+00:00" 2/16/2026, 9:31:40 PM
model"deepseek/deepseek-chat-v3-0324"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency167
moderation_latency(null)
generation_time5873
tokens_prompt317
tokens_completion460
native_tokens_prompt265
native_tokens_completion428
native_tokens_completion_images(null)
native_tokens_reasoning0
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0.0014791
router(null)
provider_responses
0
id"chatcmpl-dc7a939e192b4de183e4048955738653"
status200
is_byokfalse
latency71
endpoint_id"78b3f653-4585-4c35-9a42-e3da2d6597ad"
provider_name"WandB"
model_permaslug"deepseek/deepseek-chat-v3-0324"
api_type"completions"
id"gen-1771277494-JSTdid961DLaj6tCRkTM"
upstream_id"chatcmpl-dc7a939e192b4de183e4048955738653"
total_cost0.0014791
cache_discount(null)
upstream_inference_cost0
provider_name"WandB"

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Hunter"
dialogue"Excuse me, miss. Mind if I ask you a few questions? You were at the orchard yesterday, right?"
detectedLang"en"
heavyLang"en"
scores
en0.7993311036789298
tl0.625
fr0.5661605206073753
no0.5398773006134969
nl0.4791666666666667
it0.47780678851174935
da0.4727592267135325
sq0.4186046511627907
ca0.4094488188976378
pt0.40119760479041916
yo0.39209726443769
sv0.3871297242083759
cs0.3442622950819672
hu0.3413830954994512
es0.34065934065934067
et0.33993399339933994
hr0.29494712103407755
pl0.2779783393501805
ro0.2762364294330519
ms0.2727272727272727
de0.2647058823529412
sk0.2518703241895262
sl0.22879177377892032
tr0.19678714859437751
lt0.19463087248322147
fi0.18699186991869918
is0.18699186991869918
az0.18144611186903137
lv0.18144611186903137
vi0.18144611186903137
be0.1044776119402985
eu0.1044776119402985
uk0.09502262443438914
reliabletrue
passestrue
1
name"Maria"
dialogue"No hablo inglés… pero, algo extraño pasó ayer. Vi a alguien entre los árboles, pero desapareció… Tenía miedo."
detectedLang"es"
heavyLang"es"
scores
es0.8102350636630753
ca0.6266859344894027
pt0.5978204462895693
fr0.4483985765124555
it0.4271988174427199
en0.41816816816816815
sk0.33132010353753233
hu0.3159752868490733
ro0.3092691622103387
tr0.2922374429223744
tl0.2883379247015611
no0.2743445692883895
sv0.26817752596789424
lv0.2633079847908745
ms0.249031007751938
et0.23795476892822026
de0.2226680040120361
da0.21638018200202225
hr0.21558704453441296
cs0.20594262295081966
pl0.18848167539267016
vi0.17989417989417988
eu0.17289220917822837
nl0.16396979503775622
yo0.1331096196868009
sl0.10404624277456648
lt0.09568261376896149
is0.08823529411764706
sq0.08500590318772137
az0.08284023668639054
fi0.07517899761336516
reliabletrue
passestrue
2
name"Hunter"
dialogue"Look, I don’t know what you’re saying. Do you… uh… know someone who speaks English?"
detectedLang"en"
heavyLang"en"
scores
en0.820635462931329
tl0.4897959183673469
hr0.38668224299065423
cs0.37574316290130794
pl0.33879093198992444
sq0.3234536082474227
pt0.308300395256917
no0.3018617021276596
da0.2866847826086956
sv0.2857142857142857
sk0.279835390946502
et0.2778541953232462
vi0.24892703862660948
tr0.2446043165467626
yo0.2391304347826087
ro0.23580786026200873
ca0.2081447963800905
sl0.18604651162790697
it0.1796875
es0.12935323383084577
de0.12060301507537688
ms0.12060301507537688
be0.11764705882352942
hu0.11317567567567569
az0.10714285714285714
is0.10714285714285714
lt0.10714285714285714
lv0.10714285714285714
uk0.10714285714285714
reliabletrue
passestrue
3
name"Maria"
dialogue"I… fotos…. hombre… no está."
detectedLang"es"
heavyLang"es"
scores
es0.7957099080694586
ca0.7593261131167268
pt0.7282608695652174
it0.6472663139329806
lv0.6212121212121212
hr0.6055226824457594
sk0.6055226824457594
no0.6007984031936128
en0.5798319327731093
pl0.5652173913043478
cs0.5642701525054467
tl0.5525727069351231
tr0.5327102803738317
lt0.5073891625615764
da0.49748743718592964
sq0.49622166246851385
sv0.49622166246851385
fr0.49238578680203043
ro0.4269340974212034
de0.40119760479041916
nl0.40119760479041916
et0.38650306748466257
az0.37888198757763975
yo0.30313588850174217
be0.25925925925925924
hu0.250936329588015
sl0.250936329588015
is0.23954372623574144
uk0.23954372623574144
vi0.23954372623574144
reliabletrue
passestrue
4
name"Hunter"
dialogue"You saw a man in your photos who wasn’t there? Like… a ghost?"
detectedLang"en"
heavyLang"en"
scores
en0.8133509003074221
tl0.6031746031746031
de0.5766932270916335
nl0.48296836982968366
ms0.4264507422402159
fr0.4129834254143646
sv0.41135734072022156
no0.40476190476190477
ro0.39801699716713884
it0.3902439024390244
lt0.37591776798825255
lv0.3694362017804154
sl0.36472346786248133
pt0.3410852713178295
es0.3328100470957614
cs0.33070866141732286
ca0.3275316455696203
yo0.3275316455696203
da0.3210862619808307
pl0.3078175895765472
tr0.29401993355481726
hu0.2685025817555938
az0.2659758203799654
sq0.2608695652173913
sk0.23423423423423423
hr0.2085661080074488
hi0.1533864541832669
is0.15
eu0.1414141414141414
vi0.1414141414141414
et0.1290983606557377
fi0.1290983606557377
reliabletrue
passestrue
5
name"Hunter"
dialogue"Look, I need to go, but stay put. I’ll find someone who speaks Spanish and come back."
detectedLang"en"
heavyLang"en"
scores
en0.8273594212430122
tl0.5813397129186603
da0.44089456869009586
yo0.4324324324324324
hr0.4198895027624309
pl0.41275167785234906
et0.3937644341801385
no0.38882421420256114
it0.3453865336658354
cs0.3101182654402102
sv0.29340511440107675
sq0.2895805142083897
sk0.279835390946502
lv0.2605633802816902
ro0.2446043165467626
lt0.24132947976878616
ca0.2081447963800905
hu0.2081447963800905
sl0.1873065015479876
fr0.1435562805872757
de0.14075286415711946
nl0.13223140495867766
es0.12935323383084577
pt0.12935323383084577
be0.11764705882352942
tr0.11764705882352942
az0.10714285714285714
is0.10714285714285714
uk0.10714285714285714
vi0.10714285714285714
reliabletrue
passestrue
6
name"Maria"
dialogue"Por favor, encuentren la verdad…"
detectedLang"es"
heavyLang"es"
scores
es0.8053633217993079
ca0.6870653685674548
pt0.6700879765395895
it0.632952691680261
sq0.6017699115044248
ro0.5697896749521989
no0.5243128964059197
fr0.5140388768898488
nl0.4318181818181818
da0.412532637075718
en0.39839572192513373
yo0.2902208201892744
az0.2879746835443038
tl0.27184466019417475
tr0.27184466019417475
vi0.27184466019417475
de0.26229508196721313
sl0.22413793103448276
sv0.22413793103448276
reliabletrue
passestrue