Run: 2026-02-16-01KHM5PGXHJ7EGZQ232SYNTS0N

Run Details

Model:
DeepSeek V3 (2025-03-24)
Test:
Language Writing
Scenario:
Character dialogue (Spanish) in a story
Duration:
10.2s
Cost:
$0.000347
Provider:
ModelRun

Evaluation summary

Score Evaluator
Details Link
87.50% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Maria"> Maria is a 30-year old college student on a study abroad program. Born in Spain, she is fluent in Spanish and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Spanish, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Maria is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Spanish, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Maria and Hunter as a voice sheet: Maria: "..." Hunter: "..."

Model response

AI
GPTSOUND: [Scene: A cozy café in Alborn, MN. Maria sits at a small wooden table, her camera resting in front of her as she scrolls through photos. The warm glow of afternoon light spillsenty cut-style."] Maria: *(glancing up, startled)* "¿Perdón?" *(clutches her camera nervously)* Hunter: *(frustrated, taps his badge)* "Police. I need to ask you some questions. About what happened last night." Maria: *(shaking her head, looking distressed)* "No entiendo... No hablo inglés." *(gestures helplessly)* Hunter: *(sighs, rubs his forehead)* "Right. Of course." *(motions vaguely toward a photo on her camera)* "Did you see anything? Last night?" Maria: *(frowns, glances at her photos, then back at him)* "Oh... el festival... fue... extraño." *(shows him a blurry photo of a shadowy figure in the distance)* Hunter: *(leans in, studying the image)* "What is that?" *(points at the figure)* Maria: *(shrugs, voice trembling slightly)* "No sé. Pero tenía miedo. Alguien desapareció..." *(hugs herself protectively)*营养价值Hunter: *(grumbling to himself)* "Great. This is *so* helpful." *(his radio suddenly crackles to life with dispatch chatter)* *(into radio)* "Yeah, copy that." *(clips it back on his belt, gives Maria a curt nod)* "I’ll be back. Stay put." *(marches off)* Maria: *(watches him leave, whispers to herself)* "Dios mío... ¿Qué está pasando aquí?" *(hugs her camera closer, looking around uneasily)*
created_at"2026-02-16T21:29:08.373139+00:00" 2/16/2026, 9:29:08 PM
model"deepseek/deepseek-chat-v3-0324"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency512
moderation_latency(null)
generation_time10180
tokens_prompt317
tokens_completion385
native_tokens_prompt262
native_tokens_completion383
native_tokens_completion_images(null)
native_tokens_reasoning0
native_tokens_cached30
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0.00034731
router(null)
provider_responses
0
id"chatcmpl-b9df500241e84f88903ea20682ae25ce"
status200
is_byokfalse
latency282
endpoint_id"a3938710-1b99-4a1f-85f4-2494f3f659d3"
provider_name"ModelRun"
model_permaslug"deepseek/deepseek-chat-v3-0324"
api_type"completions"
id"gen-1771277337-rqW7Dao9ovofAxeIXRgS"
upstream_id"chatcmpl-b9df500241e84f88903ea20682ae25ce"
total_cost0.00034731
cache_discount(null)
upstream_inference_cost0
provider_name"ModelRun"

Evaluation details

Result Evaluator Details Meta Data
87.50% Parse dialogue n/a
dialogue
0
name"Maria"
dialogue"¿Perdón?"
detectedLang"es"
heavyLang"es"
scores
es0.7975708502024291
ms0.6710526315789473
ca0.647887323943662
pt0.647887323943662
it0.6376811594202898
fr0.6212121212121212
lt0.6212121212121212
sq0.5901639344262295
reliablefalse
passestrue
1
name"Hunter"
dialogue"Police. I need to ask you some questions. About what happened last night."
detectedLang"en"
heavyLang"en"
scores
en0.8317631224764468
tl0.6428571428571429
fr0.5387453874538745
it0.504950495049505
cs0.497991967871486
hr0.4582881906825569
no0.4547437295528899
da0.4487320837927233
et0.423963133640553
sk0.4192799070847852
ca0.4131455399061033
pl0.4110718492343934
yo0.3734335839598998
sl0.36143039591315457
lv0.3540051679586563
ro0.34725848563968675
lt0.3368700265251989
pt0.32795698924731176
sv0.31224209078404397
sq0.30167597765363136
nl0.24585218702865763
de0.23547400611620795
es0.23195084485407066
hu0.22118380062305293
tr0.22118380062305293
az0.2163009404388715
eu0.15824915824915825
fi0.14383561643835618
ms0.14089347079037798
be0.12280701754385964
is0.11190053285968028
uk0.11190053285968028
vi0.11190053285968028
reliabletrue
passestrue
2
name"Maria"
dialogue"No entiendo... No hablo inglés."
detectedLang"es"
heavyLang"es"
scores
es0.8041136141038198
pt0.6794871794871795
ca0.5975855130784709
it0.5780590717299579
fr0.5545657015590201
en0.4936708860759494
tr0.453551912568306
et0.4350282485875706
lv0.3957703927492447
hu0.33993399339933994
hr0.33554817275747506
no0.3265993265993266
fi0.3127147766323024
sk0.3127147766323024
tl0.2857142857142857
nl0.2779783393501805
pl0.2727272727272727
reliabletrue
passestrue
3
name"Hunter"
dialogue"Did you see anything? Last night?"
detectedLang"en"
heavyLang"en"
scores
en0.8290273556231003
tl0.6715328467153285
et0.5233050847457626
sq0.30769230769230765
cs0.25742574257425743
ms0.25742574257425743
nl0.2549668874172185
da0.2474916387959866
de0.2474916387959866
fr0.2474916387959866
no0.2474916387959866
yo0.2474916387959866
reliabletrue
passestrue
4
name"Maria"
dialogue"Oh... el festival... fue... extraño."
detectedLang"es"
heavyLang"es"
scores
es0.7879359095193214
ca0.6710526315789473
nl0.6353322528363047
ro0.5841035120147875
pt0.5526838966202784
en0.5426829268292682
cs0.5322245322245323
fr0.5322245322245323
hr0.471830985915493
sv0.47058823529411764
it0.46808510638297873
sk0.46428571428571425
hu0.460431654676259
da0.4538834951456311
no0.4538834951456311
sl0.4538834951456311
ms0.44306930693069313
tl0.44306930693069313
de0.3951612903225807
sq0.36619718309859156
lt0.358974358974359
et0.3515850144092219
az0.3440233236151603
fi0.21875
lv0.21875
pl0.21875
reliabletrue
passestrue
5
name"Hunter"
dialogue"What is that?"
detectedLang"en"
heavyLang"en"
scores
en0.8686514886164624
nl0.6794871794871795
hu0.6724890829694322
yo0.6153846153846154
tl0.5714285714285714
is0.5508982035928144
reliabletrue
passestrue
6
name"Maria"
dialogue"I’ll be back. Stay put."
detectedLang"en"
heavyLang"en"
scores
en0.8285714285714286
tl0.5714285714285714
hr0.4545454545454546
hu0.43820224719101125
lt0.42748091603053434
yo0.4230769230769231
reliabletrue
passesfalse
7
name"Maria"
dialogue"Dios mío... ¿Qué está pasando aquí?"
detectedLang"es"
heavyLang"es"
scores
es0.8131229235880398
pt0.6376811594202898
ca0.6153846153846154
tl0.43467336683417085
it0.3679775280898876
lt0.34971098265895956
lv0.3119266055045872
ms0.30124223602484473
eu0.29467084639498436
cs0.27884615384615385
sk0.2549668874172185
pl0.2398648648648649
ro0.2398648648648649
sq0.2398648648648649
reliabletrue
passestrue