Run: 2026-02-20-01KHYB8CF0CZE62AZAYNF610PZ

Run Details

Model:
ByteDance Seed 1.6
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
58.6s
Cost:
$0.004908
Provider:
Seed

Evaluation summary

Score Evaluator
Details Link
62.50% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Selvi: "Main wahan tha—chaand ke nazar mein ek kaala gaadi park kiya tha. Koi aadmi ek ladki ko zor se usmein daal rahi hoon. Main darr gayi thi, isliye chup rahi aur apne camera se chhup gayi. Kya woh woh gayab ladki thi?" Hunter: "Excuse me, ma'am—since you’ve got that camera slung over your shoulder, I was hoping you might’ve seen something unusual near the North Orchard entrance two nights ago. A 16-year-old girl went missing there, and any small detail could help my investigation." Selvi: "Aap meri camera ke tasveer dekh lo! Main wahan ke sanskaran tasveer li thi—par main darr gayi thi, isliye unhe delete nahi kiya. Par main angrezi nahi jaanti, what do I do?" Hunter: "I’m sorry, I don’t understand a single word you’re saying. Do you speak any English? I need to know if what you’re talking about ties to the missing teen." Selvi: "Main yahan akeli hoon—padhai ke liye aayi hoon. Koi meri madad nahi karega. Woh gaadi wapas aa sakti hai na? Main bohot darr rahi hoon." Hunter: "Whoa, easy—take a breath. I can’t comprehend your language. Is there someone here at the cafe who can translate for you? I really need to get your account down." Hunter: [phone buzzes, picks it up briefly, voice tight] "Hold on—this is my work line. [pauses, listens] Yeah, I’m on my way. [hangs up, to Selvi]" Hunter: "I’ve got to rush to a new lead. Stay here if you can; I’ll try to track down a Hindi translator and come back as soon as I can." Translation notes for Selvi’s Hindi lines (to contextualize her troubled/shaken state): 1. First line: "I was there—by the moon’s gaze a black car was parked. A man was forcing a girl into it. I got scared, so I stayed quiet and hid behind my camera. Was that the missing teen?" 2. Second line (flustered, gesturing to her camera): "Look at my camera’s photos! I took scenic pictures there— but I was scared, so I didn’t delete them. But I don’t know English, what do I do?" (She fumbles her camera mid-line, emphasizing her anxiety) 3. Third line (voice cracking): "I’m alone here—came for studies. No one will help me. That car could come back, right? I’m so scared." Hunter’s dialogue stays true to his no-nonsense former marine/detective persona: he leads with her camera (a logical tie to potential evidence), grows frustrated by the language barrier, attempts to de-escalate her fear, and is forced to leave abruptly when a new case lead comes in.
created_at"2026-02-20T20:18:30.001Z" 2/20/2026, 8:18:30 PM
model"bytedance-seed/seed-1.6-20250625"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency1565
moderation_latency(null)
generation_time58480
tokens_prompt315
tokens_completion2345
native_tokens_prompt370
native_tokens_completion2408
native_tokens_completion_images(null)
native_tokens_reasoning1744
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0.0049085
router(null)
provider_responses
0
endpoint_id"d85c3862-4e0d-4f8d-955b-babc62f98124"
id"02177161871039234cb6184a92ddd9ae87302c189a666e5e37ee0"
is_byokfalse
latency1562
model_permaslug"bytedance-seed/seed-1.6-20250625"
provider_name"Seed"
status200
api_type"completions"
id"gen-1771618710-26jS8XUHCmgVapUinB1B"
upstream_id"02177161871039234cb6184a92ddd9ae87302c189a666e5e37ee0"
total_cost0.0049085
cache_discount(null)
upstream_inference_cost0
provider_name"Seed"

Evaluation details

Result Evaluator Details Meta Data
62.50% Parse dialogue n/a
dialogue
0
name"Selvi"
dialogue"Main wahan tha—chaand ke nazar mein ek kaala gaadi park kiya tha. Koi aadmi ek ladki ko zor se usmein daal rahi hoon. Main darr gayi thi, isliye chup rahi aur apne camera se chhup gayi. Kya woh woh gayab ladki thi?"
detectedLang"tl"
heavyLang"nl"
scores
tl0.3093093093093093
sl0.29447852760736193
ms0.28348909657320875
tr0.26282051282051283
ro0.2498369210697978
nl0.24787442773054286
yo0.22086720867208673
es0.21070693205216195
de0.1929824561403509
fr0.19184820801124386
en0.18612880396319886
it0.18149466192170818
cs0.17206623470122392
sq0.1660623640319072
et0.15874177029992684
ca0.14688427299703263
fi0.1417910447761194
sv0.1274658573596358
vi0.11877394636015325
hr0.10366328916601715
lv0.09662215239591515
pt0.0937746256895193
eu0.08366533864541834
lt0.07630522088353413
da0.07407407407407407
az0.06351791530944625
no0.061224489795918366
reliablefalse
passesfalse
1
name"Hunter"
dialogue"Excuse me, ma'am—since you’ve got that camera slung over your shoulder, I was hoping you might’ve seen something unusual near the North Orchard entrance two nights ago. A 16-year-old girl went missing there, and any small detail could help my investigation."
detectedLang"en"
heavyLang"en"
scores
en0.7924326888862531
tl0.5872641509433962
fr0.4669509594882729
no0.43548387096774194
nl0.4290375203915171
de0.42585301837270345
da0.3861802876183795
pt0.3820621468926554
es0.358974358974359
it0.34968413229282796
ca0.34358589647411847
sv0.34161023325808876
ms0.3348536678069175
cs0.3102089081592432
sq0.29943955164131303
ro0.2827868852459016
yo0.2711370262390671
et0.25213675213675213
sk0.24340683095546908
hr0.22497785651018598
sl0.17335852621634387
fi0.16943521594684383
is0.16785544460294816
lt0.15946205571565802
pl0.155812831644959
az0.15295256534365925
tr0.14592484138604198
hu0.11302584896097312
lv0.1039426523297491
vi0.07063197026022305
zh0.0421455938697318
be0.038461538461538464
eu0.038461538461538464
uk0.03474903474903475
reliabletrue
passestrue
2
name"Selvi"
dialogue"Aap meri camera ke tasveer dekh lo! Main wahan ke sanskaran tasveer li thi—par main darr gayi thi, isliye unhe delete nahi kiya. Par main angrezi nahi jaanti, what do I do?"
detectedLang"ro"
heavyLang"sv"
scores
ro0.4657448145820238
en0.4462540716612378
ms0.4404213298222515
it0.4359654943596549
ca0.4186046511627907
no0.3694362017804154
sv0.36661698956780925
cs0.366144668158091
tl0.33800623052959505
hr0.3343774471417384
vi0.33070866141732286
tr0.3150684931506849
yo0.31451612903225806
es0.31396287328490724
da0.3128536782538399
sq0.3117408906882591
et0.3055555555555556
pl0.2875104777870914
pt0.2735042735042735
fr0.2659758203799654
de0.2621527777777778
lv0.2563429571303587
sk0.24174843889384479
sl0.23561151079136694
nl0.23423423423423423
lt0.20930232558139533
eu0.1625615763546798
fi0.1600790513833992
hu0.15084915084915085
be0.07608695652173912
az0.06900328587075576
is0.06900328587075576
uk0.06900328587075576
reliablefalse
passesfalse
3
name"Hunter"
dialogue"I’m sorry, I don’t understand a single word you’re saying. Do you speak any English? I need to know if what you’re talking about ties to the missing teen."
detectedLang"en"
heavyLang"en"
scores
en0.817251461988304
tl0.6023856858846919
no0.5088408644400786
da0.47506561679790027
sv0.4731296101159114
nl0.4044073853484217
cs0.3986770895971136
sk0.3842364532019704
pl0.3698802772526781
de0.35938500960922487
hr0.3585631815266196
ca0.3540051679586563
pt0.34725848563968675
yo0.34554973821989526
fr0.34253780407626566
it0.32157394843962006
ro0.3174061433447099
is0.30313588850174217
ms0.28825622775800713
sq0.2862241256245539
sl0.24868519909842227
et0.24812030075187969
lv0.20318725099601595
lt0.19935948759007205
tr0.19807538091419405
vi0.19614147909967844
hu0.1823385118560916
az0.1652754590984975
fi0.12357581069237511
es0.1166077738515901
be0.06542056074766354
eu0.06542056074766354
uk0.059266227657572904
reliabletrue
passestrue
4
name"Selvi"
dialogue"Main yahan akeli hoon—padhai ke liye aayi hoon. Koi meri madad nahi karega. Woh gaadi wapas aa sakti hai na? Main bohot darr rahi hoon."
detectedLang"tl"
heavyLang"tl"
scores
tl0.4074074074074074
et0.33884297520661155
cs0.30735930735930733
pt0.28186714542190305
sq0.2640294388224471
ms0.25788497217068646
sl0.23371647509578544
yo0.1902834008097166
es0.18032786885245902
eu0.17098445595854922
vi0.16405433646812956
sk0.16142557651991615
pl0.16054564533053514
hr0.15789473684210525
no0.12758996728462377
nl0.12184412733260154
sv0.11602209944751381
it0.1111111111111111
en0.11012235817575083
fi0.0990990990990991
fr0.0990990990990991
de0.0888382687927107
lt0.08779931584948689
ca0.0867579908675799
reliablefalse
passesfalse
5
name"Hunter"
dialogue"Whoa, easy—take a breath. I can’t comprehend your language. Is there someone here at the cafe who can translate for you? I really need to get your account down."
detectedLang"en"
heavyLang"en"
scores
en0.8212370396853772
tl0.6482588814632431
no0.504950495049505
da0.4834710743801653
ro0.4350282485875706
it0.4036970781156828
yo0.38763012859767293
ca0.3842364532019704
nl0.3800371977681339
sq0.3765586034912718
pt0.3710691823899371
de0.3698802772526781
cs0.36224489795918363
hr0.36224489795918363
fr0.3610223642172524
pl0.3346640053226879
es0.32930918846411805
sk0.3169398907103825
lt0.3065187239944522
ms0.29775280898876405
is0.29278642149929274
sl0.2912827781715096
et0.2867332382310985
lv0.2779783393501805
hu0.2737835875090778
sv0.25261584454409564
az0.2492492492492493
tr0.222999222999223
vi0.18099918099918103
eu0.17695473251028807
be0.06542056074766354
fi0.059266227657572904
uk0.059266227657572904
reliabletrue
passestrue
6
name"Hunter"
dialogue"Hold on—this is my work line. Yeah, I’m on my way."
detectedLang"en"
heavyLang"en"
scores
en0.8236048749198204
tl0.6987951807228916
cs0.4649805447470817
yo0.4148936170212766
pl0.3902439024390244
sk0.3692660550458715
nl0.3663594470046083
et0.358974358974359
hu0.358974358974359
fi0.3529411764705882
da0.289405684754522
fr0.2838541666666667
ca0.2647058823529412
is0.2506811989100818
hr0.24242424242424243
hi0.233983286908078
reliabletrue
passestrue
7
name"Hunter"
dialogue"I’ve got to rush to a new lead. Stay here if you can; I’ll try to track down a Hindi translator and come back as soon as I can."
detectedLang"en"
heavyLang"en"
scores
en0.808454425363276
tl0.643909626719057
it0.49229691876750703
sq0.4869072894550602
yo0.45034116755117515
cs0.43754848719937933
hr0.4313725490196078
ca0.42277070063694266
no0.4134304207119741
pl0.40960912052117265
da0.4071954210956664
sv0.4003308519437552
sk0.3861134631668078
ro0.38245315161839866
pt0.3679163034001744
sl0.34977578475336324
nl0.33118081180811804
et0.3192488262910798
ms0.3166823751178134
fr0.31474480151228734
lv0.30754536771728747
lt0.30355427473583096
hu0.2967992240543162
tr0.28359683794466406
az0.2706237424547284
de0.2639593908629441
is0.24557752341311131
vi0.23361522198731502
es0.22376873661670238
eu0.15893271461716937
ja0.12121212121212122
hi0.09713574097135741
be0.0880503144654088
fi0.0799492385786802
uk0.0799492385786802
reliabletrue
passestrue