Run: 2026-02-20-01KHY96XN52AE5YCPRASQDHMJH

Run Details

Model:
ByteDance Seed 1.6
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
53.7s
Cost:
$0.004039
Provider:
Seed

Evaluation summary

Score Evaluator
Details Link
60.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Selvi: [silent initially, responds after Hunter’s question] Hunter: "Excuse me, ma’am—did you happen to see anything unusual near the Oakridge Orchard two days ago? A local apple picker went missing there, and we’re following up with anyone who was taking photos in the area. I noticed your camera, so I figured I’d ask." Selvi: "Main us din baagh mein tasveer kheench rahi thi—ek kaala van aaya, koi aadmi ko forcefully andar le gaya! Main dar gayi thi, chup reh gayi, kisi se kuch nahi kaha!" Selvi: [frantically continuing] "Mera camera mein shayad us van ka nazara hai par main angrezi nahi bol sakti—tum samajh rahe ho na main kya keh rahi hoon?" Hunter: "I’m sorry, I don’t understand what you’re saying. Can you repeat that slower?" Selvi: [more urgently, voice cracking] "Kaala van! Aadmi ko le gaya! Tasveerien hai mera camera mein—dekho!" Hunter: "Wait, do you speak any English at all? I have no clue what you’re talking about." Selvi: [rambling, panicked] "Main dar rahi hoon—wo log phir aayein toh kya hoga? Main kisi se nahi keh saki pehle!" Hunter: "I realize I’m not getting through. I need to find a translator—can you stay put for a minute?" Hunter: [answering incoming call] "Hello? ... This is Detective Hunter. ... Precinct? ... Alright, I’m on my way immediately." Hunter: [to Selvi] "I have to leave—we just got a lead on another disappearance. Stay here if you can, I’ll send someone who speaks your language to find you as soon as I can." Translation notes for Selvi’s Hindi lines (for context, not part of the voice sheet): 1. "I was taking photos in the orchard that day—a black van came, someone was pulled in forcefully! I got scared, stayed quiet, didn’t tell anyone!" 2. "Maybe my camera has a glimpse of that van but I can’t speak English—do you understand what I’m saying?" 3. "Black van! Took the man! There are photos in my camera—look!" 4. "I’m scared—what if those people come back? I couldn’t tell anyone before!"
created_at"2026-02-20T19:42:44.914Z" 2/20/2026, 7:42:44 PM
model"bytedance-seed/seed-1.6-20250625"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency833
moderation_latency(null)
generation_time53569
tokens_prompt315
tokens_completion1947
native_tokens_prompt370
native_tokens_completion1973
native_tokens_completion_images(null)
native_tokens_reasoning1429
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0.0040385
router(null)
provider_responses
0
endpoint_id"d85c3862-4e0d-4f8d-955b-babc62f98124"
id"021771616565086276a11b7c1fd19a88cefa8362a9a9ca6e43341"
is_byokfalse
latency833
model_permaslug"bytedance-seed/seed-1.6-20250625"
provider_name"Seed"
status200
api_type"completions"
id"gen-1771616564-TVXmf3O7f5jgzUOP3vbV"
upstream_id"021771616565086276a11b7c1fd19a88cefa8362a9a9ca6e43341"
total_cost0.0040385
cache_discount(null)
upstream_inference_cost0
provider_name"Seed"

Evaluation details

Result Evaluator Details Meta Data
60.00% Parse dialogue n/a
dialogue
0
name"Hunter"
dialogue"Excuse me, ma’am—did you happen to see anything unusual near the Oakridge Orchard two days ago? A local apple picker went missing there, and we’re following up with anyone who was taking photos in the area. I noticed your camera, so I figured I’d ask."
detectedLang"en"
heavyLang"en"
scores
en0.7966263907165929
tl0.5863746958637469
nl0.46990957280947926
de0.45267224726336125
fr0.409312022237665
it0.409312022237665
no0.3724621631598376
es0.3651979088872293
sv0.3516399694889397
pt0.33774834437086093
yo0.3333333333333333
ro0.3191830196235483
ms0.31809065383072604
ca0.3136859103754542
sq0.30838079739625707
et0.30098684210526316
da0.28870292887029286
sl0.28421052631578947
sk0.25601750547045954
pl0.24645390070921988
cs0.20782851817334574
lv0.20745920745920746
hr0.177552007740687
is0.17515769044153323
lt0.1621488417939872
hu0.15716410510659395
fi0.14829659318637273
az0.14228052472250252
tr0.1205380237972064
vi0.12008281573498965
hi0.043331457512661785
be0.03954802259887005
eu0.03954802259887005
uk0.03573454339194555
reliabletrue
passestrue
1
name"Selvi"
dialogue"Main us din baagh mein tasveer kheench rahi thi—ek kaala van aaya, koi aadmi ko forcefully andar le gaya! Main dar gayi thi, chup reh gayi, kisi se kuch nahi kaha!"
detectedLang"tl"
heavyLang"nl"
scores
tl0.4410876132930514
es0.4138149556400507
ro0.40168175937904266
en0.3620689655172413
sl0.33881343817012155
ca0.3306801736613603
fr0.3306801736613603
pt0.325309992706054
nl0.2992424242424242
yo0.2801556420233463
eu0.2790335151987529
it0.27107959022852635
de0.24118129614438064
sv0.2094017094017094
hu0.1935483870967742
lt0.19284467713787085
sq0.18930762489044697
ms0.17704626334519571
da0.17336907953529937
vi0.14351851851851852
no0.13712686567164178
cs0.1281809613572102
hr0.12570888468809074
lv0.11736641221374046
tr0.10800385728061716
is0.10106899902818271
fi0.09931840311587146
et0.0975609756097561
reliablefalse
passesfalse
2
name"Selvi"
dialogue"Mera camera mein shayad us van ka nazara hai par main angrezi nahi bol sakti—tum samajh rahe ho na main kya keh rahi hoon?"
detectedLang"tl"
heavyLang"tl"
scores
tl0.4669509594882729
de0.3718592964824121
ca0.3644067796610169
sq0.3644067796610169
sk0.355116079105761
lv0.35121107266435986
nl0.3273542600896861
it0.3267504488330341
sv0.32432432432432434
fr0.29111531190926276
no0.2890995260663507
en0.27184466019417475
sl0.26398429833169773
da0.2625368731563422
ro0.2596248766041461
es0.258160237388724
cs0.25595238095238093
et0.24774322968906717
pl0.2401215805471125
pt0.22118380062305293
yo0.2163009404388715
eu0.18032786885245902
vi0.1730981256890849
hr0.16666666666666666
ms0.1601343784994401
hu0.14187643020594967
fi0.12177985948477751
is0.11971830985915494
lt0.09310761789600969
reliablefalse
passesfalse
3
name"Hunter"
dialogue"I’m sorry, I don’t understand what you’re saying. Can you repeat that slower?"
detectedLang"en"
heavyLang"en"
scores
en0.8121528912120222
tl0.6287927695287282
no0.4346116027531956
da0.4334975369458128
sv0.3777056277056277
ca0.343607305936073
cs0.31710213776722085
ro0.30303030303030304
tr0.3004866180048662
it0.2721518987341772
pl0.26187419768934533
de0.25130208333333337
nl0.23638778220451526
pt0.23435419440745675
sk0.21875
az0.1958041958041958
hr0.19467787114845939
is0.19241573033707865
sq0.18899858956276447
yo0.1314199395770393
es0.11674347158218126
be0.10852713178294573
hu0.1043613707165109
et0.0987460815047022
lt0.0987460815047022
lv0.0987460815047022
uk0.0987460815047022
vi0.0987460815047022
reliabletrue
passestrue
4
name"Selvi"
dialogue"Kaala van! Aadmi ko le gaya! Tasveerien hai mera camera mein—dekho!"
detectedLang"tl"
heavyLang"vi"
scores
tl0.48156682027649766
it0.4724501758499414
ca0.42084942084942084
fr0.412532637075718
es0.4039735099337748
de0.3877551020408163
sv0.37931034482758624
ro0.3767313019390581
nl0.36079545454545453
yo0.35988620199146515
sl0.35064935064935066
hu0.33035714285714285
eu0.3150684931506849
ms0.27652733118971057
vi0.25864909390444807
lv0.21465968586387435
et0.1818181818181818
no0.1758241758241758
lt0.17431192660550457
da0.16974169741697415
fi0.16356877323420074
en0.14448669201520914
reliablefalse
passesfalse
5
name"Hunter"
dialogue"Wait, do you speak any English at all? I have no clue what you’re talking about."
detectedLang"en"
heavyLang"en"
scores
en0.8258391386953767
tl0.5928941524796447
no0.5401337792642141
da0.492151431209603
hr0.439918533604888
ca0.4246861924686192
pt0.39890710382513656
sv0.39091915836101887
pl0.38478747203579416
sq0.3699885452462772
cs0.3648960739030023
sk0.34911242603550297
it0.3268053855569155
de0.289405684754522
lv0.260752688172043
vi0.2403314917127072
yo0.23076923076923078
ro0.22752808988764048
tr0.2231638418079096
et0.21540656205420827
es0.19941775836972345
is0.19590643274853803
sl0.1791044776119403
nl0.15644171779141106
ms0.11575562700964631
fr0.1143317230273752
be0.11290322580645161
hu0.1085899513776337
az0.10277324632952692
lt0.10277324632952692
uk0.10277324632952692
reliabletrue
passestrue
6
name"Selvi"
dialogue"Main dar rahi hoon—wo log phir aayein toh kya hoga? Main kisi se nahi keh saki pehle!"
detectedLang"yo"
heavyLang"de"
scores
yo0.3675099866844208
ro0.343015214384509
es0.31948424068767906
pt0.30858806404657935
de0.2994100294985251
fr0.2931547619047619
eu0.2578125
cs0.22258592471358432
hr0.21875
sl0.21746293245469525
lt0.2096505823627288
sq0.1908006814310051
ms0.1810344827586207
fi0.17677642980935876
en0.17247386759581881
it0.16958041958041958
ca0.16812609457092817
da0.16225749559082892
sv0.1532976827094474
no0.13636363636363635
reliablefalse
passesfalse
7
name"Hunter"
dialogue"I realize I’m not getting through. I need to find a translator—can you stay put for a minute?"
detectedLang"en"
heavyLang"en"
scores
en0.8224852071005918
tl0.6596710153148042
hr0.5965030262273033
da0.5786516853932584
no0.576271186440678
ro0.5352439969016266
it0.5334370139968896
cs0.5172968624296058
pl0.51338199513382
pt0.4919559695173582
ca0.48717948717948717
sl0.47368421052631576
sk0.47322212467076386
et0.46714031971580816
sq0.44751381215469616
de0.4470046082949309
sv0.43977591036414565
lt0.42418426103646834
nl0.4140625
ms0.3951612903225807
lv0.39086294416243655
tr0.37823834196891193
es0.3743482794577685
yo0.3637327677624602
az0.3562231759656652
fr0.3023255813953488
hu0.2709599027946537
vi0.269183922046285
is0.26199261992619927
eu0.18588873812754408
fi0.1836734693877551
be0.1044776119402985
uk0.09502262443438914
reliabletrue
passestrue
8
name"Hunter"
dialogue"Hello? ... This is Detective Hunter. ... Precinct? ... Alright, I’m on my way immediately."
detectedLang"en"
heavyLang"en"
scores
en0.7748629600626469
tl0.6187002652519895
it0.5168067226890757
ca0.4973776223776224
fr0.4763205828779599
ro0.4606003752345216
nl0.4412050534499514
de0.4295634920634921
es0.4289970208540219
sk0.40290758047767394
da0.37158469945355194
no0.36393805309734517
pt0.36323366555924697
cs0.36252771618625274
fi0.35825892857142855
hr0.35101580135440186
sv0.3458475540386803
sl0.33061699650756693
yo0.3187203791469194
et0.29187192118226607
pl0.23435419440745675
is0.22611036339165547
hu0.21124828532235942
sq0.20907840440165062
ms0.20138888888888887
hi0.1274658573596358
lv0.12213740458015267
tr0.09305993690851734
reliabletrue
passestrue
9
name"Hunter"
dialogue"I have to leave—we just got a lead on another disappearance. Stay here if you can, I’ll send someone who speaks your language to find you as soon as I can."
detectedLang"en"
heavyLang"en"
scores
en0.8234395877075779
tl0.5409429280397022
da0.46064139941690957
yo0.40476190476190477
et0.39304461942257213
cs0.38863185723727695
pl0.37415426251691475
ca0.3629476584022039
hr0.35719249478804727
no0.3392857142857143
fr0.3378668575518969
sk0.3359655419956928
sq0.3292240754169688
nl0.3277616279069767
ms0.312267657992565
pt0.3112434847356664
ro0.31021625652498136
sv0.30346385542168675
it0.29443173150266966
es0.28736517719568566
lt0.2522231204527081
hu0.24857839155158404
sl0.2285237698081735
lv0.21610169491525424
tr0.1949521322889469
is0.1935483870967742
de0.19001751313485116
fi0.18717047451669597
az0.18502202643171806
eu0.13793103448275862
vi0.12570888468809074
ja0.0975609756097561
hi0.08325074331020813
be0.07035175879396985
uk0.06376518218623482
reliabletrue
passestrue