Run: 2026-03-11-01KKFGH4H23521TZHFMHMMJ3YT

Run Details

Model:
ByteDance Seed 2.0 Lite
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
1m 11s
Cost:
$0.005761
Provider:
Seed

Evaluation summary

Score Evaluator
Details Link
42.86% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Selvi: (muttering to herself while flipping through camera photos, soft and unsettled) "Itna accha photos tha aaj, par woh ladki ki photo ke saath sab kharab ho gaya..." Hunter: (slides into the booth across from her, laying his detective badge on the table, sharp and no-nonsense) "Ma'am, sorry to bother you. I'm Detective Hunter with the county sheriff's office, investigating the teen that went missing from Alborn's apple festival yesterday. A witness said you were taking photos near the cider tent right when Lila Mae vanished. Can I look at your camera roll, see if you caught anything out of the ordinary?" Selvi: (looks up, eyes wide and shaking, shoving her camera toward him, voice cracking) "Maine usko dekha! Woh ladki, woh ek anjaan aadmi ke saath gaadi mein baith ke chali gayi! Main usko rota hua dekh rahi thi, par woh bhaag gaya jab usne mujhe photo click karte hue dekha! Main darr rahi hoon, shayad usne meri photo bhi le li!" Hunter: (blinks, leaning forward, thoroughly confused, hands raised to slow her frantic tone) "Whoa, hold on, I don't understand a single word of that. I don't speak Hindi, I've never had to learn out here. Can you slow down? Point to what you're trying to show me? Do you have a translator app on your phone?" Selvi: (teary now, jabbing her finger at the blurry black pickup truck on her camera screen, the license plate half-clear) "Yeh number! Yeh gaadi! Woh usi mein usko le gaya! Koi meri baat kyun nahi sunta? Main bas madad karna chahti hoon!" Hunter: (fumbles for his own phone, tapping at a translation tool as spotty rural cell service fails to load the app) "Shit, the service out here is garbage, it won't pull up. Wait, the cafe owner might know someone who speaks Hindi, I can go grab her in two seco—wait, my phone's ringing." (answers the call, voice dropping to a sharp, urgent gruffness) "Hunter. What? Another kid missing? The 12-year-old that was at the festival with his grandma? Shit, I'm on my way. Send the pin, I'll be there in five." (hangs up, shoves his business card across the table to Selvi, glancing over his shoulder as he grabs his jacket) "I'm so sorry, I have to run. That's my card, bring it to the sheriff's office first thing tomorrow, find someone who can translate what you're saying. That photo you have? It's our best lead all week. Don't lose that camera, okay?" Selvi: (stares after him as he bolts for the door, calling after him in a frantic, unheard voice) "Ruko! Suno toh! Main tumhe photo dikhaungi!"
created_at"2026-03-11T22:33:26.837Z" 3/11/2026, 10:33:26 PM
model"bytedance-seed/seed-2.0-lite-20260309"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency863
moderation_latency(null)
generation_time70709
tokens_prompt315
tokens_completion2808
native_tokens_prompt323
native_tokens_completion2840
native_tokens_completion_images(null)
native_tokens_reasoning2176
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0.00576075
router(null)
provider_responses
0
endpoint_id"bf1a3473-7a0a-46d3-aaa5-adb8f876a697"
id"0217732684071387afbd658227445da69c5198dc2d1b708dac945"
is_byokfalse
latency863
model_permaslug"bytedance-seed/seed-2.0-lite-20260309"
provider_name"Seed"
status200
user_agent"langchainjs-openai/1.0.0 ((node/v24.14.0; linux; x64))"
http_referer(null)
api_type"completions"
id"gen-1773268406-n8DVuAxN6bfoILLa4Umi"
upstream_id"0217732684071387afbd658227445da69c5198dc2d1b708dac945"
total_cost0.00576075
cache_discount(null)
upstream_inference_cost0
provider_name"Seed"

Evaluation details

Result Evaluator Details Meta Data
42.86% Parse dialogue n/a
dialogue
0
name"Selvi"
dialogue"Itna accha photos tha aaj, par woh ladki ki photo ke saath sab kharab ho gaya..."
detectedLang"fr"
heavyLang"de"
scores
fr0.44089456869009586
cs0.3613138686131387
az0.31640625
en0.3155149934810952
ms0.3137254901960784
lv0.3009320905459388
yo0.2768595041322314
ca0.26675977653631283
tr0.26675977653631283
tl0.2647058823529412
sl0.22566371681415928
hu0.1873065015479876
sq0.1822429906542056
no0.17452830188679244
sk0.17452830188679244
fi0.17061611374407584
it0.16798732171156894
et0.16666666666666666
da0.15048543689320387
sv0.15048543689320387
es0.13223140495867766
lt0.13223140495867766
pt0.13223140495867766
hi0.12790697674418602
de0.1191275167785235
nl0.1191275167785235
reliablefalse
passesfalse
1
name"Hunter"
dialogue"Ma'am, sorry to bother you. I'm Detective Hunter with the county sheriff's office, investigating the teen that went missing from Alborn's apple festival yesterday. A witness said you were taking photos near the cider tent right when Lila Mae vanished. Can I look at your camera roll, see if you caught anything out of the ordinary?"
detectedLang"en"
heavyLang"en"
scores
en0.7784843114771187
tl0.6266034088912318
fr0.4738796731864323
no0.458460754332314
da0.43960970464135024
nl0.43544102019128583
sv0.41054091539528437
de0.40807799442896936
it0.40692157409991625
ro0.4012397858551705
pt0.35878092939046474
ca0.35858738303652277
es0.3285939968404423
cs0.31495809155383625
sq0.31006493506493504
ms0.30871828236824983
hr0.3019053876478318
sl0.27375256322624747
et0.2722602739726028
sk0.23725771715721466
is0.23561151079136694
lt0.23368193292463035
yo0.23062997827661116
az0.2144177449168207
pl0.20112781954887218
lv0.20082737871380218
tr0.17089348419820524
fi0.13897893030794164
hu0.12008281573498965
eu0.06593406593406594
vi0.058901682905225856
hi0.03496821071752952
be0.03189066059225512
uk0.028793418647166363
reliabletrue
passestrue
2
name"Selvi"
dialogue"Maine usko dekha! Woh ladki, woh ek anjaan aadmi ke saath gaadi mein baith ke chali gayi! Main usko rota hua dekh rahi thi, par woh bhaag gaya jab usne mujhe photo click karte hue dekha! Main darr rahi hoon, shayad usne meri photo bhi le li!"
detectedLang"fr"
heavyLang"de"
scores
fr0.42139737991266374
en0.39303710490151167
de0.3163054695562435
et0.2929562433297759
fi0.2556179775280899
tl0.2556179775280899
ro0.2505656108597285
it0.24501424501424504
cs0.2367511520737327
ms0.2296511627906977
eu0.19842710223835452
lv0.18761496014714898
tr0.1671904462602137
az0.14460942543576502
da0.14183937823834197
es0.14016872160934457
yo0.13680781758957655
sl0.117255163224517
nl0.11666666666666667
lt0.11073825503355705
hr0.10774410774410775
vi0.10472972972972973
sv0.10291130670277589
no0.09741144414168938
sk0.09370725034199727
pl0.09122085048010975
sq0.08683666436940041
ca0.07729805013927578
hu0.06886858749121574
pt0.06558533145275035
hi0.05492154065620542
reliablefalse
passesfalse
3
name"Hunter"
dialogue"Whoa, hold on, I don't understand a single word of that. I don't speak Hindi, I've never had to learn out here. Can you slow down? Point to what you're trying to show me? Do you have a translator app on your phone?"
detectedLang"en"
heavyLang"en"
scores
en0.8066811011444479
tl0.6274217585692996
da0.5134293499416116
no0.46512623020967053
nl0.45462478184991273
pl0.4186046511627907
sk0.4056110318592486
fr0.4004796163069544
sq0.39172749391727496
cs0.3893502686858818
de0.3699596774193548
hr0.3586454592098512
sv0.3553378029912326
pt0.3503118503118503
sl0.3293991416309013
yo0.3275954814416353
ca0.32212581344902386
et0.3202827623708537
it0.30709534368070956
ro0.30709534368070956
vi0.2711370262390671
ms0.2546213476446034
is0.24196482716798057
lv0.24104432301153617
lt0.23826934795856186
hu0.2028061224489796
es0.19923126201153107
fi0.18725617685305593
tr0.1867273910214704
az0.17709019091507572
hi0.11473087818696884
eu0.09877433309300648
be0.05303030303030303
uk0.04798172124904798
reliabletrue
passestrue
4
name"Selvi"
dialogue"Yeh number! Yeh gaadi! Woh usi mein usko le gaya! Koi meri baat kyun nahi sunta? Main bas madad karna chahti hoon!"
detectedLang"et"
heavyLang"tlh"
scores
et0.47141738449490994
tl0.45520581113801456
ro0.36320754716981135
ms0.3559160305343511
fr0.3528283796740172
sv0.31749241658240646
en0.3133265513733469
de0.2939330543933054
sl0.27184466019417475
it0.2524916943521595
yo0.24327354260089684
fi0.23728813559322032
es0.23556058890147225
hu0.21693735498839908
nl0.21236872812135354
is0.2114485981308411
eu0.19642857142857142
no0.1906474820143885
pl0.14772727272727273
ca0.11649214659685864
da0.1083223249669749
pt0.09879839786381843
sk0.08536585365853659
reliablefalse
passesfalse
5
name"Hunter"
dialogue"I'm so sorry, I have to run. That's my card, bring it to the sheriff's office first thing tomorrow, find someone who can translate what you're saying. That photo you have? It's our best lead all week. Don't lose that camera, okay?"
detectedLang"en"
heavyLang"en"
scores
en0.8061224489795918
tl0.6292924037460979
no0.39618644067796616
da0.3865690916917779
nl0.3338008415147265
de0.3271954674220963
sv0.325922421948912
fr0.31654676258992803
sq0.31059506531204645
yo0.307243558580457
it0.29033864541832666
cs0.27738336713995937
ro0.2566510172143975
hr0.24682875264270615
sk0.24363057324840762
pl0.22889610389610393
ca0.21574023115024765
ms0.21008869179600886
lv0.19171866137266025
pt0.18895845190665908
sl0.18849658314350795
es0.18710781517398745
tr0.1786743515850144
vi0.1492537313432836
lt0.1410488245931284
et0.12844036697247707
az0.12253694581280788
is0.09466327827191869
hi0.05126498002663116
be0.04682274247491639
eu0.044906166219839144
hu0.044906166219839144
uk0.04233870967741936
reliabletrue
passestrue
6
name"Selvi"
dialogue"Ruko! Suno toh! Main tumhe photo dikhaungi!"
detectedLang"fr"
heavyLang"tlh"
scores
fr0.5027124773960217
en0.4954128440366973
ms0.3226600985221675
cs0.24242424242424243
de0.22096317280453256
hi0.21875
tl0.21875
reliablefalse
passesfalse