Run: 2026-10-13-01M4TBH283H6HS623E7ZY94YVP

Run Details

Duration:
1m 45s
Cost:
$0.090802
Provider:
Fireworks

Evaluation summary

Score Evaluator
Details Link
57.14% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
**VOICE SHEET — "The Orchard Night"** *Scene: A café in Alborn, MN, during Apple Festival week. Selvi's lines are in Hindi — translations in parentheses are for the reader only; Hunter understands none of them.* --- Hunter: "Excuse me, ma'am. Detective Hunter, Alborn Police. Mind if I ask you a few questions?" Selvi: "Jee? ... Mujhe maaf kijiye, mujhe angrezi nahi aati." *(Yes? ... I'm sorry, I don't speak English.)* Hunter: "I'll take that as a 'maybe.' I'm looking into what happened to Dale Pederson — went missing three nights ago, right when half this town was stringing lights for the Apple Festival. Somebody said you were out by the Hartman orchard that evening. With your camera." Selvi: "Woh raat...? Haan, main wahan thi. Seb ke baagh ke paas tasveerein le rahi thi. Chand bahut khoobsurat tha..." *(That night...? Yes, I was there. I was taking pictures near the apple orchard. The moon was so beautiful...)* Hunter: "Ma'am, I hate to say it, but I have no earthly idea what you just said. Do you speak any English? Eng-lish?" Selvi: "Nahi... angrezi nahi. Lekin suniye, zaroori baat hai — maine ek gadi dekhi. Kali gadi, bina batti ke. Aur phir... cheekh. Kisi ki cheekh suni maine." *(No... no English. But listen, it's important — I saw a vehicle. A black vehicle, no lights. And then... a scream. I heard someone scream.)* Hunter: "Okay. Okay, slow down. You're shaking. Whatever it is, I want to help, but you've got to meet me halfway. Is there anybody in this café who speaks Hindi? Anybody at all?" Selvi: "Main darr gayi thi. Pedon ke peeche chhup gayi. Mujhe bahut darr lag raha hai..." *(I was terrified. I hid behind the trees. I'm so frightened...)* Hunter: "Your camera. You keep looking down at it. Were you taking pictures that night? Pic-tures?" Selvi: "Haan! Dekhiye, dekhiye — meri tasveeron mein kuch hai. Yeh gadi... aur yahan, pedon ke beech, koi khada hai." *(Yes! Look, look — there's something in my photos. This vehicle... and here, between the trees, someone is standing.)* Hunter: "Hold on — go back. That one. Is that a van behind the tree line? Can you zoom in? Zoom?" Selvi: "Kya aap samajh rahe hain jo main dikhana chahti hoon?" *(Do you understand what I'm trying to show you?)* Hunter: "Plates caked with mud. Whoever this is, they didn't want to be read. Hang on — there's an app for this. Uh... 'Aapne... kya... dekha?' That anywhere close?" Selvi: "Haan, maine dekha! Gadi... aur cheekh... aur woh aadmi—" *(Yes, I saw! The vehicle... and the scream... and that man—)* Hunter: "Phone says you saw... 'the black box swallow the night.' That can't be right. Worthless thing. The Corps taught me a little Arabic, a little Pashto. Never Hindi. Figures." Selvi: "Kya woh aadmi theek hoga? Kripya usse dhoondh lijiye..." *(Will that man be all right? Please find him...)* Hunter: "I wish I knew what you were saying, ma'am. I truly do. But whatever it is — it's got you scared, and that tells me plenty." Hunter: "—Sorry, I have to take this. Hunter. ... Yeah. When? ... You're sure it's his? ... Nobody touches a thing, I'm ten minutes out." Hunter: "They found Dale's boot down by Six-Mile Creek. I have to go. But you — stay in town. Stay. Tomorrow I'm coming back with somebody who speaks Hindi. You understand? To-mor-row." Selvi: "Kripya jaldi kijiyega... usne meri taraf dekha tha. Usne mujhe dekha." *(Please hurry... he looked toward me. He saw me.)* Hunter: "I don't know what you just said. But I'm going to find out. That's a promise."
created_at"2026-10-13T10:04:31.371Z" 10/13/2026, 10:04:31 AM
model"fireworks/ember-1-20260923"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency1942
moderation_latency(null)
generation_time105231
tokens_prompt302
tokens_completion5830
native_tokens_prompt366
native_tokens_completion6046
native_tokens_completion_images(null)
native_tokens_reasoning5002
native_tokens_cached365
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
num_fetches(null)
web_search_engine(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
service_tier(null)
usage0.0908025
router(null)
user_agent"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer(null)
request_id"req-1791885871-ZCY7nHFxXLEOeeytqlBv"
session_id(null)
preset_id(null)
api_type"completions"
id"gen-1791885871-X4e0jLR6OVfZC2ZaRxSg"
upstream_id"chatcmpl-b4a823e1908a452e9d3fd837a79b1553"
provider_responses
0
endpoint_id"b89a2f05-4051-4446-a9b0-7bc8ae7b7c90"
id"chatcmpl-b4a823e1908a452e9d3fd837a79b1553"
is_byokfalse
latency1942
model_permaslug"fireworks/ember-1-20260923"
provider_name"Fireworks"
status200
total_cost0.0908025
cache_discount0.0009855
upstream_inference_cost0
provider_name"Fireworks"
response_cache_source_id(null)
data_region"global"
workspace_id"97e315e5-d303-487d-83c1-83180e8a13d4"

Evaluation details

Result Evaluator Details Meta Data
57.14% Parse dialogue n/a
dialogue
0
name"Hunter"
dialogue"Excuse me, ma'am. Detective Hunter, Alborn Police. Mind if I ask you a few questions?"
detectedLang"en"
heavyLang"en"
scores
en0.7601918465227818
fr0.6209728363866076
it0.6131528046421664
tl0.5686556434219986
ca0.5478522984174831
ro0.5440729483282675
pt0.5402298850574713
sq0.494949494949495
cs0.48674080410607357
es0.4840928632846088
no0.4796183868169991
sv0.46761313220940554
hr0.44751381215469616
nl0.4470046082949309
da0.43767572633552015
sl0.4371482176360225
et0.39879759519038077
hu0.39148073022312374
sk0.3743482794577685
de0.34711643090315564
pl0.34711643090315564
ms0.32432432432432434
tr0.31662870159453305
lt0.27884615384615385
fi0.27007299270072993
lv0.27007299270072993
az0.25742574257425743
yo0.2555831265508685
eu0.21465968586387435
is0.18699186991869918
vi0.18144611186903137
be0.1044776119402985
uk0.09502262443438914
reliabletrue
passestrue
1
name"Selvi"
dialogue"Jee? ... Mujhe maaf kijiye, mujhe angrezi nahi aati."
detectedLang"eu"
heavyLang"tl"
scores
eu0.39759036144578314
ro0.29577464788732394
no0.2732558139534884
da0.26035502958579887
de0.2378048780487805
reliablefalse
passesfalse
2
name"Hunter"
dialogue"I'll take that as a 'maybe.' I'm looking into what happened to Dale Pederson — went missing three nights ago, right when half this town was stringing lights for the Apple Festival. Somebody said you were out by the Hartman orchard that evening. With your camera."
detectedLang"en"
heavyLang"en"
scores
en0.799624295554164
tl0.6481970096745823
nl0.5111518484570731
no0.4886545222115692
da0.464524765729585
de0.3993993993993994
sv0.3934799090219864
pt0.3904761904761905
fr0.37888198757763975
ms0.3635640413683373
es0.3313832010029252
it0.32716568544995794
cs0.3153615746683783
sk0.2923485183547103
ro0.2879394748553627
yo0.27699954812471755
ca0.27206551410373064
is0.25788497217068646
sl0.25615992561599255
sq0.2438563327032136
hr0.2366412213740458
et0.21913128355295267
pl0.2083127164769916
lt0.16317991631799164
hu0.16054564533053514
lv0.13746630727762804
az0.1365353480841878
fi0.1130820399113082
eu0.1116046640755136
tr0.045915324985092425
vi0.041916167664670656
reliabletrue
passestrue
3
name"Selvi"
dialogue"Woh raat...? Haan, main wahan thi. Seb ke baagh ke paas tasveerein le rahi thi. Chand bahut khoobsurat tha..."
detectedLang"ms"
heavyLang"vi"
scores
ms0.42765567765567764
fr0.3654822335025381
de0.3543388429752066
sq0.32867883995703545
yo0.251497005988024
ro0.25059952038369304
en0.2487980769230769
tl0.24516908212560387
nl0.20382165605095542
vi0.19871794871794873
it0.1883116883116883
es0.15994623655913978
sl0.15768194070080863
cs0.14148351648351648
hu0.1355463347164592
is0.13073713490959665
ca0.1270949720670391
fi0.12342215988779803
sv0.12342215988779803
no0.10714285714285714
tr0.10714285714285714
da0.10329985652797705
pt0.10329985652797705
reliablefalse
passesfalse
4
name"Hunter"
dialogue"Ma'am, I hate to say it, but I have no earthly idea what you just said. Do you speak any English? Eng-lish?"
detectedLang"en"
heavyLang"en"
scores
en0.7901980530379322
tl0.5192307692307693
ca0.47257383966244726
hr0.46717817561807334
pl0.43387681159420294
da0.42502299908003677
cs0.41697761194029853
no0.40926275992438566
sk0.405893536121673
lv0.3914313534566699
yo0.37686939182452645
sq0.3503118503118503
sv0.3329775880469584
pt0.31991294885745375
et0.30709534368070956
sl0.27829099307159355
es0.2638398115429918
it0.2378048780487805
vi0.21777221526908636
lt0.21085858585858586
ro0.20584498094027956
tr0.20178799489144317
ms0.1925064599483204
fr0.12342215988779803
de0.10329985652797705
be0.10071942446043164
hu0.09682080924855492
az0.09156976744186046
is0.09156976744186046
uk0.09156976744186046
reliabletrue
passestrue
5
name"Selvi"
dialogue"Nahi... angrezi nahi. Lekin suniye, zaroori baat hai — maine ek gadi dekhi. Kali gadi, bina batti ke. Aur phir... cheekh. Kisi ki cheekh suni maine."
detectedLang"tr"
heavyLang"vi"
scores
tr0.36736474694589877
ms0.3444846292947558
fi0.33729433272394876
ro0.3299445471349353
en0.32808155699721964
it0.3166823751178134
eu0.3008678881388621
de0.2933723196881091
fr0.28851815505397443
et0.26988922457200404
sl0.24163179916317992
yo0.2170626349892009
lv0.210239651416122
da0.1844769403824522
vi0.17800453514739228
az0.17707150964812712
hu0.1430260047281324
cs0.12439613526570048
nl0.12121212121212122
no0.11477411477411477
is0.1082410824108241
tl0.10161090458488227
pl0.09713574097135741
sk0.09713574097135741
reliablefalse
passesfalse
6
name"Hunter"
dialogue"Okay. Okay, slow down. You're shaking. Whatever it is, I want to help, but you've got to meet me halfway. Is there anybody in this café who speaks Hindi? Anybody at all?"
detectedLang"en"
heavyLang"en"
scores
en0.7868521426968813
tl0.6216646754281163
nl0.5187436676798379
no0.4428152492668622
sq0.3890675241157556
it0.35197817189631647
da0.3493150684931507
yo0.3484224965706447
et0.33519944016794956
de0.3342676944639103
sv0.3338008415147265
pt0.3120926864590876
sl0.27646610814927647
pl0.26640926640926643
is0.2543171114599686
fr0.2531446540880503
cs0.24841772151898736
sk0.22889610389610393
lv0.22194922194922193
hr0.21161825726141079
ro0.19627749576988157
hu0.18872758326216907
lt0.1495076096687556
ms0.14337240757439135
az0.1340018231540565
ca0.12683823529411764
es0.09695817490494298
hi0.07587548638132297
fi0.07317073170731707
be0.06862745098039216
tr0.06862745098039216
uk0.06219151036525173
vi0.06219151036525173
reliabletrue
passestrue
7
name"Selvi"
dialogue"Main darr gayi thi. Pedon ke peeche chhup gayi. Mujhe bahut darr lag raha hai..."
detectedLang"vi"
heavyLang"vi"
scores
vi0.4094488188976378
de0.256198347107438
et0.23857868020304565
ms0.23728813559322032
fi0.1891891891891892
ro0.1891891891891892
sq0.1891891891891892
cs0.18625678119349007
it0.1818181818181818
en0.18032786885245902
no0.17883211678832117
sv0.1712707182320442
fr0.16356877323420074
yo0.16356877323420074
nl0.14611005692599618
reliablefalse
passesfalse
8
name"Hunter"
dialogue"Your camera. You keep looking down at it. Were you taking pictures that night? Pic-tures?"
detectedLang"en"
heavyLang"en"
scores
en0.8045347928068803
tl0.6892479801118707
no0.4807892004153686
fr0.452354874041621
da0.44320712694877507
ro0.38271604938271603
de0.3734335839598998
ca0.35233160621761656
nl0.3333333333333333
sv0.3103448275862069
et0.25261584454409564
lv0.25261584454409564
it0.2401215805471125
sk0.2401215805471125
sq0.2389649923896499
cs0.2366412213740458
ms0.23076923076923078
yo0.23076923076923078
pl0.1749174917491749
es0.1652754590984975
tr0.14675767918088736
fi0.13793103448275862
is0.1243432574430823
pt0.1243432574430823
sl0.1243432574430823
reliabletrue
passestrue
9
name"Selvi"
dialogue"Haan! Dekhiye, dekhiye — meri tasveeron mein kuch hai. Yeh gadi... aur yahan, pedon ke beech, koi khada hai."
detectedLang"ms"
heavyLang"tl"
scores
ms0.32590855803048063
fi0.31952662721893493
tl0.28035043804755944
vi0.2144808743169399
es0.18091168091168092
de0.17857142857142858
pt0.16907514450867053
en0.15441176470588236
et0.15441176470588236
lv0.15441176470588236
ro0.15441176470588236
cs0.15191740412979352
it0.14814814814814814
yo0.13273001508295626
sq0.11809815950920245
reliablefalse
passesfalse
10
name"Hunter"
dialogue"Hold on — go back. That one. Is that a van behind the tree line? Can you zoom in? Zoom?"
detectedLang"en"
heavyLang"en"
scores
en0.8235294117647058
tl0.6598639455782312
nl0.5897903372835005
yo0.5656370656370656
pl0.5098039215686274
ca0.4972067039106145
hu0.49095022624434387
cs0.44649446494464945
fr0.40318302387267907
hr0.3894165535956581
ro0.3844049247606019
it0.3767313019390581
da0.3679775280898876
sv0.3553008595988539
sl0.3515850144092219
az0.33920704845814975
es0.3273542600896861
et0.3253373313343328
ms0.32432432432432434
de0.32228915662650603
fi0.3212669683257918
eu0.31921331316187596
sk0.31297709923664124
is0.2706645056726094
no0.2682926829268293
tr0.2549668874172185
sq0.25
pt0.23728813559322032
hi0.15730337078651685
lt0.15413533834586465
lv0.1346153846153846
vi0.1346153846153846
reliabletrue
passestrue
11
name"Selvi"
dialogue"Kya aap samajh rahe hain jo main dikhana chahti hoon?"
detectedLang"fi"
heavyLang"tlh"
scores
fi0.500768049155146
eu0.4058500914076782
et0.3992606284658041
lv0.3970315398886827
yo0.37137330754352027
da0.36647173489278756
no0.3538767395626242
ms0.344758064516129
lt0.25287356321839083
sl0.2459396751740139
is0.2388758782201405
en0.23349056603773585
tl0.22985781990521328
sq0.2261904761904762
ca0.214975845410628
fr0.21307506053268765
sv0.19753086419753088
de0.1935483870967742
reliablefalse
passesfalse
12
name"Hunter"
dialogue"Plates caked with mud. Whoever this is, they didn't want to be read. Hang on — there's an app for this. Uh... 'Aapne... kya... dekha?' That anywhere close?"
detectedLang"en"
heavyLang"en"
scores
en0.7701736465781409
tl0.5143011332973556
de0.42047649710238255
yo0.4027869940278699
nl0.3263473053892215
no0.3171471927162367
fr0.3028659953524399
da0.2828685258964143
lt0.2805755395683453
et0.258037922506183
pt0.24242424242424243
sk0.24050632911392408
cs0.23599320882852293
pl0.23599320882852293
hu0.2314261315115286
hr0.22879177377892032
ca0.21052631578947367
ms0.19427036705461057
lv0.17050691244239632
sl0.16666666666666666
ro0.15651358950328023
sv0.15492957746478872
zh0.14611005692599618
fi0.14285714285714285
sq0.13211186113789777
es0.12959381044487428
tr0.1262135922330097
vi0.10802775024777006
eu0.10358565737051792
is0.09274193548387095
hi0.08536585365853659
reliabletrue
passestrue
13
name"Selvi"
dialogue"Haan, maine dekha! Gadi... aur cheekh... aur woh aadmi—"
detectedLang"en"
heavyLang"de"
scores
en0.471830985915493
ro0.45652173913043476
fr0.4094488188976378
lv0.39148073022312374
et0.35205183585313177
fi0.35205183585313177
de0.3288590604026846
tl0.21465968586387435
reliablefalse
passesfalse
14
name"Hunter"
dialogue"Phone says you saw... 'the black box swallow the night.' That can't be right. Worthless thing. The Corps taught me a little Arabic, a little Pashto. Never Hindi. Figures."
detectedLang"en"
heavyLang"en"
scores
en0.7788542544229149
tl0.6327387198321092
fr0.5358090185676392
sq0.38739789964994165
no0.3794326241134752
da0.36823104693140796
nl0.35185185185185186
de0.3354430379746835
yo0.3132766514061478
pt0.3037135278514589
it0.3
ms0.27735719201651754
es0.26419060967063773
hu0.2595204513399154
ro0.2532005689900427
et0.25
sl0.23469387755102045
ca0.22850844966936076
sv0.22509225092250923
sk0.2164179104477612
cs0.20993227990970656
lt0.2039423805913571
lv0.1784037558685446
vi0.16201117318435754
is0.14145543744889613
eu0.13651315789473684
tr0.12207357859531774
fi0.11616161616161616
hr0.09638554216867469
ar0.09090909090909091
pl0.09090909090909091
hi0.06914893617021277
az0.0625
reliabletrue
passestrue
15
name"Selvi"
dialogue"Kya woh aadmi theek hoga? Kripya usse dhoondh lijiye..."
detectedLang"nl"
heavyLang"ga"
scores
nl0.23076923076923078
sq0.23076923076923078
reliablefalse
passesfalse
16
name"Hunter"
dialogue"I wish I knew what you were saying, ma'am. I truly do. But whatever it is — it's got you scared, and that tells me plenty."
detectedLang"en"
heavyLang"en"
scores
en0.8137571393096598
tl0.4791666666666667
sq0.39271255060728744
yo0.38016528925619836
no0.36115843270868825
cs0.3495229835212489
pt0.3438320209973753
pl0.3218806509945751
ca0.3212669683257918
fr0.3112947658402204
hr0.3093922651933701
nl0.30619796484736356
it0.27395934172313646
sk0.2725509214354995
et0.24698795180722888
da0.23547400611620795
sv0.23155737704918034
hu0.22760041194644695
sl0.21711899791231734
es0.19268030139935413
vi0.1883116883116883
tr0.1847826086956522
ro0.1830065359477124
is0.1712707182320442
lv0.1657397107897664
ms0.10071942446043164
fi0.09090909090909091
be0.08536585365853659
az0.07749077490774908
lt0.07749077490774908
uk0.07749077490774908
reliabletrue
passestrue
17
name"Hunter"
dialogue"—Sorry, I have to take this. Hunter. ... Yeah. When? ... You're sure it's his? ... Nobody touches a thing, I'm ten minutes out."
detectedLang"en"
heavyLang"en"
scores
en0.8058790904048808
tl0.5913601868067717
cs0.4696969696969697
da0.46605644546147984
sk0.45567651632970446
fr0.44881889763779526
pl0.4345718901453958
ca0.40728196443691783
it0.40170940170940167
no0.40119760479041916
hr0.38271604938271603
sl0.375
lt0.3676603432700994
de0.36479128856624315
nl0.3560257589696412
pt0.3433395872420263
ro0.3383742911153119
yo0.3288590604026846
sv0.3275696445725264
sq0.31906614785992216
es0.28205128205128205
et0.2776057791537668
ms0.27007299270072993
lv0.2670157068062827
hu0.24160346695557963
tr0.2273730684326711
is0.16467780429594273
fi0.16167664670658682
az0.15966386554621848
vi0.15966386554621848
be0.09090909090909091
eu0.09090909090909091
uk0.08256880733944955
reliabletrue
passestrue
18
name"Hunter"
dialogue"They found Dale's boot down by Six-Mile Creek. I have to go. But you — stay in town. Stay. Tomorrow I'm coming back with somebody who speaks Hindi. You understand? To-mor-row."
detectedLang"en"
heavyLang"en"
scores
en0.7850562947799385
tl0.5866141732283464
da0.4827586206896552
no0.43273905996758516
pl0.4117647058823529
cs0.3941142527409118
nl0.3346007604562738
sk0.325626204238921
it0.3037135278514589
sv0.3027888446215139
de0.2827868852459016
ro0.2778541953232462
yo0.270326615705351
fr0.2584745762711864
sl0.2505353319057816
hr0.23968139029688634
et0.21991084695393756
es0.21700223713646533
is0.1828793774319066
ca0.18096723868954756
sq0.17387883556254916
lv0.14979757085020243
pt0.14075286415711946
lt0.1372226787181594
ms0.12718204488778054
az0.12280701754385964
hi0.06914893617021277
be0.0625
tr0.0625
hu0.05998209489704566
uk0.05660377358490566
vi0.05660377358490566
reliabletrue
passestrue
19
name"Selvi"
dialogue"Kripya jaldi kijiyega... usne meri taraf dekha tha. Usne mujhe dekha."
detectedLang"tr"
heavyLang"vi"
scores
tr0.358974358974359
sq0.35691318327974275
ms0.3220338983050847
et0.313893653516295
eu0.20948616600790515
is0.1902834008097166
ro0.16317991631799164
reliablefalse
passesfalse
20
name"Hunter"
dialogue"I don't know what you just said. But I'm going to find out. That's a promise."
detectedLang"en"
heavyLang"en"
scores
en0.8331664998331665
cs0.5437956204379563
tl0.52561669829222
et0.48665297741273095
hr0.47368421052631576
pl0.4617868675995694
ca0.4553376906318083
da0.453551912568306
ro0.4292237442922375
sq0.42196531791907516
yo0.40688018979833923
sk0.4004796163069544
no0.39320388349514557
it0.38042131350681535
sv0.37733499377334995
sl0.3597951344430218
fr0.35233160621761656
lv0.33774834437086093
lt0.33244325767690247
hu0.3084370677731674
pt0.3006993006993007
es0.2877492877492877
tr0.22720247295208654
is0.2163009404388715
az0.21011058451816747
vi0.21011058451816747
nl0.20508744038155804
de0.20127795527156547
ms0.19614147909967844
be0.12280701754385964
eu0.12280701754385964
fi0.11190053285968028
uk0.11190053285968028
reliabletrue
passestrue