Run: 2026-09-03-01M1M2NC2K0BX5TSVAAMAN2ZA6

Run Details

Duration:
1m 34s
Cost:
$0.019546
Provider:
Parasail

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Hunter: "Excuse me. Detective Hunter. I'm investigating the disappearances in Alborn. I saw you with your camera. Did you see anything strange at the apple festival?" Selvi: "मैंने सेब के बगीचे के पास एक औरत को देखा। वह अकेली थी।" Hunter: "I'm sorry. I don't understand. A woman? Near the orchard?" Selvi: "हाँ। उसके हाथ में लाल थैली थी। उसकी आँखें डरी हुई थीं।" Hunter: "A red bag? She was scared? Did she talk to you?" Selvi: "नहीं... वह मेरी तरफ़ देख रही थी, फिर उसने नदी की तरफ़ इशारा किया।" Hunter: "The river? She pointed toward the river? Did she run?" Selvi: "हाँ, वह पेड़ों के पीछे दौड़ गई। तभी अंधेरा हो गया।" Hunter: "Woods behind the orchard. That's where the last disappearance happened. I need to see the camera." Selvi: "मेरा कैमरा यहीं है। लेकिन मैं डर के मारे तस्वीर नहीं ले पाई।" Hunter: "You didn't get a picture? That's a problem. The red bag matches the missing woman. When did you see her?" Selvi: "सेब उत्सव शुरू होने से थोड़ी देर पहले।" Hunter: "Before the festival started. Good. My phone is ringing. I have to take it. I'll be right back. Please don't leave."
created_at"2026-09-03T16:47:03.258Z" 9/3/2026, 4:47:03 PM
model"qwen/qwen3.8-27b-20260814"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency350
moderation_latency(null)
generation_time93467
tokens_prompt302
tokens_completion10415
native_tokens_prompt338
native_tokens_completion8846
native_tokens_completion_images(null)
native_tokens_reasoning8485
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
num_fetches(null)
web_search_engine(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
service_tier(null)
usage0.0195457
router(null)
user_agent"langchainjs-openai/1.0.0 ((node/v24.19.0; linux; x64))"
http_referer(null)
request_id"req-1788454023-BJFnyZCU4pRHiTV7yv7i"
session_id(null)
preset_id(null)
api_type"completions"
id"gen-1788454023-MyJDqzQQW1BZmS3O4d1l"
upstream_id"chatcmpl-5943c8467fdb8d0e3b9ccf3af9421c6b"
provider_responses
0
endpoint_id"a58a4a1f-4e83-4776-a40e-9f55b72783cb"
id"chatcmpl-5943c8467fdb8d0e3b9ccf3af9421c6b"
is_byokfalse
latency349
model_permaslug"qwen/qwen3.8-27b-20260814"
provider_name"Parasail"
status200
total_cost0.0195457
cache_discount(null)
upstream_inference_cost0
provider_name"Parasail"
response_cache_source_id(null)
data_region"global"
workspace_id"97e315e5-d303-487d-83c1-83180e8a13d4"

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Hunter"
dialogue"Excuse me. Detective Hunter. I'm investigating the disappearances in Alborn. I saw you with your camera. Did you see anything strange at the apple festival?"
detectedLang"en"
heavyLang"en"
scores
en0.7771646859083192
tl0.6391752577319588
fr0.5938104448742747
it0.5721271393643031
nl0.5545184556639796
no0.5378521126760564
ro0.5339547270306259
ms0.5325022261798753
da0.5040151157298063
sv0.4897959183673469
de0.4852941176470589
ca0.48352188883423514
pt0.48326771653543305
es0.4755244755244755
sq0.46673438293550024
sl0.422759758108851
hr0.39999999999999997
cs0.3841642228739003
et0.37796208530805686
az0.29624664879356566
sk0.2837653478854025
lt0.26675977653631283
pl0.2505353319057816
lv0.2446043165467626
yo0.21171171171171171
is0.2033383915022762
fi0.15797914995990378
tr0.1518578352180937
hu0.11317567567567569
be0.0625
uk0.05660377358490566
vi0.05660377358490566
reliabletrue
passestrue
1
name"Selvi"
dialogue"मैंने सेब के बगीचे के पास एक औरत को देखा। वह अकेली थी।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8857024106400665
mr0.8789079700572435
reliabletrue
passestrue
2
name"Hunter"
dialogue"I'm sorry. I don't understand. A woman? Near the orchard?"
detectedLang"en"
heavyLang"en"
scores
en0.7914494264859229
no0.6530789245446661
da0.5959595959595959
tl0.5947315096251267
sv0.550561797752809
nl0.5444191343963554
cs0.494949494949495
ro0.4891443167305236
sq0.47019867549668876
it0.4594594594594595
de0.4557823129251701
hr0.44598337950138506
yo0.43899018232819076
pl0.43582510578279265
sk0.4211287988422576
ca0.4065281899109792
fr0.40298507462686567
pt0.375
hu0.3579454253611557
is0.3464052287581699
tr0.2687385740402194
lt0.26605504587155965
fi0.26335174953959484
ms0.26062846580406657
az0.24953095684803
lv0.24953095684803
vi0.24953095684803
es0.24812030075187969
et0.23954372623574144
sl0.1836734693877551
be0.14893617021276595
eu0.14893617021276595
uk0.13606911447084233
reliabletrue
passestrue
3
name"Selvi"
dialogue"हाँ। उसके हाथ में लाल थैली थी। उसकी आँखें डरी हुई थीं।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.880857823669579
mr0.8732572877059569
reliabletrue
passestrue
4
name"Hunter"
dialogue"A red bag? She was scared? Did she talk to you?"
detectedLang"en"
heavyLang"en"
scores
en0.8200261780104712
tl0.651015228426396
da0.5743034055727554
yo0.5550161812297735
cs0.5535714285714286
hr0.5242214532871973
sl0.5098039215686274
sk0.4878957169459963
pl0.46601941747572817
ro0.4410569105691057
es0.439918533604888
it0.4364754098360656
nl0.4258872651356994
lv0.41113490364025695
de0.40347071583514105
lt0.40347071583514105
no0.394273127753304
hu0.36194895591647336
pt0.3373493975903614
ca0.3309002433090025
fr0.298469387755102
tr0.21875
is0.21428571428571427
sq0.207492795389049
az0.20289855072463767
eu0.20289855072463767
vi0.20289855072463767
et0.1863905325443787
fi0.1863905325443787
ms0.1863905325443787
sv0.1863905325443787
reliabletrue
passestrue
5
name"Selvi"
dialogue"नहीं... वह मेरी तरफ़ देख रही थी, फिर उसने नदी की तरफ़ इशारा किया।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8813454395377631
mr0.8748367435785808
reliabletrue
passestrue
6
name"Hunter"
dialogue"The river? She pointed toward the river? Did she run?"
detectedLang"en"
heavyLang"en"
scores
en0.8278236914600552
tl0.6765847347994826
yo0.5881383855024712
da0.5274102079395085
no0.51171875
fr0.504950495049505
pl0.44933920704845814
sv0.4075829383886255
ca0.3961352657004831
nl0.3902439024390244
it0.2668621700879765
pt0.24242424242424243
ms0.2378048780487805
sq0.2378048780487805
es0.23076923076923078
de0.22118380062305293
reliabletrue
passestrue
7
name"Selvi"
dialogue"हाँ, वह पेड़ों के पीछे दौड़ गई। तभी अंधेरा हो गया।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8821449616971125
mr0.8608211551844119
reliabletrue
passestrue
8
name"Hunter"
dialogue"Woods behind the orchard. That's where the last disappearance happened. I need to see the camera."
detectedLang"en"
heavyLang"en"
scores
en0.8054777466542173
tl0.5586158192090396
no0.4359205776173285
nl0.4323342415985468
et0.41806331471135944
sq0.41806331471135944
it0.4013409961685824
fr0.39320388349514557
yo0.3842364532019704
da0.38057482656095143
hr0.3343982960596379
cs0.3265086206896552
sv0.3228602383531961
de0.3154435925520263
sk0.2961711711711712
pl0.2945823927765237
ms0.284077892325315
ro0.284077892325315
ca0.2774566473988439
lv0.22839506172839508
sl0.22744128553770088
lt0.21085858585858586
es0.20584498094027956
eu0.18407310704960833
be0.10071942446043164
tr0.10071942446043164
hu0.09682080924855492
az0.09156976744186046
is0.09156976744186046
uk0.09156976744186046
vi0.09156976744186046
pt0.08625730994152046
reliabletrue
passestrue
9
name"Selvi"
dialogue"मेरा कैमरा यहीं है। लेकिन मैं डर के मारे तस्वीर नहीं ले पाई।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8843156356551388
mr0.879989893885801
reliabletrue
passestrue
10
name"Hunter"
dialogue"You didn't get a picture? That's a problem. The red bag matches the missing woman. When did you see her?"
detectedLang"en"
heavyLang"en"
scores
en0.8114393463230674
tl0.6216897856242118
da0.5581737849779087
fr0.5192307692307693
no0.48761742100768574
sv0.4609164420485175
hr0.45404913557779797
nl0.44237918215613387
de0.4371482176360225
sq0.43342776203966005
it0.4157740993184031
sl0.3896236012207528
ro0.3877551020408163
et0.3814432989690722
es0.38080495356037153
cs0.37694704049844235
is0.35275080906148865
yo0.3311036789297659
az0.3212669683257918
ca0.3181818181818182
pt0.31584948688711517
tr0.3063583815028902
pl0.2998833138856476
ms0.29494712103407755
fi0.269183922046285
hu0.2673992673992674
sk0.25650557620817843
lt0.20212765957446807
lv0.19463087248322147
eu0.1044776119402985
vi0.1044776119402985
reliabletrue
passestrue
11
name"Selvi"
dialogue"सेब उत्सव शुरू होने से थोड़ी देर पहले।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8871013265594129
mr0.8826635376943385
reliabletrue
passestrue
12
name"Hunter"
dialogue"Before the festival started. Good. My phone is ringing. I have to take it. I'll be right back. Please don't leave."
detectedLang"en"
heavyLang"en"
scores
en0.8164377072477499
tl0.6512151215121511
da0.5739417262231996
no0.5473130841121495
yo0.47846567967698517
nl0.47062841530054644
cs0.4318181818181818
sv0.42464736451373425
hr0.4065849923430322
pl0.3892828999211978
sk0.38492063492063494
hu0.38296178343949044
fr0.3795036028823059
lt0.37449556093623887
sl0.37449556093623887
it0.3657937806873977
sq0.3557772236076476
ms0.3498322147651006
lv0.34709351305812974
ro0.3260869565217392
ca0.3074173369079536
et0.30180180180180183
de0.27637721755368816
is0.23795476892822026
pt0.20594262295081966
vi0.20185375901132854
es0.19102296450939457
az0.1893305439330544
be0.08284023668639054
tr0.08284023668639054
fi0.07517899761336516
uk0.07517899761336516
reliabletrue
passestrue