Run: 2026-04-24-01KQ02CJ3Q419NQS15KC97EMW6

Run Details

Duration:
33.8s
Cost:
$0.002494
Provider:
Z.AI

Evaluation summary

Score Evaluator
Details Link
52.38% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
VOICE SHEET: Selvi: "नमस्ते। मैं आपकी मदद कर सकती हूँ?" (Namaste. Main aapki madad kar sakti hoon?) - "Hello. How can I help you?" Hunter: "Excuse me, ma'am. I'm Detective Hunter. I was wondering if you might have seen anything unusual around town lately? Some strange occurrences?" Selvi: "मैं अंग्रेजी नहीं समझती।" (Main angrezi nahin samajhti.) - "I don't understand English." Hunter: "Oh. Uh... do you speak any other languages? Maybe Spanish? French?" Selvi: "हिंदी। मैं हिंदी बोलती हूँ।" (Hindi. Main Hindi bolti hoon.) - "Hindi. I speak Hindi." Hunter: (Sighs, frustrated but trying to remain professional) "Right. Look, I'm investigating some disappearances in this town. Have you noticed anything... suspicious?" Selvi: "गायब? कौन गायब हुआ?" (Gaayab? Kaun gayab hua?) - "Missing? Who went missing?" Hunter: "Three people in the past two weeks. Normal citizens, no pattern except they all disappeared without a trace. Have you seen anyone acting oddly around here?" Selvi: (Worried, gestures with her hands) "कुछ गलत है। मैं डर गई हूँ।" (Kuch galat hai. Main dar gayi hoon.) - "Something is wrong. I'm scared." Hunter: "Why? What happened?" Selvi: "आज सुबह मैंने फोटो खींची थी। वहाँ कोई था... डरावना था।" (Aaj subah maine photo kheenchi thi. Wahan koi tha... darravaan tha.) - "This morning I was taking photos. There was someone there... scary." Hunter: (Pulls out notepad) "What did this person look like? Can you describe them?" Selvi: "लंबा, काले कपड़े पहने हुए... फोटो में दिखता है।" (Lamba, kale kapde pahane hue... photo mein dikhata hai.) - "Tall, wearing black clothes... shows up in the photo." Hunter: (Looks at her camera screen, sees something concerning) "Can I see these photos? This might be important." Selvi: (Hesitates, then hands him the camera) "ठीक है।" (Theek hai.) - "Okay." Hunter: (Studies the photos intently) "That's... that's helpful. Did you see which way this person went?" Selvi: "वहाँ से दक्षिण की ओर गया। बड़ी सड़क पर।" (Wahan se dakshin ki aur gaya. Badi sadak par.) - "He went south from there. On the main road." Hunter: (Just as he's about to ask another question, his phone rings loudly) "Excuse me." (Answers phone) "Hunter... What? Another disappearance? I'll be right there." (Turns back to Selvi) "I have to go, but this is very helpful. Don't leave town, okay?" Selvi: "हाँ, मैं यहीं रहूँगी।" (Haan, main yahi rahungi.) - "Yes, I'll stay here." Hunter: "Thank you for your help." (Hurries away) Selvi: (Watching him leave, then looks at her camera with concern) "क्या हो रहा है?" (Kya ho raha hai?) - "What's happening?"
created_at"2026-04-24T15:40:27.652Z" 4/24/2026, 3:40:27 PM
model"z-ai/glm-4.5-air"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency1683
moderation_latency(null)
generation_time33565
tokens_prompt315
tokens_completion2080
native_tokens_prompt269
native_tokens_completion2220
native_tokens_completion_images(null)
native_tokens_reasoning1216
native_tokens_cached8
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
num_fetches(null)
web_search_engine(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0.00249444
router(null)
provider_responses
0
endpoint_id"c8760514-8a81-4a73-ae2c-be4942ba93f3"
id"202604242340273ce9010a5cd5412b"
is_byokfalse
latency1683
model_permaslug"z-ai/glm-4.5-air"
provider_name"Z.AI"
status200
user_agent"langchainjs-openai/1.0.0 ((node/v24.14.1; linux; x64))"
http_referer(null)
request_id"req-1777045227-kfLcPDZww7cFz67nvpG1"
session_id(null)
api_type"completions"
id"gen-1777045227-FQWdnkmrXRQt1VWnwzRH"
upstream_id"202604242340273ce9010a5cd5412b"
total_cost0.00249444
cache_discount0.00000136
upstream_inference_cost0
provider_name"Z.AI"
response_cache_source_id(null)

Evaluation details

Result Evaluator Details Meta Data
52.38% Parse dialogue n/a
dialogue
0
name"Selvi"
dialogue"Hello. How can I help you?"
detectedLang"en"
heavyLang"en"
scores
en0.7860635696821516
it0.5833333333333334
no0.580335731414868
da0.5772946859903382
sv0.5679012345679012
tl0.5679012345679012
ca0.5512820512820513
cs0.5111731843575419
tr0.45652173913043476
az0.4444444444444444
hr0.44267515923566875
is0.44267515923566875
sq0.4336569579288026
pl0.4186046511627907
fi0.34701492537313433
ro0.33962264150943394
yo0.3320610687022901
es0.3055555555555556
de0.3027888446215139
sk0.29149797570850206
be0.2857142857142857
hu0.2768595041322314
et0.2647058823529412
lt0.2647058823529412
lv0.2647058823529412
uk0.2647058823529412
vi0.2647058823529412
reliabletrue
passesfalse
1
name"Hunter"
dialogue"Excuse me, ma'am. I'm Detective Hunter. I was wondering if you might have seen anything unusual around town lately? Some strange occurrences?"
detectedLang"en"
heavyLang"en"
scores
en0.7955546236108199
tl0.5257782101167315
da0.5102963335007534
nl0.49165797705943687
fr0.4672131147540984
no0.4672131147540984
de0.41581785500299584
it0.38173747622067217
sq0.3781887755102041
sv0.365234375
ca0.3504330446369087
ro0.3280496209510682
pt0.3261921216309606
ms0.3172268907563025
es0.31386347642505275
sl0.27884615384615385
cs0.25742574257425743
et0.24826522744795684
hr0.23228346456692914
lv0.2243436754176611
pl0.22310756972111553
yo0.20278004905968927
sk0.19620774938169827
tr0.16165090283748923
fi0.1356382978723404
is0.11764705882352942
lt0.11764705882352942
az0.11121239744758432
hi0.07231208372978117
be0.06698564593301436
hu0.06429942418426103
uk0.06069364161849711
vi0.06069364161849711
reliabletrue
passestrue
2
name"Selvi"
dialogue"I don't understand English."
detectedLang"en"
heavyLang"en"
scores
en0.8060135790494666
no0.7237569060773481
da0.7191011235955056
sv0.677938808373591
de0.5698924731182796
ro0.5412844036697247
hr0.51338199513382
pl0.504950495049505
cs0.48586118251928023
nl0.4708994708994709
sk0.44598337950138506
tl0.42028985507246375
ca0.40828402366863903
is0.4065281899109792
sq0.40119760479041916
it0.36507936507936506
yo0.30313588850174217
ms0.2647058823529412
be0.25925925925925924
tr0.25925925925925924
hu0.250936329588015
az0.23954372623574144
et0.23954372623574144
lt0.23954372623574144
lv0.23954372623574144
uk0.23954372623574144
vi0.23954372623574144
reliabletrue
passesfalse
3
name"Hunter"
dialogue"Oh. Uh... do you speak any other languages? Maybe Spanish? French?"
detectedLang"en"
heavyLang"en"
scores
en0.7990174184903975
tl0.4943820224719101
nl0.4485294117647059
ro0.4375
da0.41482444733420026
pt0.3562231759656652
de0.35437589670014347
cs0.31921331316187596
ca0.3150684931506849
sq0.30448222565687794
fr0.27768860353130015
no0.27652733118971057
pl0.24114671163575044
yo0.23857868020304565
sk0.22680412371134018
hr0.21052631578947367
sl0.21052631578947367
vi0.19786096256684493
es0.17883211678832117
ms0.16201117318435754
is0.15730337078651685
sv0.15094339622641512
et0.14772727272727273
eu0.14772727272727273
it0.14611005692599618
hu0.1362763915547025
lt0.12280701754385964
reliabletrue
passestrue
4
name"Selvi"
dialogue"Hindi. I speak Hindi."
detectedLang"tl"
heavyLang"en"
scores
tl0.795417348608838
en0.7178329571106096
sq0.638728323699422
it0.6345029239766081
is0.5629370629370629
et0.5567375886524822
no0.5370370370370371
da0.5265151515151516
hr0.5265151515151516
ca0.5247148288973384
sv0.5247148288973384
pl0.50199203187251
cs0.45652173913043476
ro0.4186046511627907
yo0.410377358490566
hi0.3842364532019704
sk0.3654822335025381
be0.358974358974359
tr0.358974358974359
hu0.34895833333333337
az0.33510638297872336
lt0.33510638297872336
lv0.33510638297872336
uk0.33510638297872336
vi0.33510638297872336
reliabletrue
passesfalse
5
name"Hunter"
dialogue"Right. Look, I'm investigating some disappearances in this town. Have you noticed anything... suspicious?"
detectedLang"en"
heavyLang"en"
scores
en0.8087818696883852
tl0.6323529411764706
fr0.5259831460674157
pt0.47956823438704704
it0.4444444444444444
ro0.4439868204283361
nl0.4220890410958904
ms0.4140625
de0.3874773139745916
es0.3715083798882682
ca0.35406698564593303
da0.3395303326810176
sv0.31402439024390244
sl0.29319371727748694
no0.2902208201892744
lv0.28038379530916846
sq0.24412094064949608
sk0.23900789177001125
cs0.23556058890147225
hr0.23208191126279862
az0.2303306727480046
yo0.1935483870967742
is0.16974169741697415
et0.16044776119402984
lt0.15730337078651685
hu0.11533420707732633
pl0.11067193675889328
fi0.08038147138964578
reliabletrue
passestrue
6
name"Selvi"
dialogue"Missing? Who went missing?"
detectedLang"en"
heavyLang"en"
scores
en0.8242530755711776
nl0.6376811594202898
is0.6031746031746031
da0.5815899581589958
ms0.5238095238095238
tl0.5024875621890548
sv0.4897959183673469
no0.453551912568306
fi0.43820224719101125
ca0.4186046511627907
de0.4186046511627907
fr0.4186046511627907
az0.3939393939393939
et0.3939393939393939
it0.3939393939393939
pt0.3939393939393939
reliabletrue
passesfalse
7
name"Hunter"
dialogue"Three people in the past two weeks. Normal citizens, no pattern except they all disappeared without a trace. Have you seen anyone acting oddly around here?"
detectedLang"en"
heavyLang"en"
scores
en0.8184121621621621
tl0.6027346637102735
nl0.4960150023441162
it0.43211833069202327
ro0.4138495092693566
ca0.38746438746438744
pt0.3771726535341831
de0.3608799048751486
fr0.3562874251497006
es0.3512371756185878
sv0.34129901960784315
ms0.33188315724052203
no0.3135376756066411
pl0.3073453608247423
cs0.30104031209362814
da0.29322813938198555
sq0.2636986301369863
lv0.2519137091162143
hr0.23974540311173975
yo0.22606191504679624
tr0.22157856625633598
sl0.21988388969521042
az0.21071953010279001
sk0.2066420664206642
eu0.20429311621021465
et0.16342412451361868
hu0.12672623883021933
is0.12244897959183673
lt0.11885245901639345
fi0.10491257285595336
vi0.061135371179039305
reliabletrue
passestrue
8
name"Selvi"
dialogue"Something is wrong. I'm scared."
detectedLang"en"
heavyLang"en"
scores
en0.8188405797101449
tl0.4538834951456311
ms0.4230769230769231
nl0.4140625
hu0.4063324538258575
vi0.4063324538258575
yo0.34782608695652173
is0.2902208201892744
it0.281150159744409
es0.25742574257425743
pt0.25742574257425743
ro0.25742574257425743
reliabletrue
passesfalse
9
name"Hunter"
dialogue"Why? What happened?"
detectedLang"en"
heavyLang"en"
scores
en0.8348745046235139
tl0.4444444444444444
reliabletrue
passestrue
10
name"Selvi"
dialogue"This morning I was taking photos. There was someone there... scary."
detectedLang"en"
heavyLang"en"
scores
en0.8102226720647773
tl0.5865490628445424
de0.5443499392466585
nl0.5271122320302648
no0.48489010989010994
sv0.4791666666666667
sq0.43009118541033436
da0.4195046439628483
fr0.4028662420382166
is0.39418416801292405
pl0.3822075782537067
pt0.37913907284768217
ca0.3578767123287671
it0.35121107266435986
yo0.3169398907103825
ro0.3093922651933701
es0.2964352720450282
tr0.2937853107344633
lt0.27606177606177607
sk0.27606177606177607
hr0.2704280155642024
et0.2632612966601179
lv0.2632612966601179
cs0.21875
fi0.1758241758241758
hi0.17035398230088497
sl0.1591928251121076
be0.15730337078651685
hu0.1515837104072398
az0.14383561643835618
uk0.14383561643835618
vi0.14383561643835618
reliabletrue
passesfalse
11
name"Hunter"
dialogue"What did this person look like? Can you describe them?"
detectedLang"en"
heavyLang"en"
scores
en0.8320413436692506
es0.5460893854748603
tl0.49297971918876754
no0.46546052631578944
ca0.4519392917369309
pt0.4257950530035336
ro0.365234375
sv0.3394308943089431
it0.33264887063655035
fr0.3271221532091097
da0.3128964059196617
sq0.3128964059196617
de0.30997876857749473
tr0.30703624733475476
cs0.29653679653679654
az0.29501084598698485
is0.2919389978213508
ms0.21307506053268765
lv0.1875
nl0.1875
lt0.181360201511335
hu0.16237113402061853
et0.15364583333333331
hr0.15364583333333331
pl0.15364583333333331
sk0.15364583333333331
reliabletrue
passestrue
12
name"Selvi"
dialogue"Tall, wearing black clothes... shows up in the photo."
detectedLang"en"
heavyLang"en"
scores
en0.7819314641744548
tl0.7313891020721413
nl0.5547073791348601
fr0.5524296675191815
de0.46564885496183206
sv0.460708782742681
da0.44
ms0.4117647058823529
no0.3805309734513274
yo0.35779816513761464
sl0.3055555555555556
it0.29577464788732394
ro0.2886178861788618
cs0.2009132420091324
az0.1935483870967742
pl0.1935483870967742
sq0.1822429906542056
hi0.18032786885245902
reliabletrue
passesfalse
13
name"Hunter"
dialogue"Can I see these photos? This might be important."
detectedLang"en"
heavyLang"en"
scores
en0.8275862068965517
tl0.6268656716417911
ca0.6252676659528907
fr0.6136865342163355
it0.5394736842105263
ro0.5104895104895105
no0.504950495049505
da0.500713266761769
lt0.48224852071005914
sq0.46236559139784944
es0.44178628389154706
pt0.44178628389154706
yo0.4363929146537842
et0.3996569468267582
tr0.3934142114384749
sv0.36936936936936937
hu0.3445692883895131
de0.29292929292929293
nl0.2886178861788618
az0.2857142857142857
hr0.2842535787321063
lv0.2768595041322314
pl0.2647058823529412
cs0.23076923076923078
hi0.18032786885245902
sk0.17061611374407584
be0.16666666666666666
is0.15254237288135594
uk0.15254237288135594
vi0.15254237288135594
reliabletrue
passestrue
14
name"Selvi"
dialogue"Okay."
detectedLang"tl"
heavyLang"tl"
scores
tl0.8076923076923077
reliablefalse
passestrue
15
name"Hunter"
dialogue"That's... that's helpful. Did you see which way this person went?"
detectedLang"en"
heavyLang"en"
scores
en0.8266468548786527
tl0.47447447447447455
sq0.41471571906354515
et0.3955094991364421
sv0.3230174081237911
nl0.317738791423002
no0.3110236220472441
da0.29718875502008035
de0.29435483870967744
pt0.2827868852459016
cs0.2813141683778234
is0.2768595041322314
fi0.22048997772828507
ca0.20454545454545453
es0.2009132420091324
it0.2009132420091324
ms0.2009132420091324
fr0.1935483870967742
ro0.1935483870967742
lv0.1764705882352941
lt0.17061611374407584
tr0.1606714628297362
hu0.15254237288135594
az0.14425427872860636
hr0.14425427872860636
pl0.14425427872860636
sk0.14425427872860636
reliabletrue
passestrue
16
name"Selvi"
dialogue"He went south from there. On the main road."
detectedLang"en"
heavyLang"en"
scores
en0.8426773455377574
tl0.6994535519125682
fr0.5723172628304821
yo0.5080500894454383
de0.4821092278719397
fi0.4670542635658915
ca0.40860215053763443
cs0.3861607142857143
sq0.36194895591647336
et0.358974358974359
no0.25675675675675674
hr0.24242424242424243
es0.233983286908078
hi0.233983286908078
nl0.233983286908078
pl0.233983286908078
da0.22096317280453256
ms0.22096317280453256
sv0.22096317280453256
sk0.21428571428571427
reliabletrue
passesfalse
17
name"Hunter"
dialogue"I have to go, but this is very helpful. Don't leave town, okay?"
detectedLang"en"
heavyLang"en"
scores
en0.8176845943482224
tl0.6089931573802542
yo0.51278928136419
da0.4936708860759494
pl0.4798439531859558
hr0.3893129770992366
no0.38837920489296635
nl0.38176197836166925
cs0.3710691823899371
hu0.355877616747182
sk0.33774834437086093
lv0.3162393162393162
lt0.2945326278659612
is0.27927927927927926
ca0.25650557620817843
sv0.25650557620817843
sq0.250936329588015
sl0.23224568138195778
it0.22330097087378642
fi0.19839679358717435
ro0.1836734693877551
fr0.18032786885245902
be0.14893617021276595
tr0.14893617021276595
az0.13606911447084233
et0.13606911447084233
uk0.13606911447084233
vi0.13606911447084233
reliabletrue
passestrue
18
name"Selvi"
dialogue"Yes, I'll stay here."
detectedLang"en"
heavyLang"en"
scores
en0.7727272727272727
sq0.5
reliabletrue
passesfalse
19
name"Hunter"
dialogue"Thank you for your help."
detectedLang"en"
heavyLang"en"
scores
en0.834983498349835
tl0.6277915632754343
da0.5145631067961165
no0.512987012987013
vi0.4915254237288135
pt0.3644067796610169
cs0.34210526315789475
ms0.34210526315789475
reliabletrue
passestrue
20
name"Selvi"
dialogue"What's happening?"
detectedLang"en"
heavyLang"en"
scores
en0.8256624825662483
tl0.6130030959752323
sv0.5210727969348659
da0.5136186770428015
no0.4939271255060729
nl0.4703389830508474
is0.46808510638297873
sk0.4444444444444444
reliabletrue
passesfalse