Run: 2026-02-08-01KGYZB1X7GPDV23VN8CQ7MGYP

Run Details

Model:
Z.AI GLM 4.7 Flash
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
1m 12s
Cost:
$0.001731
Provider:
DeepInfra

Evaluation summary

Score Evaluator
Details Link
50.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Selvi: "Aaj subah... mainein unhen dophar ki ghadi mein dekha. Wahan bandh tha, bas ghaas thi. Par muh band kiya tha. Unke haath dhon diye gaye the." Hunter: "Excuse me? You saw him? With his hands... washed? I don't understand you. You're speaking very fast. Ma'am?" Selvi: "Mera naam Selvi hai. Maine wahan ghum rahi thi. Koi hamne aise sab nahi dekha. Kya wahan paisa diya gaya tha? Bilkul nahi." Hunter: "I'm sorry, I don't know what you're talking about. You said you saw someone there?" Selvi: "Hai. Maine unhein rukna tha. Maine unhein samjhaya ki mujhe aaram nahi chahiye. Par unhone muskuraya. Ha, muskuraya... aur fir wapas ghom kar gaye. Aapko lagta hai ki mainein sapna dekh rahi hoon." Hunter: "Okay, okay. Listen to me. Please. Tell me what you saw. Did they take him?" Selvi: "Mainein pohoch nahi paayi. Mainein bhaag gayi. Mainein ab bhi us ghumaaph mein hoon. Kripya aapko pata hai wo kahan gaye?" Hunter: "I don't know. But I'm going to find out. You did the right thing coming here. Please, don't leave this cafe." Hunter: (Phone rings) "Hunter." Selvi: "Kripya kisi aur ko puchiye. Mainein yahan darna lag raha hai." Hunter: "I have to go. I'm sorry. Keep your camera close to you. I'll be right back." Selvi: "Kripya wapas aa jayein. Aapko koi zinda nahi milega."
created_at"2026-02-08T15:55:00.165303+00:00" 2/8/2026, 3:55:00 PM
model"z-ai/glm-4.7-flash-20260119"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency158
moderation_latency(null)
generation_time72308
tokens_prompt262
tokens_completion4184
native_tokens_prompt268
native_tokens_completion4295
native_tokens_completion_images(null)
native_tokens_reasoning3682
native_tokens_cached64
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0.0017308800000128
router(null)
provider_responses
0
id"chatcmpl-RiMiFx9ErL1DqeZg16NPoWLB"
status200
is_byokfalse
latency53
endpoint_id"6efb5994-8fcb-4300-9c64-ba393193f5f6"
provider_name"DeepInfra"
model_permaslug"z-ai/glm-4.7-flash-20260119"
api_type"completions"
id"gen-1770566027-VMZSK2T2fpEgFSrh2QWm"
upstream_id"chatcmpl-RiMiFx9ErL1DqeZg16NPoWLB"
total_cost0.0017308800000128
cache_discount0.0000031999999872
upstream_inference_cost0
provider_name"DeepInfra"

Evaluation details

Result Evaluator Details Meta Data
50.00% Parse dialogue n/a
dialogue
0
name"Selvi"
dialogue"Aaj subah... mainein unhen dophar ki ghadi mein dekha. Wahan bandh tha, bas ghaas thi. Par muh band kiya tha. Unke haath dhon diye gaye the."
detectedLang"ms"
heavyLang"vi"
scores
ms0.4119623655913978
tl0.3686868686868687
fr0.35850439882697943
en0.31853582554517135
sq0.22497785651018598
lv0.21735241502683364
no0.21242124212421243
da0.2081447963800905
sv0.2081447963800905
tr0.20742753623188404
nl0.20164233576642335
yo0.2009132420091324
de0.18376865671641793
fi0.16745956232159848
az0.15130940834141612
vi0.15048543689320387
sl0.14883268482490272
hu0.12148594377510041
ca0.08088235294117647
et0.07602956705385427
ro0.07602956705385427
lt0.07407407407407407
is0.07112526539278131
es0.06716417910447761
pt0.06716417910447761
hr0.06316916488222697
it0.06316916488222697
reliablefalse
passesfalse
1
name"Hunter"
dialogue"Excuse me? You saw him? With his hands... washed? I don't understand you. You're speaking very fast. Ma'am?"
detectedLang"en"
heavyLang"en"
scores
en0.7888645605254927
no0.5653573728267869
da0.5445344129554657
tl0.5414402173913043
sv0.506578947368421
nl0.44581280788177335
de0.4444444444444444
is0.3673851921274602
fr0.36500470366886173
ms0.3408203125
sq0.29467084639498436
pl0.29245283018867924
cs0.2834394904458599
ro0.2549668874172185
hr0.24242424242424243
it0.22413793103448276
es0.20960187353629978
sk0.19258373205741627
pt0.1906474820143885
et0.18967587034813926
lt0.1818181818181818
ca0.16974169741697415
eu0.1434010152284264
sl0.11533420707732633
yo0.1141732283464567
fi0.09999999999999999
be0.09395973154362416
tr0.09395973154362416
hu0.09029649595687331
az0.08536585365853659
lv0.08536585365853659
uk0.08536585365853659
vi0.08536585365853659
reliabletrue
passestrue
2
name"Selvi"
dialogue"Mera naam Selvi hai. Maine wahan ghum rahi thi. Koi hamne aise sab nahi dekha. Kya wahan paisa diya gaya tha? Bilkul nahi."
detectedLang"fi"
heavyLang"sv"
scores
fi0.3854258121158911
tl0.37777777777777777
ms0.3288590604026846
vi0.308300395256917
et0.2639327024185068
sv0.24731182795698922
fr0.2290748898678414
lv0.21171171171171171
eu0.19075144508670522
en0.18887601390498263
ca0.18128654970760233
de0.17355371900826447
ro0.17355371900826447
nl0.14320685434516522
sq0.14320685434516522
da0.13793103448275862
it0.125
no0.11727616645649433
reliablefalse
passesfalse
3
name"Hunter"
dialogue"I'm sorry, I don't know what you're talking about. You said you saw someone there?"
detectedLang"en"
heavyLang"en"
scores
en0.8255813953488372
tl0.4094488188976378
de0.32950191570881227
pt0.3217054263565891
no0.3055555555555556
it0.2905405405405405
sq0.28765264586160105
sv0.284741144414169
cs0.2584745762711864
et0.25
da0.20933734939759033
hr0.20933734939759033
ca0.2081447963800905
is0.2033383915022762
pl0.1935483870967742
nl0.16267942583732056
ms0.16
ro0.14634146341463414
yo0.14215686274509806
es0.12935323383084577
sk0.12060301507537688
fr0.1191275167785235
be0.11764705882352942
tr0.11764705882352942
hu0.11317567567567569
az0.10714285714285714
lt0.10714285714285714
lv0.10714285714285714
uk0.10714285714285714
vi0.10714285714285714
reliabletrue
passestrue
4
name"Selvi"
dialogue"Hai. Maine unhein rukna tha. Maine unhein samjhaya ki mujhe aaram nahi chahiye. Par unhone muskuraya. Ha, muskuraya... aur fir wapas ghom kar gaye. Aapko lagta hai ki mainein sapna dekh rahi hoon."
detectedLang"fr"
heavyLang"tl"
scores
fr0.2885506287227002
lv0.2775537634408602
de0.23323823109843084
sl0.22326589595375723
tr0.2164723032069971
ms0.20781134856300662
tl0.20311341734618235
ro0.1899020346646571
en0.18683812405446293
hu0.18437025796661607
it0.18437025796661607
et0.18188736681887366
es0.1787624140565317
az0.17813455657492352
pt0.1724403387220939
sq0.17116422513492677
sv0.1647241647241647
yo0.1568627450980392
da0.13515687851971037
eu0.13306451612903225
fi0.13166397415185782
vi0.12743506493506493
ca0.12387938060309699
no0.09739714525608731
pl0.07883461868037703
lt0.06602953953084274
sk0.06602953953084274
nl0.06521739130434782
reliablefalse
passesfalse
5
name"Hunter"
dialogue"Okay, okay. Listen to me. Please. Tell me what you saw. Did they take him?"
detectedLang"en"
heavyLang"en"
scores
en0.8107971745711403
tl0.5753114382785957
no0.50199203187251
sl0.4798890429958391
da0.423963133640553
cs0.4204018547140649
fi0.41222570532915365
sq0.36006825938566556
lv0.3567753001715266
pl0.35008665511265163
nl0.34782608695652173
hr0.33745583038869253
sk0.33745583038869253
de0.3315508021390375
ms0.32915921288014316
es0.3055555555555556
sv0.3055555555555556
ro0.3029739776951673
fr0.29111531190926276
pt0.2870722433460076
it0.2704280155642024
yo0.267578125
eu0.2378048780487805
lt0.21711899791231734
et0.20212765957446807
hu0.1758241758241758
is0.15730337078651685
tr0.1515837104072398
reliabletrue
passestrue
6
name"Selvi"
dialogue"Mainein pohoch nahi paayi. Mainein bhaag gayi. Mainein ab bhi us ghumaaph mein hoon. Kripya aapko pata hai wo kahan gaye?"
detectedLang"de"
heavyLang"la"
scores
de0.42716857610474634
tl0.38757655293088367
en0.21612541993281076
sk0.2143658810325477
sq0.2054483541430193
fi0.2009132420091324
yo0.19447640966628307
eu0.19075144508670522
vi0.18319719953325553
ms0.16467780429594273
it0.125
fr0.11616161616161616
lv0.1116751269035533
cs0.10941475826972011
sv0.10025706940874037
tr0.10025706940874037
hr0.0979381443298969
sl0.0979381443298969
ca0.0967741935483871
es0.0967741935483871
pt0.0967741935483871
et0.09326424870466321
ro0.09326424870466321
reliablefalse
passesfalse
7
name"Hunter"
dialogue"I don't know. But I'm going to find out. You did the right thing coming here. Please, don't leave this cafe."
detectedLang"en"
heavyLang"en"
scores
en0.8323814253786939
tl0.6270718232044199
da0.46129289704708704
no0.424061433447099
fr0.3755781683626272
yo0.375
cs0.31749241658240646
sq0.3161094224924012
ro0.29906542056074764
nl0.291710388247639
pl0.27884615384615385
hr0.2741935483870968
ca0.2557883131201764
sv0.24242424242424243
it0.23642533936651583
sk0.23208191126279862
lv0.21511627906976746
lt0.1983372921615202
ms0.18772563176895307
de0.17982989064398544
sl0.1520100502512563
es0.13015463917525774
pt0.1222366710013004
be0.09395973154362416
tr0.09395973154362416
hu0.09029649595687331
az0.08536585365853659
et0.08536585365853659
is0.08536585365853659
uk0.08536585365853659
vi0.08536585365853659
reliabletrue
passestrue
8
name"Hunter"
dialogue"Hunter."
detectedLang"en"
heavyLang"de"
scores
en0.7797356828193832
de0.6376811594202898
da0.6212121212121212
no0.609375
fr0.5901639344262295
sv0.5833333333333334
tl0.5726495726495726
it0.5575221238938053
nl0.5575221238938053
pt0.5575221238938053
ca0.5412844036697247
ms0.5412844036697247
ro0.5412844036697247
sl0.5412844036697247
sq0.5412844036697247
tr0.5412844036697247
reliablefalse
passestrue
9
name"Selvi"
dialogue"Kripya kisi aur ko puchiye. Mainein yahan darna lag raha hai."
detectedLang"tl"
heavyLang"tl"
scores
tl0.5670995670995671
ro0.38366718027734975
sv0.358974358974359
ms0.3548387096774194
et0.3474714518760196
lv0.3453355155482815
sl0.3311036789297659
fi0.3055555555555556
no0.2982456140350877
nl0.2920353982300885
vi0.28186714542190305
de0.27140255009107467
yo0.24670433145009416
pl0.2263056092843327
eu0.2079207920792079
sq0.2079207920792079
it0.2
is0.19839679358717435
lt0.1919191919191919
fr0.18699186991869918
en0.18032786885245902
reliablefalse
passesfalse
10
name"Hunter"
dialogue"I have to go. I'm sorry. Keep your camera close to you. I'll be right back."
detectedLang"en"
heavyLang"en"
scores
en0.80083857442348
tl0.6829105473965288
yo0.5052083333333334
da0.49414270500532487
it0.4398584905660377
pl0.43720379146919436
lt0.42771084337349397
no0.40846824408468246
cs0.39797211660329534
hr0.3493150684931507
ro0.343015214384509
ca0.3356643356643356
de0.3338008415147265
sv0.31654676258992803
sk0.3004418262150221
lv0.2803030303030303
hu0.27921092564491656
zh0.2448330683624801
fr0.24000000000000002
ms0.24000000000000002
sq0.22003284072249588
sl0.2030201342281879
pt0.1739130434782609
es0.17247386759581881
nl0.13793103448275862
be0.12844036697247707
tr0.12844036697247707
az0.1171003717472119
et0.1171003717472119
is0.1171003717472119
uk0.1171003717472119
vi0.1171003717472119
reliabletrue
passestrue
11
name"Selvi"
dialogue"Kripya wapas aa jayein. Aapko koi zinda nahi milega."
detectedLang"es"
heavyLang"tl"
scores
es0.40476190476190477
is0.37395659432387307
pt0.36655405405405406
et0.3206521739130435
eu0.3055555555555556
no0.2378048780487805
sq0.21875
tr0.20886075949367086
ms0.19006479481641467
ca0.17218543046357618
en0.17218543046357618
sl0.17035398230088497
az0.1610738255033557
sv0.1610738255033557
tl0.1610738255033557
reliablefalse
passesfalse