Run: 2026-02-08-01KGYZW2ZKFG1TP60S7NRRB7PN

Run Details

Model:
Z.AI GLM 4.7
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
57.7s
Cost:
$0.005262
Provider:
Z.AI

Evaluation summary

Score Evaluator
Details Link
58.33% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
**Selvi:** "(In Hindi, looking up from her camera lens, confusion evident) *Namaste. Kya aap mujhe jaante hain?*" **Hunter:** "Excuse me, miss. I'm Detective Hunter. I'm investigating the incident during the apple festival a few nights ago. I was told you might have been in the area near the orchards." **Selvi:** "(In Hindi, her expression turning troubled) *Alborn police? Main koi galat nahi kiya. Main bas photos le rahi thi. Mujhe dar lag raha hai.*" **Hunter:** "(Frowning slightly) Ma'am, I can see you're upset, but I need to know if you saw anyone suspicious. A man, maybe? Or a vehicle?" **Selvi:** "(In Hindi, trembling and clutching her camera tighter) *Nahi, main samajh nahi pa rahi. Aap English bol rahe hain. Maine dekha... ek gaadi theehi gaadi ke peeche. Ek ladki thi.*" **Hunter:** "(Glancing at her camera) Look, I don't want to take up your time. Did you get any photos of this... vehicle? If you have pictures, that would help a lot." **Selvi:** "(In Hindi, voice rising in panic) *Haan! Yahan memory card mein hai. Par main unhe nahi dikhana chahti. Woh log dangerous hain. Kripya mujhe jaane dijiye.*" **Hunter:** "(Holding up a hand) Whoa, slow down. I'm not following you. 'Memori card'? Is that memory? You have a memory card?" **Selvi:** "(In Hindi, nodding frantically and looking around the café) *Haan, maine sab capture kiya hai. Par aap mujhe surakshit nahi kar sakte. Mujhe yahan se jana chahiye.*" **Hunter:** "(Sighs, frustrated by the language barrier) Alright, just... stay here. Don't leave town. I'll find someone to translate." **Hunter:** "(His phone rings sharply; he checks the screen) Detective Hunter... Yeah? I'm on my way." **Hunter:** "(To Selvi, gesturing firmly to the chair) Sit. Stay. I'll be back."
created_at"2026-02-08T16:04:03.759904+00:00" 2/8/2026, 4:04:03 PM
model"z-ai/glm-4.7-20251222"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency2280
moderation_latency(null)
generation_time57615
tokens_prompt262
tokens_completion2334
native_tokens_prompt268
native_tokens_completion2378
native_tokens_completion_images(null)
native_tokens_reasoning1880
native_tokens_cached266
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0.00526206
router(null)
provider_responses
0
id"202602090003053f48168e478c4986"
status200
is_byokfalse
latency2280
endpoint_id"be4acbf5-9fcf-4332-a01d-76dfeb6d7b99"
provider_name"Z.AI"
model_permaslug"z-ai/glm-4.7-20251222"
api_type"completions"
id"gen-1770566585-WG94DEQTsVdapYMttG6i"
upstream_id"202602090003053f48168e478c4986"
total_cost0.00526206
cache_discount0.00013034
upstream_inference_cost0
provider_name"Z.AI"

Evaluation details

Result Evaluator Details Meta Data
58.33% Parse dialogue n/a
dialogue
0
name"Selvi"
dialogue"Namaste. Kya aap mujhe jaante hain?"
detectedLang"tl"
heavyLang"id"
scores
tl0.5222929936305732
et0.5098039215686274
fr0.43467336683417085
ro0.4201030927835051
sq0.4155844155844156
no0.412532637075718
eu0.38016528925619836
pt0.35344827586206895
es0.3515850144092219
it0.34971098265895956
sv0.3119266055045872
de0.26229508196721313
az0.25742574257425743
lt0.25742574257425743
da0.23469387755102045
en0.23469387755102045
hr0.23469387755102045
nl0.23469387755102045
sl0.23469387755102045
reliablefalse
passesfalse
1
name"Hunter"
dialogue"Excuse me, miss. I'm Detective Hunter. I'm investigating the incident during the apple festival a few nights ago. I was told you might have been in the area near the orchards."
detectedLang"en"
heavyLang"en"
scores
en0.7943156320119671
tl0.6504607562758182
nl0.5897053338306601
fr0.5757809487080602
it0.5641838351822505
no0.5497339336880884
ro0.5476973684210527
da0.5429995845450768
de0.5389773679798826
sv0.4986326344576117
pt0.497716894977169
ca0.49564419990829894
es0.4850187265917603
sq0.46341463414634143
sl0.45
cs0.4300518134715026
ms0.416135881104034
hr0.4155154091392136
et0.3533215755437978
az0.35217903415783275
sk0.34795494961470064
yo0.3381468110709988
lt0.3357487922705314
pl0.289405684754522
hu0.24085576259489305
is0.2005813953488372
lv0.19472913616398244
fi0.19117647058823528
tr0.15773353751914243
vi0.10786699107866991
be0.05982905982905983
eu0.05982905982905983
uk0.05417024935511608
reliabletrue
passestrue
2
name"Selvi"
dialogue"Alborn police? Main koi galat nahi kiya. Main bas photos le rahi thi. Mujhe dar lag raha hai."
detectedLang"fr"
heavyLang"vi"
scores
fr0.5641838351822505
ro0.5084897229669348
es0.44612286002014095
en0.4421906693711968
it0.42767950052029136
tl0.4270833333333333
vi0.36194895591647336
de0.3574766355140187
et0.35672514619883045
lt0.3475682087781732
sl0.3365500603136309
eu0.32014833127317677
ms0.3193069306930693
sv0.3184634448574969
pt0.3064312736443884
lv0.3002544529262086
nl0.298469387755102
ca0.2838541666666667
no0.2537313432835821
cs0.2486338797814208
hu0.2392807745504841
hr0.233983286908078
sk0.22206506364922204
tr0.2109038737446198
yo0.18154761904761904
da0.140625
pl0.13793103448275862
fi0.13249211356466878
sq0.12974683544303797
hi0.12280701754385964
az0.12
reliablefalse
passesfalse
3
name"Hunter"
dialogue"Ma'am, I can see you're upset, but I need to know if you saw anyone suspicious. A man, maybe? Or a vehicle?"
detectedLang"en"
heavyLang"en"
scores
en0.7919143876337693
tl0.5569620253164557
ca0.46605644546147984
cs0.38917975567190227
da0.38811188811188807
fr0.38757655293088367
et0.38325991189427316
sv0.3794326241134752
no0.3738819320214669
ro0.3607305936073059
hr0.3439550140581068
pl0.3433395872420263
lv0.34148635936030103
lt0.3288590604026846
yo0.3288590604026846
sk0.3230174081237911
hu0.3076162215628091
it0.25531914893617025
ms0.25133689839572193
pt0.2456896551724138
tr0.24242424242424243
sl0.23161361141602635
az0.23076923076923078
sq0.2273730684326711
es0.22566371681415928
de0.2072480181200453
nl0.19540229885057472
fi0.1935483870967742
is0.16467780429594273
vi0.15966386554621848
be0.09090909090909091
eu0.09090909090909091
uk0.08256880733944955
reliabletrue
passestrue
4
name"Selvi"
dialogue"Nahi, main samajh nahi pa rahi. Aap English bol rahe hain. Maine dekha... ek gaadi theehi gaadi ke peeche. Ek ladki thi."
detectedLang"en"
heavyLang"tl"
scores
en0.4130434782608695
et0.3626062322946175
ro0.32432432432432434
tl0.32432432432432434
eu0.3098159509202454
de0.3055555555555556
fr0.3048403707518023
lv0.30124223602484473
ms0.29540709812108557
fi0.2834394904458599
yo0.22055427251732102
no0.21236872812135354
hr0.21052631578947367
da0.18967587034813926
vi0.18674698795180722
sv0.1837968561064087
sl0.1818181818181818
sk0.17982989064398544
tr0.1423125794155019
sq0.1357234314980794
cs0.13239074550128535
is0.13127413127413126
nl0.12903225806451613
lt0.10949868073878628
reliablefalse
passesfalse
5
name"Hunter"
dialogue"Look, I don't want to take up your time. Did you get any photos of this... vehicle? If you have pictures, that would help a lot."
detectedLang"en"
heavyLang"en"
scores
en0.8357354811360747
tl0.6077935222672065
ca0.5189323401613904
da0.4400289017341041
fr0.4276218611521418
no0.4216417910447761
nl0.413767019667171
ro0.3719611021069692
yo0.3704305442729488
hr0.367862969004894
cs0.36527436527436524
lv0.34543918918918914
sv0.32491289198606277
pl0.32077125328659073
sk0.3011722272317403
lt0.29800724637681164
is0.29673321234119787
pt0.28174235403151066
de0.2743445692883895
sl0.2716165413533835
it0.23645320197044337
et0.22422422422422422
hu0.22344689378757512
es0.21479229989868287
sq0.20998980632008157
tr0.1594360086767896
ms0.15393013100436684
az0.14647577092511013
vi0.14647577092511013
hi0.0903755868544601
be0.08284023668639054
eu0.08284023668639054
fi0.07517899761336516
uk0.07517899761336516
reliabletrue
passestrue
6
name"Selvi"
dialogue"Haan! Yahan memory card mein hai. Par main unhe nahi dikhana chahti. Woh log dangerous hain. Kripya mujhe jaane dijiye."
detectedLang"en"
heavyLang"pt"
scores
en0.4780793319415449
ms0.36224489795918363
fr0.29245283018867924
tl0.2890995260663507
eu0.2877492877492877
et0.24471299093655588
de0.21301154249737672
fi0.21052631578947367
sq0.19268030139935413
it0.1883116883116883
vi0.1730981256890849
lv0.1712707182320442
yo0.11764705882352942
da0.11032028469750889
sv0.11032028469750889
lt0.10501193317422433
es0.08980582524271845
ro0.08980582524271845
reliablefalse
passesfalse
7
name"Hunter"
dialogue"Whoa, slow down. I'm not following you. 'Memori card'? Is that memory? You have a memory card?"
detectedLang"en"
heavyLang"en"
scores
en0.7986577181208053
tl0.6014171833480957
hu0.40789473684210525
nl0.40554821664464996
it0.38101788170563966
yo0.34687953555878087
da0.3273542600896861
ro0.3212669683257918
cs0.3181818181818182
es0.31402439024390244
is0.2706645056726094
tr0.256198347107438
ms0.24496644295302009
sq0.24496644295302009
pt0.23728813559322032
ca0.23208191126279862
sk0.22413793103448276
fr0.20634920634920634
hr0.199288256227758
pl0.1891891891891892
sl0.16666666666666666
lt0.15413533834586465
az0.1346153846153846
eu0.1346153846153846
lv0.1346153846153846
no0.1346153846153846
vi0.1346153846153846
de0.12959381044487428
et0.12280701754385964
fi0.12280701754385964
sv0.12280701754385964
reliabletrue
passestrue
8
name"Selvi"
dialogue"Haan, maine sab capture kiya hai. Par aap mujhe surakshit nahi kar sakte. Mujhe yahan se jana chahiye."
detectedLang"fr"
heavyLang"tl"
scores
fr0.5094191522762952
sq0.4349005424954792
sl0.3705941591137966
en0.36224489795918363
fi0.3609406952965235
hr0.3372216330858961
de0.3315508021390375
tl0.31917211328976036
it0.31167400881057267
ro0.29932735426008966
da0.2945823927765237
lv0.2799539170506913
cs0.27829099307159355
ms0.2707117852975496
es0.24789410348977134
pt0.2378048780487805
sv0.22263681592039805
yo0.22166874221668745
ca0.21580928481806777
eu0.20886075949367086
et0.20685279187817257
vi0.20076726342711
no0.19458762886597938
nl0.13793103448275862
tr0.13793103448275862
lt0.11095305832147938
reliablefalse
passesfalse
9
name"Hunter"
dialogue"Alright, just... stay here. Don't leave town. I'll find someone to translate."
detectedLang"en"
heavyLang"en"
scores
en0.8000888494002666
da0.43109987357774965
tl0.42084942084942084
no0.4163424124513619
hr0.36079545454545453
yo0.31921331316187596
pl0.31297709923664124
sk0.3023255813953488
cs0.296875
lv0.29577464788732394
sl0.2857142857142857
sq0.27652733118971057
lt0.2753623188405797
ro0.2706645056726094
et0.26350245499181674
sv0.26350245499181674
pt0.2598684210526316
es0.256198347107438
fr0.2549668874172185
ca0.2524916943521595
de0.23857868020304565
it0.23469387755102045
vi0.16356877323420074
eu0.12959381044487428
nl0.12280701754385964
tr0.12280701754385964
az0.11591355599214145
ms0.11591355599214145
reliabletrue
passestrue
10
name"Hunter"
dialogue"Detective Hunter... Yeah? I'm on my way."
detectedLang"en"
heavyLang"en"
scores
en0.7950819672131147
tl0.6453900709219859
fr0.5993589743589743
ca0.5748299319727891
ro0.5543672014260249
it0.48559670781893005
cs0.48240165631469983
pt0.48240165631469983
es0.41588785046728977
pl0.4131455399061033
de0.4075829383886255
da0.39903846153846156
sk0.39172749391727496
no0.3872549019607844
hr0.38271604938271603
et0.3811881188118812
sq0.37810945273631835
fi0.375
nl0.3670886075949367
sv0.3540051679586563
sl0.33510638297872336
hi0.251497005988024
yo0.23076923076923078
ms0.19093851132686085
tr0.19093851132686085
reliabletrue
passestrue
11
name"Hunter"
dialogue"Sit. Stay. I'll be back."
detectedLang"en"
heavyLang"en"
scores
en0.7524752475247525
da0.5098039215686274
hu0.4834710743801653
lt0.47257383966244726
yo0.46808510638297873
no0.4444444444444444
tl0.4444444444444444
reliabletrue
passestrue