Run: 2026-02-08-01KGYWWW9Z277YQZWEJW6DYS3Z

Run Details

Model:
Z.AI GLM 4.7
Test:
Language Writing
Scenario:
Character dialogue (Spanish) in a story
Duration:
52.3s
Cost:
$0.005057
Provider:
Nebius

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Maria"> Maria is a 30-year old college student on a study abroad program. Born in Spain, she is fluent in Spanish and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Spanish, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Maria is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Spanish, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Maria and Hunter as a voice sheet: Maria: "..." Hunter: "..."

Model response

AI
Maria: "No entiendo. ¿Me dice algo?" Hunter: "I'm Detective Hunter, Alborn Police Department. I need to ask you a few questions about Tuesday night. We received a report of a foreigner near the storage sheds by the fairgrounds." Maria: "Yo... yo solo estaba tomando fotos. Es un pueblo precioso. No hice nada malo." Hunter: "I'm not saying you did anything wrong, miss. But people are going missing. We need to account for everyone. Did you see anyone? A vehicle, maybe?" Maria: "Vi algo... algo extraño. Había una luz, y luego... un grito. Tuve miedo. Escondí mi cámara y corrí." Hunter: "A scream? You heard a scream near the apple orchards? Was it a man or a woman?" Maria: "No sé, estaba oscuro. Por favor, no me interrogue así. Soy solo una estudiante. Mi cámara... creo que tengo la prueba en la tarjeta de memoria." Hunter: "Camera? You have evidence on a camera? Ma'am, I need you to hand that over. I can't understand what you're saying, but if you have photos, show me." Maria: "¡No! Es mi equipo, es caro. No me da confianza. Usted parece muy enfadado." Hunter: "I'm not angry, I'm trying to do my job. Look, we're getting nowhere. Do you have a student visa? Some ID?" Maria: "Esto es una pesadilla. Nadie me entiende en este lugar. Solo quería ver los manzanos." Hunter: (Sighs and pinches the bridge of his nose) "Yeah, the apple festival brings 'em in every year. Just... stay there. Don't move." (Hunter’s phone rings loudly) Hunter: (Answers phone) "Hunter. ... Yeah? ... Are you serious? ... Alright, I’m on my way. Don't touch anything." Hunter: (Hangs up and looks at Maria) "I have to go. But stay put. Do not leave this cafe. We'll get a translator down here." Maria: "¿Se va? Pero yo no... ¡Esper!"
created_at"2026-02-08T15:11:58.242421+00:00" 2/8/2026, 3:11:58 PM
model"z-ai/glm-4.7-20251222"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency435
moderation_latency(null)
generation_time51823
tokens_prompt257
tokens_completion2429
native_tokens_prompt263
native_tokens_completion2476
native_tokens_completion_images(null)
native_tokens_reasoning2026
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0.0050572
router(null)
provider_responses
0
id"chatcmpl-a8f4db222e4212a9"
status200
is_byokfalse
latency435
endpoint_id"c2876732-9e69-4455-b537-663d3637f2af"
provider_name"Nebius"
model_permaslug"z-ai/glm-4.7-20251222"
api_type"completions"
id"gen-1770563465-5xVQGnp1GstKseW6DSWe"
upstream_id"chatcmpl-a8f4db222e4212a9"
total_cost0.0050572
cache_discount(null)
upstream_inference_cost0
provider_name"Nebius"

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Maria"
dialogue"No entiendo. ¿Me dice algo?"
detectedLang"es"
heavyLang"es"
scores
es0.8205128205128206
pt0.7576177285318559
it0.694055944055944
en0.6179039301310044
fr0.5901639344262295
ca0.5558375634517766
no0.5179063360881543
et0.49567723342939485
fi0.4868035190615836
nl0.4791666666666667
sq0.4582043343653251
lv0.4281045751633987
hr0.36594202898550726
sk0.34210526315789475
sl0.3346007604562738
tr0.3346007604562738
ms0.32432432432432434
tl0.3137254901960784
pl0.3
reliabletrue
passestrue
1
name"Hunter"
dialogue"I'm Detective Hunter, Alborn Police Department. I need to ask you a few questions about Tuesday night. We received a report of a foreigner near the storage sheds by the fairgrounds."
detectedLang"en"
heavyLang"en"
scores
en0.7969460688758935
tl0.649859943977591
fr0.5892211633256654
no0.5164410058027079
da0.5141857753595025
it0.485384932070811
ro0.4808970099667774
nl0.468763280917977
cs0.4653550042771599
ca0.45864010394110005
sv0.4351558969724356
sk0.41397093295827475
hr0.40702087286527516
pt0.4056110318592486
pl0.3929091792132103
de0.38695438940657184
sl0.3648373983739837
sq0.3632195618950586
yo0.358974358974359
es0.35064935064935066
lt0.2724097788125727
ms0.2568370986920333
hu0.2550655542312277
et0.24834636199639207
lv0.21580928481806777
az0.21383647798742136
is0.20331421287444232
tr0.1819371727748691
eu0.11598302687411598
fi0.10522548317823907
vi0.09616775126536516
be0.05303030303030303
uk0.04798172124904798
reliabletrue
passestrue
2
name"Maria"
dialogue"Yo... yo solo estaba tomando fotos. Es un pueblo precioso. No hice nada malo."
detectedLang"es"
heavyLang"es"
scores
es0.795786758383491
pt0.6638358103326256
ca0.6227164416203336
it0.6125611745513866
lv0.5709123757904245
en0.4186046511627907
hr0.40476190476190477
sk0.4032663316582915
tl0.4032663316582915
ro0.3886743886743887
de0.3683510638297872
sl0.34027777777777785
lt0.3300423131170663
fr0.3271954674220963
pl0.32239657631954355
sv0.3065693430656934
nl0.3055555555555556
yo0.29629629629629634
tr0.24960505529225907
no0.24722662440570525
eu0.19217687074829934
hu0.17677642980935876
cs0.12361623616236161
et0.1171003717472119
sq0.1171003717472119
az0.11048689138576778
da0.11048689138576778
reliabletrue
passestrue
3
name"Hunter"
dialogue"I'm not saying you did anything wrong, miss. But people are going missing. We need to account for everyone. Did you see anyone? A vehicle, maybe?"
detectedLang"en"
heavyLang"en"
scores
en0.830954169797145
tl0.6212121212121212
da0.34497816593886466
fr0.33969185619955977
et0.32685115931189235
no0.3181818181818182
ca0.3055555555555556
nl0.29467084639498436
ro0.2885375494071147
pl0.27594529364440873
cs0.2747784045124899
ms0.2730210016155089
it0.24686192468619247
pt0.24433249370277077
sk0.225473321858864
yo0.2214532871972318
tr0.22077922077922074
hr0.20212765957446807
is0.20141969831410825
vi0.199288256227758
sl0.1899189918991899
lv0.1758241758241758
lt0.1712707182320442
sq0.16044776119402984
sv0.1501416430594901
hu0.14772727272727273
fi0.13544668587896252
de0.13378248315688163
az0.13043478260869565
es0.12790697674418602
eu0.07216494845360825
reliabletrue
passestrue
4
name"Maria"
dialogue"Vi algo... algo extraño. Había una luz, y luego... un grito. Tuve miedo. Escondí mi cámara y corrí."
detectedLang"es"
heavyLang"es"
scores
es0.7911311053984575
pt0.5188749074759438
it0.5123780945236309
ca0.49961508852963815
fr0.4610281923714759
ro0.38679245283018865
tl0.344758064516129
sv0.2537313432835821
vi0.23349056603773585
yo0.22985781990521328
pl0.21968787515006
en0.2073170731707317
de0.20634920634920634
lv0.20440636474908203
sk0.1965389369592089
nl0.19154228855721395
cs0.18851435705368288
tr0.18648310387984982
da0.1792929292929293
no0.16237113402061853
sl0.12398921832884095
hu0.11564625850340135
hr0.10714285714285714
lt0.10468319559228649
reliabletrue
passestrue
5
name"Hunter"
dialogue"A scream? You heard a scream near the apple orchards? Was it a man or a woman?"
detectedLang"en"
heavyLang"en"
scores
en0.8010887772194305
tl0.6499631540162122
nl0.5287698412698413
fr0.5278330019880716
de0.5268924302788844
no0.46022727272727276
yo0.45023148148148145
da0.42702050663449936
sv0.4186046511627907
sq0.39258312020460356
es0.3741765480895916
cs0.3716931216931217
lv0.3572395128552098
ro0.3155619596541787
it0.30453879941434847
hr0.27811550151975684
lt0.27035330261136714
hu0.24722662440570525
fi0.2313915857605178
ms0.22889610389610393
pt0.22764227642276424
ca0.22258592471358432
sk0.21487603305785125
pl0.1810344827586207
sl0.1592920353982301
tr0.1394927536231884
is0.13636363636363635
az0.12844036697247707
eu0.12844036697247707
vi0.12844036697247707
et0.1171003717472119
reliabletrue
passestrue
6
name"Maria"
dialogue"No sé, estaba oscuro. Por favor, no me interrogue así. Soy solo una estudiante. Mi cámara... creo que tengo la prueba en la tarjeta de memoria."
detectedLang"es"
heavyLang"es"
scores
es0.799554565701559
ca0.6555683122847301
it0.6363636363636364
pt0.6357749898826386
fr0.5909090909090909
ro0.5027624309392266
tl0.4794679005205321
sq0.4746059544658494
no0.4708994708994709
en0.4371482176360225
nl0.3736951983298539
eu0.371946964410328
tr0.3648553281580804
sl0.3571428571428572
ms0.35344827586206895
sv0.3464052287581699
da0.3161094224924012
hr0.303405572755418
is0.2896606156274665
fi0.2862807295796987
yo0.2857142857142857
hu0.26769731489015464
sk0.26229508196721313
pl0.25
de0.20704845814977973
lv0.19427036705461057
et0.15492957746478872
cs0.1501416430594901
vi0.14040114613180515
az0.1262135922330097
lt0.07881269191402251
reliabletrue
passestrue
7
name"Hunter"
dialogue"Camera? You have evidence on a camera? Ma'am, I need you to hand that over. I can't understand what you're saying, but if you have photos, show me."
detectedLang"en"
heavyLang"en"
scores
en0.8061104582843713
tl0.5669291338582677
no0.5228455754771545
da0.5189504373177842
fr0.5074626865671642
nl0.5059880239520957
cs0.47982345523329134
sv0.45219123505976094
ca0.42827442827442824
pt0.42105263157894735
es0.40902578796561606
sk0.40860215053763443
it0.4043321299638989
ro0.39248895434462444
pl0.3902439024390244
et0.3838685586258402
de0.3726235741444867
yo0.3702290076335878
lv0.36244204018547144
hr0.35546874999999994
sq0.3378812199036918
sl0.3119266055045872
lt0.2850953206239168
tr0.27568042142230026
fi0.25876010781671155
hu0.21278625954198474
ms0.20977011494252876
is0.20443587270973965
hi0.16328600405679514
az0.13883089770354906
vi0.13883089770354906
be0.0782122905027933
eu0.0782122905027933
uk0.07094594594594594
reliabletrue
passestrue
8
name"Maria"
dialogue"¡No! Es mi equipo, es caro. No me da confianza. Usted parece muy enfadado."
detectedLang"es"
heavyLang"es"
scores
es0.7858431018935979
pt0.6650211565585332
it0.6172441579371474
ca0.5967741935483871
en0.5410628019323671
fr0.5301681503461919
ro0.4656917885264342
no0.42702050663449936
tr0.42284325637910086
lv0.4193154034229829
tl0.39258312020460356
sl0.38946015424164526
hr0.38471502590673573
eu0.3510928961748634
de0.32142857142857145
pl0.31259044862518093
lt0.2846385542168675
hu0.2824773413897281
et0.2803030303030303
da0.27811550151975684
sk0.2669753086419753
yo0.2554858934169279
fi0.24841772151898736
nl0.24603174603174602
sq0.2375601926163724
az0.18244406196213425
ms0.15026833631484796
cs0.14721723518850988
sv0.12037037037037036
vi0.1171003717472119
reliabletrue
passestrue
9
name"Hunter"
dialogue"I'm not angry, I'm trying to do my job. Look, we're getting nowhere. Do you have a student visa? Some ID?"
detectedLang"en"
heavyLang"en"
scores
en0.7943402435011517
tl0.5434623813002191
cs0.5290128108515448
da0.5
pl0.4947453516572352
sk0.49351701782820095
de0.4512730465320456
no0.44246208742194465
hr0.4404655326768129
pt0.4131455399061033
sq0.39379243452958296
sl0.3842364532019704
sv0.36740890688259115
it0.36676798378926034
ro0.3563336766220391
lt0.3543388429752066
lv0.35165975103734437
yo0.3482794577685088
nl0.3329775880469584
fr0.29218573046432617
ca0.2586002372479241
hu0.25595238095238093
vi0.22456575682382132
tr0.19871794871794873
ms0.19768934531450577
is0.1935483870967742
az0.1883116883116883
et0.17546174142480211
es0.17437252311756934
eu0.10071942446043164
fi0.09156976744186046
reliabletrue
passestrue
10
name"Maria"
dialogue"Esto es una pesadilla. Nadie me entiende en este lugar. Solo quería ver los manzanos."
detectedLang"es"
heavyLang"es"
scores
es0.8036006546644845
pt0.6141479099678457
ca0.588477366255144
it0.5405819295558958
fr0.48497854077253216
nl0.4614003590664273
tl0.4296577946768061
no0.4094488188976378
de0.3963782696177062
fi0.3795243019648397
is0.3710691823899371
da0.36575052854122625
sv0.3485342019543974
sq0.3333333333333333
et0.3135011441647597
ro0.28741092636579574
sl0.2857142857142857
lv0.2673992673992674
ms0.24242424242424243
hu0.23857868020304565
en0.22978177150192552
sk0.21363040629095675
eu0.2125984251968504
tr0.15492957746478872
lt0.13169319826338638
az0.11504424778761062
cs0.1137370753323486
hr0.1137370753323486
yo0.1137370753323486
reliabletrue
passestrue
11
name"Hunter"
dialogue"Yeah, the apple festival brings 'em in every year. Just... stay there. Don't move."
detectedLang"en"
heavyLang"en"
scores
en0.800304298212248
de0.5823389021479713
tl0.56575682382134
sv0.5434782608695653
nl0.5253164556962026
it0.4491080797481637
fr0.44678609062170704
da0.43910256410256415
es0.43790149892933616
no0.40273037542662116
sl0.3937644341801385
ms0.38739789964994165
sq0.3526510480887793
ca0.3502475247524753
hr0.34375
pt0.34375
ro0.3312101910828026
et0.29906542056074764
sk0.29340511440107675
az0.2778541953232462
yo0.27083333333333337
cs0.26264044943820225
pl0.21875
lt0.1935483870967742
is0.1435562805872757
hu0.11317567567567569
fi0.10714285714285714
lv0.10714285714285714
reliabletrue
passestrue
12
name"Hunter"
dialogue"Hunter. ... Yeah? ... Are you serious? ... Alright, I’m on my way. Don't touch anything."
detectedLang"en"
heavyLang"en"
scores
en0.8065585851142225
tl0.6156661786237189
fr0.4479495268138801
cs0.362089914945322
ro0.3453865336658354
pl0.31282722513089006
sq0.3009320905459388
ca0.3
de0.3
no0.29718875502008035
sk0.2953020134228188
da0.29435483870967744
ms0.2827868852459016
et0.22680412371134018
fi0.2222222222222222
yo0.22106824925816024
hr0.21875
sv0.20694864048338368
it0.20212765957446807
pt0.1984732824427481
nl0.1935483870967742
sl0.18351477449455675
tr0.18351477449455675
hu0.1435562805872757
hi0.13793103448275862
es0.11317567567567569
az0.10102739726027396
lt0.10102739726027396
reliabletrue
passestrue
13
name"Hunter"
dialogue"I have to go. But stay put. Do not leave this cafe. We'll get a translator down here."
detectedLang"en"
heavyLang"en"
scores
en0.8079608938547486
pl0.5782208588957055
hr0.5723172628304821
tl0.5592948717948718
da0.5158450704225351
sq0.5089285714285715
cs0.5045045045045045
sk0.4902687673772011
yo0.4751908396946565
sl0.45054945054945056
no0.44889779559118237
pt0.4427558257345492
ro0.4148936170212766
ca0.38820912124582874
vi0.3764172335600907
lv0.3692660550458715
sv0.3685419058553387
lt0.3648960739030023
it0.3552168815943728
tr0.3436754176610978
fr0.3413173652694611
et0.30904522613065327
is0.30203045685279184
hu0.28848641655886154
es0.2753623188405797
de0.26764314247669774
nl0.26666666666666666
az0.25876010781671155
ms0.24965893587994542
eu0.19941775836972345
be0.11290322580645161
fi0.10277324632952692
uk0.10277324632952692
reliabletrue
passestrue
14
name"Maria"
dialogue"¿Se va? Pero yo no... ¡Esper!"
detectedLang"es"
heavyLang"es"
scores
es0.8099891422366994
ca0.7384155455904334
tl0.691358024691358
pt0.6788990825688073
it0.6704331450094161
ro0.5949074074074074
no0.5823389021479713
hr0.5721271393643031
fr0.5489690721649484
da0.5442708333333333
yo0.5345744680851064
en0.515235457063712
cs0.4372990353697749
sl0.4299674267100977
lv0.4281045751633987
sq0.3902439024390244
eu0.37275985663082434
fi0.36823104693140796
sk0.34210526315789475
tr0.3346007604562738
sv0.32950191570881227
pl0.3
reliabletrue
passestrue