Run: 2026-02-08-01KGZ06TVHHRC6RSZ8ABXVHHBY

Run Details

Model:
Z.AI GLM 4.7 Flash
Test:
Language Writing
Scenario:
Character dialogue (Italian) in a story
Duration:
1m 31s
Cost:
$0.001745
Provider:
DeepInfra

Evaluation summary

Score Evaluator
Details Link
95.24% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Isabella"> Isabella is a 30-year old college student on a study abroad program. Born in Italy, she is fluent in Italian and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Italian, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Isabella is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Italian, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Isabella and Hunter as a voice sheet: Isabella: "..." Hunter: "..."

Model response

AI
Hunter: "Excuse me, miss? Can I ask you a few questions?" Isabella: (In Italian, gesturing frantically) "Non capisco. Lui era lì. L'uomo... è scomparso." Hunter: "Excuse me? I don't speak Italian." Isabella: (In Italian) "Lo so! Ma tu... tu non andarci. È pericoloso." Hunter: "Wait, you understand me? You speak English?" Isabella: (Shaking head no, voice trembling) "No. ...Inglese. Mai sentito prima." Hunter: "Okay, okay. Look, you look shaken. Did you see something happen near the old mill? We're looking for someone." Isabella: (In Italian) "Il mulino... sì. C'era qualcuno che fissava la casa. Occhi bianchi. Molto orribile." Hunter: "A white-eyed man? Can you describe him?" Isabella: (Points to camera) "Foto. Guarda foto. Non... non vivo." Hunter: "The photos? What's wrong with the photos?" Isabella: (In Italian) "Tu vedi? Lui osserva noi. Ormai... troppo tardi." Hunter: "Miss, this is terrifying. Is he still near here?" Isabella: (Holds up camera defensively, shakes head no) "No. Corre. Via." Hunter: "Alright, listen to me. Do you have a phone?" Isabella: (Shrugs, looks confused) Hunter: "Okay. Just... stay here until I get backup." Isabella: (In Italian) "Non tornare indietro. Prendi l'auto. Corri." Hunter: "I have to go. I'm getting a call." (Pulls radio to ear) Hunter: "Hunter speaking. Yeah, I found the foreign student. Send another unit to the coffee shop, now." Hunter: "I have to go. Keep your eyes open." Isabella: (Whispers in Italian) "La quiete... non era mai qui."
created_at"2026-02-08T16:10:28.93794+00:00" 2/8/2026, 4:10:28 PM
model"z-ai/glm-4.7-flash-20260119"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency232
moderation_latency(null)
generation_time90699
tokens_prompt261
tokens_completion4241
native_tokens_prompt268
native_tokens_completion4331
native_tokens_completion_images(null)
native_tokens_reasoning4198
native_tokens_cached64
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0.0017452800000128
router(null)
provider_responses
0
id"chatcmpl-REVfdhavMTQFS8FfhQOegzy6"
status200
is_byokfalse
latency54
endpoint_id"6efb5994-8fcb-4300-9c64-ba393193f5f6"
provider_name"DeepInfra"
model_permaslug"z-ai/glm-4.7-flash-20260119"
api_type"completions"
id"gen-1770566937-YxPyzB1LMiXbj3gya4je"
upstream_id"chatcmpl-REVfdhavMTQFS8FfhQOegzy6"
total_cost0.0017452800000128
cache_discount0.0000031999999872
upstream_inference_cost0
provider_name"DeepInfra"

Evaluation details

Result Evaluator Details Meta Data
95.24% Parse dialogue n/a
dialogue
0
name"Hunter"
dialogue"Excuse me, miss? Can I ask you a few questions?"
detectedLang"en"
heavyLang"en"
scores
en0.7939124920735574
fr0.6311010215664017
it0.6281464530892449
ca0.6026894865525673
tl0.5695364238410596
pt0.5529573590096286
sq0.5213549337260678
cs0.4921875
es0.4881889763779528
no0.48494453248811414
nl0.43868739205526774
hr0.4357638888888889
pl0.41546762589928055
ro0.4133574007220217
tr0.4080145719489982
hu0.40693430656934304
et0.40476190476190477
da0.39365671641791045
az0.3925233644859813
yo0.3879472693032015
sk0.38330170777988615
sv0.3821292775665399
sl0.3538767395626242
ms0.3114406779661017
lt0.30851063829787234
fi0.29805615550755943
is0.29805615550755943
lv0.2903930131004367
vi0.2903930131004367
be0.17721518987341772
eu0.17721518987341772
de0.1709183673469388
uk0.16237113402061853
reliabletrue
passestrue
1
name"Isabella"
dialogue"Non capisco. Lui era lì. L'uomo... è scomparso."
detectedLang"it"
heavyLang"it"
scores
it0.8040496407576747
ro0.5176848874598071
fr0.5081967213114754
pt0.48186528497409326
es0.4800693240901213
ca0.46808510638297873
tl0.45750452079566006
en0.45155393053016457
yo0.4163424124513619
eu0.3684210526315789
ms0.1935483870967742
reliabletrue
passestrue
2
name"Hunter"
dialogue"Excuse me? I don't speak Italian."
detectedLang"en"
heavyLang"en"
scores
en0.7589199614271939
sq0.6318114874815906
no0.5446265938069217
it0.5291902071563088
tl0.5088408644400786
ro0.4908350305498982
ms0.4834710743801653
fi0.4553376906318083
da0.44196428571428575
hr0.44196428571428575
sv0.44071588366890374
es0.39759036144578314
cs0.3961352657004831
et0.3872549019607844
sl0.3872549019607844
yo0.3857493857493857
fr0.3811881188118812
nl0.37027707808564225
pt0.37027707808564225
ca0.3556701030927836
tr0.3403693931398417
lt0.33510638297872336
pl0.33510638297872336
az0.32795698924731176
sk0.22360248447204967
be0.21875
hu0.21135646687697163
de0.20127795527156547
is0.20127795527156547
lv0.20127795527156547
uk0.20127795527156547
vi0.20127795527156547
reliabletrue
passestrue
3
name"Isabella"
dialogue"Lo so! Ma tu... tu non andarci. È pericoloso."
detectedLang"it"
heavyLang"it"
scores
it0.8018731988472623
yo0.6352785145888594
ca0.5807926829268293
es0.5703125
fr0.5476973684210527
ro0.5462046204620462
sk0.5027124773960217
en0.49817518248175185
vi0.49355432780847147
hr0.4701348747591522
tl0.4607843137254902
pt0.45972495088408644
sl0.44779116465863456
sq0.4294605809128631
lt0.416135881104034
pl0.4073275862068965
et0.3663594470046083
no0.3648960739030023
ms0.3483412322274882
lv0.33894230769230765
de0.30730478589420657
eu0.2403314917127072
cs0.23611111111111113
hu0.22969187675070027
fi0.20289855072463767
da0.1863905325443787
nl0.1863905325443787
sv0.1863905325443787
tr0.17664670658682635
reliabletrue
passestrue
4
name"Hunter"
dialogue"Wait, you understand me? You speak English?"
detectedLang"en"
heavyLang"en"
scores
en0.8065015479876162
no0.6527777777777778
da0.5987158908507223
sv0.5309568480300189
de0.5145631067961165
nl0.51171875
tl0.497991967871486
cs0.39320388349514557
ms0.3842364532019704
sq0.3718592964824121
ro0.3686868686868687
es0.28977272727272724
et0.2753623188405797
fr0.2668621700879765
sk0.2625368731563422
pt0.26035502958579887
sl0.26035502958579887
it0.24242424242424243
pl0.2378048780487805
fi0.23076923076923078
is0.22839506172839508
hr0.22360248447204967
reliabletrue
passestrue
5
name"Isabella"
dialogue"No. ...Inglese. Mai sentito prima."
detectedLang"it"
heavyLang"it"
scores
it0.797979797979798
ro0.6753246753246753
ca0.6694214876033058
es0.658703071672355
pt0.6557659208261618
hr0.5876288659793815
no0.576271186440678
en0.5391705069124424
tr0.5121951219512195
tl0.5024875621890548
ms0.4910941475826972
et0.44598337950138506
fr0.4350282485875706
sk0.4350282485875706
lv0.3957703927492447
yo0.375
vi0.3127147766323024
eu0.29577464788732394
sl0.29577464788732394
nl0.2727272727272727
pl0.2727272727272727
az0.23954372623574144
cs0.23954372623574144
fi0.23954372623574144
lt0.23954372623574144
da0.2277992277992278
de0.2277992277992278
sq0.2277992277992278
reliabletrue
passestrue
6
name"Hunter"
dialogue"Okay, okay. Look, you look shaken. Did you see something happen near the old mill? We're looking for someone."
detectedLang"en"
heavyLang"en"
scores
en0.8140635564570656
tl0.6177901320361362
no0.49308755760368667
nl0.4270833333333333
sv0.3799323562570462
da0.3721461187214612
pt0.29936305732484075
et0.23611111111111113
de0.23504867872044508
ms0.22096317280453256
fr0.21316165951359084
yo0.1628614916286149
hu0.14596273291925466
cs0.12420382165605094
es0.12420382165605094
sq0.12420382165605094
is0.1143317230273752
reliabletrue
passestrue
7
name"Isabella"
dialogue"Il mulino... sì. C'era qualcuno che fissava la casa. Occhi bianchi. Molto orribile."
detectedLang"it"
heavyLang"it"
scores
it0.8121528912120222
ca0.5740740740740741
fr0.4884341637010676
ro0.47679708826205647
pt0.451858913250715
es0.4306930693069307
tl0.35825892857142855
yo0.31137724550898205
ms0.2353723404255319
no0.2353723404255319
en0.222972972972973
de0.21555252387448842
az0.16666666666666666
da0.16058394160583941
tr0.1274658573596358
vi0.1274658573596358
sq0.11944869831546708
lt0.11674347158218126
hr0.11402157164869028
sl0.11402157164869028
reliabletrue
passestrue
8
name"Hunter"
dialogue"A white-eyed man? Can you describe him?"
detectedLang"en"
heavyLang"en"
scores
en0.8080949057920448
es0.6126760563380281
ca0.533106960950764
tl0.4731800766283525
pt0.46911196911196906
ro0.46808510638297873
cs0.43298969072164945
da0.4222689075630252
it0.41983122362869196
fr0.40987124463519314
sv0.40860215053763443
de0.39956331877729256
lv0.39293598233995586
lt0.3902439024390244
nl0.3820224719101124
no0.3735763097949886
hu0.36194895591647336
tr0.358974358974359
az0.3483412322274882
sk0.32098765432098764
yo0.30203045685279184
hr0.289405684754522
pl0.2763157894736842
sl0.24657534246575344
is0.21428571428571427
sq0.207492795389049
eu0.20289855072463767
vi0.20289855072463767
et0.1863905325443787
fi0.1863905325443787
ms0.1863905325443787
reliabletrue
passestrue
9
name"Isabella"
dialogue"Foto. Guarda foto. Non... non vivo."
detectedLang"it"
heavyLang"it"
scores
it0.7596153846153846
pt0.7171945701357465
es0.6603260869565218
ca0.6345029239766081
en0.5860927152317881
tl0.5437956204379563
hr0.5155038759689923
tr0.49186991869918695
az0.46808510638297873
fr0.45652173913043476
eu0.410377358490566
no0.3961352657004831
sl0.3811881188118812
sk0.375
da0.358974358974359
de0.33510638297872336
lv0.33510638297872336
nl0.33510638297872336
pl0.33510638297872336
ro0.33510638297872336
cs0.3206521739130435
et0.3206521739130435
reliabletrue
passestrue
10
name"Hunter"
dialogue"The photos? What's wrong with the photos?"
detectedLang"en"
heavyLang"en"
scores
en0.8244073748902546
tl0.6376811594202898
fr0.5652173913043478
ms0.5485327313769752
nl0.43661971830985913
vi0.4350282485875706
yo0.3485342019543974
no0.3220338983050847
es0.2857142857142857
lt0.2857142857142857
pt0.2857142857142857
da0.2805755395683453
sq0.2805755395683453
sv0.2805755395683453
hi0.2779783393501805
ca0.26199261992619927
de0.26199261992619927
lv0.26199261992619927
reliabletrue
passestrue
11
name"Isabella"
dialogue"Tu vedi? Lui osserva noi. Ormai... troppo tardi."
detectedLang"it"
heavyLang"it"
scores
it0.7878359264497878
ro0.53198127925117
es0.5137763371150729
fr0.4845360824742268
ca0.4392523364485981
pt0.35344827586206895
hr0.35064935064935066
sq0.3181818181818182
tr0.25
sk0.23076923076923078
cs0.22077922077922074
lv0.21465968586387435
pl0.21465968586387435
et0.20424403183023873
de0.2
no0.2
tl0.2
lt0.1935483870967742
sl0.1935483870967742
reliabletrue
passestrue
12
name"Hunter"
dialogue"Miss, this is terrifying. Is he still near here?"
detectedLang"en"
heavyLang"en"
scores
en0.8155600268276324
tl0.576923076923077
nl0.5158450704225351
sq0.47115384615384615
is0.462890625
yo0.44668008048289737
hu0.4410569105691057
sv0.43064182194616984
ca0.3806306306306307
es0.358974358974359
da0.3544600938967136
no0.3544600938967136
fi0.3529411764705882
it0.34523809523809523
de0.32098765432098764
fr0.21428571428571427
pt0.207492795389049
hr0.19590643274853803
lt0.19590643274853803
lv0.19590643274853803
az0.1863905325443787
et0.1863905325443787
pl0.17664670658682635
reliabletrue
passestrue
13
name"Isabella"
dialogue"No. Corre. Via."
detectedLang"pt"
heavyLang"es"
scores
pt0.8
ca0.7950819672131147
it0.7854077253218884
es0.7607655502392344
en0.7245179063360881
no0.6268656716417911
nl0.6197718631178707
fr0.6047430830039525
tl0.6031746031746031
lv0.5670995670995671
hr0.5024875621890548
sk0.47643979057591623
tr0.46808510638297873
sv0.4444444444444444
pl0.42857142857142855
da0.4152046783625731
reliabletrue
passesfalse
14
name"Hunter"
dialogue"Alright, listen to me. Do you have a phone?"
detectedLang"en"
heavyLang"en"
scores
en0.7945205479452054
da0.6822033898305085
cs0.6415770609318996
no0.635036496350365
sl0.6143958868894601
tl0.6119016817593791
sk0.601593625498008
pl0.6
pt0.5983935742971888
fr0.588477366255144
hr0.5850622406639004
yo0.576271186440678
de0.5726495726495726
sq0.5714285714285714
nl0.5348837209302325
fi0.5207667731629393
vi0.511400651465798
es0.49748743718592964
lv0.4809688581314879
it0.46808510638297873
hu0.44029850746268656
sv0.4318181818181818
ro0.402390438247012
eu0.3839835728952772
lt0.38271604938271603
et0.34497816593886466
ms0.3288590604026846
is0.3258426966292135
tr0.32432432432432434
ca0.3119266055045872
az0.1891891891891892
reliabletrue
passestrue
15
name"Hunter"
dialogue"Okay. Just... stay here until I get backup."
detectedLang"en"
heavyLang"en"
scores
en0.7870528109028961
sv0.584717607973422
ca0.5378927911275416
sq0.4834710743801653
no0.4692144373673036
tl0.4186046511627907
et0.39759036144578314
is0.3946731234866829
da0.3573264781491003
hr0.3573264781491003
pl0.33510638297872336
it0.3150684931506849
cs0.29577464788732394
ro0.2647058823529412
yo0.258160237388724
es0.2331288343558282
pt0.2331288343558282
sk0.22360248447204967
be0.21875
tr0.21875
hu0.21135646687697163
az0.20127795527156547
lt0.20127795527156547
lv0.20127795527156547
uk0.20127795527156547
vi0.20127795527156547
reliabletrue
passestrue
16
name"Isabella"
dialogue"Non tornare indietro. Prendi l'auto. Corri."
detectedLang"it"
heavyLang"it"
scores
it0.7766195085629188
ca0.6319018404907976
fr0.604221635883905
es0.5873452544704264
pt0.5821727019498607
sq0.5260663507109005
tl0.4915254237288135
en0.4633273703041145
tr0.44547134935304994
et0.4434137291280148
eu0.4263862332695985
hr0.4163424124513619
lt0.4129158512720157
sv0.358974358974359
ro0.3576017130620985
no0.3348115299334811
sl0.3333333333333333
cs0.3273542600896861
nl0.31662870159453305
sk0.31662870159453305
da0.3135011441647597
is0.21875
ms0.1935483870967742
az0.1891891891891892
yo0.1891891891891892
de0.17355371900826447
lv0.16434540389972147
reliabletrue
passestrue
17
name"Hunter"
dialogue"I have to go. I'm getting a call."
detectedLang"en"
heavyLang"en"
scores
en0.8335798816568047
pl0.6781115879828327
da0.6724890829694322
tl0.6590909090909091
hr0.6585735963581183
yo0.6511627906976745
no0.6445497630331753
it0.6439873417721518
cs0.6205733558178752
sk0.5974955277280859
ro0.5681381957773513
sv0.5553359683794467
ca0.5490981963927856
lv0.53125
lt0.5253164556962026
hu0.49776785714285715
is0.4863013698630137
sl0.48394495412844035
pt0.4791666666666667
sq0.4779582366589328
nl0.43324937027707805
ms0.4063324538258575
de0.3951612903225807
tr0.3951612903225807
az0.3715083798882682
vi0.3715083798882682
es0.3697478991596639
et0.358974358974359
fr0.34210526315789475
be0.23728813559322032
eu0.23728813559322032
fi0.21875
uk0.21875
reliabletrue
passestrue
18
name"Hunter"
dialogue"Hunter speaking. Yeah, I found the foreign student. Send another unit to the coffee shop, now."
detectedLang"en"
heavyLang"en"
scores
en0.7975352112676056
tl0.7022268254790264
no0.568642160540135
da0.555984555984556
sv0.46009389671361506
fr0.4334975369458128
sq0.41624365482233505
pl0.40904419321685515
nl0.40352697095435686
de0.39727463312368977
cs0.3966421825813221
ca0.3823845327604726
sk0.36674008810572684
hr0.3660418963616317
yo0.3653421633554084
lt0.3604004449388209
ms0.35101580135440186
ro0.33449074074074076
lv0.3072289156626506
it0.30133657351154314
sl0.2936117936117936
is0.28214731585518105
az0.1935483870967742
pt0.18899858956276447
et0.18785310734463279
tr0.18323863636363635
hu0.1797432239657632
es0.14814814814814814
be0.10852713178294573
uk0.0987460815047022
vi0.0987460815047022
reliabletrue
passestrue
19
name"Hunter"
dialogue"I have to go. Keep your eyes open."
detectedLang"en"
heavyLang"en"
scores
en0.8278829604130808
tl0.6627318718381113
da0.6610169491525424
pl0.648506151142355
no0.6219281663516069
yo0.6007984031936128
sk0.5824634655532359
hr0.5604395604395604
cs0.5412844036697247
sv0.5157384987893463
lv0.4805194805194805
lt0.4550408719346049
ca0.40828402366863903
sq0.40119760479041916
sl0.37694704049844235
it0.36507936507936506
nl0.3127147766323024
ro0.3103448275862069
ms0.2805755395683453
be0.25925925925925924
tr0.25925925925925924
hu0.250936329588015
az0.23954372623574144
et0.23954372623574144
is0.23954372623574144
uk0.23954372623574144
vi0.23954372623574144
reliabletrue
passestrue
20
name"Isabella"
dialogue"La quiete... non era mai qui."
detectedLang"it"
heavyLang"it"
scores
it0.7979214780600462
es0.7422680412371134
fr0.7422680412371134
ca0.7299382716049383
ro0.7018739352640544
eu0.5
no0.5
vi0.5
en0.4852941176470589
pt0.3613138686131387
yo0.3445692883895131
lv0.32432432432432434
sk0.32432432432432434
tl0.32432432432432434
sq0.308300395256917
de0.3
nl0.3
ms0.29149797570850206
reliabletrue
passestrue