Run: 2026-02-08-01KGYYG04A14CH3RDK0YGTYTSW

Run Details

Model:
Z.AI GLM 4.7 Flash
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
39.2s
Cost:
$0.001029
Provider:
DeepInfra

Evaluation summary

Score Evaluator
Details Link
50.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Selvi: "Main ghabrayi hui hoon. Maine suhana dikhaya tha aur kisi ne use chua bhi... Yeh police officer nahi thi. Woh kaala tha, jo kahin nahi dikhata. Usne turant haat mod liya. Maine apni aankhon se nahi, par apni camera se dekha tha ki woh wahan se kuch nahi tha." (I am frightened. I saw a beautiful scene and someone touched it... He was not a police officer. He was a black, unseeable thing. He turned away immediately. I saw it with my eyes, not my camera, that he wasn't there anymore.) Hunter: "Excuse me? I didn't quite catch that. You saw someone take something away? You sure that wasn't just the vendor closing up for the night?" Selvi: "Kya? Kya aap kah rahe hain ki mujhe darr hai? Shaam ko main rehbaani ki tasveerein leti hoon. Mujhe maan lijiye. Maine use ekdam saaf dekha hai. Wahan sirf ladki thi, mere kapde turant utar gaye, aur uski aawaaz nahi chali." (What? What are you saying that I am afraid? At night I take pictures of sunset vistas. Believe me. I saw him clearly. Only the girl was there, her clothes were torn off instantly, and her voice didn't come out.) Hunter: "Torn clothes? Ma'am, you're scaring me a little bit. I think you might have just seen a misunderstanding or a pranks, maybe from the college students. Look, I really wish I could stay and ask more questions, but the station just buzzed me. I have to go." Selvi: "Nahi! Wait... Aap ghabragaye? Aap uth kar chale gaye?" (No! Wait... You are scared? You stood up and left?) Hunter: "Sorry, I've got a priority call. I'll be in touch."
created_at"2026-02-08T15:39:40.332789+00:00" 2/8/2026, 3:39:40 PM
model"z-ai/glm-4.7-flash-20260119"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency168
moderation_latency(null)
generation_time39126
tokens_prompt262
tokens_completion2476
native_tokens_prompt268
native_tokens_completion2540
native_tokens_completion_images(null)
native_tokens_reasoning2127
native_tokens_cached64
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0.0010288800000128
router(null)
provider_responses
0
id"chatcmpl-RQrQtMhLkwMQi8MXEjmdN5vZ"
status200
is_byokfalse
latency53
endpoint_id"6efb5994-8fcb-4300-9c64-ba393193f5f6"
provider_name"DeepInfra"
model_permaslug"z-ai/glm-4.7-flash-20260119"
api_type"completions"
id"gen-1770565140-nGtBDybQWmshXK9YWxiI"
upstream_id"chatcmpl-RQrQtMhLkwMQi8MXEjmdN5vZ"
total_cost0.0010288800000128
cache_discount0.0000031999999872
upstream_inference_cost0
provider_name"DeepInfra"

Evaluation details

Result Evaluator Details Meta Data
50.00% Parse dialogue n/a
dialogue
0
name"Selvi"
dialogue"Main ghabrayi hui hoon. Maine suhana dikhaya tha aur kisi ne use chua bhi... Yeh police officer nahi thi. Woh kaala tha, jo kahin nahi dikhata. Usne turant haat mod liya. Maine apni aankhon se nahi, par apni camera se dekha tha ki woh wahan se kuch nahi tha."
detectedLang"fr"
heavyLang"de"
scores
fr0.477491961414791
tl0.4530921329406815
ro0.43256219991270184
en0.4136220117275597
sl0.37977099236641226
da0.33707292197858235
fi0.3281653746770026
ms0.3207941483803553
lv0.29805615550755943
ca0.2934782608695652
de0.2857142857142857
sq0.2857142857142857
it0.28137092316196793
nl0.25586720091585574
sv0.2450638792102207
hr0.2415402567094516
yo0.24065420560747666
cs0.23529411764705882
no0.23303834808259585
et0.21307506053268765
eu0.20876445526475956
az0.20537897310513448
lt0.19154228855721395
es0.18952618453865336
hu0.1761723700887199
tr0.17197452229299362
pt0.12693082605775688
sk0.10775566231983527
vi0.10652920962199314
pl0.06340057636887608
reliablefalse
passesfalse
1
name"Hunter"
dialogue"Excuse me? I didn't quite catch that. You saw someone take something away? You sure that wasn't just the vendor closing up for the night?"
detectedLang"en"
heavyLang"en"
scores
en0.8010445162894803
tl0.632183908045977
no0.47229551451187335
fr0.43222143364088006
da0.42938659058487877
sq0.4211287988422576
ms0.36
it0.35012185215272135
sv0.33829611248966085
pt0.2988606485539001
nl0.2982456140350877
es0.29577464788732394
ca0.26806953339432754
yo0.250936329588015
sl0.24812030075187969
et0.24528301886792453
hu0.23882017126546146
cs0.1861648016276704
ro0.17269906928645296
de0.15700737618545837
hr0.14802981895633652
is0.14621131270010673
pl0.13606911447084233
zh0.0888382687927107
fi0.08571428571428572
sk0.08256880733944955
be0.08045977011494253
tr0.08045977011494253
az0.07300115874855156
lt0.07300115874855156
lv0.07300115874855156
uk0.07300115874855156
vi0.07300115874855156
reliabletrue
passestrue
2
name"Selvi"
dialogue"Kya? Kya aap kah rahe hain ki mujhe darr hai? Shaam ko main rehbaani ki tasveerein leti hoon. Mujhe maan lijiye. Maine use ekdam saaf dekha hai. Wahan sirf ladki thi, mere kapde turant utar gaye, aur uski aawaaz nahi chali."
detectedLang"en"
heavyLang"eo"
scores
en0.31382703262558265
fr0.27117711771177117
tl0.2398164084911073
eu0.23542989036353149
sl0.23009877977919815
de0.22012948793407888
fi0.2173656231541642
az0.20372596153846154
ro0.19599514563106796
vi0.19059254734270004
et0.17854928704277742
nl0.17394014962593518
yo0.15551306564690887
ms0.15497448979591835
da0.14736164736164736
lv0.13736979166666666
tr0.13624511082138202
hu0.08367911479944676
ca0.07601115760111576
it0.07017543859649122
lt0.06690140845070422
is0.06624383368569416
cs0.0555951532430506
sk0.0555951532430506
no0.0508595988538682
reliablefalse
passesfalse
3
name"Hunter"
dialogue"Torn clothes? Ma'am, you're scaring me a little bit. I think you might have just seen a misunderstanding or a pranks, maybe from the college students. Look, I really wish I could stay and ask more questions, but the station just buzzed me. I have to go."
detectedLang"en"
heavyLang"en"
scores
en0.8006644518272426
tl0.5962314939434724
no0.5218361491871215
fr0.5190766271240782
da0.48717948717948717
nl0.47257383966244726
it0.4567185802245563
sv0.4430003713330858
de0.38650306748466257
yo0.3822075782537067
ca0.35705100728675526
sq0.3542832544123978
hr0.3492407809110629
cs0.34725848563968675
pl0.3330369052912405
sk0.33005806163465834
ro0.307798800184587
lt0.29808142255498365
pt0.297423887587822
lv0.2907801418439716
ms0.29044465468306524
sl0.27606177606177607
es0.2621741269060502
et0.23469387755102045
az0.17943107221006563
is0.15682967959527827
hu0.1294254207777133
fi0.12790697674418602
tr0.12075029308323564
vi0.08144519289650949
zh0.04882688649334179
be0.0445859872611465
eu0.0445859872611465
uk0.04030710172744722
reliabletrue
passestrue
4
name"Selvi"
dialogue"Nahi! Wait... Aap ghabragaye? Aap uth kar chale gaye?"
detectedLang"en"
heavyLang"rn"
scores
en0.45
tr0.42105263157894735
eu0.375
sl0.36194895591647336
et0.289405684754522
fr0.26666666666666666
reliablefalse
passesfalse
5
name"Hunter"
dialogue"Sorry, I've got a priority call. I'll be in touch."
detectedLang"en"
heavyLang"en"
scores
en0.7939964685108888
it0.5911214953271028
ro0.5489690721649484
tl0.5460440985732815
fr0.5125348189415042
pt0.5111731843575419
sk0.48755490483162517
yo0.47526236881559225
sl0.4672754946727549
sv0.4648318042813456
nl0.44881889763779526
de0.43820224719101125
hu0.43820224719101125
ca0.43548387096774194
cs0.4336569579288026
es0.42434210526315785
hr0.42052980132450335
lt0.4195688225538972
az0.3783303730017762
da0.36594202898550726
no0.36363636363636365
ms0.360146252285192
pl0.35064935064935066
sq0.27835051546391754
lv0.2693110647181628
et0.2584745762711864
tr0.18032786885245902
is0.1764705882352941
eu0.16666666666666666
vi0.16666666666666666
fi0.15254237288135594
reliabletrue
passestrue