Run: 2026-03-11-01KKFHRYGG3DCXXZ3ZM57X6SJC

Run Details

Model:
Qwen 3.5 9B
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
1m 46s
Cost:
$0.001160
Provider:
Together

Evaluation summary

Score Evaluator
Details Link
57.89% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Selvi: *Takes a deep breath, clutching her neck as she stares at her camera screen.* "Humne dekha... maine dekha. (I saw... I saw it.)" Hunter: *Stops approaching, hand hovering over his badge.* "Saw what?" Selvi: *Shakes her head, refusing to look at him.* "'Alborn ki hawa... saaya par raha hai.' (Alborn's air... is shadowed.)" Hunter: *Frowns, confusion etching his face.* "Shadowed? This is a café. Someone, please... take care of the situation." Selvi: *Whispers frantically, English impossible in her mouth.* "Darr... hotha hai yahan. (Fear... is here.)" Hunter: *Steps closer, detecting the silence but not hearing English.* "Who is it? The name of the person?" Selvi: *Points her camera at his chest, then points to the door.* "'Nahi... par wahan haara hai.' (No... but she is there.)" Hunter: *Squints, trying to decipher her anxiety through the language gap.* "A girl? Is someone missing? Tell me." Selvi: *Looks directly into the lens, her voice trembling.* "'Riya. Riya chala gayi.' (Riya. Riya went away.)" Hunter: *Stiffens. The coffee shop hums around them, oblivious.* "Riya...? Okay. Listen to me, Selvi. You are safe here." Selvi: *Nods slowly, tears forming.* "Roshni... kyun dekhi? (Light... why seen?)" Hunter: "Noted. I know who to ask. Tell me what exactly?" Selvi: *Picks at the lens of her camera.* "Bhisi hua poora hai. (It is all wet.)" Hunter: *Gestures toward the camera she holds.* "Is that you? You in a photo?" Selvi: *Swallows hard.* "Poche. (Ask.)" Hunter: "I will. But you must keep it safe." Selvi: *Nods once more.* "Haa. Haa. (Yes.)" Hunter: *Reaches into his pocket. His phone chirps and flashes.* "Sorry. Dispatch. I have to go." Selvi: *Nods again, shaking her head back.* "Bye. ... (Bye...)
created_at"2026-03-11T22:55:11.388Z" 3/11/2026, 10:55:11 PM
model"qwen/qwen3.5-9b-20260310"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency222
moderation_latency(null)
generation_time106200
tokens_prompt315
tokens_completion7393
native_tokens_prompt300
native_tokens_completion7534
native_tokens_completion_images(null)
native_tokens_reasoning6926
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0.0011601
router(null)
provider_responses
0
endpoint_id"00d506d9-a5e9-4382-a2b9-d54732365594"
id"oagmnKN-6Ng1vN-9dae253045466fa8"
is_byokfalse
latency222
model_permaslug"qwen/qwen3.5-9b-20260310"
provider_name"Together"
status200
user_agent"langchainjs-openai/1.0.0 ((node/v24.14.0; linux; x64))"
http_referer(null)
api_type"completions"
id"gen-1773269711-Fn3sGJuDRhla4c0Oyv4r"
upstream_id"oagmnKN-6Ng1vN-9dae253045466fa8"
total_cost0.0011601
cache_discount(null)
upstream_inference_cost0
provider_name"Together"

Evaluation details

Result Evaluator Details Meta Data
57.89% Parse dialogue n/a
dialogue
0
name"Selvi"
dialogue"Takes a deep breath, clutching her neck as she stares at her camera screen."
detectedLang"en"
heavyLang"en"
scores
en0.7816593886462883
tl0.6896337678460583
da0.5044598612487611
no0.49647532729103727
es0.45054945054945056
pt0.4350282485875706
ro0.4212962962962963
it0.40617577197149646
ca0.39172749391727496
fr0.39172749391727496
sl0.3872549019607844
nl0.3834771886559803
ms0.38042131350681535
sk0.3630573248407643
hu0.3234100135317997
sq0.3160054719562244
sv0.3084370677731674
lv0.30362116991643456
de0.30167597765363136
cs0.29775280898876405
yo0.2937853107344633
tr0.2877492877492877
hr0.27219796215429404
pl0.26793557833089315
is0.24471299093655588
fi0.22720247295208654
lt0.21996879875195008
et0.19614147909967844
az0.12280701754385964
eu0.12280701754385964
vi0.12280701754385964
reliabletrue
passesfalse
1
name"Hunter"
dialogue"Saw what?"
detectedLang"en"
heavyLang"en"
scores
en0.8344370860927153
ms0.6666666666666666
reliablefalse
passestrue
2
name"Selvi"
dialogue"'Alborn ki hawa... saaya par raha hai.'"
detectedLang"vi"
heavyLang"en"
scores
vi0.3857493857493857
az0.3842364532019704
lv0.38271604938271603
sl0.3796526054590571
fr0.3654822335025381
et0.36061381074168797
hu0.32614555256064687
yo0.3112947658402204
tr0.2937853107344633
it0.2857142857142857
da0.2711370262390671
sv0.2711370262390671
reliablefalse
passesfalse
3
name"Hunter"
dialogue"Shadowed? This is a café. Someone, please... take care of the situation."
detectedLang"en"
heavyLang"en"
scores
en0.8029863127333057
nl0.6447270007479431
tl0.5926243567753002
ro0.5514636449480642
yo0.5374878286270691
fr0.5143149284253579
pt0.5077720207253886
da0.46145124716553293
de0.4571428571428572
no0.45652173913043476
sv0.45276497695852536
hu0.39490445859872614
es0.3708609271523179
is0.35020519835841313
sl0.3233618233618234
ca0.309593023255814
sq0.3055555555555556
ms0.29629629629629634
sk0.29629629629629634
cs0.2952522255192878
it0.291044776119403
hr0.2692307692307693
lt0.23878205128205127
fi0.23387096774193547
lv0.23387096774193547
pl0.1810344827586207
tr0.1394927536231884
zh0.1394927536231884
az0.12844036697247707
eu0.12844036697247707
vi0.12844036697247707
et0.1171003717472119
reliabletrue
passestrue
4
name"Selvi"
dialogue"Darr... hotha hai yahan."
detectedLang"vi"
heavyLang"tl"
scores
vi0.511400651465798
ms0.4791666666666667
tl0.46619217081850534
it0.39999999999999997
fi0.3697478991596639
reliablefalse
passesfalse
5
name"Hunter"
dialogue"Who is it? The name of the person?"
detectedLang"en"
heavyLang"en"
scores
en0.8435054773082942
nl0.7229916897506925
tl0.6855345911949685
yo0.6753246753246753
no0.6343692870201096
is0.6116504854368932
sq0.609375
de0.6055226824457594
sv0.550561797752809
da0.5305164319248826
hu0.5203836930455635
ms0.453551912568306
fr0.44751381215469616
lv0.44598337950138506
pt0.40828402366863903
ca0.3103448275862069
es0.3055555555555556
it0.3055555555555556
ro0.29577464788732394
lt0.2647058823529412
tr0.250936329588015
az0.2277992277992278
cs0.2277992277992278
et0.2277992277992278
hr0.2277992277992278
pl0.2277992277992278
sk0.2277992277992278
reliabletrue
passestrue
6
name"Selvi"
dialogue"'Nahi... par wahan haara hai.'"
detectedLang"ms"
heavyLang"tl"
scores
ms0.5192307692307693
fi0.4617224880382775
vi0.4109947643979057
lv0.40789473684210525
fr0.3902439024390244
tl0.3679775280898876
de0.30769230769230765
it0.30769230769230765
nl0.30769230769230765
da0.29245283018867924
sv0.29245283018867924
reliablefalse
passesfalse
7
name"Hunter"
dialogue"A girl? Is someone missing? Tell me."
detectedLang"en"
heavyLang"en"
scores
en0.8151191454396056
nl0.6848739495798318
pt0.62248322147651
is0.5863970588235294
es0.5810055865921787
hu0.5794392523364486
fr0.5544554455445544
tl0.5481927710843374
it0.5454545454545454
ms0.533195020746888
no0.5202558635394456
yo0.5150862068965517
et0.49776785714285715
sq0.4943820224719101
fi0.4897959183673469
da0.48394495412844035
ca0.4803695150115473
sl0.44168734491315137
sv0.4140625
de0.3818681318681319
ro0.3818681318681319
az0.375
cs0.3697478991596639
sk0.36619718309859156
hr0.33234421364985167
pl0.3181818181818182
lt0.267100977198697
tr0.2549668874172185
eu0.23728813559322032
lv0.23728813559322032
vi0.23728813559322032
reliabletrue
passestrue
8
name"Selvi"
dialogue"'Riya. Riya chala gayi.'"
detectedLang"en"
heavyLang"tl"
scores
en0.4067796610169492
az0.4006849315068493
fr0.36363636363636365
eu0.3320610687022901
tl0.3320610687022901
cs0.3055555555555556
sk0.3055555555555556
reliablefalse
passesfalse
9
name"Hunter"
dialogue"Riya...? Okay. Listen to me, Selvi. You are safe here."
detectedLang"en"
heavyLang"tl"
scores
en0.7411561691113029
no0.6108949416342413
da0.563953488372093
fi0.5542347696879644
tl0.5238095238095238
sq0.5090016366612111
cs0.4755244755244755
sl0.471830985915493
ro0.4129158512720157
lv0.4094488188976378
pl0.402390438247012
nl0.39999999999999997
hr0.3890020366598778
sk0.3890020366598778
de0.38271604938271603
es0.3548387096774194
sv0.3548387096774194
fr0.33920704845814975
pt0.3348115299334811
it0.31662870159453305
yo0.3135011441647597
eu0.2805755395683453
lt0.25742574257425743
et0.24050632911392408
ms0.21875
hu0.21052631578947367
ca0.20424403183023873
is0.1891891891891892
tr0.18256130790190736
reliabletrue
passestrue
10
name"Selvi"
dialogue"Roshni... kyun dekhi?"
detectedLang""
heavyLang"vi"
scores
reliablefalse
passesfalse
11
name"Hunter"
dialogue"Noted. I know who to ask. Tell me what exactly?"
detectedLang"en"
heavyLang"en"
scores
en0.8232174425456688
no0.5348837209302325
lv0.494949494949495
sq0.4845360824742268
it0.47368421052631576
pl0.46524064171123
hr0.4594594594594595
da0.44751381215469616
cs0.44029850746268656
yo0.42748091603053434
sv0.4152046783625731
sl0.4106090373280943
sk0.40476190476190477
es0.375
ro0.358974358974359
lt0.3576017130620985
fr0.3562231759656652
tl0.35205183585313177
et0.34497816593886466
ca0.3150684931506849
pt0.22680412371134018
ms0.21875
nl0.21875
de0.2
fi0.2
be0.1891891891891892
tr0.1891891891891892
hu0.18256130790190736
az0.17355371900826447
is0.17355371900826447
uk0.17355371900826447
vi0.17355371900826447
reliabletrue
passestrue
12
name"Selvi"
dialogue"Bhisi hua poora hai."
detectedLang"vi"
heavyLang"la"
scores
vi0.511400651465798
it0.39999999999999997
reliablefalse
passesfalse
13
name"Hunter"
dialogue"Is that you? You in a photo?"
detectedLang"en"
heavyLang"en"
scores
en0.8430493273542601
tl0.7058823529411765
nl0.6875
yo0.651394422310757
hu0.6391752577319588
fr0.6369294605809128
cs0.6300211416490487
ro0.6162280701754387
it0.6085011185682326
sl0.5823389021479713
de0.5501285347043702
pl0.5192307692307693
sv0.49275362318840576
is0.4883040935672514
az0.46808510638297873
pt0.4444444444444444
ms0.44089456869009586
ca0.4372990353697749
es0.4299674267100977
sk0.42622950819672134
hr0.3902439024390244
lt0.31906614785992216
hi0.3055555555555556
tr0.3055555555555556
da0.29149797570850206
sq0.29149797570850206
eu0.2857142857142857
lv0.2857142857142857
no0.2857142857142857
vi0.2857142857142857
et0.2647058823529412
fi0.2647058823529412
reliabletrue
passestrue
14
name"Selvi"
dialogue"Poche."
detectedLang"it"
heavyLang"es"
scores
it0.7727272727272727
cs0.6621621621621622
es0.6621621621621622
fr0.6503496503496503
pl0.6503496503496503
sk0.6503496503496503
de0.635036496350365
reliablefalse
passestrue
15
name"Hunter"
dialogue"I will. But you must keep it safe."
detectedLang"en"
heavyLang"en"
scores
en0.8348472336911643
tl0.6581196581196581
sq0.5238095238095238
cs0.47780678851174935
yo0.4490358126721763
lv0.4269340974212034
no0.42028985507246375
da0.41002949852507375
hr0.41002949852507375
ca0.40828402366863903
sv0.40828402366863903
pl0.38650306748466257
it0.36507936507936506
de0.3464052287581699
ro0.3103448275862069
fr0.3055555555555556
sk0.2647058823529412
be0.25925925925925924
tr0.25925925925925924
hu0.250936329588015
az0.23954372623574144
et0.23954372623574144
is0.23954372623574144
lt0.23954372623574144
uk0.23954372623574144
vi0.23954372623574144
reliabletrue
passestrue
16
name"Selvi"
dialogue"Haa. Haa."
detectedLang""
heavyLang"fi"
scores
reliablefalse
passestrue
17
name"Hunter"
dialogue"Sorry. Dispatch. I have to go."
detectedLang"en"
heavyLang"en"
scores
en0.7802734375
tl0.6484375
da0.6341463414634145
it0.6317512274959083
pl0.6212121212121212
cs0.5754716981132075
yo0.5722433460076045
sk0.5481927710843374
hr0.53125
no0.5302713987473904
sv0.5044052863436124
ca0.5033112582781457
sq0.4742990654205608
pt0.47058823529411764
fr0.45652173913043476
ro0.45255474452554745
lv0.45121951219512196
lt0.4260204081632653
de0.3902439024390244
sl0.34971098265895956
es0.29906542056074764
be0.23728813559322032
tr0.23728813559322032
hu0.22945205479452058
az0.21875
et0.21875
is0.21875
uk0.21875
vi0.21875
reliabletrue
passestrue
18
name"Selvi"
dialogue"Nods again, shaking her head back. \"Bye. ..."
detectedLang"en"
heavyLang"en"
scores
en0.7823984526112185
tl0.6335504885993485
nl0.5730550284629982
no0.47058823529411764
tr0.3571428571428572
da0.3515850144092219
et0.281150159744409
de0.26229508196721313
fr0.2398648648648649
is0.2398648648648649
pt0.2398648648648649
sv0.2398648648648649
reliabletrue
passesfalse