Run: 2026-04-27-01KQ72Q7HTAE7GZAH74DWB3SG9

Run Details

Model:
Qwen 3.6 27B
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
1m 15s
Cost:
$0.011699
Provider:
Morph

Evaluation summary

Score Evaluator
Details Link
50.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Selvi: "Main bilkul English nahi jaanti... par haan, maine dekha. Meri saansein theek nahi chal rahi hain. Yahan kuch galat hai." Hunter: "I’m sorry, ma’am, I don’t understand. Look, I’m Detective Hunter. I’m looking into what happened near the old apple barn last night. Do you speak any English at all, even a few words?" Selvi: "Nahi... bilkul nahi. Par main aapko dikhati hoon. Yeh mere camera ki screen hai. Shaam ke chubhe ke waqt, maine teen log dekhe. Ab wo gayab hain. Ek purani gaadi... bina kisi number plate ke. Usne rukna band kar diya." Hunter: "Alright, let me turn on a translation app. I’m listening. You said three people, old car, no plates, near the barn? Take a breath. I’m going to track that down. How long were they there?" Selvi: "Bas kuch minute... par unke chehron par dar saaf dikh raha tha. Main darri hui hoon, isliye yeh sab yad hain. Kripya, unki madad karein. Main wahan se nahi jaati jab tak waapas nahi aati." Hunter: "Understood. You played it safe coming back to the café. That was smart. I’m going to run a camera sweep on the main road. Keep your phone close, stay right here by the window. You see anything else before you left?" Selvi: "Ek saaya... zameen par, jab gaadi chali gayi. Maine photo le liya. Yeh last frame hai. Isme saaya saaf dikhayi de raha hai. Mera camera uska saboot hai." Hunter: "That’s the break I needed. Clear shadow, unmarked vehicle, dusk. I’m on it now. I won’t stop until those people are found safe." Selvi: "Dhanyavaad... please jaldi karein. Yeh sheher shant hai, par aaj kal kuch ajeeb mehsoos hota hai." Hunter: "Dispatch just pinged me. Secondary sighting down County Road 9. I’ve got to move." Selvi: "Ji... savdhaan se rahein. Koi aur gayab nahi hona chahiye." Hunter: "Will do. Keep your camera safe. I’ll be back before dark."
created_at"2026-04-27T09:00:58.307Z" 4/27/2026, 9:00:58 AM
model"qwen/qwen3.6-27b-20260422"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency728
moderation_latency(null)
generation_time74933
tokens_prompt315
tokens_completion4766
native_tokens_prompt300
native_tokens_completion4806
native_tokens_completion_images(null)
native_tokens_reasoning4296
native_tokens_cached256
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
num_fetches(null)
web_search_engine(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0.0116994
router(null)
provider_responses
0
endpoint_id"826cab4e-dc26-4472-83be-e4ddd5ebd2ab"
id"475f092003804699babc336fd5ba8589"
is_byokfalse
latency654
model_permaslug"qwen/qwen3.6-27b-20260422"
provider_name"Morph"
status200
user_agent"langchainjs-openai/1.0.0 ((node/v24.14.1; linux; x64))"
http_referer(null)
request_id"req-1777280458-YGeCbuZz6SqO4a69kxEW"
session_id(null)
api_type"completions"
id"gen-1777280458-TkXjPDxxNRBMQZl87NF0"
upstream_id"475f092003804699babc336fd5ba8589"
total_cost0.0116994
cache_discount(null)
upstream_inference_cost0
provider_name"Morph"
response_cache_source_id(null)

Evaluation details

Result Evaluator Details Meta Data
50.00% Parse dialogue n/a
dialogue
0
name"Selvi"
dialogue"Main bilkul English nahi jaanti... par haan, maine dekha. Meri saansein theek nahi chal rahi hain. Yahan kuch galat hai."
detectedLang"et"
heavyLang"tl"
scores
et0.4557057057057057
fi0.40622440622440625
en0.39583333333333337
tl0.3813993174061433
fr0.3776824034334764
ro0.37607573149741824
de0.3538324420677362
lv0.3521000893655049
ms0.3354720439963337
eu0.29474708171206226
sv0.24870466321243526
it0.22376873661670238
da0.18539325842696627
vi0.17800453514739228
tr0.1637831603229527
hr0.16087962962962962
nl0.12650602409638553
lt0.1082410824108241
no0.10161090458488227
es0.09488139825218476
ca0.09375000000000001
cs0.0845959595959596
sk0.0845959595959596
sl0.0845959595959596
sq0.0845959595959596
reliablefalse
passesfalse
1
name"Hunter"
dialogue"I’m sorry, ma’am, I don’t understand. Look, I’m Detective Hunter. I’m looking into what happened near the old apple barn last night. Do you speak any English at all, even a few words?"
detectedLang"en"
heavyLang"en"
scores
en0.8069187449718422
tl0.6442336199229173
no0.526813880126183
da0.49238578680203043
nl0.47689625108979944
sv0.45897204688908927
de0.4485294117647059
fr0.4143484626647145
it0.3785603314344899
ca0.37597503900156004
pt0.3684210526315789
ro0.3637327677624602
sq0.3424657534246575
cs0.3348115299334811
hr0.2982456140350877
yo0.27927927927927926
es0.2779783393501805
pl0.2736077481840194
sk0.26062846580406657
is0.23076923076923078
sl0.21875
et0.19517102615694165
ms0.1847826086956522
vi0.16897506925207756
hu0.1567111735769501
tr0.1465149359886202
lt0.10780669144981414
az0.099774943735934
lv0.099774943735934
be0.05511811023622047
eu0.05511811023622047
fi0.0498812351543943
uk0.0498812351543943
reliabletrue
passestrue
2
name"Selvi"
dialogue"Nahi... bilkul nahi. Par main aapko dikhati hoon. Yeh mere camera ki screen hai. Shaam ke chubhe ke waqt, maine teen log dekhe. Ab wo gayab hain. Ek purani gaadi... bina kisi number plate ke. Usne rukna band kar diya."
detectedLang"en"
heavyLang"ber"
scores
en0.4237588652482269
ms0.38823529411764707
fr0.34343434343434337
de0.3431025770591208
tl0.3281653746770026
nl0.3183009963293131
tr0.2984349703184026
sl0.2919389978213508
et0.2757660167130919
yo0.26345609065155806
ro0.26094371802160315
it0.2388758782201405
sv0.2388758782201405
no0.22526817640047678
da0.20391916717697492
lv0.19053549190535493
eu0.18902058640049907
ca0.15966386554621848
fi0.15966386554621848
hr0.15584415584415584
es0.1541964866623292
sq0.14586070959264125
hu0.1390728476821192
cs0.11864406779661016
vi0.10775566231983527
az0.10714285714285714
sk0.09784871616932686
is0.059334298118668596
lt0.04341427520235468
pl0.04341427520235468
pt0.04341427520235468
reliablefalse
passesfalse
3
name"Hunter"
dialogue"Alright, let me turn on a translation app. I’m listening. You said three people, old car, no plates, near the barn? Take a breath. I’m going to track that down. How long were they there?"
detectedLang"en"
heavyLang"en"
scores
en0.82123839951316
tl0.6429656639319355
fr0.540656763096169
no0.46395985401459855
da0.4499063670411985
de0.44020962363030014
ca0.4005102040816326
sv0.399591211037302
yo0.3908761016070503
es0.38255386232264843
cs0.3806009488666315
nl0.3753322700691122
sk0.3740010655301012
sl0.35932388222464556
et0.35332966428178314
sq0.3526170798898072
pt0.35226019845644985
hr0.34467373117679867
pl0.3361581920903955
it0.32198499711482975
tr0.2976688583383144
lv0.27825552825552824
fi0.2692786069651742
ro0.23202614379084968
ms0.22595520421607376
is0.22030524220305242
lt0.20981842636180228
vi0.17946927374301674
hu0.11720510894064613
eu0.10442073170731707
az0.09892638036809816
hi0.06671961874503574
zh0.06150159744408946
reliabletrue
passestrue
4
name"Selvi"
dialogue"Bas kuch minute... par unke chehron par dar saaf dikh raha tha. Main darri hui hoon, isliye yeh sab yad hain. Kripya, unki madad karein. Main wahan se nahi jaati jab tak waapas nahi aati."
detectedLang"fr"
heavyLang"tl"
scores
fr0.37163375224416517
et0.32214331826985154
ms0.317738791423002
sq0.3110236220472441
cs0.29577464788732394
tl0.2948287441235729
eu0.2905405405405405
ro0.2793411118737131
ca0.27636113025499653
es0.27083333333333337
pt0.2631578947368421
sv0.25213675213675213
de0.22048997772828507
sl0.20933734939759033
hr0.20694864048338368
fi0.19969512195121952
da0.1935483870967742
it0.1847826086956522
en0.18351477449455675
sk0.16201117318435754
lt0.15254237288135594
pl0.14979757085020243
is0.14004914004914004
lv0.1286307053941909
nl0.1257285595337219
no0.1191275167785235
yo0.09248055315471045
tr0.09090909090909091
reliablefalse
passesfalse
5
name"Hunter"
dialogue"Understood. You played it safe coming back to the café. That was smart. I’m going to run a camera sweep on the main road. Keep your phone close, stay right here by the window. You see anything else before you left?"
detectedLang"en"
heavyLang"en"
scores
en0.8119767276855401
tl0.6330656327887012
da0.433518597691321
de0.4283865401207938
nl0.42240627724498697
fr0.37411431270666035
yo0.36874702239161505
no0.3508084272415482
cs0.32259713701431497
sk0.2978272390037096
pl0.28184281842818426
sv0.2779291553133515
sq0.24758659852356618
pt0.24673109721432634
ca0.24544419134396356
es0.23542989036353149
ro0.2296511627906977
et0.22605140186915884
it0.22150411280846063
ms0.217827626918536
lt0.20276774969915762
hr0.19256550883607554
sl0.18310727496917387
lv0.17342482844666252
hu0.14900449582530506
fi0.13849154746423928
vi0.13285340314136126
tr0.10412440838404327
zh0.10412440838404327
hi0.0596167494677076
is0.05357142857142857
az0.05017921146953405
eu0.05017921146953405
reliabletrue
passestrue
6
name"Selvi"
dialogue"Ek saaya... zameen par, jab gaadi chali gayi. Maine photo le liya. Yeh last frame hai. Isme saaya saaf dikhayi de raha hai. Mera camera uska saboot hai."
detectedLang"fr"
heavyLang"ber"
scores
fr0.5421245421245421
en0.4728915662650602
ro0.4247205785667324
sv0.36823104693140796
nl0.36640115858073863
et0.36270939548434084
it0.34944237918215615
tl0.3099369085173501
es0.2983159582999198
sk0.24828178694158076
de0.24633936261843237
fi0.24438687392055264
ca0.22497785651018598
pt0.22153024911032027
lv0.21735241502683364
sl0.20742753623188404
no0.19871794871794873
yo0.19798350137488543
da0.19503219871205152
tr0.1935483870967742
hr0.18452935694315006
hu0.1822429906542056
cs0.15946205571565802
vi0.15213178294573643
az0.13877952755905512
ms0.13366336633663367
is0.12848605577689243
hi0.08088235294117647
eu0.07407407407407407
sq0.06716417910447761
reliablefalse
passesfalse
7
name"Hunter"
dialogue"That’s the break I needed. Clear shadow, unmarked vehicle, dusk. I’m on it now. I won’t stop until those people are found safe."
detectedLang"en"
heavyLang"en"
scores
en0.8107997545510329
tl0.5863148479427549
ca0.35133239831697055
sq0.3499648629655657
da0.2992424242424242
no0.29871114480667177
fr0.29496951219512196
yo0.27165354330708663
ro0.25463336019339244
hr0.1970486111111111
et0.19001751313485116
sv0.18930762489044697
it0.18859649122807018
pl0.18502202643171806
nl0.1651624548736462
cs0.16289592760180996
es0.15985467756584923
fi0.13953488372093023
lv0.1387337057728119
tr0.13793103448275862
sk0.13712686567164178
eu0.09224730127576054
hi0.08325074331020813
ms0.0777666999002991
pt0.07592407592407592
be0.07035175879396985
hu0.06754032258064516
az0.06376518218623482
is0.06376518218623482
lt0.06376518218623482
uk0.06376518218623482
vi0.06376518218623482
reliabletrue
passestrue
8
name"Selvi"
dialogue"Dhanyavaad... please jaldi karein. Yeh sheher shant hai, par aaj kal kuch ajeeb mehsoos hota hai."
detectedLang"en"
heavyLang"de"
scores
en0.2966002344665885
fr0.29328621908127206
tl0.26108374384236455
is0.23857868020304565
de0.23371647509578544
vi0.2073976221928666
lv0.2052980132450331
eu0.1501416430594901
sq0.14893617021276595
cs0.14285714285714285
it0.14285714285714285
ro0.14285714285714285
da0.1341991341991342
sv0.1341991341991342
nl0.12790697674418602
et0.11504424778761062
reliablefalse
passesfalse
9
name"Hunter"
dialogue"Dispatch just pinged me. Secondary sighting down County Road 9. I’ve got to move."
detectedLang"en"
heavyLang"en"
scores
en0.7883801462100808
tl0.544701986754967
it0.494485294117647
no0.45652173913043476
nl0.4092373791621912
fr0.4028230184581976
et0.359720605355064
ms0.34911242603550297
sv0.33171324422843257
pt0.3167701863354037
ro0.30203045685279184
de0.289405684754522
sq0.28292046936114734
sl0.2753623188405797
sk0.26764314247669774
cs0.26666666666666666
es0.2647058823529412
hr0.24965893587994542
ca0.2329149232914923
yo0.19941775836972345
pl0.19708029197080293
lv0.18154761904761904
da0.15902140672782875
lt0.15902140672782875
fi0.12
is0.12
reliabletrue
passestrue
10
name"Selvi"
dialogue"Ji... savdhaan se rahein. Koi aur gayab nahi hona chahiye."
detectedLang"cs"
heavyLang"tl"
scores
cs0.3892508143322475
sl0.3811881188118812
ro0.375
fi0.3556701030927836
eu0.3055555555555556
hr0.2618110236220473
es0.25742574257425743
pt0.24089068825910928
lt0.23155737704918034
sq0.2299794661190965
fr0.22520661157024793
yo0.2219917012448133
de0.21875
it0.20550847457627117
ca0.20382165605095542
da0.19700214132762314
sv0.18655097613882862
no0.16666666666666666
reliablefalse
passesfalse
11
name"Hunter"
dialogue"Will do. Keep your camera safe. I’ll be back before dark."
detectedLang"en"
heavyLang"en"
scores
en0.8121309715512615
tl0.5501285347043702
hu0.3554327808471455
yo0.34944237918215615
de0.3371212121212121
it0.3110236220472441
ro0.3110236220472441
sv0.3110236220472441
pt0.308300395256917
ms0.3
pl0.29006085192697767
cs0.2753623188405797
sk0.2738589211618257
hr0.25531914893617025
sl0.25531914893617025
sq0.2505353319057816
lt0.24242424242424243
vi0.24078091106290672
ca0.22566371681415928
es0.22048997772828507
da0.19724770642201836
no0.19724770642201836
fr0.1784037558685446
nl0.1784037558685446
reliabletrue
passestrue