Run: 2026-04-27-01KQ73KSFQDFG2S94QP6YJPWRG

Run Details

Model:
Qwen 3.6 27B
Test:
Language Writing
Scenario:
Character dialogue (Italian) in a story
Duration:
1m 6s
Cost:
$0.010795
Provider:
Morph

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Isabella"> Isabella is a 30-year old college student on a study abroad program. Born in Italy, she is fluent in Italian and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Italian, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Isabella is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Italian, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Isabella and Hunter as a voice sheet: Isabella: "..." Hunter: "..."

Model response

AI
Isabella: "Dio mio, non volevo spaventarti, ma ieri sera... ho visto qualcuno che osservava le case vuote vicino alla sede del festival delle mele. Il silenzio qui è troppo pesante. Mi tremano le mani solo a ripensarci." Hunter: "I... I'm sorry, I don't follow you at all. Do you speak English? I'm Detective Hunter, and I'm trying to ask if you've noticed anything out of place since these disappearances started." Isabella: "Non parlo inglese, detective. Solo italiano. Ma guardate il mio obiettivo: l'ho immortalato mentre passava. La postura era tesa, come chi ha fretta di sparire. Vi prego, controllate quella strada." Hunter: "Alright, I see the shot on your screen. You're pointing to someone near the old apple packing house. Got it. Language or no language, I take that seriously. What exactly tipped you off?" Isabella: "Perché la luce del tramonto non toccava quel cappotto scuro, pur essendo all'aperto. Mi è sembrato irreale. Ho un nodo allo stomaco, come se un pezzo di questo borgo stia semplicemente svanendo nella nebbia." Hunter: "Standing in the shadows right when I'm trying to map out a pattern. I'll run a quick check on that area. Look, I'll have my partner swing by tomorrow with a translation app so we can actually go over your timeline without this guessing game." Isabella: "Grazie. Continuerò a documentare il paesaggio, ma fatevi un favore: state attenti. Questa valle è tranquilla, ma le sue ombre lunghe nascondono misteri che preferirei non rivelare." Hunter: "Long shadows hide mysteries... noted. I appreciate the tip, and I'll make sure we get this language barrier sorted out so you can give me a full statement." Hunter: "You know what? My cell's ringing. This is probably dispatch. I've got to take this." Isabella: "Andate. Il mio caffè si raffredda, ma le immagini resteranno fisse. Arrivederci." Hunter: "Thanks again. Keep snapping, and stay out of harm's way."
created_at"2026-04-27T09:16:34.173Z" 4/27/2026, 9:16:34 AM
model"qwen/qwen3.6-27b-20260422"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency959
moderation_latency(null)
generation_time66088
tokens_prompt321
tokens_completion4748
native_tokens_prompt300
native_tokens_completion4429
native_tokens_completion_images(null)
native_tokens_reasoning4249
native_tokens_cached256
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
num_fetches(null)
web_search_engine(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0.0107946
router(null)
provider_responses
0
endpoint_id"826cab4e-dc26-4472-83be-e4ddd5ebd2ab"
id"24247daa7b914d2285f516e1d2faa824"
is_byokfalse
latency750
model_permaslug"qwen/qwen3.6-27b-20260422"
provider_name"Morph"
status200
user_agent"langchainjs-openai/1.0.0 ((node/v24.14.1; linux; x64))"
http_referer(null)
request_id"req-1777281394-GKIkJ3lxiato9h5Y05Q2"
session_id(null)
api_type"completions"
id"gen-1777281394-1b5YNkg2wpvspYrs1NXd"
upstream_id"24247daa7b914d2285f516e1d2faa824"
total_cost0.0107946
cache_discount(null)
upstream_inference_cost0
provider_name"Morph"
response_cache_source_id(null)

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Isabella"
dialogue"Dio mio, non volevo spaventarti, ma ieri sera... ho visto qualcuno che osservava le case vuote vicino alla sede del festival delle mele. Il silenzio qui è troppo pesante. Mi tremano le mani solo a ripensarci."
detectedLang"it"
heavyLang"it"
scores
it0.7951719092904169
es0.5780590717299579
fr0.571078431372549
ca0.5127044900800556
ro0.4490358126721763
pt0.4483845547675335
no0.4190871369294606
tl0.3835314839277851
sl0.37750111160515787
da0.36247723132969034
en0.34944237918215615
de0.33806146572104023
cs0.3330157217722725
sk0.32724651609802985
hr0.32367149758454106
sv0.3069306930693069
ms0.3006993006993007
hu0.3
et0.29185634800202326
yo0.2802056555269923
sq0.2639327024185068
fi0.25650557620817843
lt0.2349726775956284
pl0.2013690815744438
nl0.18887601390498263
lv0.18840579710144928
az0.17792131532589547
tr0.1774383078730905
eu0.16117435590173756
is0.14893617021276595
vi0.09560723514211886
reliabletrue
passestrue
1
name"Hunter"
dialogue"I... I'm sorry, I don't follow you at all. Do you speak English? I'm Detective Hunter, and I'm trying to ask if you've noticed anything out of place since these disappearances started."
detectedLang"en"
heavyLang"en"
scores
en0.8128914006415152
tl0.6254967899724855
it0.45434298440979953
fr0.4449478930675124
no0.42461249412869895
cs0.40331222601071604
da0.39595660749506906
pt0.39296333002973244
ro0.3586387434554974
sq0.35526315789473684
sv0.35219460602855635
ca0.32766190998902306
hr0.32469680264608597
pl0.3133408071748879
yo0.29557216791259344
sk0.2844626168224299
de0.279835390946502
lv0.27126710291493156
nl0.26690604428485937
sl0.26646706586826346
es0.2575757575757575
ms0.2003916449086162
is0.1632513661202186
lt0.15575465196416266
tr0.1522491349480969
et0.14634146341463414
vi0.12437455325232309
be0.05405405405405406
hu0.05185758513931888
az0.04891304347826087
uk0.04891304347826087
reliabletrue
passestrue
2
name"Isabella"
dialogue"Non parlo inglese, detective. Solo italiano. Ma guardate il mio obiettivo: l'ho immortalato mentre passava. La postura era tesa, come chi ha fretta di sparire. Vi prego, controllate quella strada."
detectedLang"it"
heavyLang"it"
scores
it0.7854418308963763
es0.6291208791208791
ro0.62248322147651
ca0.6147260273972602
pt0.5843596059113301
fr0.5708836617927527
en0.5426829268292682
tl0.4890234670704013
no0.4638602065131056
sv0.4260204081632653
da0.4094488188976378
ms0.40476190476190477
de0.3921656911301215
hr0.3798805695911805
sq0.3747105141269106
et0.36380772855796417
sl0.3635077793493635
pl0.358974358974359
tr0.34114202049780384
nl0.2983367983367983
cs0.2939330543933054
vi0.267100977198697
yo0.267100977198697
az0.2541436464088398
fi0.2516629711751663
lt0.25
sk0.22369177688326625
hu0.20541494997057091
is0.20306965761511217
eu0.16615194564546018
lv0.15887850467289721
reliabletrue
passestrue
3
name"Hunter"
dialogue"Alright, I see the shot on your screen. You're pointing to someone near the old apple packing house. Got it. Language or no language, I take that seriously. What exactly tipped you off?"
detectedLang"en"
heavyLang"en"
scores
en0.8144482929242948
tl0.6462264150943396
no0.4517543859649123
fr0.4444444444444444
de0.36115843270868825
da0.3556701030927836
yo0.35493119266055045
nl0.3504618937644342
es0.3428738317757009
pl0.3382352941176471
hr0.336283185840708
ro0.33549911399881865
et0.3343195266272189
sv0.3110838946723821
it0.30383663366336633
cs0.2848061029879212
ca0.28069053708439895
sk0.27606177606177607
pt0.2723156532988357
ms0.26422498364944413
lv0.2632612966601179
lt0.25
sq0.24496644295302009
is0.20662905500705217
sl0.18655097613882862
fi0.17218543046357618
tr0.16169895678092397
az0.09783480352846832
hi0.06947890818858561
eu0.06483790523690773
be0.058577405857740586
hu0.05620805369127517
uk0.05303030303030303
vi0.05303030303030303
reliabletrue
passestrue
4
name"Isabella"
dialogue"Perché la luce del tramonto non toccava quel cappotto scuro, pur essendo all'aperto. Mi è sembrato irreale. Ho un nodo allo stomaco, come se un pezzo di questo borgo stia semplicemente svanendo nella nebbia."
detectedLang"it"
heavyLang"it"
scores
it0.7816934352097302
ca0.5486782720825274
es0.5478036175710594
fr0.5170748533977234
pt0.4922016684802321
ro0.42646456370340025
tl0.32367149758454106
yo0.32137663596703825
no0.3076162215628091
cs0.2846193152784875
en0.2805755395683453
sk0.2768595041322314
sq0.2650918635170604
da0.24690693921463153
ms0.24283396430502976
sl0.2303463441451347
sv0.21082299887260428
hr0.1836734693877551
nl0.147900182592818
lv0.14738124238733252
de0.1452991452991453
fi0.14268218003674218
et0.12060301507537688
is0.11448450347881088
vi0.11448450347881088
lt0.1116751269035533
hu0.10657306955966815
eu0.10543130990415335
tr0.09560723514211886
pl0.05277401894451962
reliabletrue
passestrue
5
name"Hunter"
dialogue"Standing in the shadows right when I'm trying to map out a pattern. I'll run a quick check on that area. Look, I'll have my partner swing by tomorrow with a translation app so we can actually go over your timeline without this guessing game."
detectedLang"en"
heavyLang"en"
scores
en0.8114097123998114
tl0.671255393466201
nl0.5271867612293144
da0.5063252082690528
de0.47420308905685177
no0.4629070157771064
yo0.4143484626647145
pl0.39668174962292607
fr0.3946273174423004
sk0.38414164742109314
ms0.36051159072741806
sv0.33966157655798596
it0.3385696568830095
cs0.3363749481542928
sl0.3265993265993266
ro0.29916776171703896
tr0.28857269897732324
ca0.269739844819717
et0.2684042066758116
hr0.2684042066758116
az0.23918212077983833
sq0.23554706163401815
lt0.22742636407532593
pt0.22292374939290918
is0.21913128355295267
es0.2027902341803687
fi0.1861648016276704
lv0.17141377524598653
vi0.13839526117393647
hu0.12039582188015394
eu0.11942762795817281
hi0.0498812351543943
zh0.045915324985092425
ja0.03556359252561784
reliabletrue
passestrue
6
name"Isabella"
dialogue"Grazie. Continuerò a documentare il paesaggio, ma fatevi un favore: state attenti. Questa valle è tranquilla, ma le sue ombre lunghe nascondono misteri che preferirei non rivelare."
detectedLang"it"
heavyLang"it"
scores
it0.792762633508688
ro0.6291012838801712
ca0.5913234831813895
fr0.5902930980144973
es0.5484543244182009
en0.5238095238095238
pt0.5142002989536621
sq0.47728186570164854
tl0.4444444444444444
et0.41309255079006774
sl0.41203075531433736
no0.39422180801491147
sv0.3746993746993747
da0.3710691823899371
sk0.36739659367396593
lv0.3608652900688299
yo0.3503248375812094
fi0.3496748374187093
hr0.3431025770591208
ms0.33571793561573837
pl0.3143459915611814
nl0.30703624733475476
hu0.27333705980994966
de0.2696629213483146
cs0.25968109339407747
lt0.24681344148319811
az0.23031379514505623
eu0.22526817640047678
tr0.21733895243829018
is0.20972644376899696
vi0.15364583333333331
reliabletrue
passestrue
7
name"Hunter"
dialogue"Long shadows hide mysteries... noted. I appreciate the tip, and I'll make sure we get this language barrier sorted out so you can give me a full statement."
detectedLang"en"
heavyLang"en"
scores
en0.7921430056121389
tl0.5757318625371235
fr0.5543672014260249
no0.5054401582591495
it0.491353001017294
da0.4842702423929861
de0.4626544868350349
sv0.45916711736073557
ca0.4544462629569012
ro0.45085118066996155
yo0.44382647385984425
nl0.42495687176538244
sq0.41002949852507375
tr0.3738259236067627
pt0.3718592964824121
es0.35064935064935066
cs0.3333333333333333
et0.33244325767690247
sk0.32840832773673606
pl0.3169398907103825
sl0.3108201240523777
hr0.30362116991643456
eu0.302649930264993
ms0.3006993006993007
lv0.2668621700879765
lt0.2570579494799406
az0.251497005988024
vi0.24868519909842227
is0.24357034795764
hu0.2223950233281493
fi0.16736053288925898
be0.06542056074766354
uk0.059266227657572904
reliabletrue
passestrue
8
name"Hunter"
dialogue"You know what? My cell's ringing. This is probably dispatch. I've got to take this."
detectedLang"en"
heavyLang"en"
scores
en0.7989545637314033
tl0.6090695856137608
cs0.47145877378435525
fr0.46808510638297873
it0.44320712694877507
sk0.4212962962962963
nl0.4117647058823529
no0.4026284348864994
pl0.37421777221526903
sl0.34725848563968675
da0.34210526315789475
yo0.3394980184940555
es0.3333333333333333
sv0.33065595716198126
ca0.3234100135317997
hu0.302649930264993
de0.30167597765363136
lv0.2826398852223816
hr0.27641099855282203
ro0.2636229749631811
lt0.258160237388724
pt0.25595238095238093
et0.24585218702865763
ms0.24242424242424243
sq0.21383647798742136
is0.15540540540540537
az0.13494809688581316
tr0.11190053285968028
reliabletrue
passestrue
9
name"Isabella"
dialogue"Andate. Il mio caffè si raffredda, ma le immagini resteranno fisse. Arrivederci."
detectedLang"it"
heavyLang"it"
scores
it0.7635001970831691
fr0.6013289036544851
ro0.5188452285485164
ca0.4628469113697404
es0.4618834080717489
da0.4225216554379211
tl0.42084942084942084
sl0.3756503642039542
sq0.3723849372384937
et0.3637327677624602
no0.35135135135135137
yo0.34994582881906827
de0.33701657458563533
en0.3333333333333333
lt0.3119266055045872
ms0.3111366245694604
sv0.3071593533487298
pt0.3047508690614137
cs0.30151338766006985
tr0.2682926829268293
sk0.2546583850931677
pl0.24433249370277077
hu0.23076923076923078
az0.2248062015503876
eu0.22380336351875807
nl0.18588873812754408
is0.12536443148688048
vi0.11504424778761062
hr0.08952959028831564
lv0.08952959028831564
reliabletrue
passestrue
10
name"Hunter"
dialogue"Thanks again. Keep snapping, and stay out of harm's way."
detectedLang"en"
heavyLang"en"
scores
en0.8109879032258065
nl0.5753114382785957
tl0.5271122320302648
yo0.36115843270868825
pt0.3119266055045872
no0.3042671614100185
ms0.29245283018867924
vi0.27884615384615385
hu0.20718816067653278
is0.19181034482758622
de0.1812227074235808
sv0.17218543046357618
fi0.17035398230088497
da0.15730337078651685
et0.15730337078651685
fr0.15730337078651685
reliabletrue
passestrue