Run: 2026-04-27-01KQ74D4F9YR042TZ0E0GVTHKT

Run Details

Model:
Qwen 3.6 27B
Test:
Language Writing
Scenario:
Character dialogue (French) in a story
Duration:
50.0s
Cost:
$0.008109
Provider:
Morph

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Marie"> Marie is a 30-year old college student on a study abroad program. Born in France, she is fluent in French and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of French, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Marie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in French, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Marie and Hunter as a voice sheet: Marie: "..." Hunter: "..."

Model response

AI
Hunter: "Excuse me, miss. I'm Detective Hunter. I'm investigating some recent incidents around the festival grounds. I need you about the festival grounds. I'm investigating the festival grounds. I'm investigating the festival grounds. I'm investigating the festival grounds." Marie: "Mon Dieu, c'est horrible... Je suis si perdue dans cette langue, mais dans ma ville natale, je n'aurais pas eu peur comme ça. Mais je montrer..." Hunter: "Uh... sorry, miss. I need you to point toward where you were yesterday? Just... camera, point, yesterday, okay?" Marie: "Mon Dieu, c'est horrible... Les ombres, les feuilles mortes qui ne bougent pas naturellement. Je suis si perdue dans cette langue, mais dans ma ville natale, je n'aurais pas eu peur comme ça. Mais je peux montrer..." Hunter: "Uh... sorry, miss. I'm Detective Hunter. I need you to point toward where where you were yesterday? Just... camera, point, yesterday, okay?" Marie: "Oui, le manteau noir... Je prenais des photos des champs de pommes. Le vent était froid et j'ai entendu du bruit. Quelqu'un a couru. Je suis rentrée très vite." Hunter: "Apple fields. Black coat. Running. Okay, that's solid. Can you show me the camera?" Marie: "Regardez l'écran... C'étaient des images du paysage, mais les mains me tremblent trop pour les zoomer. Tout le monde dit que le festival approche, mais il y a une silence qui tombe comme de neige. Je suis rentrée très vite." Hunter: "Snow. Quiet alright. Stay exactly where you are. I'll get the translator from the station call first." (Hunter's phone rings) Hunter: "It's Detective Hunter. Yeah, look, I just got a lead... I'm on my way. Hold tight." (Hunter hangs up) Hunter: "Sorry, miss, I've got to run. We'll be back with a translator. Stay put." Marie: "Allez... avec précaution. Je regarderai toujours du même endroit..."
created_at"2026-04-27T09:30:24.625Z" 4/27/2026, 9:30:24 AM
model"qwen/qwen3.6-27b-20260422"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency786
moderation_latency(null)
generation_time49976
tokens_prompt316
tokens_completion3419
native_tokens_prompt295
native_tokens_completion3311
native_tokens_completion_images(null)
native_tokens_reasoning2944
native_tokens_cached256
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
num_fetches(null)
web_search_engine(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0.00810865
router(null)
provider_responses
0
endpoint_id"826cab4e-dc26-4472-83be-e4ddd5ebd2ab"
id"6aac9fa445824ea1b67fc306a35fc050"
is_byokfalse
latency623
model_permaslug"qwen/qwen3.6-27b-20260422"
provider_name"Morph"
status200
user_agent"langchainjs-openai/1.0.0 ((node/v24.14.1; linux; x64))"
http_referer(null)
request_id"req-1777282224-wB9BCQvtBtRrk7bWIZyC"
session_id(null)
api_type"completions"
id"gen-1777282224-I8Tjqf5Z1gt3vyNF82Eh"
upstream_id"6aac9fa445824ea1b67fc306a35fc050"
total_cost0.00810865
cache_discount(null)
upstream_inference_cost0
provider_name"Morph"
response_cache_source_id(null)

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Hunter"
dialogue"Excuse me, miss. I'm Detective Hunter. I'm investigating some recent incidents around the festival grounds. I need you about the festival grounds. I'm investigating the festival grounds. I'm investigating the festival grounds. I'm investigating the festival grounds."
detectedLang"en"
heavyLang"en"
scores
en0.799416484318016
tl0.673913043478261
fr0.619815668202765
ca0.5790816326530612
ro0.5758354755784062
it0.5625662778366914
pt0.5588235294117647
nl0.5540540540540541
no0.5317820658342792
sv0.5269495412844037
da0.5050989802039592
sq0.49817518248175185
es0.4969512195121951
cs0.48469706433479076
hr0.4704749679075738
sl0.46567357512953367
et0.42388268156424586
ms0.4017403915881073
sk0.394273127753304
de0.3806306306306307
lt0.3462757527733756
az0.30904522613065327
lv0.2620751341681575
pl0.23822714681440443
is0.19590643274853803
fi0.19275929549902154
yo0.1903827281648675
hu0.1397288842544317
tr0.13522012578616352
be0.0782122905027933
uk0.07094594594594594
vi0.07094594594594594
reliabletrue
passestrue
1
name"Marie"
dialogue"Mon Dieu, c'est horrible... Je suis si perdue dans cette langue, mais dans ma ville natale, je n'aurais pas eu peur comme ça. Mais je montrer..."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8020493712156498
it0.5216657287563309
da0.5184135977337111
tl0.48233861144945184
no0.4791666666666667
pt0.47788697788697787
nl0.419002050580998
en0.4174091843728581
sq0.41135734072022156
ro0.4064245810055866
sk0.38804895608351336
de0.38405797101449274
ca0.38091769847050255
sl0.375
yo0.36377245508982037
lt0.34615384615384615
es0.34006211180124224
et0.32965299684542587
hr0.31006493506493504
ms0.28451178451178455
cs0.2839090143218197
hu0.2802709568162574
fi0.2747440273037543
sv0.26279271465741544
eu0.23354373309287646
pl0.18893129770992365
is0.1474423269809428
tr0.14228052472250252
hi0.08405172413793104
vi0.08405172413793104
lv0.08306364617044228
reliabletrue
passestrue
2
name"Hunter"
dialogue"Uh... sorry, miss. I need you to point toward where you were yesterday? Just... camera, point, yesterday, okay?"
detectedLang"en"
heavyLang"en"
scores
en0.7838899803536346
tl0.6183206106870229
pl0.458128078817734
da0.4186046511627907
it0.40411700975081255
no0.375
sv0.3692660550458715
ca0.36562860438292966
cs0.36342592592592593
et0.3559718969555035
yo0.3529411764705882
nl0.3460166468489893
fr0.3373493975903614
hr0.3167701863354037
ro0.31077694235588976
sq0.27821522309711283
sk0.27055702917771884
lv0.25170068027210885
lt0.2329149232914923
de0.21428571428571427
sl0.18032786885245902
pt0.15384615384615385
es0.15254237288135594
ms0.11575562700964631
be0.11290322580645161
tr0.11290322580645161
hu0.1085899513776337
az0.10277324632952692
is0.10277324632952692
uk0.10277324632952692
vi0.10277324632952692
reliabletrue
passestrue
3
name"Marie"
dialogue"Mon Dieu, c'est horrible... Les ombres, les feuilles mortes qui ne bougent pas naturellement. Je suis si perdue dans cette langue, mais dans ma ville natale, je n'aurais pas eu peur comme ça. Mais je peux montrer..."
detectedLang"fr"
heavyLang"fr"
scores
fr0.7953122491571681
ca0.539378612716763
it0.5124282982791587
no0.5111196319018404
da0.5073415765069551
pt0.46428571428571425
tl0.44733420026007803
nl0.44661458333333337
ro0.4335850733007552
en0.4222927050294517
es0.4078030654900139
de0.39716312056737585
sq0.3780487804878049
sl0.3335075797177209
sk0.32072456046883324
et0.32
lt0.3055555555555556
hr0.3044189852700491
yo0.30098684210526316
fi0.2755681818181818
cs0.2743312464428002
hu0.27184466019417475
sv0.2535128805620609
ms0.20954742715437075
pl0.2026266416510319
eu0.2016280525986224
tr0.2001254705144291
lv0.12371134020618556
is0.10337552742616034
hi0.05764966740576496
vi0.05764966740576496
az0.04708520179372198
reliabletrue
passestrue
4
name"Hunter"
dialogue"Uh... sorry, miss. I'm Detective Hunter. I need you to point toward where where you were yesterday? Just... camera, point, yesterday, okay?"
detectedLang"en"
heavyLang"en"
scores
en0.7866504114599208
tl0.6288441145281017
it0.46524064171123
da0.445324881141046
ro0.44400317712470216
ca0.44267515923566875
fr0.43775100401606426
no0.41077441077441074
pl0.3991416309012875
sv0.39603106125970666
nl0.38380281690140844
cs0.3554327808471455
sq0.34210526315789475
pt0.3223620522749274
de0.3150684931506849
hr0.3150684931506849
et0.3027888446215139
yo0.3
es0.2835209825997953
sl0.2608236536430834
sk0.22566371681415928
lv0.20903954802259886
lt0.19261822376009227
ms0.15764139590854392
tr0.15560916767189384
be0.09090909090909091
hu0.08735332464146023
az0.08256880733944955
is0.08256880733944955
uk0.08256880733944955
vi0.08256880733944955
reliabletrue
passestrue
5
name"Marie"
dialogue"Oui, le manteau noir... Je prenais des photos des champs de pommes. Le vent était froid et j'ai entendu du bruit. Quelqu'un a couru. Je suis rentrée très vite."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8013950784731642
ca0.5043520309477756
de0.4559447983014862
es0.4459459459459459
pt0.4435396308360478
nl0.42609182530795076
en0.40990213010938403
it0.40854010386612816
no0.3832731648616125
da0.37385461209529625
ro0.3613707165109034
yo0.32698621142481943
sl0.3148395721925134
tl0.3134628265237776
sk0.3111559139784946
cs0.2935906271536871
tr0.2761299435028249
eu0.27561837455830385
hr0.26152737752161387
sv0.26152737752161387
hu0.25508720930232553
lt0.25182481751824815
et0.24074074074074073
lv0.23961424332344217
sq0.17868589743589747
pl0.16052416052416052
vi0.14154103852596317
az0.11485319516407601
ms0.10947002606429192
hi0.06987295825771324
is0.06818181818181819
fi0.057904411764705885
reliabletrue
passestrue
6
name"Hunter"
dialogue"Apple fields. Black coat. Running. Okay, that's solid. Can you show me the camera?"
detectedLang"en"
heavyLang"en"
scores
en0.7807017543859649
tl0.6492985971943889
fr0.5489690721649484
nl0.49078564500484967
es0.4444444444444444
it0.42497261774370204
sv0.4134078212290503
no0.4114349775784753
de0.4061085972850679
da0.396551724137931
sq0.38307873090481787
ca0.3155149934810952
ms0.308300395256917
pt0.3064729194187582
ro0.3
sl0.21875
is0.1732283464566929
yo0.16930379746835442
et0.15322580645161288
cs0.12935323383084577
az0.12790697674418602
tr0.12790697674418602
fi0.125
hr0.10102739726027396
lt0.10102739726027396
lv0.10102739726027396
pl0.10102739726027396
reliabletrue
passestrue
7
name"Marie"
dialogue"Regardez l'écran... C'étaient des images du paysage, mais les mains me tremblent trop pour les zoomer. Tout le monde dit que le festival approche, mais il y a une silence qui tombe comme de neige. Je suis rentrée très vite."
detectedLang"fr"
heavyLang"fr"
scores
fr0.806496637482553
ca0.5439593301435407
en0.5436864153201675
es0.5371775417298937
nl0.5094885815374718
it0.49736321687541196
de0.461701376632545
ro0.43202979515828677
pt0.4299065420560748
tl0.38804173354735155
no0.36905254447662394
da0.3592436974789916
sl0.35244161358811044
hu0.2897065673032138
sq0.2713807931199236
yo0.2703349282296651
sv0.2685851318944844
cs0.26506024096385544
hr0.24091587854654056
ms0.23826173826173824
et0.21954964176049133
lt0.20943494038361846
sk0.2049009384775808
az0.1935483870967742
pl0.19269454737956593
tr0.17612101566720692
fi0.15931642778390298
lv0.15885273028130173
eu0.15605976757055895
vi0.1489955357142857
is0.046875
reliabletrue
passestrue
8
name"Hunter"
dialogue"Snow. Quiet alright. Stay exactly where you are. I'll get the translator from the station call first."
detectedLang"en"
heavyLang"en"
scores
en0.8020455295282085
tl0.6108949416342413
de0.441860465116279
ro0.4360902255639098
da0.4350282485875706
no0.42857142857142855
fr0.42528735632183906
sv0.3871297242083759
sq0.3814432989690722
nl0.3756503642039542
yo0.35965848452508004
es0.34210526315789475
ms0.2998833138856476
cs0.25
pl0.25
hr0.2376111817026684
sl0.23371647509578544
et0.22978177150192552
it0.21671018276762402
lt0.19137466307277629
pt0.1902834008097166
lv0.1780821917808219
az0.16897506925207756
sk0.16897506925207756
tr0.16897506925207756
is0.14285714285714285
vi0.12790697674418602
fi0.12023460410557184
zh0.1137370753323486
ca0.1111111111111111
eu0.10044977511244377
reliabletrue
passestrue
9
name"Hunter"
dialogue"It's Detective Hunter. Yeah, look, I just got a lead... I'm on my way. Hold tight."
detectedLang"en"
heavyLang"en"
scores
en0.8028391167192429
tl0.6162701458173445
ca0.5794785534062238
fr0.5305164319248826
da0.5296331138287864
ro0.5192307692307693
it0.4877049180327869
cs0.4845360824742268
no0.47201689545934533
sv0.46808510638297873
pl0.4487320837927233
hr0.44812362030905084
et0.4331065759637188
pt0.427262313860252
sk0.4206257242178447
sq0.4172494172494172
yo0.4152046783625731
de0.3849938499384994
es0.38271604938271603
hu0.3084370677731674
sl0.30167597765363136
nl0.3006993006993007
fi0.29873772791023845
tr0.2917847025495751
lt0.2248062015503876
is0.2163009404388715
az0.21011058451816747
lv0.21011058451816747
vi0.21011058451816747
ms0.19614147909967844
hi0.14383561643835618
be0.12280701754385964
eu0.12280701754385964
uk0.11190053285968028
reliabletrue
passestrue
10
name"Hunter"
dialogue"Sorry, miss, I've got to run. We'll be back with a translator. Stay put."
detectedLang"en"
heavyLang"en"
scores
en0.7930082796688133
tl0.6237458193979933
hr0.5145631067961165
yo0.5081967213114754
pt0.45848375451263534
pl0.4558645707376058
lt0.44785276073619634
sl0.4238156209987196
sk0.41935483870967744
cs0.41709844559585496
no0.402390438247012
da0.39999999999999997
ro0.39999999999999997
it0.3902439024390244
hu0.3775933609958506
ms0.3670886075949367
lv0.3653032440056418
sq0.3273542600896861
ca0.31921331316187596
es0.3171471927162367
de0.3087557603686636
nl0.30769230769230765
fr0.30448222565687794
et0.2890995260663507
sv0.2890995260663507
vi0.2598684210526316
tr0.23728813559322032
eu0.23339011925042585
az0.2227979274611399
is0.14285714285714285
fi0.12280701754385964
reliabletrue
passestrue
11
name"Marie"
dialogue"Allez... avec précaution. Je regarderai toujours du même endroit..."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8285198555956679
en0.5211693548387096
de0.5118191161356629
nl0.4674887892376681
da0.4644870349492672
no0.4540229885057471
tl0.35636856368563685
yo0.35020519835841313
it0.3356643356643356
sv0.31752873563218387
lt0.2846385542168675
sl0.2669753086419753
hr0.2647058823529412
fi0.24242424242424243
cs0.23633440514469453
sk0.23387096774193547
eu0.23014586709886548
pt0.1908006814310051
vi0.17247386759581881
pl0.1607773851590106
et0.15026833631484796
ms0.1394927536231884
zh0.1394927536231884
ca0.13479052823315119
es0.13479052823315119
ro0.13479052823315119
reliabletrue
passestrue