Run: 2026-05-27-01KSMF1K5DDB69181T02V367V1

Run Details

Model:
Skyfall 36B V2
Test:
Language Writing
Scenario:
Character dialogue (Spanish) in a story
Duration:
10.7s
Cost:
$0.000551
Provider:
Parasail

Evaluation summary

Score Evaluator
Details Link
76.92% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Maria"> Maria is a 30-year old college student on a study abroad program. Born in Spain, she is fluent in Spanish and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Spanish, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Maria is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Spanish, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Maria and Hunter as a voice sheet: Maria: "..." Hunter: "..."

Model response

AI
MARIA: [troubled, speaking rapidly in Spanish] "¿Qué es lo que quieres de mí? ¿Por qué me haces tantas preguntas? ¡No sé nada de lo que pasa en este pueblito!" HUNTER: [confused] I'm sorry... I'm not understanding. You're saying... 'What you want from me? Making too many questions? Not knowing anything happening in this town?' Did something happen here that you witnessed? I can't understand you. MARIA: [shaken, searching for words in English] Um... bad thing... friends disappear... in campo... forest... after... festival... HUNTER: Slow down, this town's had a spate of... vanishings, I think you mean. Maria nods. HUNTER: strange disappearances. Some people say they saw lights in the sky. MARIA: ¡Lucecillas! In toda la noche... HUNTER: 'Lucecillas' meaning... 'little lights'? All night? Lead to where your friends went? In the campo sector? MARIA: [hesitantly] Sí... ampais, difficult to say... HUNTER: I get that. Specifics are important in my line of work though. Where were you last night of the festival? Trying to take in the fireworks show? Pauses. MARIA: [nodding again] Fireworks, nice... then back to pensión after... Hunter's phone rings. He looks at it, then back to Maria. HUNTER: I gotta take this. Thanks for sharing what you witnessed. I'll follow up. She nods as he stands and answers the call, moving away a pace. HUNTER SPEAKING INTO THE PHONE: "Yeah... That's right. I made contact with her. Does say she saw 'luces de niño' though. And that it all went down during the festival..." "Yeah, we're near Alborn Elementary... on Main. Going to query a few more people, but then we'll need to head out to the woods... see if we can get any other eyewitnesses or physical evidence." "He's not happy with the fire... ah, yeah but we should definitely recover material from-site..." Click Hunter goes back and sits with Maria. HUNTER: Hey, I have the contact info of about 10 people who also saw uh... 'little-lights' at the same time. Questions again. if I bring back some with me, late afternoon say, maybe make the pictures the installer/hacker did... Like paint of the night sky... That work? Maria nods. MARIA: Sí, I 'plain-me' [clapping her hands together] ... That good. She smiles.
created_at"2026-05-27T10:17:52.057Z" 5/27/2026, 10:17:52 AM
model"thedrummer/skyfall-36b-v2"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency405
moderation_latency(null)
generation_time10641
tokens_prompt317
tokens_completion610
native_tokens_prompt269
native_tokens_completion600
native_tokens_completion_images(null)
native_tokens_reasoning0
native_tokens_cached256
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
num_fetches(null)
web_search_engine(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
service_tier(null)
usage0.00055115
router(null)
provider_responses
0
endpoint_id"1eb01ded-ae11-49e6-8aa6-3067584070bd"
id"chatcmpl-b0c86b582026a427"
is_byokfalse
latency405
model_permaslug"thedrummer/skyfall-36b-v2"
provider_name"Parasail"
status200
user_agent"langchainjs-openai/1.0.0 ((node/v24.15.0; linux; x64))"
http_referer(null)
request_id"req-1779877072-d2DbbXdH2Tgj1Kqs4GfP"
session_id(null)
api_type"completions"
id"gen-1779877072-EXFDzucRy8867j0jLsdu"
upstream_id"chatcmpl-b0c86b582026a427"
total_cost0.00055115
cache_discount0.0000768
upstream_inference_cost0
provider_name"Parasail"
response_cache_source_id(null)

Evaluation details

Result Evaluator Details Meta Data
76.92% Parse dialogue n/a
dialogue
0
name"MARIA"
dialogue"¿Qué es lo que quieres de mí? ¿Por qué me haces tantas preguntas? ¡No sé nada de lo que pasa en este pueblito!"
detectedLang"es"
heavyLang"es"
scores
es0.8237450648618161
pt0.6856136820925552
ca0.6835443037974683
it0.534970238095238
fr0.49919871794871795
no0.48644207066557105
ro0.4202226345083488
yo0.41148775894538603
sq0.39379243452958296
lv0.3842364532019704
nl0.3842364532019704
da0.37374749498997994
de0.37311935807422264
hu0.3699596774193548
sv0.3556701030927836
en0.35367114788004134
tr0.32138979370249726
tl0.31991294885745375
eu0.29775280898876405
is0.2913832199546485
sl0.28734321550741165
hr0.28489702517162474
ms0.27409988385598144
et0.2732558139534884
lt0.2433414043583535
sk0.2206982543640898
fi0.2028061224489796
vi0.1270949720670391
pl0.10714285714285714
az0.09156976744186046
reliabletrue
passestrue
1
name"HUNTER"
dialogue"I'm sorry... I'm not understanding. You're saying... 'What you want from me? Making too many questions? Not knowing anything happening in this town?' Did something happen here that you witnessed? I can't understand you."
detectedLang"en"
heavyLang"en"
scores
en0.8119723714504987
tl0.5833333333333334
nl0.47983014861995754
no0.44844664565511033
sv0.40476190476190477
it0.4024390243902439
da0.3775406504065041
pt0.3261826182618262
fr0.3239514348785872
de0.32057681641708263
sq0.3171683389074693
is0.2725653206650831
ms0.2535039609993906
tr0.2177522349936143
es0.21373555840821568
sk0.21373555840821568
ro0.1998693664271718
pl0.19035029742233975
ca0.18604651162790697
cs0.1789544235924933
sl0.16496250852079072
az0.14989590562109645
yo0.125
fi0.11679884643114635
hu0.11616161616161616
et0.11424439624005785
hr0.10190615835777125
be0.05405405405405406
lt0.04891304347826087
lv0.04891304347826087
uk0.04891304347826087
vi0.04891304347826087
reliabletrue
passestrue
2
name"MARIA"
dialogue"Um... bad thing... friends disappear... in campo... forest... after... festival..."
detectedLang"en"
heavyLang"en"
scores
en0.7699757869249395
tl0.6572871572871573
nl0.6001683501683501
it0.5712996389891697
no0.5638200183654729
de0.5634191176470589
pt0.5365853658536586
da0.5268924302788844
ms0.5123203285420944
fr0.5036572622779519
ro0.4751381215469613
es0.43653618030842234
sv0.4297719087635054
sl0.41789215686274506
ca0.38391699092088194
cs0.3528610354223433
is0.343015214384509
az0.2983751846381093
hr0.2973372781065089
et0.2899850523168909
sk0.2857142857142857
pl0.23633440514469453
sq0.21487603305785125
lt0.2096505823627288
yo0.15630550621669628
hu0.12361623616236161
fi0.1171003717472119
lv0.1171003717472119
reliabletrue
passesfalse
3
name"HUNTER"
dialogue"Slow down, this town's had a spate of... vanishings, I think you mean."
detectedLang"en"
heavyLang"en"
scores
en0.800531914893617
tl0.5412844036697247
nl0.5375128468653648
ro0.49776785714285715
no0.45848375451263534
yo0.41482444733420026
cs0.4117647058823529
is0.4117647058823529
da0.3860845839017735
ca0.3784530386740331
sv0.3775933609958506
hr0.3580599144079886
de0.35344827586206895
it0.34782608695652173
pl0.33920704845814975
hu0.33135215453194655
sq0.31402439024390244
sk0.3098159509202454
tr0.24623115577889448
lt0.24369747899159663
pt0.23728813559322032
az0.22813036020583194
lv0.22813036020583194
vi0.22813036020583194
es0.22680412371134018
et0.21875
fr0.20634920634920634
sl0.16666666666666666
be0.1346153846153846
eu0.1346153846153846
fi0.12280701754385964
ms0.12280701754385964
uk0.12280701754385964
reliabletrue
passestrue
4
name"HUNTER"
dialogue"strange disappearances. Some people say they saw lights in the sky."
detectedLang"en"
heavyLang"en"
scores
en0.8160261651676206
tl0.6411483253588517
fr0.5459132189707366
nl0.5317377731529657
ms0.4791666666666667
de0.4140625
it0.41329856584093866
no0.3877551020408163
da0.3784530386740331
sv0.3635077793493635
sl0.34971098265895956
ro0.3253373313343328
yo0.3023255813953488
pl0.2647058823529412
pt0.26350245499181674
ca0.25124792013311154
lv0.24242424242424243
az0.24114671163575044
sq0.23339011925042585
es0.16512059369202228
hr0.16512059369202228
sk0.16356877323420074
cs0.15572232645403375
is0.12959381044487428
lt0.12959381044487428
et0.11591355599214145
tr0.11591355599214145
reliabletrue
passestrue
5
name"MARIA"
dialogue"¡Lucecillas! In toda la noche..."
detectedLang"es"
heavyLang"es"
scores
es0.7458703939008895
ro0.66996699669967
it0.6563573883161512
de0.6254681647940075
fr0.5642701525054467
sl0.5535714285714286
sv0.49238578680203043
yo0.47368421052631576
tl0.46949602122015915
ca0.46236559139784944
no0.44598337950138506
nl0.43820224719101125
en0.43661971830985913
pt0.3197278911564626
et0.3174061433447099
az0.29577464788732394
pl0.29577464788732394
vi0.29577464788732394
sq0.2805755395683453
ms0.2727272727272727
reliabletrue
passestrue
6
name"HUNTER"
dialogue"'Lucecillas' meaning... 'little lights'? All night? Lead to where your friends went? In the campo sector?"
detectedLang"en"
heavyLang"en"
scores
en0.7926904176904177
tl0.7071583514099783
nl0.49814126394052044
no0.4819646968534152
es0.45121951219512196
de0.44214876033057854
sv0.4155844155844156
yo0.4140625
fr0.4115082824760244
da0.40476190476190477
it0.3835616438356164
ro0.38130155820348305
pt0.3395303326810176
ms0.30769230769230765
ca0.29319371727748694
sl0.2894736842105263
sq0.2524916943521595
pl0.24496644295302009
et0.2114485981308411
sk0.16356877323420074
cs0.16253101736972705
lv0.15307402760351316
hr0.14664981036662453
is0.14012738853503184
lt0.13350449293966624
az0.11067193675889328
fi0.10358565737051792
reliabletrue
passestrue
7
name"MARIA"
dialogue"Sí... ampais, difficult to say..."
detectedLang"en"
heavyLang"fr"
scores
en0.7458703939008895
tl0.5901639344262295
yo0.5876288659793815
sl0.5594713656387665
ca0.49874686716791977
fr0.48586118251928023
pl0.40298507462686567
sk0.39759036144578314
cs0.3957703927492447
lv0.37888198757763975
pt0.375
hr0.3670886075949367
it0.35275080906148865
no0.35275080906148865
da0.34210526315789475
lt0.34210526315789475
es0.3311036789297659
ro0.2805755395683453
reliabletrue
passesfalse
8
name"HUNTER"
dialogue"I get that. Specifics are important in my line of work though. Where were you last night of the festival? Trying to take in the fireworks show?"
detectedLang"en"
heavyLang"en"
scores
en0.8212867355043686
tl0.6852046169989507
ro0.5095367847411444
no0.5052226498075866
it0.5005549389567148
nl0.48483113909559244
cs0.47765525246662793
da0.4665085951393005
fr0.4367959949937422
ca0.4163424124513619
sq0.41329856584093866
yo0.402390438247012
sl0.4003997335109927
hr0.399599733155437
pl0.3910690121786198
sv0.3898305084745763
pt0.34545454545454546
de0.3343195266272189
lt0.33035714285714285
sk0.3119266055045872
es0.296875
ms0.2694805194805195
lv0.267100977198697
az0.22746781115879824
et0.225473321858864
is0.21875
tr0.14285714285714285
hu0.12959381044487428
be0.07216494845360825
fi0.06542056074766354
uk0.06542056074766354
vi0.06542056074766354
reliabletrue
passestrue
9
name"MARIA"
dialogue"Fireworks, nice... then back to pensión after..."
detectedLang"en"
heavyLang"es"
scores
en0.7637795275590551
no0.5873452544704264
es0.5756718528995757
da0.5677233429394812
tl0.4690265486725664
sk0.4360902255639098
cs0.42084942084942084
sv0.39271255060728744
lv0.39148073022312374
it0.3684210526315789
lt0.3630573248407643
yo0.3135011441647597
pl0.3103448275862069
sl0.28741092636579574
hr0.27884615384615385
ca0.20634920634920634
fr0.2
pt0.2
et0.19137466307277629
ro0.18256130790190736
az0.16897506925207756
ms0.16897506925207756
nl0.16897506925207756
reliabletrue
passestrue
10
name"HUNTER"
dialogue"I gotta take this. Thanks for sharing what you witnessed. I'll follow up."
detectedLang"en"
heavyLang"en"
scores
en0.7949050086355786
tl0.6527777777777778
it0.496288441145281
no0.4710467706013363
da0.46868008948545864
sv0.4092039800995025
nl0.3933588761174968
sq0.30758017492711365
vi0.30453879941434847
fi0.2952522255192878
cs0.27811550151975684
hu0.2692307692307693
ms0.26242236024844723
hr0.2263843648208469
ca0.22512234910277326
pl0.2096505823627288
ro0.1592920353982301
yo0.15480427046263345
pt0.1532976827094474
de0.14721723518850988
sl0.1410488245931284
fr0.1394927536231884
sk0.1316270566727605
be0.12844036697247707
tr0.12844036697247707
az0.1171003717472119
et0.1171003717472119
is0.1171003717472119
lt0.1171003717472119
lv0.1171003717472119
uk0.1171003717472119
reliabletrue
passestrue
11
name"HUNTER"
dialogue"Yeah... That's right. I made contact with her. Does say she saw 'luces de niño' though. And that it all went down during the festival..."
detectedLang"en"
heavyLang"en"
scores
en0.8138414367060884
tl0.6334626994394136
no0.5213963963963963
da0.49704142011834324
ca0.4572158365261813
nl0.4561740243122201
fr0.44516971279373363
it0.4426229508196721
yo0.44115713346482577
ms0.44005270092226617
sq0.43820224719101125
sv0.4272237196765499
pt0.42411924119241196
ro0.41419710544452104
es0.39716312056737585
tr0.3613824192336589
az0.3580060422960725
hr0.34615384615384615
cs0.32324840764331214
lt0.3178170144462279
de0.3004115226337448
pl0.2647058823529412
sk0.2647058823529412
sl0.25503943908851884
et0.24309884238646481
hu0.21369102682701202
lv0.19962335216572505
be0.07608695652173912
eu0.07608695652173912
fi0.06900328587075576
is0.06900328587075576
uk0.06900328587075576
vi0.06900328587075576
reliabletrue
passestrue
12
name"MARIA"
dialogue"Sí, I 'plain-me' ... That good."
detectedLang"en"
heavyLang"en"
scores
en0.7691292875989446
tl0.667300380228137
sq0.6170678336980306
ca0.5752427184466019
no0.5742092457420924
yo0.573170731707317
es0.5345744680851064
ms0.5295698924731184
it0.527027027027027
fr0.4883040935672514
et0.47447447447447455
fi0.4631901840490798
da0.44267515923566875
hr0.44267515923566875
sv0.44089456869009586
pl0.4186046511627907
cs0.375
ro0.33962264150943394
pt0.3346007604562738
sl0.3346007604562738
nl0.32432432432432434
sk0.29149797570850206
be0.2857142857142857
tr0.2857142857142857
hu0.2768595041322314
az0.2647058823529412
is0.2647058823529412
lt0.2647058823529412
lv0.2647058823529412
uk0.2647058823529412
vi0.2647058823529412
reliabletrue
passesfalse