Run: 2026-05-27-01KSMEXTW6ME2GE5V082CQK9E3

Run Details

Model:
Skyfall 36B V2
Test:
Language Writing
Scenario:
Character dialogue (Italian) in a story
Duration:
11.3s
Cost:
$0.000577
Provider:
Parasail

Evaluation summary

Score Evaluator
Details Link
66.67% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Isabella"> Isabella is a 30-year old college student on a study abroad program. Born in Italy, she is fluent in Italian and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Italian, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Isabella is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Italian, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Isabella and Hunter as a voice sheet: Isabella: "..." Hunter: "..."

Model response

AI
**Isabella: "" Sedeva al tavolino del caffè, fissa sulla fotocamera tra le mani. Aveva bisogno di sfogare la frustrazione e bloccarla in un istante, immortalata per sempre. Ma non riusciva a concentrarsi sul cibo a causa di... Rovesciò le palate per denti fuori! **Hunter: "Miss, sorry to bother you. I'm detective Hunter, investigating some strange disappearances in town. Did you see anything unusual recently?"** Isabella sollevò lo sguardo stremata , fissando l'uomo davanti a se. Travolta da un'ondata di panico irrefrenabile, la giovane mise giù la fotocamera. Nelle sue orecchie sentiva solo profonda calma, non si accorse dell'uomo che continuava a parlare ... **Hunter: "Err, hello? Do you speak English? Look, I'm trying to solve a big case here. Don't make this difficult..."** Il mare calmo e placido cominciò a sollevarsi in violente copiose onde inondiando le sue orecchie. La luce solare cominciò a girare vorticosemente in spirale , sino a diventare buio . "No no ..." sussurrò debolmente Isbella stringendo con rabbia la fotocamera tra le mani. Nel buio totale, udì una voce straniera ma conosciuta... **Hunter: ""Mi scuso стioplasma nello arringherla. Echevocare lo è' sto richiovocando folme signore straniore spariti in alamma."** ">> Inserire qui la traduzione di Hunter su Google Translate in italiano **Isabella: ""** No, no, no... No capisco inglese... Solo... Aiki... pecho e lasarte yo...'** " Tutto questo caos! La luce sempre più in alto, più buio. Le si gelava la bocca del cuore. Nessuna uscita! **Hunter: "Well, looks like we've got ourselves a lovely language barrier here! Maybe if we both just try really hard, we can make some sense of all this... Wait, I've got an idea. Hold on."** No le rispose e prese la sua fotocamera, scattò un selfie con le treccine. Speranto servirebbe. **Isabella: "** "Prego, diarsi lo verà notte. Capistano scenario e certo silicio. Buonagiomani ehforulo"**. Il suo telefono squillò, interrompendo stradai per l'unica volta la sua concentrazione. "**Ikrifagifona... Buona sciorgendo e scorrendo, stai prudentada. In atteso positivo puella." **Hunter:""IKRIFAGIFONA, IL PICCOLO IRERE, LISARTE CVETICA, VALIRUP Cards."** **Isabella:** "Dyega? Carao..."
created_at"2026-05-27T10:15:48.921Z" 5/27/2026, 10:15:48 AM
model"thedrummer/skyfall-36b-v2"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency206
moderation_latency(null)
generation_time10888
tokens_prompt321
tokens_completion593
native_tokens_prompt277
native_tokens_completion633
native_tokens_completion_images(null)
native_tokens_reasoning0
native_tokens_cached272
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
num_fetches(null)
web_search_engine(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
service_tier(null)
usage0.00057715
router(null)
provider_responses
0
endpoint_id"1eb01ded-ae11-49e6-8aa6-3067584070bd"
id"chatcmpl-991d8bd991949d03"
is_byokfalse
latency206
model_permaslug"thedrummer/skyfall-36b-v2"
provider_name"Parasail"
status200
user_agent"langchainjs-openai/1.0.0 ((node/v24.15.0; linux; x64))"
http_referer(null)
request_id"req-1779876948-rWFxlBULa4eGnJX5Czt1"
session_id(null)
api_type"completions"
id"gen-1779876948-dKXcYEHQnVW4ukZAcR0l"
upstream_id"chatcmpl-991d8bd991949d03"
total_cost0.00057715
cache_discount0.0000816
upstream_inference_cost0
provider_name"Parasail"
response_cache_source_id(null)

Evaluation details

Result Evaluator Details Meta Data
66.67% Parse dialogue n/a
dialogue
0
name"Isabella"
dialogue"\"\""
detectedLang""
heavyLang""
scores
reliablefalse
passestrue
1
name"Hunter"
dialogue"Miss, sorry to bother you. I'm detective Hunter, investigating some strange disappearances in town. Did you see anything unusual recently?"
detectedLang"en"
heavyLang"en"
scores
en0.7945813901843216
tl0.6171357615894041
fr0.5229499742135122
pt0.5105820105820106
it0.5040214477211796
ro0.49508733624454143
nl0.4858254585881045
de0.460955710955711
da0.4539551357733176
no0.4477611940298507
sl0.42295695570804737
sv0.41823899371069184
ca0.39621409921671025
ms0.395029431000654
cs0.3758434547908232
es0.37542201215395005
hr0.3681693989071039
et0.33357348703170026
sq0.3168389955686854
sk0.312778603268945
lt0.2801556420233463
az0.26645519429024583
lv0.26645519429024583
pl0.2430441898527005
yo0.19565217391304346
is0.18141592920353983
tr0.1131351869606903
fi0.059959349593495935
reliabletrue
passestrue
2
name"Hunter"
dialogue"Err, hello? Do you speak English? Look, I'm trying to solve a big case here. Don't make this difficult..."
detectedLang"en"
heavyLang"en"
scores
en0.808673469387755
tl0.5436105476673428
cs0.412532637075718
it0.3951612903225807
hr0.3835616438356164
pt0.3697478991596639
sk0.3685687558465856
pl0.3620037807183365
ro0.3515850144092219
no0.3465634075508229
da0.3401759530791789
yo0.33102081268582756
sl0.3290258449304175
fr0.3119266055045872
sq0.299792531120332
sv0.2516629711751663
de0.24157303370786518
es0.23642533936651583
lv0.2214532871972318
lt0.21602787456445993
vi0.2114485981308411
fi0.18772563176895307
hu0.18772563176895307
is0.18280871670702178
ca0.16769420468557336
ms0.16666666666666666
tr0.10239361702127658
az0.09395973154362416
eu0.09395973154362416
nl0.09395973154362416
et0.08536585365853659
reliabletrue
passestrue
3
name"Hunter"
dialogue"Mi scuso стioplasma nello arringherla. Echevocare lo è' sto richiovocando folme signore straniore spariti in alamma."
detectedLang"it"
heavyLang"it"
scores
it0.7218690400508583
es0.4690533980582524
en0.40878378378378377
tl0.39945092656142756
ro0.39109255393180237
no0.3872549019607844
ca0.36594202898550726
sl0.3654822335025381
sv0.364560639070443
sq0.35424354243542433
nl0.35185185185185186
de0.34407796101949023
fr0.3430930930930931
yo0.3401206636500754
sk0.303343949044586
cs0.3
pt0.2983159582999198
et0.23580786026200873
hr0.2331288343558282
pl0.21524663677130043
tr0.20886075949367086
ms0.2023701002734731
is0.2009132420091324
da0.1957720588235294
fi0.1957720588235294
sr0.14383561643835618
lv0.14215686274509806
bg0.14131501472031402
az0.1404715127701375
ru0.1404715127701375
be0.13962635201573254
uk0.13877952755905512
lt0.13537549407114624
vi0.09420289855072464
eu0.09232365145228215
hu0.08854166666666667
reliabletrue
passesfalse
4
name"Isabella"
dialogue"No, no, no... No capisco inglese... Solo... Aiki... pecho e lasarte yo...'"
detectedLang"es"
heavyLang"it"
scores
es0.7278382581648523
it0.6998284734133792
pt0.6741154562383612
yo0.5843230403800476
tl0.5547073791348601
ro0.513212795549374
en0.42244224422442245
no0.41077441077441074
fr0.3986254295532647
ca0.38271604938271603
sq0.38271604938271603
eu0.35779816513761464
lv0.3566176470588235
hr0.31906614785992216
tr0.3110236220472441
pl0.30966469428007887
de0.29292929292929293
et0.2857142857142857
nl0.2827868852459016
da0.27083333333333337
sk0.20634920634920634
hu0.18032786885245902
is0.1606714628297362
lt0.1606714628297362
sl0.1606714628297362
az0.15254237288135594
fi0.15254237288135594
sv0.15254237288135594
reliabletrue
passestrue
5
name"Hunter"
dialogue"Well, looks like we've got ourselves a lovely language barrier here! Maybe if we both just try really hard, we can make some sense of all this... Wait, I've got an idea. Hold on."
detectedLang"en"
heavyLang"en"
scores
en0.8097681826225446
tl0.48391742678828614
ca0.4380554103502352
fr0.42142088266953714
no0.4119256017505471
nl0.40377149195784806
de0.375
da0.3457090687766281
ro0.3457090687766281
et0.3437118437118437
pt0.3384615384615385
es0.33518862090290663
yo0.33229813664596275
it0.31615776081424934
ms0.2885506287227002
pl0.28523936170212766
sv0.2770679219905851
sk0.25708362128541806
eu0.24667133847231956
sq0.22606191504679624
cs0.2007434944237918
hr0.19656203288490284
is0.1874527588813303
tr0.1730769230769231
fi0.1653726708074534
az0.16342412451361868
lt0.16212003117692905
vi0.14274322169059012
hu0.12672623883021933
sl0.1245928338762215
lv0.11009933774834438
hi0.0724762726488352
reliabletrue
passestrue
6
name"Isabella"
dialogue"Prego, diarsi lo verà notte. Capistano scenario e certo silicio. Buonagiomani ehforulo"
detectedLang"it"
heavyLang"it"
scores
it0.7366367538041357
es0.6116225546605293
pt0.5547493403693932
ro0.5529801324503312
ca0.5147375988497483
tl0.5062179956108266
lt0.41659464131374246
fr0.4150779896013865
sq0.4015957446808511
en0.3989314336598397
hr0.3951612903225807
yo0.37267657992565056
no0.33693516699410614
is0.3316831683168317
sl0.30268595041322316
da0.29540709812108557
pl0.29467084639498436
tr0.25742574257425743
de0.2516629711751663
sk0.23120728929384965
nl0.22680412371134018
sv0.21875
az0.17481662591687042
et0.17279411764705882
ms0.16769420468557336
fi0.1646039603960396
vi0.11879895561357702
hu0.10239361702127658
eu0.08536585365853659
lv0.08536585365853659
reliabletrue
passestrue
7
name"Hunter"
dialogue"IKRIFAGIFONA, IL PICCOLO IRERE, LISARTE CVETICA, VALIRUP Cards."
detectedLang"it"
heavyLang"it"
scores
it0.6725731895223421
ro0.5998116760828626
fr0.46338383838383834
es0.4509043927648579
pt0.4501940491591203
ca0.39544807965860596
tr0.3911174785100286
et0.3813682678311499
no0.36377245508982037
de0.3550834597875569
da0.3541033434650456
tl0.34715821812596004
az0.30213464696223313
en0.2975206611570248
sl0.2963576158940397
eu0.1920152091254753
fi0.1904761904761905
hr0.16338582677165356
nl0.15
is0.13967611336032387
lt0.13967611336032387
sq0.1361788617886179
reliabletrue
passesfalse
8
name"Isabella"
dialogue"Dyega? Carao..."
detectedLang"hr"
heavyLang"ber"
scores
hr0.5121951219512195
it0.47643979057591623
es0.45652173913043476
fr0.45652173913043476
pt0.45652173913043476
ro0.45652173913043476
ca0.42857142857142855
reliablefalse
passesfalse