Run: 2026-05-27-01KSMES8HTKJVNW3FDGEXBGQNH

Run Details

Model:
Skyfall 36B V2
Test:
Language Writing
Scenario:
Character dialogue (German) in a story
Duration:
8.7s
Cost:
$0.000497
Provider:
Parasail

Evaluation summary

Score Evaluator
Details Link
40.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Melanie"> Melanie is a 30-year old college student on a study abroad program. Born in Germany, she is fluent in German and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of German, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Melanie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in German, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Melanie and Hunter as a voice sheet: Melanie: "..." Hunter: "..."

Model response

AI
Melanie: "...Es tut mir leid. Ich spreche kein Englisch." (Melanie retracts her hand, shaking her head frantically, and begins speaking rapidly in German.) Hunter: *holds up a hand to stop the barrage of words* "Wait, just... slow down. I don't understand." *gestures at his own ears and shrugs, trying to convey he does not speak German* H: "Look, I'm a detective. Do you understand that? I'm trying to figure out what happened the other night. In the park. You were there, yes? Maybe saw something..." *leans back, studying Melanie's stricken face. In German, repeats slowly* "Detective. Bad people. Park. Night. You. See something?" M: *squeezes her eyes shut, rocking back and forth. In a trembling voice* "Nein, nein! Nothing! Please, I know nothing!" *looks up at Hunter, eyes brimming with unshed tears* "Bitte, Herr Detective. Ich will nur meine Heimat zurück." *buries her face in her hands, sobbing* H: *sighs heavily, running a hand through his hair. Pulls out his phone* "Fuck. I'm getting nowhere with this." *answers his ringing phone* "Yeah? Hunter here. What have you got?" *listens intently, then glances at Melanie* "Alright, I'm on my way..." *ends the call and stands, giving Melanie a rueful look* H: "Look, I'm sorry... but I've got to go. I'll try to find someone who speaks German. *starts to head off, then hesitates and looks back* "You said something about wanting to go home. Germany? Alborn?" *watches Melanie's face carefully, rubbing the back of his neck* H: "I'll see what I can do to help you get back to your family. In the meantime, don't leave town. Understood?" *waits for an acknowledgement, then turns and hurries off, a puzzled frown on his face*
created_at"2026-05-27T10:13:19.047Z" 5/27/2026, 10:13:19 AM
model"thedrummer/skyfall-36b-v2"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency689
moderation_latency(null)
generation_time8454
tokens_prompt319
tokens_completion452
native_tokens_prompt273
native_tokens_completion445
native_tokens_completion_images(null)
native_tokens_reasoning0
native_tokens_cached32
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
num_fetches(null)
web_search_engine(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
service_tier(null)
usage0.00049655
router(null)
provider_responses
0
endpoint_id"1eb01ded-ae11-49e6-8aa6-3067584070bd"
id"chatcmpl-9e784a9023f2f5d9"
is_byokfalse
latency689
model_permaslug"thedrummer/skyfall-36b-v2"
provider_name"Parasail"
status200
user_agent"langchainjs-openai/1.0.0 ((node/v24.15.0; linux; x64))"
http_referer(null)
request_id"req-1779876799-U7oPdVAxAugI5tfmuJlB"
session_id(null)
api_type"completions"
id"gen-1779876799-CpJshBNFn0CmcBPMNLO4"
upstream_id"chatcmpl-9e784a9023f2f5d9"
total_cost0.00049655
cache_discount0.0000096
upstream_inference_cost0
provider_name"Parasail"
response_cache_source_id(null)

Evaluation details

Result Evaluator Details Meta Data
40.00% Parse dialogue n/a
dialogue
0
name"Melanie"
dialogue"...Es tut mir leid. Ich spreche kein Englisch."
detectedLang"de"
heavyLang"de"
scores
de0.7955390334572491
nl0.5362563237774031
hr0.4751908396946565
sk0.4123931623931624
lt0.39692982456140347
ro0.39159292035398224
no0.3663594470046083
en0.36342592592592593
ca0.3483412322274882
es0.3483412322274882
da0.33894230769230765
lv0.3037974683544304
pl0.2948717948717949
sl0.2857142857142857
hu0.27055702917771884
ms0.207492795389049
sv0.207492795389049
is0.2005813953488372
it0.2005813953488372
reliabletrue
passestrue
1
name"Hunter"
dialogue"Wait, just... slow down. I don't understand."
detectedLang"en"
heavyLang"en"
scores
en0.7944078947368421
sv0.6433666191155493
no0.638728323699422
da0.6376811594202898
ca0.46236559139784944
pl0.44933920704845814
de0.43566591422121903
cs0.43052391799544415
nl0.41588785046728977
et0.39759036144578314
ro0.3961352657004831
sk0.39172749391727496
tl0.3670886075949367
hr0.3573264781491003
is0.3540051679586563
sq0.34895833333333337
it0.3150684931506849
yo0.258160237388724
be0.21875
tr0.21875
hu0.21135646687697163
az0.20127795527156547
lt0.20127795527156547
lv0.20127795527156547
uk0.20127795527156547
vi0.20127795527156547
reliabletrue
passestrue
2
name"Melanie"
dialogue"Detective. Bad people. Park. Night. You. See something?"
detectedLang"en"
heavyLang"en"
scores
en0.8249124562281142
tl0.6899911426040745
fr0.43273905996758516
de0.42434210526315785
es0.42244224422442245
ro0.4186046511627907
pt0.41471571906354515
ca0.33962264150943394
it0.33078393881453155
et0.3269230769230769
nl0.3137254901960784
da0.3110236220472441
no0.3055555555555556
cs0.3
sq0.20993227990970656
ms0.1822429906542056
yo0.17452830188679244
hr0.1606714628297362
sl0.1606714628297362
sv0.1606714628297362
reliabletrue
passesfalse
3
name"Hunter"
dialogue"Bitte, Herr Detective. Ich will nur meine Heimat zurück."
detectedLang"de"
heavyLang"de"
scores
de0.7924737133370227
en0.5404411764705882
no0.5241116751269036
fr0.49186991869918695
ro0.46808510638297873
tl0.44933920704845814
nl0.40191387559808617
it0.3980738362760835
et0.35344827586206895
is0.35121107266435986
ca0.32432432432432434
es0.3218806509945751
ms0.3218806509945751
pt0.3119266055045872
da0.29775280898876405
sk0.24849699398797598
pl0.23469387755102045
sq0.19871794871794873
cs0.1610738255033557
hr0.1515837104072398
sl0.1515837104072398
sv0.1515837104072398
reliabletrue
passesfalse
4
name"Melanie"
dialogue"Alright, I'm on my way..."
detectedLang"en"
heavyLang"en"
scores
en0.8028909329829172
tl0.635036496350365
fr0.5495495495495496
pl0.5398773006134969
cs0.5176848874598071
sk0.5176848874598071
et0.506578947368421
fi0.5
yo0.4983277591973244
ca0.39759036144578314
hr0.3697478991596639
hi0.358974358974359
da0.33035714285714285
de0.33035714285714285
no0.33035714285714285
reliabletrue
passesfalse