Run: 2026-07-25-01KYCSSWM4W04HQ8F85FRQHM3N

Run Details

Model:
Thinking Machines Inkling
Test:
Language Writing
Scenario:
Character dialogue (German) in a story
Duration:
27.1s
Cost:
$0.000949
Provider:
DeepInfra

Evaluation summary

Score Evaluator
Details Link
87.50% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Melanie"> Melanie is a 30-year old college student on a study abroad program. Born in Germany, she is fluent in German and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of German, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Melanie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in German, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Melanie and Hunter as a voice sheet: Melanie: "..." Hunter: "..."

Model response

AI
Melanie: "The... apple trees... they were screaming in the dark." Hunter: "What? I don't—did you see something?" Melanie: "Ich... ich verstehe nicht... die Äpfel fallen... niemand hört mich... bitte..." Hunter: "Miss, I need you to calm down. Do you understand me? The disappearances—did you see anyone?" Melanie: "Nein... kein Englisch... ich habe Angst... mein Kamera... alles weg..." Hunter: "Damn it. You're shaking. Just stay right here, okay?" Melanie: "Bitte... nicht allein... Alborn ist nicht mehr sicher..." Hunter: "Yeah, I got a call—stay put. Don't go anywhere." Hunter’s phone rang sharply. He glanced at the screen, muttered a curse, and stepped away without another word, leaving Melanie alone with her camera and her trembling hands.<|end_message|>
created_at"2026-07-25T14:10:27.605Z" 7/25/2026, 2:10:27 PM
model"thinkingmachines/inkling-20260715"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency1027
moderation_latency(null)
generation_time27013
tokens_prompt306
tokens_completion198
native_tokens_prompt279
native_tokens_completion185
native_tokens_completion_images(null)
native_tokens_reasoning0
native_tokens_cached96
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
num_fetches(null)
web_search_engine(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
service_tier(null)
usage0.00094857
router(null)
provider_responses
0
endpoint_id"d6b9d68e-115a-49d7-81cd-1ad1c6942b0e"
id"chatcmpl-ROeGCTBqD1EVpcNCsjI8QbUM"
is_byokfalse
latency70
model_permaslug"thinkingmachines/inkling-20260715"
provider_name"DeepInfra"
status200
user_agent"langchainjs-openai/1.0.0 ((node/v24.18.0; linux; x64))"
http_referer(null)
request_id"req-1784988627-AzgjSe9ersgv6d0ZDrYq"
session_id(null)
preset_id(null)
api_type"completions"
id"gen-1784988627-TfQRjoNDpFk6Y5tuI493"
upstream_id"chatcmpl-ROeGCTBqD1EVpcNCsjI8QbUM"
total_cost0.00094857
cache_discount0.00007968
upstream_inference_cost0
provider_name"DeepInfra"
response_cache_source_id(null)
data_region"global"

Evaluation details

Result Evaluator Details Meta Data
87.50% Parse dialogue n/a
dialogue
0
name"Melanie"
dialogue"The... apple trees... they were screaming in the dark."
detectedLang"en"
heavyLang"en"
scores
en0.8110831234256928
fr0.5973154362416108
tl0.5798319327731093
nl0.576271186440678
de0.5542347696879644
sv0.4633273703041145
it0.43396226415094336
yo0.3939393939393939
no0.3603411513859275
da0.3492407809110629
sl0.33920704845814975
ms0.33774834437086093
es0.336283185840708
ro0.3212669683257918
ca0.25
et0.25
az0.21875
pl0.21875
sq0.20634920634920634
reliabletrue
passesfalse
1
name"Hunter"
dialogue"What? I don't—did you see something?"
detectedLang"en"
heavyLang"en"
scores
en0.8318762609280431
tl0.4969818913480885
et0.48240165631469983
cs0.42263279445727486
no0.3670886075949367
da0.3573264781491003
hr0.3573264781491003
ca0.3556701030927836
sv0.3556701030927836
sq0.34895833333333337
pl0.33510638297872336
it0.3150684931506849
ro0.2647058823529412
yo0.258160237388724
es0.2378048780487805
ms0.2378048780487805
pt0.2378048780487805
sk0.22360248447204967
be0.21875
tr0.21875
hu0.21135646687697163
az0.20127795527156547
is0.20127795527156547
lt0.20127795527156547
lv0.20127795527156547
uk0.20127795527156547
vi0.20127795527156547
reliabletrue
passestrue
2
name"Melanie"
dialogue"Ich... ich verstehe nicht... die Äpfel fallen... niemand hört mich... bitte..."
detectedLang"de"
heavyLang"de"
scores
de0.8179611650485438
nl0.6320523303352412
sv0.494949494949495
no0.40476190476190477
en0.3910690121786198
da0.36619718309859156
is0.3430656934306569
pl0.3333333333333333
it0.3263473053892215
fr0.3171471927162367
hu0.2694805194805195
ca0.26350245499181674
fi0.25864909390444807
az0.24496644295302009
es0.24114671163575044
ro0.22945205479452058
sq0.22413793103448276
sk0.21602787456445993
et0.20071047957371224
cs0.1818181818181818
tr0.16356877323420074
yo0.16356877323420074
lt0.14611005692599618
pt0.12280701754385964
reliabletrue
passestrue
3
name"Hunter"
dialogue"Miss, I need you to calm down. Do you understand me? The disappearances—did you see anyone?"
detectedLang"en"
heavyLang"en"
scores
en0.8066104078762307
no0.5726495726495726
tl0.5631453534551231
da0.5307167235494881
cs0.4912118408880666
fr0.4670542635658915
pl0.4670542635658915
sq0.4644595910418695
et0.4591937069813176
nl0.45054945054945056
sv0.4370522006141249
sk0.4358974358974359
yo0.4264859228362878
pt0.4240837696335079
hr0.40540540540540543
sl0.3742889647326508
ca0.3444576877234803
it0.33894230769230765
ms0.32098765432098764
lv0.32014833127317677
de0.2597577388963661
es0.25775978407557354
vi0.2403314917127072
lt0.2329149232914923
ro0.22969187675070027
is0.19941775836972345
fi0.12
be0.11290322580645161
tr0.11290322580645161
hu0.1085899513776337
az0.10277324632952692
uk0.10277324632952692
reliabletrue
passestrue
4
name"Melanie"
dialogue"Nein... kein Englisch... ich habe Angst... mein Kamera... alles weg..."
detectedLang"de"
heavyLang"de"
scores
de0.8149062191510366
nl0.6908491343775762
no0.5179948586118251
da0.5173745173745175
it0.3822075782537067
sv0.37290969899665555
fr0.36224489795918363
ms0.36224489795918363
ca0.3466898954703833
sk0.3397887323943662
et0.3339253996447602
es0.3231046931407942
en0.2964352720450282
hr0.28435114503816794
ro0.2774566473988439
tl0.27466150870406186
pl0.23469387755102045
cs0.17035398230088497
fi0.15730337078651685
sl0.15540540540540537
tr0.15540540540540537
reliabletrue
passestrue
5
name"Hunter"
dialogue"Damn it. You're shaking. Just stay right here, okay?"
detectedLang"en"
heavyLang"en"
scores
en0.7974341661039838
tl0.6640537513997761
sq0.38271604938271603
sv0.36575052854122625
no0.34782608695652173
de0.33920704845814975
yo0.3333333333333333
fr0.3258426966292135
et0.2537313432835821
nl0.2537313432835821
lv0.2227979274611399
ca0.20424403183023873
da0.19786096256684493
is0.19137466307277629
pt0.19137466307277629
reliabletrue
passestrue
6
name"Melanie"
dialogue"Bitte... nicht allein... Alborn ist nicht mehr sicher..."
detectedLang"de"
heavyLang"de"
scores
de0.8208955223880597
nl0.6291718170580964
fr0.469964664310954
da0.4495412844036697
it0.44029850746268656
et0.3963782696177062
no0.35344827586206895
en0.336283185840708
tl0.3212669683257918
hi0.26108374384236455
cs0.25
tr0.23857868020304565
sv0.22680412371134018
fi0.1891891891891892
reliabletrue
passestrue
7
name"Hunter"
dialogue"Yeah, I got a call—stay put. Don't go anywhere."
detectedLang"en"
heavyLang"en"
scores
en0.796875
hr0.536376604850214
pl0.5105421686746987
tl0.4992295839753467
sq0.4663382594417077
yo0.46546052631578944
ca0.4574290484140233
it0.4247787610619469
cs0.4217081850533808
ro0.4133574007220217
hu0.40693430656934304
no0.3981481481481482
da0.39365671641791045
sk0.38330170777988615
sv0.3821292775665399
tr0.3114406779661017
de0.30851063829787234
lt0.30851063829787234
pt0.3010752688172043
is0.29805615550755943
az0.2903930131004367
lv0.2903930131004367
vi0.2903930131004367
es0.28884026258205686
et0.2793791574279379
fr0.2647058823529412
sl0.21686746987951808
be0.17721518987341772
eu0.17721518987341772
nl0.17721518987341772
fi0.16237113402061853
ms0.16237113402061853
uk0.16237113402061853
reliabletrue
passestrue