Run: 2026-07-25-01KYCXDTXG8C63THJB6TEE0PCP

Run Details

Model:
Thinking Machines Inkling
Test:
Language Writing
Scenario:
Character dialogue (French) in a story
Duration:
4.8s
Cost:
$0.001265
Provider:
Together

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Marie"> Marie is a 30-year old college student on a study abroad program. Born in France, she is fluent in French and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of French, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Marie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in French, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Marie and Hunter as a voice sheet: Marie: "..." Hunter: "..."

Model response

AI
Marie: "Je... j'ai vu quelque chose... dans la forêt, près du vieux moulin. Les arbres étaient trop silencieux." Hunter: "Ma'am, I'm Detective Hunter. Do you understand English? Did you see someone near the orchard?" Marie: "Non... pardon... trop peur. L'appareil photo... il a capturé... quelqu'un qui n'était pas là avant." Hunter: "Slow down. I can't understand a word you're saying, but you look terrified. Show me the camera." Marie: "Pas... pas de mots. La brume, la disparition... mon Dieu." Hunter: "I'm going to need a translator, but stay right here. You're shaking." Marie: "Vous ne comprenez pas... c'est déjà trop tard pour eux." Hunter: "Damn it. My phone—Hunter here. Yes, I'm at the cafe. No, she doesn't speak English. I'm leaving now—stay put." Marie: "Allez... mais faites attention aux pommes... et à l'ombre." Hunter: "I'm sorry, I have to go. Don't leave." [Hunter's phone rings; he answers abruptly and exits, leaving Marie alone with her camera.]
created_at"2026-07-25T15:13:46.939Z" 7/25/2026, 3:13:46 PM
model"thinkingmachines/inkling-20260715"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency1301
moderation_latency(null)
generation_time4352
tokens_prompt303
tokens_completion250
native_tokens_prompt273
native_tokens_completion245
native_tokens_completion_images(null)
native_tokens_reasoning0
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
num_fetches(null)
web_search_engine(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
service_tier(null)
usage0.00126525
router(null)
provider_responses
0
endpoint_id"9911deb9-f44e-4e18-87fe-9d7b60acee72"
id"otYfmS2-6z2FuN-a20c1c4cdc794c94"
is_byokfalse
latency1301
model_permaslug"thinkingmachines/inkling-20260715"
provider_name"Together"
status200
user_agent"langchainjs-openai/1.0.0 ((node/v24.18.0; linux; x64))"
http_referer(null)
request_id"req-1784992426-F4Yx3m9E2qA10FFLEeVe"
session_id(null)
preset_id(null)
api_type"completions"
id"gen-1784992426-74BgBki08u9ElCwGkLzX"
upstream_id"otYfmS2-6z2FuN-a20c1c4cdc794c94"
total_cost0.00126525
cache_discount(null)
upstream_inference_cost0
provider_name"Together"
response_cache_source_id(null)
data_region"global"

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Marie"
dialogue"Je... j'ai vu quelque chose... dans la forêt, près du vieux moulin. Les arbres étaient trop silencieux."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8183041722745625
ca0.6205733558178752
es0.44762684124386254
it0.3484555984555985
de0.3356299212598425
en0.33102081268582756
da0.32567432567432564
no0.2939330543933054
yo0.2741935483870968
hr0.2726293103448276
pt0.2710583153347732
sl0.25905598243688255
ro0.25742574257425743
sk0.24832962138084633
cs0.23728813559322032
nl0.23728813559322032
tl0.21875
vi0.21328671328671328
lt0.2049469964664311
pl0.18576598311218334
eu0.17380660954712362
sq0.17279411764705882
sv0.14556962025316456
is0.10119840213049268
hu0.08536585365853659
lv0.08536585365853659
tr0.08536585365853659
reliabletrue
passestrue
1
name"Hunter"
dialogue"Ma'am, I'm Detective Hunter. Do you understand English? Did you see someone near the orchard?"
detectedLang"en"
heavyLang"en"
scores
en0.7912127814088599
no0.5514820592823713
tl0.5275267050123253
da0.5176174496644296
de0.47102115915363385
sv0.4641192917054986
nl0.45600756859035
pt0.4481765834932822
ro0.4428294573643411
fr0.4209466263846928
cs0.3895966029723991
sq0.37635574837310193
hr0.3105515587529976
es0.30806257521058966
sl0.2996345919610231
ca0.2936117936117936
it0.2909987669543773
pl0.2776381909547738
sk0.2776381909547738
ms0.26658163265306123
yo0.24342105263157895
et0.22818791946308725
vi0.16180758017492713
is0.11402157164869028
tr0.09305993690851734
reliabletrue
passestrue
2
name"Marie"
dialogue"Non... pardon... trop peur. L'appareil photo... il a capturé... quelqu'un qui n'était pas là avant."
detectedLang"fr"
heavyLang"fr"
scores
fr0.792861695347355
it0.5614035087719298
ca0.5403111739745403
en0.4583333333333333
sq0.37560038424591735
ro0.37137330754352027
cs0.3298969072164949
lt0.3179433368310598
pt0.3114406779661017
es0.3055555555555556
tl0.2809734513274336
tr0.26220204313280365
vi0.2588369441277081
yo0.2415402567094516
az0.2215568862275449
fi0.2004920049200492
nl0.19852034525277434
eu0.19454770755885997
hu0.1935483870967742
ms0.18444165621079048
no0.18341708542713567
de0.18238993710691823
et0.1698595146871009
sv0.1698595146871009
sk0.16666666666666666
hr0.14698162729658792
pl0.1390728476821192
sl0.12162162162162163
hi0.10591471801925723
is0.10344827586206896
da0.09972299168975068
lv0.09722222222222222
reliabletrue
passestrue
3
name"Hunter"
dialogue"Slow down. I can't understand a word you're saying, but you look terrified. Show me the camera."
detectedLang"en"
heavyLang"en"
scores
en0.8024027821688271
no0.5490620490620491
tl0.5457848837209303
da0.5109546165884193
nl0.5043616177636797
sv0.503968253968254
fr0.49104234527687296
it0.4707874682472481
ro0.4630584192439862
sq0.44543034605146403
ca0.42075996292863765
es0.39202334630350194
cs0.3896484375
de0.3872549019607844
pt0.37624750499001997
pl0.3705941591137966
yo0.3336886993603412
ms0.32212581344902386
sk0.31768558951965065
hu0.31394072447859495
et0.3124312431243124
hr0.2865296803652968
tr0.28325688073394495
is0.2532855436081242
fi0.23965936739659366
az0.23873325213154686
sl0.22166874221668745
lt0.1883116883116883
lv0.17546174142480211
vi0.17546174142480211
be0.10071942446043164
eu0.10071942446043164
uk0.09156976744186046
reliabletrue
passestrue
4
name"Marie"
dialogue"Pas... pas de mots. La brume, la disparition... mon Dieu."
detectedLang"fr"
heavyLang"fr"
scores
fr0.7890295358649789
en0.6300863131935881
ca0.6273291925465838
es0.5850622406639004
ro0.5738636363636364
da0.5607613469985359
tl0.5405819295558958
de0.5341614906832298
sq0.526813880126183
it0.5169082125603864
nl0.5169082125603864
sv0.4957983193277311
yo0.48186528497409326
no0.47368421052631576
pt0.453551912568306
ms0.3288590604026846
tr0.24623115577889448
hu0.24433249370277077
lt0.23273657289002556
vi0.21875
fi0.21465968586387435
hi0.20634920634920634
zh0.20424403183023873
eu0.1891891891891892
cs0.18699186991869918
sk0.18699186991869918
az0.17355371900826447
reliabletrue
passestrue
5
name"Hunter"
dialogue"I'm going to need a translator, but stay right here. You're shaking."
detectedLang"en"
heavyLang"en"
scores
en0.8244929797191887
tl0.6341463414634145
no0.5071193866374589
fr0.4886363636363637
pl0.4558645707376058
da0.4538834951456311
de0.4409937888198758
hr0.43890274314214467
pt0.43890274314214467
sl0.4238156209987196
yo0.4230769230769231
sk0.41935483870967744
cs0.41709844559585496
et0.41709844559585496
sq0.41482444733420026
nl0.4015957446808511
ro0.39999999999999997
lv0.3653032440056418
sv0.36079545454545453
lt0.35988620199146515
ca0.31921331316187596
es0.3171471927162367
it0.29467084639498436
ms0.2890995260663507
vi0.2598684210526316
hu0.25742574257425743
is0.24496644295302009
tr0.23728813559322032
eu0.23339011925042585
az0.2227979274611399
fi0.12280701754385964
reliabletrue
passestrue
6
name"Marie"
dialogue"Vous ne comprenez pas... c'est déjà trop tard pour eux."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8414855072463768
ca0.5705521472392638
it0.45567651632970446
lt0.4514106583072101
sq0.40476190476190477
ro0.3794326241134752
es0.37163375224416517
nl0.34210526315789475
eu0.28716904276985744
sl0.2677824267782427
en0.2631578947368421
pt0.2584745762711864
hr0.24406047516198706
lv0.2273730684326711
tr0.21171171171171171
tl0.20634920634920634
fi0.2009132420091324
ms0.1935483870967742
cs0.1898148148148148
hu0.1898148148148148
reliabletrue
passestrue
7
name"Hunter"
dialogue"Damn it. My phone—Hunter here. Yes, I'm at the cafe. No, she doesn't speak English. I'm leaving now—stay put."
detectedLang"en"
heavyLang"en"
scores
en0.8123014727115219
tl0.5593220338983051
no0.47707160096540624
da0.4257950530035336
sq0.3319630010277493
nl0.3298969072164949
hr0.3143459915611814
de0.2655367231638418
fr0.2647058823529412
sv0.25287356321839083
lv0.2502883506343714
ms0.24330616996507565
pt0.236192714453584
ca0.22985781990521328
yo0.21968787515006
sk0.2140266021765417
pl0.20440636474908203
tr0.18444165621079048
it0.18032786885245902
es0.17407878017789072
vi0.1698595146871009
ro0.1677336747759283
cs0.11684782608695651
sl0.08321579689703808
reliabletrue
passestrue
8
name"Marie"
dialogue"Allez... mais faites attention aux pommes... et à l'ombre."
detectedLang"fr"
heavyLang"fr"
scores
fr0.813803376365442
en0.6383799421407909
da0.569954128440367
et0.5598591549295775
pt0.5393120393120393
no0.5376078914919853
it0.4993324432576769
de0.49528936742934054
tl0.48489010989010994
ca0.47257383966244726
yo0.42748091603053434
es0.4140625
nl0.41222570532915365
fi0.3644067796610169
sv0.31066176470588236
lt0.2647058823529412
lv0.2647058823529412
zh0.17035398230088497
ro0.15730337078651685
az0.1515837104072398
hr0.1515837104072398
ms0.1515837104072398
sl0.1515837104072398
sq0.1515837104072398
reliabletrue
passestrue
9
name"Hunter"
dialogue"I'm sorry, I have to go. Don't leave."
detectedLang"en"
heavyLang"en"
scores
en0.8119015047879617
da0.5864661654135338
pl0.5729813664596274
tl0.5528455284552846
yo0.5225694444444445
hr0.4811320754716981
no0.48015122873345933
cs0.461839530332681
it0.4387755102040817
sk0.4258872651356994
lv0.40217391304347827
lt0.3778280542986425
ca0.3341404358353511
sv0.3341404358353511
sq0.3276283618581907
sl0.3055555555555556
pt0.26666666666666666
ro0.24657534246575344
be0.20289855072463767
tr0.20289855072463767
hu0.19590643274853803
az0.1863905325443787
et0.1863905325443787
is0.1863905325443787
uk0.1863905325443787
vi0.1863905325443787
reliabletrue
passestrue