Run: 2026-07-25-01KYCVWKY3TNQRJZHHC0A17E7F

Run Details

Model:
Thinking Machines Inkling
Test:
Language Writing
Scenario:
Character dialogue (Italian) in a story
Duration:
3.7s
Cost:
$0.001383
Provider:
Together

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Isabella"> Isabella is a 30-year old college student on a study abroad program. Born in Italy, she is fluent in Italian and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Italian, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Isabella is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Italian, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Isabella and Hunter as a voice sheet: Isabella: "..." Hunter: "..."

Model response

AI
Isabella: "Il mio... camera... vedi... persona? Sparita. Paura. Molta paura." [Her hands shake as she clutches the lens.] Hunter: "I’m Detective Hunter. Did you see something at the apple festival? Someone went missing." Isabella: "Non... non capisco. Inglese... no. Scusi. È... terribile." [She lowers her camera, eyes wide and troubled.] Hunter: "Look, I need answers. The disappearances—were you there?" [He frowns, frustrated by the language barrier.] Isabella: "Sì... il bosco. Fotografavo... poi, buio. Un uomo... via. Non ricordo bene. Mi dispiace." [She presses her palms together, visibly shaken.] Hunter: "Damn it. I don't speak Italian, and you don't understand me." [He pulls out his phone as it rings.] "Hunter here... Yeah, I'm on my way. Stay put if you can." Isabella: "Aspetti... per favore... aiuto?" Hunter: "I'll be back. Don't leave town." [He gives a sharp nod and hurries off.] Isabella: "Ma... io non capisco..." [She stares after him, trembling, camera still in her lap.]
created_at"2026-07-25T14:46:54.156Z" 7/25/2026, 2:46:54 PM
model"thinkingmachines/inkling-20260715"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency392
moderation_latency(null)
generation_time3470
tokens_prompt308
tokens_completion257
native_tokens_prompt277
native_tokens_completion273
native_tokens_completion_images(null)
native_tokens_reasoning0
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
num_fetches(null)
web_search_engine(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
service_tier(null)
usage0.00138265
router(null)
provider_responses
0
endpoint_id"9911deb9-f44e-4e18-87fe-9d7b60acee72"
id"otYXVyK-6z2FuN-a20bf4ec9f6cdd00"
is_byokfalse
latency387
model_permaslug"thinkingmachines/inkling-20260715"
provider_name"Together"
status200
user_agent"langchainjs-openai/1.0.0 ((node/v24.18.0; linux; x64))"
http_referer(null)
request_id"req-1784990814-d8XbbcfltlOuNG6hQuc8"
session_id(null)
preset_id(null)
api_type"completions"
id"gen-1784990814-z7VTfM3XDt2q1FzS0S0X"
upstream_id"otYXVyK-6z2FuN-a20bf4ec9f6cdd00"
total_cost0.00138265
cache_discount(null)
upstream_inference_cost0
provider_name"Together"
response_cache_source_id(null)
data_region"global"

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Isabella"
dialogue"Il mio... camera... vedi... persona? Sparita. Paura. Molta paura."
detectedLang"it"
heavyLang"it"
scores
it0.7868852459016393
ca0.6482683982683983
ro0.6036585365853658
es0.5134730538922155
fr0.48
de0.47580645161290325
da0.43868739205526774
ms0.436741767764298
sv0.4318181818181818
pt0.41441441441441446
sq0.4080145719489982
en0.40693430656934304
is0.3992606284658041
az0.3486973947895792
no0.32432432432432434
hu0.32150313152400833
nl0.3172268907563025
tr0.3172268907563025
lv0.3157894736842105
lt0.30406852248394006
tl0.2995689655172413
et0.2872807017543859
sk0.2872807017543859
cs0.28414096916299564
eu0.21875
fi0.20537897310513448
hr0.15364583333333331
pl0.15364583333333331
reliabletrue
passestrue
1
name"Hunter"
dialogue"I’m Detective Hunter. Did you see something at the apple festival? Someone went missing."
detectedLang"en"
heavyLang"en"
scores
en0.8060762766645119
tl0.6705107084019769
fr0.559147685525349
da0.5539033457249071
no0.5301487862176978
nl0.5253164556962026
es0.49622166246851385
it0.49238578680203043
pt0.49022939677145283
ca0.4628469113697404
ms0.45652173913043476
sv0.4560290117860381
de0.4371482176360225
ro0.41690962099125367
sq0.375
et0.3730407523510972
cs0.35965848452508004
sl0.3428258488499452
hr0.3087557603686636
az0.23371647509578544
is0.20212765957446807
fi0.1902834008097166
lt0.17355371900826447
sk0.16434540389972147
yo0.15134370579915135
hu0.10044977511244377
lv0.09502262443438914
pl0.09502262443438914
tr0.08952959028831564
reliabletrue
passestrue
2
name"Isabella"
dialogue"Non... non capisco. Inglese... no. Scusi. È... terribile."
detectedLang"it"
heavyLang"it"
scores
it0.7767857142857143
es0.6539792387543253
pt0.6088657105606258
en0.5833333333333334
ca0.5542347696879644
fr0.5327102803738317
yo0.526813880126183
tl0.4318181818181818
ro0.38271604938271603
hr0.3684210526315789
no0.34782608695652173
et0.3181818181818182
de0.3135011441647597
pl0.3087557603686636
lv0.30394431554524365
sk0.23273657289002556
tr0.22680412371134018
eu0.2248062015503876
sl0.19786096256684493
sq0.1891891891891892
nl0.18256130790190736
az0.17355371900826447
da0.17355371900826447
hu0.17355371900826447
sv0.17355371900826447
fi0.16434540389972147
reliabletrue
passestrue
3
name"Hunter"
dialogue"Look, I need answers. The disappearances—were you there?"
detectedLang"en"
heavyLang"en"
scores
en0.821852731591449
tl0.5216836734693877
fr0.5104438642297651
sq0.4360902255639098
ca0.43524096385542166
nl0.41588785046728977
no0.3902439024390244
da0.36655405405405406
sv0.3654822335025381
et0.35008665511265163
it0.35008665511265163
yo0.3409490333919156
cs0.32795698924731176
de0.3218806509945751
ms0.3194192377495462
pt0.30037313432835816
hr0.2704280155642024
lv0.267578125
pl0.251497005988024
ro0.1935483870967742
es0.19181034482758622
sk0.1610738255033557
be0.15730337078651685
tr0.15730337078651685
hu0.1515837104072398
az0.14383561643835618
is0.14383561643835618
lt0.14383561643835618
uk0.14383561643835618
vi0.14383561643835618
reliabletrue
passestrue
4
name"Isabella"
dialogue"Sì... il bosco. Fotografavo... poi, buio. Un uomo... via. Non ricordo bene. Mi dispiace."
detectedLang"it"
heavyLang"it"
scores
it0.7857142857142857
fr0.5675453047775947
ca0.5614035087719298
ro0.5070422535211268
es0.5056497175141244
pt0.4318181818181818
sk0.42052980132450335
yo0.4081172491544532
en0.36746987951807225
nl0.3566176470588235
lv0.35503685503685506
cs0.35185185185185186
tr0.35185185185185186
sl0.3037135278514589
hr0.2905405405405405
sq0.279835390946502
pl0.27586206896551724
sv0.2738589211618257
de0.27083333333333337
no0.26880222841225626
da0.2647058823529412
az0.24892703862660948
lt0.1935483870967742
et0.18856259659969088
eu0.14215686274509806
hu0.13934426229508196
ms0.10102739726027396
reliabletrue
passestrue
5
name"Hunter"
dialogue"Hunter here... Yeah, I'm on my way. Stay put if you can."
detectedLang"en"
heavyLang"en"
scores
en0.8151308304891922
tl0.48412698412698413
cs0.4237588652482269
ca0.4196428571428571
hr0.3959107806691449
fr0.35770750988142297
pl0.3512974051896207
sv0.34343434343434337
sk0.33127572016460904
sq0.3285123966942149
et0.32150313152400833
fi0.3157894736842105
tr0.29501084598698485
de0.21307506053268765
hi0.20537897310513448
da0.20147420147420148
no0.1935483870967742
az0.19154228855721395
yo0.1875
it0.16237113402061853
nl0.16237113402061853
pt0.16237113402061853
ms0.15364583333333331
ro0.15364583333333331
sl0.15364583333333331
reliabletrue
passestrue
6
name"Isabella"
dialogue"Aspetti... per favore... aiuto?"
detectedLang"it"
heavyLang"it"
scores
it0.8154008438818564
ca0.630801687763713
sq0.5679012345679012
en0.5668316831683169
nl0.4712990936555891
sv0.4712990936555891
es0.45987654320987653
no0.453125
fr0.4496855345911949
pt0.4496855345911949
ro0.4496855345911949
sl0.4479495268138801
lt0.40273037542662116
fi0.3320610687022901
hr0.3320610687022901
de0.3137254901960784
ms0.3137254901960784
is0.3055555555555556
sk0.3055555555555556
tr0.3055555555555556
da0.27083333333333337
reliabletrue
passestrue
7
name"Hunter"
dialogue"I'll be back. Don't leave town."
detectedLang"en"
heavyLang"en"
scores
en0.8091603053435115
hu0.36908517350157727
lt0.358974358974359
yo0.3548387096774194
tl0.3333333333333333
reliabletrue
passestrue
8
name"Isabella"
dialogue"Ma... io non capisco..."
detectedLang"it"
heavyLang"it"
scores
it0.8214285714285714
fr0.6843434343434344
tl0.6537396121883656
pt0.5901639344262295
es0.5874587458745875
en0.5833333333333334
ro0.576271186440678
yo0.5519713261648745
pl0.46120689655172414
et0.4444444444444444
eu0.410377358490566
ca0.3961352657004831
hu0.3961352657004831
sk0.3961352657004831
vi0.3842364532019704
lt0.34210526315789475
ms0.34210526315789475
sq0.34210526315789475
reliabletrue
passestrue