Run: 2026-07-25-01KYCVPGSDKTSJQ60SWB1CW2BR

Run Details

Model:
Thinking Machines Inkling
Test:
Language Writing
Scenario:
Character dialogue (Spanish) in a story
Duration:
5.2s
Cost:
$0.001528
Provider:
Together

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Maria"> Maria is a 30-year old college student on a study abroad program. Born in Spain, she is fluent in Spanish and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Spanish, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Maria is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Spanish, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Maria and Hunter as a voice sheet: Maria: "..." Hunter: "..."

Model response

AI
Maria: "..." Hunter: "Maria? Excuse me—I'm Detective Hunter. There was an incident near the orchard last night. Did you see anything? Your camera, maybe you took pictures?" Maria: "...Es... es todo tan extraño. Desaparecieron... cerca del festival. Tengo miedo... y estas fotografías... no sé qué capturé. Estoy muy preocupada, no entiendo qué pasa en este pueblo..." Hunter: "Wait—slow down. I don't—are you saying you saw something? The disappearances?" Maria: "...Sí... la gente... se va. No puedo dormir. Mi cámara... vi algo... en la sombra... No hablo inglés... lo siento..." Hunter: "I... I have no idea what you're saying. Look, this is important. Did you see someone taken?" Maria: "¡Por favor, escúcheme! Es peligroso... el bosque... la noche... necesito ayuda..." Hunter: "Damn it. I really wish I spoke Spanish right now. Stay right here, okay? Don't go." Maria: "...No me vaya... tengo miedo..." Hunter: "I'm not leaving you—just—" [Phone rings] "Hunter. Yeah, I'm on my way. Copy that." [Sighs] "Listen, I have to go. There's another one. Stay put." Maria: "...¿Se va? Entiendo... vaya con cuidado, detective..." Hunter: "Yeah. You too. We'll figure this out." [Walks away quickly]
created_at"2026-07-25T14:43:34.327Z" 7/25/2026, 2:43:34 PM
model"thinkingmachines/inkling-20260715"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency172
moderation_latency(null)
generation_time3501
tokens_prompt304
tokens_completion314
native_tokens_prompt273
native_tokens_completion310
native_tokens_completion_images(null)
native_tokens_reasoning0
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
num_fetches(null)
web_search_engine(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
service_tier(null)
usage0.0015285
router(null)
provider_responses
0
endpoint_id"9911deb9-f44e-4e18-87fe-9d7b60acee72"
id"otYWUwQ-6z2FuN-a20bf01449d0a206"
is_byokfalse
latency172
model_permaslug"thinkingmachines/inkling-20260715"
provider_name"Together"
status200
user_agent"langchainjs-openai/1.0.0 ((node/v24.18.0; linux; x64))"
http_referer(null)
request_id"req-1784990615-Q7uYcuoxJeepctSaFjvM"
session_id(null)
preset_id(null)
api_type"completions"
id"gen-1784990615-SBAzeOdoyJ9PLL7IETBR"
upstream_id"otYWUwQ-6z2FuN-a20bf01449d0a206"
total_cost0.0015285
cache_discount(null)
upstream_inference_cost0
provider_name"Together"
response_cache_source_id(null)
data_region"global"

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Maria"
dialogue"..."
detectedLang""
heavyLang""
scores
reliablefalse
passestrue
1
name"Hunter"
dialogue"Maria? Excuse me—I'm Detective Hunter. There was an incident near the orchard last night. Did you see anything? Your camera, maybe you took pictures?"
detectedLang"en"
heavyLang"en"
scores
en0.7941115915173975
tl0.6058336618052819
fr0.5487364620938628
de0.5313964386129335
ro0.5210727969348659
nl0.5164410058027079
ca0.4655264564404062
no0.45054945054945056
sq0.4444444444444444
it0.43438914027149317
es0.3979530403371463
ms0.3943064809206541
da0.38949938949938945
et0.3872549019607844
pt0.3765586034912718
sv0.3581514762516046
yo0.2982456140350877
sl0.29328621908127206
cs0.250936329588015
eu0.19807538091419405
hr0.16736053288925898
fi0.16177703269069574
sk0.1610738255033557
lt0.15611814345991562
az0.12663755458515283
lv0.1243432574430823
pl0.12049252418645558
tr0.11504424778761062
vi0.09828674481514878
hu0.05571293673276676
reliabletrue
passestrue
2
name"Maria"
dialogue"...Es... es todo tan extraño. Desaparecieron... cerca del festival. Tengo miedo... y estas fotografías... no sé qué capturé. Estoy muy preocupada, no entiendo qué pasa en este pueblo..."
detectedLang"es"
heavyLang"es"
scores
es0.8013573911604039
ca0.6273291925465838
pt0.6248827758674586
it0.4759825327510917
fr0.43396226415094336
en0.3896236012207528
ro0.37139863803038237
sk0.3644067796610169
ms0.35518538420204193
no0.34994582881906827
nl0.3402968664101154
hr0.33884297520661155
sl0.3258426966292135
sv0.32088285229202035
da0.31584948688711517
lv0.3055555555555556
et0.29906542056074764
eu0.29865575686732904
tl0.2966002344665885
sq0.28014397120575885
lt0.2736077481840194
pl0.2736077481840194
de0.25742574257425743
tr0.2518703241895262
cs0.24528301886792453
is0.23420548819400125
hu0.21671018276762402
fi0.2079207920792079
yo0.17751884852638794
az0.12854030501089325
vi0.07550077041602464
reliabletrue
passestrue
3
name"Hunter"
dialogue"Wait—slow down. I don't—are you saying you saw something? The disappearances?"
detectedLang"en"
heavyLang"en"
scores
en0.81089258698941
tl0.5121951219512195
fr0.43883277216610556
ms0.414519906323185
ca0.3662864385297845
no0.32432432432432434
pt0.3234100135317997
ro0.32249322493224936
da0.302649930264993
sv0.30167597765363136
sq0.29775280898876405
it0.2877492877492877
yo0.2795389048991354
nl0.274310595065312
cs0.26793557833089315
tr0.2537313432835821
es0.25037481259370314
hr0.21752738654147105
lv0.21507064364207218
pl0.20127795527156547
sk0.12587412587412586
be0.12280701754385964
hu0.11816578483245149
az0.11190053285968028
et0.11190053285968028
is0.11190053285968028
lt0.11190053285968028
uk0.11190053285968028
vi0.11190053285968028
reliabletrue
passestrue
4
name"Maria"
dialogue"...Sí... la gente... se va. No puedo dormir. Mi cámara... vi algo... en la sombra... No hablo inglés... lo siento..."
detectedLang"es"
heavyLang"es"
scores
es0.7964934251721979
it0.6607515657620042
pt0.6457765667574932
ca0.631310266591038
fr0.5435393258426966
no0.48371723590150917
ro0.4787489975942261
yo0.46808510638297873
da0.45240101095197977
tl0.40962761126248864
sk0.40855323020928114
tr0.3953488372093023
sl0.3737957610789981
sv0.364613880742913
cs0.32432432432432434
hr0.32432432432432434
sq0.29729729729729726
vi0.29729729729729726
nl0.2737430167597766
lv0.2476851851851852
lt0.24418604651162787
hu0.2243436754176611
fi0.22248803827751198
eu0.19053549190535493
pl0.19053549190535493
is0.1709183673469388
az0.1390728476821192
en0.13793103448275862
de0.10714285714285714
et0.10591471801925723
reliabletrue
passestrue
5
name"Hunter"
dialogue"I... I have no idea what you're saying. Look, this is important. Did you see someone taken?"
detectedLang"en"
heavyLang"en"
scores
en0.8263340700978845
tl0.548440065681445
ca0.5409015025041736
es0.47569113441372735
no0.4649805447470817
da0.4353182751540041
pt0.42886812045690553
it0.4148936170212766
ro0.39890710382513656
nl0.39091915836101887
tr0.3806306306306307
fr0.3529411764705882
sv0.34679334916864607
sk0.30467762326169406
hr0.3037974683544304
et0.29757343550446996
hu0.28664072632944226
yo0.27344782034346105
pl0.26764314247669774
sq0.26764314247669774
lv0.260752688172043
cs0.24965893587994542
is0.2198581560283688
lt0.19590643274853803
sl0.12420382165605094
ms0.12280701754385964
be0.11290322580645161
az0.10277324632952692
uk0.10277324632952692
vi0.10277324632952692
reliabletrue
passestrue
6
name"Maria"
dialogue"¡Por favor, escúcheme! Es peligroso... el bosque... la noche... necesito ayuda..."
detectedLang"es"
heavyLang"es"
scores
es0.7872771474878444
ca0.6173469387755102
it0.5205479452054795
pt0.5179063360881543
ro0.5061147695202258
fr0.471830985915493
de0.38596491228070173
sq0.34210526315789475
en0.3320610687022901
hu0.3018617021276596
tl0.25742574257425743
no0.22106824925816024
lv0.18604651162790697
fi0.15730337078651685
yo0.14910858995137766
lt0.14772727272727273
vi0.13793103448275862
ms0.12790697674418602
da0.11016949152542374
nl0.11016949152542374
sl0.11016949152542374
sv0.11016949152542374
reliabletrue
passestrue
7
name"Hunter"
dialogue"Damn it. I really wish I spoke Spanish right now. Stay right here, okay? Don't go."
detectedLang"en"
heavyLang"en"
scores
en0.7939262472885033
tl0.6218152866242038
sq0.4973544973544973
pl0.4424882629107981
no0.4297719087635054
da0.4193154034229829
yo0.39797211660329534
ro0.34027777777777785
cs0.33936022253129344
de0.31948424068767906
sv0.31457431457431456
sk0.3115942028985507
lv0.30858806404657935
ca0.3065693430656934
hr0.2983751846381093
it0.2857142857142857
nl0.2263843648208469
hu0.22512234910277326
az0.2096505823627288
lt0.2096505823627288
pt0.15026833631484796
es0.14874551971326164
fr0.13479052823315119
be0.12844036697247707
tr0.12844036697247707
et0.1171003717472119
is0.1171003717472119
sl0.1171003717472119
uk0.1171003717472119
vi0.1171003717472119
ms0.11048689138576778
reliabletrue
passestrue
8
name"Maria"
dialogue"...No me vaya... tengo miedo..."
detectedLang"es"
heavyLang"es"
scores
es0.8076923076923077
it0.576271186440678
pt0.5635910224438903
en0.5231607629427792
no0.5179063360881543
ms0.515235457063712
sq0.4582043343653251
ca0.43548387096774194
lv0.4281045751633987
eu0.38811188811188807
is0.38596491228070173
hr0.36594202898550726
et0.35185185185185186
fr0.34210526315789475
sk0.34210526315789475
sl0.3346007604562738
tr0.3346007604562738
nl0.32432432432432434
tl0.3137254901960784
hu0.3055555555555556
fi0.3
pl0.3
reliabletrue
passestrue
9
name"Hunter"
dialogue"Listen, I have to go. There's another one. Stay put."
detectedLang"en"
heavyLang"en"
scores
en0.8195446973903386
da0.6632124352331606
hr0.6251441753171857
pl0.616745283018868
tl0.5987654320987654
no0.570673712021136
sv0.482484076433121
yo0.48083067092651754
cs0.4791666666666667
de0.46808510638297873
lv0.4546979865771812
sk0.4472789115646259
sq0.37739463601532564
fi0.36647173489278756
sl0.3564356435643564
it0.3486973947895792
lt0.3394308943089431
es0.3340163934426229
ro0.3200836820083682
hu0.3114406779661017
ca0.29805615550755943
tr0.29653679653679654
is0.2903930131004367
eu0.2647058823529412
nl0.2630385487528345
be0.17721518987341772
az0.16237113402061853
et0.16237113402061853
fr0.16237113402061853
pt0.16237113402061853
uk0.16237113402061853
vi0.16237113402061853
reliabletrue
passestrue
10
name"Maria"
dialogue"...¿Se va? Entiendo... vaya con cuidado, detective..."
detectedLang"es"
heavyLang"es"
scores
es0.8014559894109861
pt0.7087378640776698
it0.679144385026738
fr0.6539792387543253
ca0.6319018404907976
ro0.6291718170580964
en0.5683453237410072
tl0.4318181818181818
cs0.4094488188976378
sq0.40594059405940597
hr0.39999999999999997
sl0.39879759519038077
fi0.39148073022312374
da0.3697478991596639
nl0.3464052287581699
no0.34065934065934067
sv0.33774834437086093
vi0.30394431554524365
yo0.2628992628992629
de0.21875
et0.20424403183023873
reliabletrue
passestrue
11
name"Hunter"
dialogue"Yeah. You too. We'll figure this out."
detectedLang"en"
heavyLang"en"
scores
en0.768041237113402
tl0.5526838966202784
fr0.3951612903225807
ro0.3951612903225807
cs0.25742574257425743
ca0.2549668874172185
sq0.2549668874172185
da0.23469387755102045
de0.23469387755102045
es0.23469387755102045
it0.23469387755102045
no0.23469387755102045
pt0.23469387755102045
reliabletrue
passestrue