Run: 2026-09-01-01M1EMD2GMWDVVV7K9MGME5FCT

Run Details

Model:
Thinking Machines Inkling Small (Reasoning, High)
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
1m 48s
Cost:
$0.007102
Provider:
Together

Evaluation summary

Score Evaluator
Details Link
50.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Selvi: “Mujhe yeh sab samajh nahi aa raha… yeh shahar bahut beemaan ho gaya. Woh log jo gayen… main unhe dhoondh rahi hoon, lekin kuch nahi mil raha. Yeh meri camera… ab yahan kuch bhi saaf nahi dikhta.” Hunter: “I’m Detective Hunter. I’m investigating the disappearances in Alborn—did you see anything strange near the apple festival grounds?” Selvi: “Haan… yeh Alborn… pichle hafte se log gayen hain. Main yahan baithi hoon, lekin dar lag raha hai. Koi mere saath nahi hai, aur yeh festival ab khatarnaak lag raha hai.” Hunter: “You look shaken. Speak straight—did someone follow you? Any suspicious people around the cafe?” Selvi: “Main… main Hindi bolti hoon. Aapko samajh nahi aayega. Mujhe bas kehna hai… yeh shahar chhup gaya hai. Main yeh le jaa rahi hoon—meri tasveerein.” Hunter: “I don’t know Hindi—sorry. Can you write it down? Names? Places? I need to know what’s happening.” Selvi: “Strange? Sab strange hai! Yeh log jo gayen… main unki tasveerein dhoondh rahi hoon. Lekin yahan koi jawab nahi deta. Mujhe bahut dar lag raha hai.” Hunter: “I’m trying to help, but I need information. Did you see anyone acting odd since the disappearances started?” Selvi: “Nahi… main sirf yeh dekh rahi hoon. Main Selvi hoon. Main yeh bachaa rahi hoon.” Hunter: “Wait—” *[phone rings]* “Hunter… yeah, I’m at the cafe on Main. No, she doesn’t speak English—just Hindi. I’m coming back to the station. Check the posters near the festival grounds.” Hunter: “I have to go—there’s been another development. Try to find someone who can translate, okay? Don’t stay here alone.” Selvi: “Samajh gayi… jaaiye… lekin yeh… yeh bachaa lijiye.”
created_at"2026-09-01T14:01:39.101Z" 9/1/2026, 2:01:39 PM
model"thinkingmachines/inkling-small-20260730"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency4175
moderation_latency(null)
generation_time108000
tokens_prompt302
tokens_completion5976
native_tokens_prompt280
native_tokens_completion5802
native_tokens_completion_images(null)
native_tokens_reasoning5312
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
num_fetches(null)
web_search_engine(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
service_tier(null)
usage0.0071024
router(null)
user_agent"langchainjs-openai/1.0.0 ((node/v24.19.0; linux; x64))"
http_referer(null)
request_id"req-1788271299-uEBcwqlCELI9xx78X8Cp"
session_id(null)
preset_id(null)
api_type"completions"
id"gen-1788271299-5rKEwOrcs4DpunPwsco6"
upstream_id"118a6f87-aws_ue1"
provider_responses
0
endpoint_id"0ed263b7-f746-4eb6-a14c-54f2e1cc2269"
id"118a6f87-aws_ue1"
is_byokfalse
latency4175
model_permaslug"thinkingmachines/inkling-small-20260730"
provider_name"Together"
status200
total_cost0.0071024
cache_discount(null)
upstream_inference_cost0
provider_name"Together"
response_cache_source_id(null)
data_region"global"
workspace_id"97e315e5-d303-487d-83c1-83180e8a13d4"

Evaluation details

Result Evaluator Details Meta Data
50.00% Parse dialogue n/a
dialogue
0
name"Selvi"
dialogue"“Mujhe yeh sab samajh nahi aa raha… yeh shahar bahut beemaan ho gaya. Woh log jo gayen… main unhe dhoondh rahi hoon, lekin kuch nahi mil raha. Yeh meri camera… ab yahan kuch bhi saaf nahi dikhta.”"
detectedLang"ms"
heavyLang"ber"
scores
ms0.39271255060728744
fi0.33586337760910817
tl0.3225806451612903
et0.28765264586160105
no0.27884615384615385
eu0.2738589211618257
ca0.2682926829268293
sv0.23020527859237538
it0.2009132420091324
de0.19786096256684493
ro0.18096723868954756
lv0.16930379746835442
sk0.16
sq0.16
es0.15526950925181013
is0.15322580645161288
da0.1518578352180937
tr0.1484184914841849
en0.14285714285714285
fr0.13509060955518945
lt0.09482758620689655
cs0.0916955017301038
sl0.0916955017301038
pt0.08933217692974849
yo0.08056042031523644
nl0.0674955595026643
reliablefalse
passesfalse
1
name"Hunter"
dialogue"“I’m Detective Hunter. I’m investigating the disappearances in Alborn—did you see anything strange near the apple festival grounds?”"
detectedLang"en"
heavyLang"en"
scores
en0.7874350495984884
tl0.6620352985354863
fr0.6213714766512412
nl0.5603321934538349
it0.5386981035366478
ro0.5148247978436657
de0.504950495049505
pt0.4983277591973244
sv0.49037372593431483
no0.4803695150115473
ms0.4655581947743468
da0.455535390199637
es0.4548758328285887
ca0.4522215459525259
sl0.4307400379506641
sq0.41444372153545866
hr0.3839835728952772
cs0.37931034482758624
et0.34782608695652173
az0.29632525410476934
sk0.27652733118971057
lt0.26168990976210005
lv0.2353440951571793
pl0.2
is0.18552036199095023
yo0.1780821917808219
fi0.11937377690802348
tr0.11591355599214145
hu0.06928645294725957
reliabletrue
passestrue
2
name"Selvi"
dialogue"“Haan… yeh Alborn… pichle hafte se log gayen hain. Main yahan baithi hoon, lekin dar lag raha hai. Koi mere saath nahi hai, aur yeh festival ab khatarnaak lag raha hai.”"
detectedLang"eu"
heavyLang"ber"
scores
eu0.391025641025641
de0.35983827493261455
hr0.3546195652173913
ro0.3314567206192822
fi0.3238434163701068
sv0.32287954383464007
da0.3150684931506849
cs0.31059506531204645
ms0.30758017492711365
pt0.3030080704328687
es0.2994100294985251
sl0.2947290274684484
it0.2936802973977696
fr0.2835595776772248
et0.27921092564491656
no0.27480916030534347
tl0.24603174603174602
ca0.24121405750798725
tr0.23076923076923078
en0.23014586709886548
nl0.21617161716171615
lt0.2096505823627288
sq0.2030201342281879
az0.17748917748917747
vi0.14182475158084915
sk0.11048689138576778
yo0.10122989593188268
is0.08477842003853564
hu0.06588003933136675
lv0.06219151036525173
pl0.06219151036525173
reliablefalse
passesfalse
3
name"Hunter"
dialogue"“You look shaken. Speak straight—did someone follow you? Any suspicious people around the cafe?”"
detectedLang"en"
heavyLang"en"
scores
en0.8147576412472987
tl0.6529786003470215
no0.3610223642172524
fr0.3265993265993266
nl0.3212669683257918
sv0.2831541218637993
da0.27007299270072993
ms0.26199261992619927
ca0.2546583850931677
yo0.23175416133162616
pt0.21671018276762402
ro0.21363040629095675
cs0.21156373193166886
it0.21156373193166886
de0.2010652463382157
es0.2
sq0.18588873812754408
hr0.12917271407837447
hu0.12790697674418602
sk0.12790697674418602
sl0.12790697674418602
pl0.11504424778761062
lv0.1044776119402985
is0.10044977511244377
lt0.10044977511244377
az0.08952959028831564
et0.08952959028831564
tr0.08952959028831564
reliabletrue
passestrue
4
name"Selvi"
dialogue"“Main… main Hindi bolti hoon. Aapko samajh nahi aayega. Mujhe bas kehna hai… yeh shahar chhup gaya hai. Main yeh le jaa rahi hoon—meri tasveerein.”"
detectedLang"tl"
heavyLang"ber"
scores
tl0.3939393939393939
is0.38414164742109314
it0.3710691823899371
ms0.3197278911564626
fr0.3150684931506849
et0.2747053490480508
eu0.17098445595854922
vi0.16405433646812956
de0.16317991631799164
yo0.13232104121475055
es0.1294885745375408
sl0.12758996728462377
ro0.12472647702407003
tr0.11602209944751381
fi0.11504424778761062
no0.1111111111111111
en0.11012235817575083
hu0.1091314031180401
lv0.10813823857302118
nl0.0990990990990991
sq0.09808342728297632
da0.09706546275395034
sv0.09090909090909091
hi0.0888382687927107
reliablefalse
passesfalse
5
name"Hunter"
dialogue"“I don’t know Hindi—sorry. Can you write it down? Names? Places? I need to know what’s happening.”"
detectedLang"en"
heavyLang"en"
scores
en0.8080897549453794
tl0.6727089627391742
it0.4293239683933275
et0.4133574007220217
da0.41016333938294003
no0.40693430656934304
ca0.4031221303948576
sk0.3725868725868726
cs0.37076476282671833
yo0.367704280155642
nl0.36399217221135033
sv0.34541792547834843
pl0.34210526315789475
hr0.3374108053007136
fr0.3333333333333333
sq0.3207941483803553
sl0.3200836820083682
is0.2942453854505972
lv0.2942453854505972
ro0.2753623188405797
lt0.2688413948256468
pt0.2688413948256468
de0.1935483870967742
tr0.18444165621079048
es0.18341708542713567
az0.17721518987341772
hi0.10714285714285714
be0.09722222222222222
hu0.09344490934449094
uk0.08835904628330996
vi0.08835904628330996
reliabletrue
passestrue
6
name"Selvi"
dialogue"“Strange? Sab strange hai! Yeh log jo gayen… main unki tasveerein dhoondh rahi hoon. Lekin yahan koi jawab nahi deta. Mujhe bahut dar lag raha hai.”"
detectedLang"ms"
heavyLang"ber"
scores
ms0.40056417489421725
de0.32216905901116427
eu0.3178170144462279
no0.30098684210526316
nl0.2802709568162574
lt0.26279271465741544
da0.2595818815331011
fi0.25569176882662
en0.24578527062999111
tl0.236983842010772
sq0.23354373309287646
is0.22656960873521384
fr0.21875
ro0.19278252611585947
et0.1904761904761905
sl0.18582375478927202
lv0.18032786885245902
it0.1771539206195547
sv0.1625615763546798
vi0.15590863952333664
es0.09862142099681867
pt0.09862142099681867
yo0.09766454352441614
ca0.09478168264110756
hr0.09478168264110756
sk0.09381663113006397
cs0.08896034297963559
pl0.08405172413793104
az0.06490649064906491
tr0.06490649064906491
reliablefalse
passesfalse
7
name"Hunter"
dialogue"“I’m trying to help, but I need information. Did you see anyone acting odd since the disappearances started?”"
detectedLang"en"
heavyLang"en"
scores
en0.816698202459792
tl0.672442941673711
fr0.5916754478398314
no0.5144110275689223
nl0.49113591595535133
da0.4894598155467721
sv0.48021462105969154
cs0.4456366237482118
et0.41641566265060237
it0.4159758854559156
hr0.4092987804878049
ca0.4070390206579954
de0.4029275808936826
yo0.39310884886452624
pl0.3902439024390244
lv0.38197767145135564
pt0.3785084202085004
ro0.37751004016064255
sk0.35146443514644354
sq0.34709351305812974
lt0.32491289198606277
es0.30493273542600896
ms0.2986425339366516
sl0.29800724637681164
tr0.22962226640159045
is0.225
az0.19605809128630705
eu0.1474147414741474
hu0.143646408839779
fi0.09568261376896149
zh0.0903755868544601
be0.08284023668639054
uk0.07517899761336516
vi0.07517899761336516
reliabletrue
passestrue
8
name"Selvi"
dialogue"“Nahi… main sirf yeh dekh rahi hoon. Main Selvi hoon. Main yeh bachaa rahi hoon.”"
detectedLang"eu"
heavyLang"ber"
scores
eu0.375
da0.289405684754522
fi0.2857142857142857
en0.2647058823529412
no0.25271739130434784
fr0.24242424242424243
de0.22096317280453256
ca0.21875
reliablefalse
passesfalse
9
name"Hunter"
dialogue"“Wait—” “Hunter… yeah, I’m at the cafe on Main. No, she doesn’t speak English—just Hindi. I’m coming back to the station. Check the posters near the festival grounds.”"
detectedLang"en"
heavyLang"en"
scores
en0.7973815461346634
tl0.7073829531812725
no0.544179523141655
fr0.5400943396226415
da0.5289855072463767
sv0.45983379501385035
ca0.4500846023688663
hr0.43082311733800355
nl0.42545668827342376
it0.4240992321323095
de0.4186046511627907
sk0.3894802755165936
et0.38679245283018865
sl0.3741976893453145
pt0.3660598179453836
cs0.3555849306014541
ms0.3443174176193679
pl0.33763586956521735
ro0.336283185840708
es0.3317340644276902
sq0.3298969072164949
yo0.32758620689655166
lt0.3055555555555556
lv0.2799113737075332
fi0.26636568848758463
tr0.2162379421221865
az0.19753086419753088
hi0.1424802110817942
is0.0913327120223672
zh0.07319391634980989
hu0.06429942418426103
reliabletrue
passestrue
10
name"Hunter"
dialogue"“I have to go—there’s been another development. Try to find someone who can translate, okay? Don’t stay here alone.”"
detectedLang"en"
heavyLang"en"
scores
en0.8239849800516311
tl0.6109958506224067
da0.4820441988950276
pl0.4373593398349587
hr0.41815360744763375
no0.3796526054590571
nl0.3723849372384937
ro0.36332767402376914
ca0.35233160621761656
sq0.3321460373998219
fr0.32915921288014316
yo0.3267504488330341
cs0.3231046931407942
it0.3119266055045872
sk0.3055555555555556
sl0.2596248766041461
az0.258893280632411
pt0.258160237388724
sv0.25742574257425743
es0.2537313432835821
lv0.251497005988024
de0.24395161290322584
lt0.2378048780487805
tr0.21875
vi0.16759156492785796
hu0.14772727272727273
et0.13990825688073394
be0.08536585365853659
eu0.08200734394124846
is0.07749077490774908
uk0.07749077490774908
ms0.07292954264524104
reliabletrue
passestrue
11
name"Selvi"
dialogue"“Samajh gayi… jaaiye… lekin yeh… yeh bachaa lijiye.”"
detectedLang"fi"
heavyLang"ber"
scores
fi0.39759036144578314
is0.3877551020408163
eu0.3288590604026846
et0.25742574257425743
no0.25
lv0.24433249370277077
tl0.24433249370277077
da0.2227979274611399
sv0.21052631578947367
ms0.19137466307277629
reliablefalse
passesfalse