Run: 2026-07-25-01KYCWSTXJZTGVHBMR69WFRBAC

Run Details

Model:
Thinking Machines Inkling
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
4.4s
Cost:
$0.001667
Provider:
Together

Evaluation summary

Score Evaluator
Details Link
46.15% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Selvi: "Ye sab kya ho raha hai... mujhe samajh nahi aa raha... mere haath kaanp rahe hain..." Hunter: "Hey, you okay? You seen anything weird around town lately—the disappearances?" Selvi: "Nahi... woh log gayab ho rahe hain... mujhe darr lag raha hai... main toh sirf... tasveerein..." Hunter: "Sorry, I don't speak... whatever that is. You understand me?" Selvi: "Main... angrezi nahi janti... maaf kijiye... yeh jagah ab surakshit nahi rahi..." Hunter: "Look, I need to know if you saw something near the orchard. The festival's coming up." Selvi: "Sev ka tyohar...? Main wahan gayi thi... lekin sab kuch... ajeeb tha... kaun gayab hua?" Hunter: "Yeah, the apple thing. Three people. You got a camera—did you take pictures?" Selvi: "Haan... mera camera... lekin tasveerein... woh... woh kuch chhupa rahi thi... mujhe... mujhe darr lagta hai..." Hunter: "You're shaking. Okay, we'll figure this out. Stay put—" Selvi: "Aap... aap meri baat sun rahe hain... lekin samajh nahi... main akeli hoon yahan..." Hunter: "—Wait, I gotta take this. Don't go anywhere. We'll talk." Selvi: "Jaane mat dijiye... yeh sheher... yeh sheher ab... soona sa lagta hai..."
created_at"2026-07-25T15:02:51.577Z" 7/25/2026, 3:02:51 PM
model"thinkingmachines/inkling-20260715"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency264
moderation_latency(null)
generation_time4182
tokens_prompt302
tokens_completion295
native_tokens_prompt278
native_tokens_completion343
native_tokens_completion_images(null)
native_tokens_reasoning0
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
num_fetches(null)
web_search_engine(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
service_tier(null)
usage0.00166715
router(null)
provider_responses
0
endpoint_id"9911deb9-f44e-4e18-87fe-9d7b60acee72"
id"otYcQYQ-6z2FuN-a20c0c4ccd0f6abb"
is_byokfalse
latency259
model_permaslug"thinkingmachines/inkling-20260715"
provider_name"Together"
status200
user_agent"langchainjs-openai/1.0.0 ((node/v24.18.0; linux; x64))"
http_referer(null)
request_id"req-1784991771-zlFbGOuFkjQWY6YHBCnk"
session_id(null)
preset_id(null)
api_type"completions"
id"gen-1784991771-LJwQRplIaTFVkmn8tPhQ"
upstream_id"otYcQYQ-6z2FuN-a20c0c4ccd0f6abb"
total_cost0.00166715
cache_discount(null)
upstream_inference_cost0
provider_name"Together"
response_cache_source_id(null)
data_region"global"

Evaluation details

Result Evaluator Details Meta Data
46.15% Parse dialogue n/a
dialogue
0
name"Selvi"
dialogue"Ye sab kya ho raha hai... mujhe samajh nahi aa raha... mere haath kaanp rahe hain..."
detectedLang"no"
heavyLang"en"
scores
no0.40846824408468246
eu0.38946015424164526
et0.34027777777777785
da0.33936022253129344
it0.302496328928047
tl0.2983751846381093
vi0.24841772151898736
yo0.20833333333333331
ca0.20168067226890754
sk0.18941979522184302
cs0.18244406196213425
fi0.17962003454231434
is0.17677642980935876
tr0.1739130434782609
lv0.16958041958041958
sv0.14414414414414414
ms0.13003663003663005
reliablefalse
passesfalse
1
name"Hunter"
dialogue"Hey, you okay? You seen anything weird around town lately—the disappearances?"
detectedLang"en"
heavyLang"en"
scores
en0.7801231310466139
tl0.5370370370370371
fr0.43883277216610556
nl0.3734335839598998
ms0.3368700265251989
sq0.2625368731563422
pt0.24357034795764
ca0.23195084485407066
yo0.17627677100494232
no0.15966386554621848
es0.15110356536502548
it0.1482112436115843
cs0.13494809688581316
da0.13494809688581316
fi0.13494809688581316
sk0.13494809688581316
sv0.13494809688581316
de0.13194444444444445
hi0.13194444444444445
pl0.13194444444444445
lv0.1289198606271777
reliabletrue
passestrue
2
name"Selvi"
dialogue"Nahi... woh log gayab ho rahe hain... mujhe darr lag raha hai... main toh sirf... tasveerein..."
detectedLang"eu"
heavyLang"de"
scores
eu0.37733499377334995
de0.31787175989085953
no0.29478138222849076
it0.2917847025495751
nl0.24812030075187969
vi0.2389649923896499
et0.21996879875195008
ca0.1935483870967742
sk0.18166939443535188
cs0.1749174917491749
ms0.17355371900826447
en0.1652754590984975
is0.15824915824915825
sv0.15682967959527827
fr0.14965986394557826
reliablefalse
passesfalse
3
name"Hunter"
dialogue"Sorry, I don't speak... whatever that is. You understand me?"
detectedLang"en"
heavyLang"en"
scores
en0.8120300751879699
no0.5936902485659656
tl0.5833333333333334
da0.5559038662486938
nl0.5449678800856531
sv0.5069605568445477
it0.4097222222222222
sq0.3988684582743989
cs0.38583815028901736
pt0.3795620437956204
is0.3501529051987768
hu0.34210526315789475
yo0.3275316455696203
pl0.32432432432432434
de0.3122977346278317
ro0.2784380305602716
fr0.2772108843537415
sk0.2747440273037543
et0.27101200686106347
hr0.24645390070921988
ca0.24511545293072823
es0.1935483870967742
sl0.17153996101364524
ms0.1650294695481336
fi0.15
be0.1414141414141414
tr0.1414141414141414
az0.1290983606557377
lt0.1290983606557377
lv0.1290983606557377
uk0.1290983606557377
vi0.1290983606557377
reliabletrue
passestrue
4
name"Selvi"
dialogue"Main... angrezi nahi janti... maaf kijiye... yeh jagah ab surakshit nahi rahi..."
detectedLang"ms"
heavyLang"ber"
scores
ms0.3963068181818182
de0.38405797101449274
sq0.30213464696223313
sv0.2951907131011609
ro0.288107202680067
hr0.28087986463620984
lt0.28087986463620984
eu0.2796610169491525
tr0.25438596491228066
et0.2085661080074488
it0.20411985018726592
en0.18893129770992365
no0.18111753371868977
da0.17153996101364524
fr0.17153996101364524
lv0.15
cs0.1361788617886179
sk0.1361788617886179
sl0.1361788617886179
tl0.1361788617886179
reliablefalse
passesfalse
5
name"Hunter"
dialogue"Look, I need to know if you saw something near the orchard. The festival's coming up."
detectedLang"en"
heavyLang"en"
scores
en0.8060583671961581
tl0.6217579250720461
no0.5430809399477807
da0.5023696682464455
nl0.46098562628336753
cs0.45595854922279794
fr0.45426195426195426
sv0.45255474452554745
hr0.42934782608695654
ms0.4160177975528365
ca0.4140625
it0.39724454649827784
sq0.3944636678200692
yo0.38668224299065423
et0.38162544169611307
pl0.38162544169611307
sk0.38016528925619836
pt0.37275985663082434
ro0.36823104693140796
es0.3644067796610169
lt0.3581907090464548
lv0.3208279430789133
sl0.31994818652849744
de0.29435483870967744
az0.2563739376770538
be0.11764705882352942
tr0.11764705882352942
hu0.11317567567567569
fi0.10714285714285714
is0.10714285714285714
uk0.10714285714285714
vi0.10714285714285714
reliabletrue
passestrue
6
name"Selvi"
dialogue"Sev ka tyohar...? Main wahan gayi thi... lekin sab kuch... ajeeb tha... kaun gayab hua?"
detectedLang"lv"
heavyLang"vi"
scores
lv0.3514915693904021
sq0.34210526315789475
tl0.32795698924731176
ms0.3270524899057874
fi0.2668621700879765
vi0.2366412213740458
eu0.22720247295208654
et0.2223950233281493
yo0.17627677100494232
en0.1652754590984975
fr0.14965986394557826
is0.14965986394557826
pl0.14383561643835618
de0.13494809688581316
reliablefalse
passesfalse
7
name"Hunter"
dialogue"Yeah, the apple thing. Three people. You got a camera—did you take pictures?"
detectedLang"en"
heavyLang"en"
scores
en0.8087954110898662
tl0.6551724137931034
fr0.5575221238938053
nl0.4877049180327869
ro0.4731296101159114
ca0.44933920704845814
es0.4337485843714609
sv0.4246260069044879
it0.42263279445727486
de0.4206257242178447
ms0.3678887484197219
no0.32157394843962006
yo0.3112947658402204
da0.30747922437673125
cs0.29577464788732394
sl0.251497005988024
et0.24357034795764
hu0.2378048780487805
lv0.23430321592649314
sq0.23076923076923078
pt0.21875
sk0.20634920634920634
hr0.1830065359477124
pl0.17355371900826447
lt0.14089347079037798
tr0.1334488734835355
is0.13043478260869565
az0.12280701754385964
eu0.12280701754385964
vi0.12280701754385964
fi0.11190053285968028
reliabletrue
passestrue
8
name"Selvi"
dialogue"Haan... mera camera... lekin tasveerein... woh... woh kuch chhupa rahi thi... mujhe... mujhe darr lagta hai..."
detectedLang"vi"
heavyLang"de"
scores
vi0.37275985663082434
it0.32950191570881227
sv0.26264044943820225
is0.25742574257425743
nl0.23802612481857763
ro0.23133235724743775
de0.2222222222222222
eu0.21875
ca0.16267942583732056
es0.15865384615384615
fi0.1518578352180937
en0.1264559068219634
fr0.1264559068219634
ms0.12060301507537688
tl0.12060301507537688
reliablefalse
passesfalse
9
name"Hunter"
dialogue"You're shaking. Okay, we'll figure this out. Stay put—"
detectedLang"en"
heavyLang"en"
scores
en0.7769389155799589
tl0.6135552913198573
fr0.4014732965009208
no0.3229166666666667
de0.3143459915611814
ro0.3114406779661017
pt0.3010752688172043
hr0.2777777777777778
nl0.2388758782201405
ca0.19154228855721395
sq0.19154228855721395
is0.1792929292929293
sv0.1792929292929293
da0.1751269035532995
es0.1751269035532995
it0.1751269035532995
reliabletrue
passestrue
10
name"Selvi"
dialogue"Aap... aap meri baat sun rahe hain... lekin samajh nahi... main akeli hoon yahan..."
detectedLang"eu"
heavyLang"tl"
scores
eu0.5142857142857142
fi0.4022503516174402
tl0.3491577335375191
et0.32965299684542587
ms0.32965299684542587
en0.3189102564102564
is0.3089430894308943
yo0.2085661080074488
no0.1904761904761905
lv0.18582375478927202
fr0.17153996101364524
da0.16829745596868884
sv0.15841584158415842
de0.1550695825049702
reliablefalse
passesfalse
11
name"Hunter"
dialogue"—Wait, I gotta take this. Don't go anywhere. We'll talk."
detectedLang"en"
heavyLang"en"
scores
en0.7545811518324608
tl0.5856353591160222
it0.4549418604651163
pl0.3842364532019704
sv0.3644067796610169
sq0.36115843270868825
hu0.3181818181818182
yo0.3042671614100185
no0.27884615384615385
da0.2704280155642024
hr0.2704280155642024
ca0.2690058479532163
fi0.2299794661190965
cs0.21875
ro0.1935483870967742
de0.17218543046357618
sl0.17218543046357618
sk0.1610738255033557
be0.15730337078651685
tr0.15730337078651685
az0.14383561643835618
et0.14383561643835618
is0.14383561643835618
lt0.14383561643835618
lv0.14383561643835618
uk0.14383561643835618
vi0.14383561643835618
reliabletrue
passestrue
12
name"Selvi"
dialogue"Jaane mat dijiye... yeh sheher... yeh sheher ab... soona sa lagta hai..."
detectedLang"sv"
heavyLang"ber"
scores
sv0.3872549019607844
sk0.38016528925619836
et0.3644067796610169
de0.36332767402376914
tl0.3267504488330341
it0.3218806509945751
no0.29775280898876405
vi0.2951127819548872
ro0.2690058479532163
fr0.2378048780487805
hr0.2219917012448133
sq0.20212765957446807
is0.1830065359477124
tr0.17218543046357618
lt0.16666666666666666
ms0.16666666666666666
reliablefalse
passesfalse