Run: 2026-07-25-01KYCV41SC0NNCD47A2YVPBKD3

Run Details

Model:
Thinking Machines Inkling (Reasoning)
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
6m 4s
Cost:
$0.014244
Provider:
DeepInfra

Evaluation summary

Score Evaluator
Details Link
50.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Selvi: (looking up from her camera, troubled) "Mujhe angrezi nahi aati... aap kaun hain?" [I don't know English... who are you?] Hunter: "Detective Hunter, Alborn P.D. I'm investigating the disappearances. You were near the orchard during the apple festival, right?" Selvi: (clutches camera tighter, shaken, in rapid Hindi) "Haan... main wahan thi. Tasveerein le rahi thi... lekin maine kuch dekha tha. Koi aadmi... andhere mein..." [Yes... I was there. Taking pictures... but I saw something. Someone... in the darkness...] Hunter: (leaning in, frustrated but calm) "I don't understand a word of Hindi. Slow down. Show me." Selvi: (points urgently at her camera screen) "Yeh... yeh saboot hai! Dekhiye!" [This... this is proof! Look!] Hunter: "That shadow by the barn? Is that what you're talking about?" Selvi: (nods frantically, voice trembling) "Haan! Woh... woh logon ko le ja raha tha! Mujhe darr lag raha hai!" [Yes! He... he was taking people! I'm scared!] Hunter: (no-nonsense, studying the photo) "How long have you been in Alborn? Are you a student?" Selvi: "Main toh yahan padh rahi hoon... do mahine..." [I'm studying here... two months...] Hunter: (phone rings sharply) "Hunter. ...Yeah, I'm at the cafe on Main. ...Another one? Near the river? ...I'm coming." (To Selvi, gesturing firmly) "Don't leave. Lock the door. I need every picture on that camera." Selvi: (standing, calling after him in frightened Hindi) "Rukiye! Kripya rukiye! Yeh khatarnak hai!" [Wait! Please wait! This is dangerous!] Hunter: (over his shoulder, gruff) "Stay put. Don't talk to anyone else."
created_at"2026-07-25T14:33:29.142Z" 7/25/2026, 2:33:29 PM
model"thinkingmachines/inkling-20260715"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency1161
moderation_latency(null)
generation_time363554
tokens_prompt302
tokens_completion3648
native_tokens_prompt280
native_tokens_completion3461
native_tokens_completion_images(null)
native_tokens_reasoning3243
native_tokens_cached64
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
num_fetches(null)
web_search_engine(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
service_tier(null)
usage0.01424393
router(null)
provider_responses
0
endpoint_id"d6b9d68e-115a-49d7-81cd-1ad1c6942b0e"
id"chatcmpl-R7S4LZMWYA6QpnFE6G4TnxLH"
is_byokfalse
latency155
model_permaslug"thinkingmachines/inkling-20260715"
provider_name"DeepInfra"
status200
user_agent"langchainjs-openai/1.0.0 ((node/v24.18.0; linux; x64))"
http_referer(null)
request_id"req-1784990009-o57HYkA7XWP8wjWveCaI"
session_id(null)
preset_id(null)
api_type"completions"
id"gen-1784990009-iJlQiBxssh6ufkZAxZIp"
upstream_id"chatcmpl-R7S4LZMWYA6QpnFE6G4TnxLH"
total_cost0.01424393
cache_discount0.00005312
upstream_inference_cost0
provider_name"DeepInfra"
response_cache_source_id(null)
data_region"global"

Evaluation details

Result Evaluator Details Meta Data
50.00% Parse dialogue n/a
dialogue
0
name"Selvi"
dialogue"Mujhe angrezi nahi aati... aap kaun hain?"
detectedLang"eu"
heavyLang"tl"
scores
eu0.5738636363636364
ro0.3181818181818182
no0.29467084639498436
da0.281150159744409
de0.25742574257425743
reliabletrue
passesfalse
1
name"Hunter"
dialogue"Detective Hunter, Alborn P.D. I'm investigating the disappearances. You were near the orchard during the apple festival, right?"
detectedLang"en"
heavyLang"en"
scores
en0.7767270816916207
tl0.6544715447154472
fr0.6407438715131022
nl0.5720040281973817
no0.5476317189994678
pt0.5435016111707841
de0.5285635052689961
it0.5248742314141979
da0.5081018518518519
es0.5055264688772542
ro0.5017584994138335
ca0.4946492271105826
sv0.480440097799511
ms0.47788697788697787
sq0.41540577716643745
cs0.4076655052264809
hr0.3862815884476534
lt0.37591776798825255
sl0.371301775147929
sk0.3055555555555556
et0.2672413793103448
yo0.26022628372497825
lv0.23835125448028674
az0.21731123388581952
is0.19811320754716982
pl0.18190567853705486
fi0.17555771096023276
tr0.17555771096023276
hu0.07306434023991276
reliabletrue
passestrue
2
name"Selvi"
dialogue"Haan... main wahan thi. Tasveerein le rahi thi... lekin maine kuch dekha tha. Koi aadmi... andhere mein..."
detectedLang"de"
heavyLang"vi"
scores
de0.45750452079566006
fr0.4360902255639098
en0.3969849246231156
fi0.36507936507936506
ro0.30313588850174217
ms0.28825622775800713
tl0.26199261992619927
sq0.24528301886792453
is0.23273657289002556
et0.21363040629095675
vi0.2052980132450331
eu0.19678714859437751
it0.19463087248322147
yo0.16897506925207756
es0.16550764951321278
sl0.16317991631799164
hu0.14040114613180515
lv0.12790697674418602
nl0.12790697674418602
reliablefalse
passesfalse
3
name"Hunter"
dialogue"I don't understand a word of Hindi. Slow down. Show me."
detectedLang"en"
heavyLang"en"
scores
en0.7832369942196532
tl0.6660730186999109
no0.6501865671641791
nl0.5879120879120879
da0.5772266065388951
sq0.5404411764705882
it0.5294855708908407
sv0.5235069885641677
is0.5155038759689923
de0.4777158774373259
cs0.46120689655172414
yo0.4596541786743516
et0.45652173913043476
pl0.4517543859649123
pt0.4485294117647059
ro0.4469026548672566
sk0.4369369369369369
ca0.4221879815100154
hr0.4009584664536741
es0.3842364532019704
hu0.37290969899665555
fr0.3567753001715266
sl0.3218806509945751
ms0.2816091954022989
tr0.2816091954022989
lt0.27884615384615385
fi0.2690058479532163
az0.2618110236220473
lv0.2618110236220473
vi0.2618110236220473
hi0.17218543046357618
be0.15730337078651685
eu0.15730337078651685
uk0.14383561643835618
reliabletrue
passestrue
4
name"Selvi"
dialogue"Yeh... yeh saboot hai! Dekhiye!"
detectedLang"vi"
heavyLang"ber"
scores
vi0.511400651465798
hr0.4444444444444444
it0.39999999999999997
pt0.39999999999999997
reliablefalse
passesfalse
5
name"Hunter"
dialogue"That shadow by the barn? Is that what you're talking about?"
detectedLang"en"
heavyLang"en"
scores
en0.8193082085699536
nl0.49640287769784175
tl0.47368421052631576
no0.43910256410256415
da0.4176372712146422
sv0.4176372712146422
is0.4067796610169492
yo0.3934142114384749
hu0.3055555555555556
fr0.2985971943887776
sk0.279835390946502
cs0.2723492723492723
pl0.25213675213675213
de0.18604651162790697
ms0.1822429906542056
sq0.1822429906542056
pt0.16864608076009502
reliabletrue
passestrue
6
name"Selvi"
dialogue"Haan! Woh... woh logon ko le ja raha tha! Mujhe darr lag raha hai!"
detectedLang"yo"
heavyLang"de"
scores
yo0.48377581120943947
sl0.47994056463595847
et0.45736434108527135
it0.4117647058823529
lv0.40476190476190477
sq0.35424354243542433
fr0.32432432432432434
sv0.32432432432432434
de0.32038834951456313
vi0.30966469428007887
fi0.30417495029821073
tl0.2768595041322314
es0.2537313432835821
ro0.2456896551724138
ca0.2374727668845316
eu0.23076923076923078
hr0.23076923076923078
hu0.21875
no0.21875
lt0.21348314606741572
sk0.1935483870967742
da0.18604651162790697
pl0.18604651162790697
nl0.18032786885245902
reliablefalse
passesfalse
7
name"Hunter"
dialogue"How long have you been in Alborn? Are you a student?"
detectedLang"en"
heavyLang"en"
scores
en0.8172959805115714
ro0.6547756041426928
tl0.5535714285714286
nl0.5495495495495496
cs0.5398773006134969
de0.5363214837712519
fr0.5356037151702787
da0.5348837209302325
it0.5327102803738317
pl0.5207667731629393
sl0.5024875621890548
sv0.5024875621890548
sk0.4633273703041145
az0.43289224952741023
ca0.42084942084942084
hu0.4174757281553398
sq0.4129158512720157
no0.4106090373280943
yo0.40828402366863903
hr0.38650306748466257
vi0.3603411513859275
lt0.336283185840708
lv0.3181818181818182
pt0.3181818181818182
ms0.3150684931506849
et0.3071593533487298
es0.3055555555555556
tr0.20424403183023873
is0.2
eu0.1891891891891892
fi0.17355371900826447
reliabletrue
passestrue
8
name"Selvi"
dialogue"Main toh yahan padh rahi hoon... do mahine..."
detectedLang"tl"
heavyLang"ga"
scores
tl0.5798319327731093
en0.5283018867924528
fr0.4075829383886255
pt0.3842364532019704
de0.3796526054590571
pl0.36386768447837153
ms0.3556701030927836
cs0.34725848563968675
sk0.34554973821989526
hr0.32432432432432434
sl0.32432432432432434
sq0.31880108991825606
vi0.30747922437673125
az0.2857142857142857
fi0.26035502958579887
yo0.2378048780487805
et0.23076923076923078
tr0.23076923076923078
reliablefalse
passesfalse
9
name"Hunter"
dialogue"Don't leave. Lock the door. I need every picture on that camera."
detectedLang"en"
heavyLang"en"
scores
en0.8121961997348652
tl0.6198568872987478
fr0.46874999999999994
it0.45790816326530615
et0.4558258642765685
yo0.4444444444444444
ca0.44371727748691103
nl0.43408788282290284
ro0.43408788282290284
hr0.42411924119241196
sv0.4121715076071923
sq0.3997175141242938
sk0.3675595238095238
no0.3609022556390977
da0.33800623052959505
pl0.33070866141732286
cs0.2975206611570248
fi0.2608695652173913
ms0.2608695652173913
de0.2517605633802817
es0.18893129770992365
hi0.1650294695481336
sl0.15841584158415842
be0.1414141414141414
tr0.1414141414141414
hu0.1361788617886179
az0.1290983606557377
is0.1290983606557377
lt0.1290983606557377
lv0.1290983606557377
uk0.1290983606557377
vi0.1290983606557377
reliabletrue
passestrue
10
name"Selvi"
dialogue"Rukiye! Kripya rukiye! Yeh khatarnak hai!"
detectedLang"vi"
heavyLang"rn"
scores
vi0.4109947643979057
tr0.38524590163934425
hu0.34210526315789475
sq0.3181818181818182
it0.30769230769230765
hr0.281150159744409
sl0.25742574257425743
sv0.25742574257425743
reliablefalse
passesfalse
11
name"Hunter"
dialogue"Stay put. Don't talk to anyone else."
detectedLang"en"
heavyLang"en"
scores
en0.8221343873517788
tl0.5778611632270169
hr0.5171673819742489
yo0.3784530386740331
pl0.375
sk0.3697478991596639
cs0.3679775280898876
lv0.3515850144092219
sl0.34971098265895956
no0.3263473053892215
da0.3161094224924012
lt0.3161094224924012
reliabletrue
passestrue