Run: 2026-07-25-01KYCXXZ0MNK7P2AFRYXN7RSX2

Run Details

Model:
Thinking Machines Inkling (Reasoning)
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
6m 18s
Cost:
$0.014580
Provider:
DeepInfra

Evaluation summary

Score Evaluator
Details Link
50.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Selvi: [Clutching her camera, trembling] "Maaf kijiye... main angrezi nahi jaanti. Lekin woh raat... seb ke bagh ke paas..." Hunter: "No English. Fine. I'm Detective Hunter. People are disappearing in Alborn. You been near the orchard? You take pictures there?" Selvi: "Haan... photo lene gayi thi. Aur... ek chhaya. Bina chehre ke. Log... gayab ho gaye." Hunter: "Shadow? No face? You caught that on this camera?" Selvi: [Holds up the screen, shaken] "Dekhiye... yeh tasveer... yeh toh sach nahi ho sakta. Main bahut darr gayi hoon." Hunter: "I don't know your words, but I know that look. Show me the screen. Now." Selvi: "Aap... samjhenge? Kripya... mujhe akela mat chhodiye..." Hunter: "Just stay put—" [Hunter's phone rings sharply.] Hunter: "Hunter. ...North orchard? Another one missing? ...I'm moving. Stay right there. Don't touch that camera. I'll be back. Understand? Stay." Selvi: [Still trembling, in Hindi] "Jaldi... kripya... jaldi wapas aaiye..."
created_at"2026-07-25T15:22:35.424Z" 7/25/2026, 3:22:35 PM
model"thinkingmachines/inkling-20260715"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency1042
moderation_latency(null)
generation_time377634
tokens_prompt302
tokens_completion3678
native_tokens_prompt280
native_tokens_completion3544
native_tokens_completion_images(null)
native_tokens_reasoning3431
native_tokens_cached64
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
num_fetches(null)
web_search_engine(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
service_tier(null)
usage0.01458008
router(null)
provider_responses
0
endpoint_id"d6b9d68e-115a-49d7-81cd-1ad1c6942b0e"
id"chatcmpl-R4Tx4IKloJzrqoWhATWnuR9A"
is_byokfalse
latency58
model_permaslug"thinkingmachines/inkling-20260715"
provider_name"DeepInfra"
status200
user_agent"langchainjs-openai/1.0.0 ((node/v24.18.0; linux; x64))"
http_referer(null)
request_id"req-1784992955-cMvKC5xow51s9MKIc6sq"
session_id(null)
preset_id(null)
api_type"completions"
id"gen-1784992955-JfJNKY07Njke9QIcNXu6"
upstream_id"chatcmpl-R4Tx4IKloJzrqoWhATWnuR9A"
total_cost0.01458008
cache_discount0.00005312
upstream_inference_cost0
provider_name"DeepInfra"
response_cache_source_id(null)
data_region"global"

Evaluation details

Result Evaluator Details Meta Data
50.00% Parse dialogue n/a
dialogue
0
name"Selvi"
dialogue"Maaf kijiye... main angrezi nahi jaanti. Lekin woh raat... seb ke bagh ke paas..."
detectedLang"eu"
heavyLang"tl"
scores
eu0.42333785617367703
ms0.3410852713178295
ro0.288107202680067
cs0.2857142857142857
de0.2685025817555938
et0.23561151079136694
it0.20411985018726592
en0.18893129770992365
fi0.18111753371868977
no0.18111753371868977
da0.17153996101364524
fr0.17153996101364524
is0.17153996101364524
lt0.17153996101364524
yo0.17153996101364524
lv0.15
hr0.1361788617886179
sk0.1361788617886179
sl0.1361788617886179
sq0.1361788617886179
tl0.1361788617886179
tr0.1361788617886179
reliablefalse
passesfalse
1
name"Hunter"
dialogue"No English. Fine. I'm Detective Hunter. People are disappearing in Alborn. You been near the orchard? You take pictures there?"
detectedLang"en"
heavyLang"en"
scores
en0.7986914947156517
tl0.5961635537607269
ro0.5076923076923077
de0.49937421777221525
no0.49238578680203043
nl0.4855305466237942
fr0.46200403496973774
it0.4490358126721763
da0.4227994227994228
sv0.42028985507246375
ca0.40476190476190477
ms0.37205651491365777
pt0.31682322801024765
sl0.30915371329879104
es0.2825112107623318
sq0.2779783393501805
hr0.23076923076923078
lv0.21104536489151873
yo0.19597989949748743
pl0.16579770594369134
cs0.15789473684210525
tr0.15522703273495247
et0.1091314031180401
sk0.10213243546576879
az0.09502262443438914
reliabletrue
passestrue
2
name"Selvi"
dialogue"Haan... photo lene gayi thi. Aur... ek chhaya. Bina chehre ke. Log... gayab ho gaye."
detectedLang"ms"
heavyLang"vi"
scores
ms0.4930629669156884
cs0.38471502590673573
tr0.30858806404657935
fr0.2857142857142857
en0.2647058823529412
vi0.24603174603174602
ca0.20168067226890754
no0.18941979522184302
sk0.18941979522184302
it0.18244406196213425
da0.1810344827586207
ro0.1810344827586207
nl0.1739130434782609
yo0.15630550621669628
hi0.1394927536231884
tl0.1394927536231884
reliablefalse
passesfalse
3
name"Hunter"
dialogue"Shadow? No face? You caught that on this camera?"
detectedLang"en"
heavyLang"en"
scores
en0.7919556171983356
tl0.6314496314496314
ca0.5283018867924528
fr0.4854202401372213
ro0.47368421052631576
it0.44237918215613387
es0.44029850746268656
pt0.4174757281553398
hr0.38650306748466257
sk0.3562231759656652
pl0.3464052287581699
et0.33920704845814975
cs0.33774834437086093
fi0.3333333333333333
lv0.30394431554524365
no0.24433249370277077
tr0.22680412371134018
hi0.21875
sv0.21465968586387435
nl0.20212765957446807
yo0.2
de0.1935483870967742
ms0.1935483870967742
reliabletrue
passestrue
4
name"Selvi"
dialogue"Dekhiye... yeh tasveer... yeh toh sach nahi ho sakta. Main bahut darr gayi hoon."
detectedLang"sq"
heavyLang"ber"
scores
sq0.4022503516174402
no0.3055555555555556
eu0.2796610169491525
ca0.22018348623853207
nl0.21586715867158673
sk0.20708955223880596
cs0.19962335216572505
it0.19962335216572505
en0.18893129770992365
tr0.18582375478927202
fr0.17153996101364524
de0.1550695825049702
is0.15169660678642716
sv0.15169660678642716
reliablefalse
passesfalse
5
name"Hunter"
dialogue"I don't know your words, but I know that look. Show me the screen. Now."
detectedLang"en"
heavyLang"en"
scores
en0.8266897746967071
tl0.663582842724979
nl0.5475113122171946
no0.5037220843672456
sq0.47368421052631576
fr0.4550408719346049
ms0.375
da0.35170178282009723
sv0.35064935064935066
ca0.34959349593495936
it0.3277310924369748
yo0.3265993265993266
es0.30675909878682844
pt0.2920353982300885
fi0.2844364937388193
et0.2831541218637993
hr0.25788497217068646
pl0.23954372623574144
cs0.2079207920792079
de0.1902834008097166
ro0.1836734693877551
sl0.18032786885245902
sk0.15254237288135594
be0.14893617021276595
tr0.14893617021276595
hu0.14346895074946467
az0.13606911447084233
is0.13606911447084233
lt0.13606911447084233
lv0.13606911447084233
uk0.13606911447084233
vi0.13606911447084233
reliabletrue
passestrue
6
name"Selvi"
dialogue"Aap... samjhenge? Kripya... mujhe akela mat chhodiye..."
detectedLang"no"
heavyLang"tr"
scores
no0.3230174081237911
tr0.2631578947368421
sq0.23076923076923078
da0.2290748898678414
ca0.19724770642201836
is0.1935483870967742
de0.1784037558685446
en0.1784037558685446
lt0.1764705882352941
ms0.1764705882352941
sk0.1764705882352941
sv0.1764705882352941
reliablefalse
passesfalse
7
name"Hunter"
dialogue"Just stay put—"
detectedLang"en"
heavyLang"en"
scores
en0.8179611650485438
hr0.625
et0.576271186440678
sv0.576271186440678
ca0.506578947368421
reliabletrue
passestrue
8
name"Hunter"
dialogue"Hunter. ...North orchard? Another one missing? ...I'm moving. Stay right there. Don't touch that camera. I'll be back. Understand? Stay."
detectedLang"en"
heavyLang"en"
scores
en0.8042094958394518
tl0.6272134203168686
no0.49044585987261147
de0.4845360824742268
da0.45725915875169604
nl0.4542974079126876
fr0.375487900078064
sv0.36457505957108816
es0.3197278911564626
it0.3162393162393162
ca0.2779783393501805
pt0.27140255009107467
ro0.26672777268560954
ms0.23150816522574447
is0.2202729044834308
yo0.18699186991869918
pl0.17098445595854922
sq0.14621131270010673
hu0.12758996728462377
lt0.12280701754385964
sk0.10011248593925759
hr0.09808342728297632
cs0.09502262443438914
fi0.0888382687927107
az0.07514450867052024
et0.07514450867052024
sl0.06868451688009314
tr0.06868451688009314
reliabletrue
passestrue
9
name"Selvi"
dialogue"Jaldi... kripya... jaldi wapas aaiye..."
detectedLang"eu"
heavyLang"is"
scores
eu0.3464052287581699
sq0.3442622950819672
es0.3333333333333333
pt0.3333333333333333
is0.3197278911564626
et0.2805755395683453
reliablefalse
passesfalse