Run: 2026-09-01-01M1EKV74VE1F6FY1R32YZGHPV

Run Details

Model:
Thinking Machines Inkling Small (Reasoning, High)
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
2m 34s
Cost:
$0.005715
Provider:
Together

Evaluation summary

Score Evaluator
Details Link
58.33% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Selvi sat at a corner table of the small café on Main Street, her camera resting on the laminate like a protective shield. The midday crowd from Alborn’s annual apple festival had thinned, leaving a hollow quiet in the air—the kind that followed the missing. Hunter approached with his no-nonsense stride, badge glinting, and asked about the recent disappearances. She looked up, trembling, and spoke rapidly in Hindi, clutching her lens. Hunter blinked, confused, repeating his questions in plain English, but she only shook her head and pointed at her camera. They spoke in a messy cross-current—her shaken Hindi, his direct questions—until Hunter’s phone rang with urgent news, and he had to leave her with one last instruction. **Voice Sheet** Selvi: "Mujhe samajh nahi aa raha... yahan kuch bahut galat ho raha hai. Main bohut dar gayi." Hunter: "Excuse me—I'm Detective Hunter, Alborn PD. I'm investigating the disappearances. Did you see anything strange around town lately? The apple festival?" Selvi: "Nahi... main sirf Hindi bolti hoon. Angrezi meri samajh mein nahi aati." Hunter: "I—I'm sorry. I don't understand. Did you see anything near the square? Did you take any pictures?" Selvi: "Haan, main photographer hoon. Main ne tasweer li... ek shakhs alag tha... wahin tha jahan log gayab hue. Yeh camera... isme sab kuch hai." Hunter: "A photo? You have something on that camera? Listen, if you saw someone suspicious—anything—I'm trying to figure out what's happening in Alborn." Selvi: "Woh alag tha... aur ab... mujhe dar lag raha hai. Kripaya..." Hunter: "I'm not trying to scare you—I'm just asking. Those photos could matter. If you have evidence, come to the station. Alborn Police." *Hunter's phone rings sharply. He answers, all business.* Hunter: "Hunter. Yeah, Brennan. What? ... Okay. I'm leaving now." Hunter: "Listen, miss—if that camera has anything, bring it to the station. Don't go anywhere alone. Things are wrong here, and I need every lead I can get." Selvi: "Main aapko dikhana chahti hoon..." Hunter: "Sorry—gotta run."
created_at"2026-09-01T13:51:54.024Z" 9/1/2026, 1:51:54 PM
model"thinkingmachines/inkling-small-20260730"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency6289
moderation_latency(null)
generation_time143275
tokens_prompt302
tokens_completion5096
native_tokens_prompt280
native_tokens_completion4646
native_tokens_completion_images(null)
native_tokens_reasoning4133
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
num_fetches(null)
web_search_engine(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
service_tier(null)
usage0.0057152
router(null)
user_agent"langchainjs-openai/1.0.0 ((node/v24.19.0; linux; x64))"
http_referer(null)
request_id"req-1788270714-Vqb8faZId6KuGLvHlmgT"
session_id(null)
preset_id(null)
api_type"completions"
id"gen-1788270714-MnUdNpmwKafABTmu6WCh"
upstream_id"8aad51fa-aws_ue1"
provider_responses
0
endpoint_id"d1d9657b-3c3a-49b5-8f81-33204e7c71c3"
is_byokfalse
latency10303
model_permaslug"thinkingmachines/inkling-small-20260730"
provider_name"DeepInfra"
status504
1
endpoint_id"0ed263b7-f746-4eb6-a14c-54f2e1cc2269"
id"8aad51fa-aws_ue1"
is_byokfalse
latency6285
model_permaslug"thinkingmachines/inkling-small-20260730"
provider_name"Together"
status200
total_cost0.0057152
cache_discount(null)
upstream_inference_cost0
provider_name"Together"
response_cache_source_id(null)
data_region"global"
workspace_id"97e315e5-d303-487d-83c1-83180e8a13d4"

Evaluation details

Result Evaluator Details Meta Data
58.33% Parse dialogue n/a
dialogue
0
name"Selvi"
dialogue"Mujhe samajh nahi aa raha... yahan kuch bahut galat ho raha hai. Main bohut dar gayi."
detectedLang"tl"
heavyLang"tl"
scores
tl0.42934782608695654
no0.38452520515826494
et0.37869822485207094
ms0.35185185185185186
ro0.34701492537313433
cs0.3009320905459388
sk0.2866847826086956
it0.2818057455540356
ca0.27083333333333337
fi0.2677824267782427
lv0.24785100286532946
es0.2435158501440922
eu0.2391304347826087
vi0.23020527859237538
sv0.22794117647058826
lt0.1935483870967742
sq0.16666666666666666
is0.16267942583732056
en0.15865384615384615
pt0.15048543689320387
fr0.1435562805872757
da0.14075286415711946
de0.12935323383084577
tr0.125
reliablefalse
passesfalse
1
name"Hunter"
dialogue"Excuse me—I'm Detective Hunter, Alborn PD. I'm investigating the disappearances. Did you see anything strange around town lately? The apple festival?"
detectedLang"en"
heavyLang"en"
scores
en0.774113395075672
fr0.593330622204148
tl0.586606035551881
nl0.5421245421245421
it0.5229007633587787
pt0.4954591321897074
no0.47997919916796666
ro0.4772608468374281
es0.4603345925526173
de0.4585814834867353
ms0.44227551589514774
sq0.43977591036414565
da0.42954934398174555
ca0.4262765347102696
sv0.405116002379536
sl0.38080495356037153
et0.36507936507936506
hr0.35938500960922487
cs0.3548387096774194
sk0.29676511954992973
lt0.2418498862774829
az0.2277992277992278
lv0.21691464369616287
fi0.21568627450980393
pl0.1783073130649137
is0.17012448132780084
tr0.10554561717352416
yo0.09665763324299909
hi0.07063197026022305
hu0.06279287722586692
reliabletrue
passestrue
2
name"Selvi"
dialogue"Nahi... main sirf Hindi bolti hoon. Angrezi meri samajh mein nahi aati."
detectedLang"tl"
heavyLang"tl"
scores
tl0.5210727969348659
is0.5192307692307693
et0.4469026548672566
de0.42835365853658536
it0.37707641196013286
no0.3409490333919156
da0.3169398907103825
eu0.3055555555555556
ro0.21875
fi0.21711899791231734
en0.20886075949367086
lv0.20550847457627117
fr0.19006479481641467
sq0.1883116883116883
sv0.1758241758241758
hi0.17218543046357618
ms0.1591928251121076
reliablefalse
passesfalse
3
name"Hunter"
dialogue"I—I'm sorry. I don't understand. Did you see anything near the square? Did you take any pictures?"
detectedLang"en"
heavyLang"en"
scores
en0.809038828771483
tl0.5801259622113366
no0.5037220843672456
da0.4957983193277311
sv0.45404913557779797
ca0.42363112391930835
ro0.40594059405940597
it0.40535183349851334
nl0.3576017130620985
et0.35553168635875404
sq0.34210526315789475
fr0.3103448275862069
cs0.3079584775086505
de0.3063583815028902
pl0.2537313432835821
yo0.24433249370277077
sk0.21156373193166886
ms0.20634920634920634
lv0.19571045576407506
hr0.1880920162381597
is0.18588873812754408
pt0.14285714285714285
sl0.11504424778761062
be0.1044776119402985
tr0.1044776119402985
hu0.10044977511244377
az0.09502262443438914
lt0.09502262443438914
uk0.09502262443438914
vi0.09502262443438914
reliabletrue
passestrue
4
name"Selvi"
dialogue"Haan, main photographer hoon. Main ne tasweer li... ek shakhs alag tha... wahin tha jahan log gayab hue. Yeh camera... isme sab kuch hai."
detectedLang"en"
heavyLang"vi"
scores
en0.4647790055248619
fr0.42930780559646536
tl0.3973561430793157
it0.356312292358804
ro0.3011722272317403
ms0.2889908256880734
nl0.2743445692883895
ca0.2688679245283019
sq0.22962226640159045
hr0.21638018200202225
tr0.20998980632008157
lt0.19270833333333331
fi0.18506834910620398
cs0.17553191489361702
vi0.16845493562231761
de0.16216216216216217
sl0.14174972314507198
lv0.11731207289293849
es0.11327231121281463
hu0.09568261376896149
sv0.09568261376896149
hi0.0903755868544601
pl0.08716136631330978
reliablefalse
passesfalse
5
name"Hunter"
dialogue"A photo? You have something on that camera? Listen, if you saw someone suspicious—anything—I'm trying to figure out what's happening in Alborn."
detectedLang"en"
heavyLang"en"
scores
en0.8010752688172043
tl0.6019793459552496
fr0.45556209535020603
ro0.4434416365824308
da0.4293645897594078
sv0.4138149556400507
cs0.38002680965147456
it0.37626432906271073
no0.3720298710115411
de0.369031377899045
nl0.3638239339752407
es0.35674547983310156
sk0.34904996481351164
ca0.34443656980864634
pl0.3392857142857143
ms0.3321299638989169
pt0.32134996331621424
sl0.3143068939955523
yo0.3117559523809524
fi0.30241327300150833
hr0.29711246200607905
hu0.2594075260208166
sq0.2522231204527081
lv0.23108894430590188
is0.21610169491525424
et0.19001751313485116
eu0.1681654676258993
lt0.16741674167416742
hi0.14825046040515655
az0.14272474513438368
tr0.13470533208606175
vi0.07035175879396985
reliabletrue
passestrue
6
name"Selvi"
dialogue"Woh alag tha... aur ab... mujhe dar lag raha hai. Kripaya..."
detectedLang"ro"
heavyLang"de"
scores
ro0.417562724014337
sq0.4058500914076782
de0.36399217221135033
sv0.344758064516129
vi0.3257261410788381
et0.30257510729613735
ms0.29805615550755943
lt0.2793791574279379
it0.23529411764705882
no0.2316784869976359
es0.22248803827751198
pt0.22248803827751198
tr0.1935483870967742
nl0.19154228855721395
reliablefalse
passesfalse
7
name"Hunter"
dialogue"I'm not trying to scare you—I'm just asking. Those photos could matter. If you have evidence, come to the station. Alborn Police."
detectedLang"en"
heavyLang"en"
scores
en0.8105163429654192
fr0.5987963891675026
tl0.5886889460154242
it0.5223880597014925
no0.5037220843672456
sv0.5021779713752333
da0.47333772218564846
nl0.4478951000690131
cs0.4326241134751773
ro0.42938659058487877
de0.42321557317952413
lv0.37888198757763975
yo0.3685872138910813
pt0.35275080906148865
sl0.3447993447993448
sk0.3442622950819672
sq0.32998324958123953
hr0.3025283347863993
lt0.3019197207678883
es0.2812219227313567
ca0.2673992673992674
pl0.26335174953959484
tr0.25650557620817843
et0.23809523809523808
fi0.23809523809523808
ms0.21491658488714427
az0.14712153518123666
eu0.10514541387024609
hi0.08779931584948689
zh0.08779931584948689
hu0.08571428571428572
is0.08151549942594719
reliabletrue
passestrue
8
name"Hunter"
dialogue"Hunter. Yeah, Brennan. What? ... Okay. I'm leaving now."
detectedLang"en"
heavyLang"en"
scores
en0.7474747474747475
no0.5431893687707641
nl0.47817836812144215
tl0.4751908396946565
is0.40217391304347827
sv0.4008714596949891
de0.3721461187214612
sq0.3692660550458715
fi0.30203045685279184
da0.22969187675070027
hr0.21428571428571427
fr0.207492795389049
it0.1863905325443787
pt0.1863905325443787
ca0.17664670658682635
ms0.17664670658682635
ro0.17664670658682635
sl0.17664670658682635
tr0.17664670658682635
reliabletrue
passestrue
9
name"Hunter"
dialogue"Listen, miss—if that camera has anything, bring it to the station. Don't go anywhere alone. Things are wrong here, and I need every lead I can get."
detectedLang"en"
heavyLang"en"
scores
en0.8220007119971521
tl0.6339677891654465
sv0.500998003992016
da0.48612538540596095
no0.4669509594882729
de0.44196428571428575
yo0.42495687176538244
nl0.41961694718514214
sq0.41383352872215706
pl0.3654822335025381
ro0.34895833333333337
it0.3429697766097241
fr0.3359893758300133
hr0.3183367416496251
ms0.31787175989085953
sk0.29676511954992973
lv0.29577464788732394
ca0.29428369795342274
cs0.26578560939794427
is0.242997728993187
tr0.21445404556166536
fi0.2125984251968504
et0.2069785884218874
sl0.19549477071600965
lt0.19484702093397743
es0.19093851132686085
vi0.1783073130649137
az0.1687448046550291
hu0.1281604184829991
pt0.12049252418645558
eu0.10474485228290062
zh0.07149489322191271
be0.06542056074766354
uk0.059266227657572904
reliabletrue
passestrue
10
name"Selvi"
dialogue"Main aapko dikhana chahti hoon..."
detectedLang"et"
heavyLang"tlh"
scores
et0.358974358974359
fi0.358974358974359
ms0.3333333333333333
yo0.3333333333333333
en0.3311036789297659
fr0.3055555555555556
de0.2805755395683453
reliablefalse
passesfalse
11
name"Hunter"
dialogue"Sorry—gotta run."
detectedLang"it"
heavyLang"en"
scores
it0.7044917257683215
en0.6081504702194357
tl0.5874587458745875
fi0.47257383966244726
hu0.46351931330472107
pt0.4444444444444444
yo0.44196428571428575
sv0.3811881188118812
reliabletrue
passestrue