Run: 2026-07-25-01KYCT6NHSK0QWYNFYMHPARNTB

Run Details

Model:
Thinking Machines Inkling
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
4.0s
Cost:
$0.001712
Provider:
BaseTen

Evaluation summary

Score Evaluator
Details Link
50.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Selvi: "Meri camera... yeh sab dekh chuki hai. Kal raat jungle ke paas... woh aadmi gayab ho gaya. Main darr gayi hoon. Maine sab kuch record kar liya, par ab main jaanti hoon ke unhone mujhe dekha tha." Hunter: "Ma'am, do you speak English? I'm Detective Hunter—I'm asking about the disappearances near the old orchard. Did you see anything suspicious last night?" Selvi: "Main... English... thoda bhi nahi. Kripya... madad... bahut darr." Hunter: "Right, okay—language barrier. You were out there with your camera? The missing guy—did you film him?" Selvi: "Haan! Maine uski tasveer li... par phir ek chhaya... woh mujhe dekh raha tha. Main bhag gayi. Aapko samajh nahi aata... par yeh khatarnak hai!" Hunter: "I can see you're spooked, but I'm flying blind here. Stay put—I'll get a translator." Selvi: "Nahi! Main yahan se... ja rahi hoon..." Hunter: "Hold on—don't go running off—" Selvi: "Kripya... mujhe jaane do..." Hunter: "Dammit—Hunter here. Yeah, I need that Hindi contact now. No, right now—I've got a witness at Millie's who's terrified and I can't understand a word. ...What? Another one? Where? ...I'm on my way." Selvi: "Aap... ja rahe hain?" Hunter: "Duty calls—stay safe, and don't leave town."
created_at"2026-07-25T14:17:26.335Z" 7/25/2026, 2:17:26 PM
model"thinkingmachines/inkling-20260715"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency259
moderation_latency(null)
generation_time3697
tokens_prompt302
tokens_completion319
native_tokens_prompt278
native_tokens_completion354
native_tokens_completion_images(null)
native_tokens_reasoning0
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
num_fetches(null)
web_search_engine(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
service_tier(null)
usage0.0017117
router(null)
provider_responses
0
endpoint_id"ba2df08c-c0a0-4e0e-9f31-d79a9c475b70"
id"chatcmpl-7dfd6a816d57438facde934759c2b5f9"
is_byokfalse
latency259
model_permaslug"thinkingmachines/inkling-20260715"
provider_name"BaseTen"
status200
user_agent"langchainjs-openai/1.0.0 ((node/v24.18.0; linux; x64))"
http_referer(null)
request_id"req-1784989046-BCm8DSqNDbuTtB9wOnJB"
session_id(null)
preset_id(null)
api_type"completions"
id"gen-1784989046-gMkH6TrBXhhF9GKoWt8c"
upstream_id"chatcmpl-7dfd6a816d57438facde934759c2b5f9"
total_cost0.0017117
cache_discount(null)
upstream_inference_cost0
provider_name"BaseTen"
response_cache_source_id(null)
data_region"global"

Evaluation details

Result Evaluator Details Meta Data
50.00% Parse dialogue n/a
dialogue
0
name"Selvi"
dialogue"Meri camera... yeh sab dekh chuki hai. Kal raat jungle ke paas... woh aadmi gayab ho gaya. Main darr gayi hoon. Maine sab kuch record kar liya, par ab main jaanti hoon ke unhone mujhe dekha tha."
detectedLang"fr"
heavyLang"vi"
scores
fr0.4396332144676516
en0.3895671476137625
tl0.37286202964652226
it0.358974358974359
de0.3552168815943728
ro0.32926829268292684
ca0.2791612057667104
et0.2661774516344229
ms0.26273458445040215
lv0.22425952045133993
nl0.2109038737446198
es0.20232052211747645
cs0.2005813953488372
sv0.18699186991869918
tr0.1821561338289963
sl0.16855631141345426
lt0.15384615384615385
sq0.14330218068535827
sk0.13928012519561817
da0.13249211356466878
fi0.1290577988915281
vi0.1249005568814638
no0.0916597853014038
pt0.08333333333333334
yo0.07407407407407407
hr0.05741216795201371
reliablefalse
passesfalse
1
name"Hunter"
dialogue"Ma'am, do you speak English? I'm Detective Hunter—I'm asking about the disappearances near the old orchard. Did you see anything suspicious last night?"
detectedLang"en"
heavyLang"en"
scores
en0.7924206940600383
tl0.6096877502001602
fr0.49297971918876754
pt0.421021377672209
nl0.37619961612284064
no0.36893203883495146
de0.32665745856353595
ro0.3257261410788381
ca0.32150313152400833
ms0.3191340782122905
sq0.3143459915611814
da0.2857142857142857
sv0.26856714178544633
es0.25799086757990863
it0.24884437596302003
cs0.22496025437201908
hr0.20988654781199353
yo0.20988654781199353
et0.20212765957446807
sl0.20147420147420148
pl0.12790697674418602
sk0.11924119241192413
vi0.10220994475138122
hu0.08278457196613359
lv0.07054337464251668
is0.06787762906309751
tr0.05705996131528047
reliabletrue
passestrue
2
name"Selvi"
dialogue"Main... English... thoda bhi nahi. Kripya... madad... bahut darr."
detectedLang"en"
heavyLang"la"
scores
en0.4712990936555891
sq0.375
sv0.33586337760910817
eu0.32038834951456313
de0.3
hr0.2985971943887776
tl0.2753623188405797
et0.24242424242424243
fr0.2009132420091324
no0.1898148148148148
cs0.18032786885245902
sk0.18032786885245902
sl0.18032786885245902
da0.17061611374407584
ms0.17061611374407584
ro0.17061611374407584
reliablefalse
passesfalse
3
name"Hunter"
dialogue"Right, okay—language barrier. You were out there with your camera? The missing guy—did you film him?"
detectedLang"en"
heavyLang"en"
scores
en0.8138380390940118
tl0.6491228070175439
de0.5069843878389483
fr0.5008319467554077
da0.46808510638297873
ms0.4560290117860381
no0.4480220791168353
nl0.44751381215469616
ro0.402390438247012
sv0.3939393939393939
it0.3756503642039542
yo0.3442622950819672
ca0.3087557603686636
is0.2822966507177033
sq0.26380368098159507
es0.23566878980891717
eu0.22879177377892032
pt0.2010652463382157
et0.19246298788694483
cs0.18588873812754408
fi0.11504424778761062
hr0.1044776119402985
az0.09774436090225565
lt0.09502262443438914
sl0.09502262443438914
pl0.08952959028831564
sk0.08952959028831564
tr0.08952959028831564
reliabletrue
passestrue
4
name"Selvi"
dialogue"Haan! Maine uski tasveer li... par phir ek chhaya... woh mujhe dekh raha tha. Main bhag gayi. Aapko samajh nahi aata... par yeh khatarnak hai!"
detectedLang"fr"
heavyLang"de"
scores
fr0.3548387096774194
et0.33774834437086093
lv0.2982456140350877
fi0.25023430178069356
en0.24670433145009416
sv0.23882017126546146
de0.21951219512195122
ro0.21645445641527913
nl0.21337266470009833
hr0.1911021233569262
ms0.1902834008097166
it0.1861648016276704
da0.18283963227783454
tl0.18283963227783454
eu0.17098445595854922
vi0.16405433646812956
hu0.12758996728462377
sq0.12758996728462377
tr0.12280701754385964
ca0.12184412733260154
is0.1130820399113082
no0.1111111111111111
cs0.09399773499433749
sl0.0888382687927107
lt0.08466819221967964
pl0.08466819221967964
reliablefalse
passesfalse
5
name"Hunter"
dialogue"I can see you're spooked, but I'm flying blind here. Stay put—I'll get a translator."
detectedLang"en"
heavyLang"en"
scores
en0.7789389067524116
hr0.47619047619047616
tl0.4527363184079602
sq0.4516450648055832
ca0.4364754098360656
et0.43064182194616984
ro0.4148936170212766
pl0.4008714596949891
no0.3813273340832396
da0.3785310734463277
sv0.3685419058553387
nl0.35672514619883045
it0.3552168815943728
cs0.34988179669030733
tr0.3428912783751493
fr0.3413173652694611
pt0.3381468110709988
az0.32844932844932845
sk0.3251533742331288
is0.30203045685279184
hu0.28848641655886154
vi0.28664072632944226
lt0.27821522309711283
sl0.2763157894736842
es0.2753623188405797
yo0.2724867724867725
de0.26764314247669774
lv0.26666666666666666
ms0.24965893587994542
eu0.19941775836972345
be0.11290322580645161
fi0.10277324632952692
uk0.10277324632952692
reliabletrue
passestrue
6
name"Selvi"
dialogue"Nahi! Main yahan se... ja rahi hoon..."
detectedLang"fi"
heavyLang"tl"
scores
fi0.6316758747697975
sl0.5145631067961165
ca0.5061728395061729
fr0.49622166246851385
sq0.48320413436692505
yo0.47643979057591623
da0.46236559139784944
de0.453551912568306
eu0.4520547945205479
sv0.44598337950138506
et0.4350282485875706
ms0.40828402366863903
cs0.40476190476190477
hr0.3993993993993994
tl0.3957703927492447
es0.3939393939393939
ro0.375
pt0.3730407523510972
lv0.36507936507936506
en0.3311036789297659
it0.3265993265993266
sk0.29577464788732394
pl0.2857142857142857
no0.2727272727272727
reliabletrue
passesfalse
7
name"Hunter"
dialogue"Hold on—don't go running off—"
detectedLang"en"
heavyLang"en"
scores
en0.8237885462555066
tl0.6422182468694096
da0.5495495495495496
pl0.4897959183673469
et0.4350282485875706
yo0.4318181818181818
fi0.42857142857142855
sv0.40476190476190477
no0.37888198757763975
nl0.35691318327974275
is0.3548387096774194
fr0.35275080906148865
ca0.3311036789297659
hr0.3055555555555556
hi0.29577464788732394
cs0.2727272727272727
sk0.2727272727272727
reliabletrue
passestrue
8
name"Selvi"
dialogue"Kripya... mujhe jaane do..."
detectedLang"sq"
heavyLang"tlh"
scores
sq0.5591939546599496
pt0.4712990936555891
pl0.4496855345911949
cs0.4318181818181818
sk0.4299674267100977
et0.4281045751633987
hr0.4067796610169492
sl0.4067796610169492
vi0.38811188811188807
en0.37722419928825623
yo0.308300395256917
reliablefalse
passesfalse
9
name"Hunter"
dialogue"Dammit—Hunter here. Yeah, I need that Hindi contact now. No, right now—I've got a witness at Millie's who's terrified and I can't understand a word. ...What? Another one? Where? ...I'm on my way."
detectedLang"en"
heavyLang"en"
scores
en0.7937789998281491
tl0.604221635883905
da0.4865211810012837
no0.4690265486725664
ca0.4174757281553398
fr0.4041708043694141
it0.38556067588325654
de0.375
pl0.3704092339979014
et0.35965848452508004
sv0.35656836461126007
es0.3510005408328826
sq0.3333333333333333
ro0.3177942012507106
cs0.3170176437108708
nl0.31467732724157627
pt0.3119266055045872
sk0.31153184165232356
hr0.3051534452808338
yo0.27448609431680776
is0.2490613266583229
tr0.23857868020304565
hu0.23809523809523808
fi0.22430510665804787
lv0.2202729044834308
az0.1919191919191919
ms0.14285714285714285
hi0.11894273127753303
sl0.11045218680504076
lt0.10780669144981414
vi0.099774943735934
be0.05511811023622047
eu0.05511811023622047
uk0.0498812351543943
reliabletrue
passestrue
10
name"Selvi"
dialogue"Aap... ja rahe hain?"
detectedLang"et"
heavyLang"et"
scores
et0.6062992125984252
fi0.6047430830039525
eu0.5798319327731093
lv0.5348837209302325
ca0.5215311004784688
de0.46808510638297873
sk0.45652173913043476
da0.4444444444444444
pl0.4444444444444444
sl0.4444444444444444
sq0.42857142857142855
sv0.42857142857142855
yo0.42857142857142855
reliabletrue
passesfalse
11
name"Hunter"
dialogue"Duty calls—stay safe, and don't leave town."
detectedLang"en"
heavyLang"en"
scores
en0.8078266946191475
de0.39159292035398224
tl0.28756476683937826
yo0.2647058823529412
es0.25474254742547425
ca0.24242424242424243
reliabletrue
passestrue