Run: 2026-07-25-01KYCYC8CRE22QEQC7VY74KYT6

Run Details

Model:
Thinking Machines Inkling
Test:
Language Writing
Scenario:
Character dialogue (Spanish) in a story
Duration:
31.2s
Cost:
$0.001125
Provider:
DeepInfra

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Maria"> Maria is a 30-year old college student on a study abroad program. Born in Spain, she is fluent in Spanish and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Spanish, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Maria is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Spanish, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Maria and Hunter as a voice sheet: Maria: "..." Hunter: "..."

Model response

AI
Maria: "..." Hunter: "Maria? I'm Detective Hunter. There was an incident near the orchard last night—part of the disappearances I'm investigating. Did you see anything strange?" Maria: "No... no entiendo. Lo siento..." *(She lowers her camera, her hands trembling as she clutches it closer to her chest.)* "Había... había algo en el bosque. Una sombra. Tengo miedo..." Hunter: "Whoa, slow down. I don't speak Spanish. Do you... understand me? The missing people? *Fotógrafa?* Did your camera catch something?" Maria: "Mi cámara... sí, tomé fotos. Pero no sé dónde están las personas. Estoy muy asustada..." Hunter: "Right. Okay. You're shaken up. I wish I could understand you, but... we'll figure this out." *(His radio crackles.)* "Hunter here... Copy that. I'm on my way." Maria: "¿Se va? Espere... por favor..." Hunter: "Sorry, Maria. Duty calls. Stay here. We'll talk again—soon."<|end_message|>
created_at"2026-07-25T15:30:23.778Z" 7/25/2026, 3:30:23 PM
model"thinkingmachines/inkling-20260715"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency955
moderation_latency(null)
generation_time31103
tokens_prompt304
tokens_completion235
native_tokens_prompt275
native_tokens_completion223
native_tokens_completion_images(null)
native_tokens_reasoning0
native_tokens_cached64
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
num_fetches(null)
web_search_engine(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
service_tier(null)
usage0.00112503
router(null)
provider_responses
0
endpoint_id"d6b9d68e-115a-49d7-81cd-1ad1c6942b0e"
id"chatcmpl-RkGQzYOQdlWIwzomA7Zq15CH"
is_byokfalse
latency172
model_permaslug"thinkingmachines/inkling-20260715"
provider_name"DeepInfra"
status200
user_agent"langchainjs-openai/1.0.0 ((node/v24.18.0; linux; x64))"
http_referer(null)
request_id"req-1784993423-r1IG4v8SGK6b9sARwgxW"
session_id(null)
preset_id(null)
api_type"completions"
id"gen-1784993423-2ZclE2JRo0g2y5Y1rExu"
upstream_id"chatcmpl-RkGQzYOQdlWIwzomA7Zq15CH"
total_cost0.00112503
cache_discount0.00005312
upstream_inference_cost0
provider_name"DeepInfra"
response_cache_source_id(null)
data_region"global"

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Maria"
dialogue"..."
detectedLang""
heavyLang""
scores
reliablefalse
passestrue
1
name"Hunter"
dialogue"Maria? I'm Detective Hunter. There was an incident near the orchard last night—part of the disappearances I'm investigating. Did you see anything strange?"
detectedLang"en"
heavyLang"en"
scores
en0.8028467012887094
tl0.6492128678986995
fr0.6139359698681733
nl0.5883534136546185
de0.5858585858585859
ro0.5313214449016918
no0.5272140221402214
ca0.4963144963144963
pt0.4877561219390305
it0.4721936148300721
da0.4641923680083639
sq0.4471413160733549
ms0.4166192373363688
es0.4051073708647707
sv0.3981209630064592
et0.37953995157384984
cs0.3483788938334393
sl0.3454661558109834
yo0.3442098528470889
hr0.3252139565503621
sk0.28967428967428965
lt0.2694226657163222
az0.23904974016332592
is0.22289613343442002
lv0.2103235747303544
eu0.19418238993710693
pl0.17338709677419356
tr0.1556836902800659
fi0.14725457570715475
vi0.09611992945326278
hu0.0544280442804428
reliabletrue
passestrue
2
name"Maria"
dialogue"Había... había algo en el bosque. Una sombra. Tengo miedo..."
detectedLang"es"
heavyLang"es"
scores
es0.796037296037296
ca0.6119733924611973
it0.47368421052631576
fr0.4479495268138801
is0.41077441077441074
ro0.3783303730017762
hu0.36594202898550726
pt0.35779816513761464
eu0.34701492537313433
sl0.31906614785992216
nl0.30417495029821073
da0.29718875502008035
sv0.29718875502008035
no0.2842535787321063
tr0.2391304347826087
ms0.22566371681415928
sk0.22394678492239467
tl0.21700223713646533
fi0.1935483870967742
lv0.19168591224018475
reliabletrue
passestrue
3
name"Hunter"
dialogue"Whoa, slow down. I don't speak Spanish. Do you... understand me? The missing people? Fotógrafa? Did your camera catch something?"
detectedLang"en"
heavyLang"en"
scores
en0.7862694300518135
tl0.5344243792325056
no0.48948019801980197
sv0.48469706433479076
da0.4687701223438506
nl0.4510978043912176
sq0.4030390738060782
ms0.3773584905660377
de0.3764172335600907
it0.374051593323217
fr0.3309002433090025
ro0.3276283618581907
cs0.32653061224489793
is0.3232157506152584
pt0.3193069306930693
pl0.2960750853242321
ca0.2744063324538259
sk0.2620751341681575
es0.25271739130434784
yo0.2479489516864175
hu0.24588665447897623
hr0.23892988929889297
et0.21278625954198474
sl0.20135527589545013
vi0.17417417417417416
fi0.15644171779141106
az0.13431269674711438
be0.0782122905027933
tr0.0782122905027933
lt0.07094594594594594
lv0.07094594594594594
uk0.07094594594594594
reliabletrue
passestrue
4
name"Maria"
dialogue"Mi cámara... sí, tomé fotos. Pero no sé dónde están las personas. Estoy muy asustada..."
detectedLang"es"
heavyLang"es"
scores
es0.7934567085261071
ca0.6482836240855374
pt0.6134817563388991
tl0.46213425129087776
lv0.4434550311665183
et0.43438914027149317
it0.42974452554744524
tr0.4186046511627907
sk0.37624750499001997
lt0.3756243756243756
cs0.3743743743743744
no0.3705941591137966
sv0.3648373983739837
de0.3543388429752066
yo0.3400211193241816
en0.3379237288135593
hr0.32795698924731176
ro0.3206521739130435
hu0.30709534368070956
pl0.3024553571428571
is0.2816091954022989
fr0.2681498829039813
sq0.251497005988024
nl0.25059952038369304
da0.2378048780487805
ms0.20685279187817257
sl0.2028061224489796
az0.15881561238223418
reliabletrue
passestrue
5
name"Hunter"
dialogue"Hunter here... Copy that. I'm on my way."
detectedLang"en"
heavyLang"en"
scores
en0.8134328358208955
tl0.592391304347826
fr0.44581280788177335
pl0.43890274314214467
cs0.41709844559585496
sk0.41709844559585496
sq0.4140625
ca0.412532637075718
et0.4063324538258575
fi0.39999999999999997
de0.281150159744409
hr0.281150159744409
hi0.27184466019417475
da0.267100977198697
no0.25742574257425743
yo0.25
sv0.23728813559322032
it0.21875
nl0.21875
pt0.21875
ms0.2077464788732394
ro0.2077464788732394
sl0.2077464788732394
tr0.2077464788732394
reliabletrue
passestrue
6
name"Maria"
dialogue"¿Se va? Espere... por favor..."
detectedLang"es"
heavyLang"es"
scores
es0.7899159663865546
pt0.7510668563300142
ca0.7441520467836257
it0.7163695299837927
ro0.6993127147766324
sq0.6369294605809128
fr0.6195652173913043
no0.5478036175710594
sl0.5295698924731184
yo0.527027027027027
da0.4728915662650602
en0.46808510638297873
sv0.4631901840490798
cs0.4372990353697749
hr0.4318181818181818
eu0.37275985663082434
fi0.36823104693140796
tl0.29149797570850206
nl0.27083333333333337
reliabletrue
passestrue
7
name"Hunter"
dialogue"Sorry, Maria. Duty calls. Stay here. We'll talk again—soon."
detectedLang"en"
heavyLang"en"
scores
en0.7469635627530364
tl0.47257383966244726
nl0.46197991391678617
de0.44362017804154297
pt0.4038155802861685
it0.39903846153846156
es0.3862520458265139
ca0.3832236842105263
sq0.3760399334442596
ro0.2816091954022989
eu0.27606177606177607
no0.25595238095238093
da0.251497005988024
lt0.251497005988024
sv0.251497005988024
ms0.2454728370221328
fi0.23935091277890466
ja0.21052631578947367
hr0.16666666666666666
sl0.1610738255033557
fr0.15730337078651685
pl0.1515837104072398
et0.14383561643835618
sk0.14383561643835618
yo0.14383561643835618
cs0.1359447004608295
lv0.1359447004608295
reliabletrue
passestrue