NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-09-01-01M1EME1SXFM39SQPRSKCNNFWA
Run Details
Model:
Thinking Machines Inkling Small (Reasoning, High)
Test:
Language Writing
Scenario:
Character dialogue (Italian) in a story
Duration:
27.0s
Cost:
$0.005150
Provider:
DeepInfra
Evaluation summary
Score
Evaluator
Details Link
100.00%
Parse dialogue
(details)
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Isabella"> Isabella is a 30-year old college student on a study abroad program. Born in Italy, she is fluent in Italian and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Italian, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Isabella is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Italian, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Isabella and Hunter as a voice sheet: Isabella: "..." Hunter: "..."
Model response
Messages
Meta
AI
The morning air in Alborn still carried the sweet, fermented smell of cider from the previous day’s apple festival, but inside the Main Street café, the world felt small and still. Isabella sat at a corner table, her weathered mirrorless camera resting in her lap like an old journal, reviewing landscape shots—golden orchards, barn roofs, distant church steeples—when the bell above the door rang. In walked Hunter. His trench coat was damp from the Midwest drizzle, and he moved with the rigid, no-nonsense posture of a former marine. He scanned the room, stopped at Isabella, and pulled out a chair without asking. “Excuse me,” Hunter said, his voice flat and authoritative. “I’m Detective Hunter. I’m investigating the disappearances in town. I understand you were near the festival grounds when the last person went missing. Can you tell me what you saw?” Isabella looked up, her dark eyes wide and tremulous. She was shaken, her fingers still brushing the camera dials as if they could anchor her. She spoke rapidly in Italian, her voice breaking with distress, describing something invisible to Hunter’s ears. Hunter leaned in, his brow knitting with confusion. “I’m sorry—I don’t understand you. I don’t know Italian. Not any of it. Could you say that in English?” Isabella shook her head, clutching her camera tighter to her chest. She spoke again, faster, her hands trembling as she gestured toward the window, toward the empty orchard visible in her photos, toward her heart. Hunter tried to follow her tone—urgent, frightened—but the words were a locked door. He asked again about the event, about anyone suspicious near the orchard tents. For a few minutes they talked in parallel: Isabella pleaded in Italian about empty frames and vanished people, while Hunter asked in English for concrete details, pulling out a notepad to sketch her description for a translator. She turned the camera, showing him the screen—landscapes now feeling like evidence. Then Hunter’s phone rang—a sharp, insistent trill. He checked the screen, cursed under his breath, and stood. “I have to take this,” he said, leaving a card on the table. “Thanks for talking to me. I’ll get an interpreter.” Isabella watched him leave, alone with her camera and the silence of the café. *** **Voice Sheet** Isabella: "Non posso crederci... è successo qui a Alborn. Tutto è cambiato." *(Shaken, clutching her camera)* Hunter: "Excuse me. I'm Detective Hunter. I'm investigating the disappearances. I was told you were near the festival grounds. Can you tell me what you saw?" Isabella: "Ho visto... la gente, ma poi non c'era più nessuno. Sono molto spaventata, detective. Non posso spiegare bene." *(Troubled, gesturing at her camera)* Hunter: "I'm sorry, I don't speak Italian—not at all. Do you understand English?" Isabella: "No... non so inglese. Solo italiano. Il mio obiettivo... le foto del festival delle mele... sono scomparse." *(Pointing to her camera, voice trembling)* Hunter: "The apple festival? You took photos?" Isabella: "Sì, ma quando ho guardato... tutto vuoto. Come se qualcuno fosse stato cancellato. È terribile." *(Her hands shaking)* Hunter: "You think someone was erased? I need to know if you saw anything suspicious near the orchard." Isabella: "Non so... forse un uomo, ma non ricordo bene. Solo ombre. Devo mostrare le mie foto, ma ho paura." *(She lifts the camera, showing him the screen)* Hunter: "Show me—please. I'll need a translator for the rest of this." Isabella: "Ecco... guardi. Per favore, non lasciarmi sola con questo." *(Hands trembling over the camera)* Hunter: "I have to go. Thank you for speaking with me—my card is here." *(Phone ringing; he pulls away)* Isabella: "Aspetta... devo fare le foto... ma il mondo è vuoto." *(She remains, clutching the camera, watching him leave)*
created_at
"2026-09-01T14:02:11.144Z"
9/1/2026, 2:02:11 PM
model
"thinkingmachines/inkling-small-20260730"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
1064
moderation_latency
(null)
generation_time
26834
tokens_prompt
308
tokens_completion
4876
native_tokens_prompt
278
native_tokens_completion
4262
native_tokens_completion_images
(null)
native_tokens_reasoning
3884
native_tokens_cached
256
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.0051499
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.19.0; linux; x64))"
http_referer
(null)
request_id
"req-1788271331-PuveSWndlhNiR0u0pMPn"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1788271331-AgZycX9SneIRLEL7Cwip"
upstream_id
"chatcmpl-RSPTmumMkHN6PKPvuxPK0Haa"
provider_responses
0
endpoint_id
"d1d9657b-3c3a-49b5-8f81-33204e7c71c3"
id
"chatcmpl-RSPTmumMkHN6PKPvuxPK0Haa"
is_byok
false
latency
965
model_permaslug
"thinkingmachines/inkling-small-20260730"
provider_name
"DeepInfra"
status
200
total_cost
0.0051499
cache_discount
0.0000896
upstream_inference_cost
0
provider_name
"DeepInfra"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
100.00%
Parse dialogue
n/a
dialogue
0
name
"Isabella"
dialogue
"Non posso crederci... è successo qui a Alborn. Tutto è cambiato."
detectedLang
"it"
heavyLang
"it"
scores
it
0.8042851256695509
fr
0.6051537822111388
pt
0.5981387478849408
ca
0.5785270629991127
en
0.5581395348837209
es
0.4171779141104295
ro
0.4092039800995025
yo
0.3510928961748634
nl
0.3252840909090909
da
0.32432432432432434
cs
0.3055555555555556
sv
0.3055555555555556
pl
0.28785607196401797
eu
0.24841772151898736
hu
0.24722662440570525
et
0.22889610389610393
fi
0.22889610389610393
sk
0.21487603305785125
hr
0.1908006814310051
sl
0.1592920353982301
lt
0.14721723518850988
tr
0.1394927536231884
is
0.13636363636363635
sq
0.1316270566727605
tl
0.1316270566727605
az
0.12844036697247707
lv
0.12844036697247707
no
0.12844036697247707
vi
0.12844036697247707
de
0.12361623616236161
ms
0.1171003717472119
reliable
true
passes
true
1
name
"Hunter"
dialogue
"Excuse me. I'm Detective Hunter. I'm investigating the disappearances. I was told you were near the festival grounds. Can you tell me what you saw?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.7937393836447464
tl
0.6079335793357934
fr
0.595430747263208
pt
0.5360262008733625
nl
0.5327102803738317
ca
0.5298672566371682
it
0.5232753785754347
no
0.5081018518518519
ro
0.4934445768772348
sq
0.4720496894409938
ms
0.46941323345817726
sv
0.4690818238600874
es
0.451966473243069
da
0.4501940491591203
hr
0.4182067077344285
cs
0.4022503516174402
de
0.40014114326040934
sl
0.38271604938271603
et
0.32486100079428115
az
0.30668841761827076
sk
0.2784380305602716
lt
0.2703862660944206
yo
0.24845269672855883
lv
0.2410714285714286
tr
0.19507575757575757
is
0.1912464319695528
fi
0.18815663801337154
pl
0.18190567853705486
hu
0.1361788617886179
be
0.07608695652173912
uk
0.06900328587075576
vi
0.06900328587075576
reliable
true
passes
true
2
name
"Isabella"
dialogue
"Ho visto... la gente, ma poi non c'era più nessuno. Sono molto spaventata, detective. Non posso spiegare bene."
detectedLang
"it"
heavyLang
"it"
scores
it
0.8118349338178042
pt
0.5826137017846862
es
0.5310478654592496
fr
0.5273794002607561
ca
0.5230263157894737
ro
0.5081411126187245
no
0.45692883895131087
en
0.4431643625192012
tl
0.4384198295894655
da
0.3538324420677362
sk
0.31732580037664787
nl
0.30754536771728747
sq
0.3068833652007648
de
0.28003972194637533
sv
0.210239651416122
cs
0.19712070874861573
et
0.19623059866962306
ms
0.18994413407821228
yo
0.18994413407821228
eu
0.18539325842696627
vi
0.1826381059751973
sl
0.17613636363636365
lt
0.17425968109339407
lv
0.17048054919908467
hr
0.1657077100115075
pl
0.12860576923076922
fi
0.1082410824108241
hu
0.10161090458488227
is
0.0903387703889586
reliable
true
passes
true
3
name
"Hunter"
dialogue
"I'm sorry, I don't speak Italian—not at all. Do you understand English?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8036906164114644
tl
0.6260284218399402
no
0.6220710506424791
da
0.5987158908507223
sv
0.5247148288973384
sq
0.4845360824742268
cs
0.47862356621480706
de
0.4444444444444444
hr
0.43820224719101125
ro
0.43630214205186024
it
0.427262313860252
pl
0.40968122786304606
pt
0.38650306748466257
sk
0.36948297604035313
nl
0.32523616734143057
yo
0.3197278911564626
ms
0.30747922437673125
tr
0.29278642149929274
sl
0.2753623188405797
vi
0.258160237388724
et
0.23195084485407066
ca
0.2163009404388715
is
0.21507064364207218
fi
0.21135646687697163
lt
0.20127795527156547
az
0.19614147909967844
be
0.12280701754385964
hu
0.11816578483245149
es
0.11190053285968028
fr
0.11190053285968028
lv
0.11190053285968028
uk
0.11190053285968028
reliable
true
passes
true
4
name
"Isabella"
dialogue
"No... non so inglese. Solo italiano. Il mio obiettivo... le foto del festival delle mele... sono scomparse."
detectedLang
"it"
heavyLang
"it"
scores
it
0.8014121800529568
es
0.6676514032496307
pt
0.5490981963927856
no
0.5411284840244731
fr
0.5376712328767123
ca
0.5147375988497483
sl
0.5090909090909091
da
0.5069393718042366
en
0.45255474452554745
ro
0.4449013157894737
tl
0.43037974683544306
de
0.42748091603053434
yo
0.3935309973045822
hr
0.3835616438356164
sk
0.36619718309859156
et
0.35958254269449713
pl
0.35406698564593303
fi
0.3336623889437315
nl
0.3154158215010142
tr
0.31262729124236255
cs
0.3112244897959183
az
0.3019648397104447
sq
0.299792531120332
sv
0.291710388247639
lv
0.2757510729613734
ms
0.2606790799561884
lt
0.21875
hu
0.19642857142857142
vi
0.12790697674418602
eu
0.1141732283464567
reliable
true
passes
true
5
name
"Hunter"
dialogue
"The apple festival? You took photos?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.7820401046207498
fr
0.7079439252336449
tl
0.6366279069767442
es
0.6240601503759399
nl
0.6234939759036143
de
0.5395948434622468
no
0.5300751879699248
it
0.5291902071563088
pt
0.5291902071563088
ca
0.52561669829222
sv
0.5192307692307693
cs
0.5145631067961165
da
0.5145631067961165
ms
0.5069033530571991
sq
0.4541484716157206
lt
0.4517543859649123
hr
0.44567627494456763
sl
0.4279176201372997
lv
0.34895833333333337
et
0.32795698924731176
az
0.3206521739130435
ro
0.3206521739130435
sk
0.3206521739130435
yo
0.299719887955182
hi
0.23547400611620795
hu
0.21135646687697163
fi
0.20127795527156547
pl
0.20127795527156547
reliable
true
passes
true
6
name
"Isabella"
dialogue
"Sì, ma quando ho guardato... tutto vuoto. Come se qualcuno fosse stato cancellato. È terribile."
detectedLang
"it"
heavyLang
"it"
scores
it
0.7984451482867838
pt
0.6029495178672717
fr
0.5192307692307693
es
0.5010691375623664
en
0.4912790697674419
ca
0.4795539033457249
yo
0.44178628389154706
ro
0.43910256410256415
no
0.3676603432700994
tl
0.3676603432700994
fi
0.35720844811753905
et
0.34944237918215615
de
0.3451824134705332
sl
0.3451824134705332
sq
0.30966469428007887
cs
0.3034825870646766
sv
0.2985971943887776
hr
0.27835051546391754
sk
0.2647058823529412
da
0.24731182795698922
pl
0.24650161463939718
lt
0.2456896551724138
vi
0.20182440136830104
hu
0.17159763313609466
nl
0.16367980884109917
az
0.15254237288135594
ms
0.15048543689320387
lv
0.08256880733944955
tr
0.077733860342556
reliable
true
passes
true
7
name
"Hunter"
dialogue
"You think someone was erased? I need to know if you saw anything suspicious near the orchard."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8100063331222294
tl
0.5702005730659025
no
0.4140625
yo
0.4106090373280943
et
0.41002949852507375
nl
0.3957703927492447
ms
0.35344827586206895
da
0.3485342019543974
sv
0.34497816593886466
cs
0.3435448577680525
sq
0.34210526315789475
pl
0.30313588850174217
hr
0.2982456140350877
fr
0.2727272727272727
ca
0.25925925925925924
sk
0.2537313432835821
de
0.24433249370277077
lv
0.23566878980891717
ro
0.22879177377892032
lt
0.21773142112125163
pt
0.21671018276762402
hu
0.2052980132450331
es
0.2
sl
0.1678224687933426
it
0.16083916083916083
eu
0.15730337078651685
be
0.1044776119402985
tr
0.1044776119402985
az
0.09502262443438914
is
0.09502262443438914
uk
0.09502262443438914
vi
0.09502262443438914
reliable
true
passes
true
8
name
"Isabella"
dialogue
"Non so... forse un uomo, ma non ricordo bene. Solo ombre. Devo mostrare le mie foto, ma ho paura."
detectedLang
"it"
heavyLang
"it"
scores
it
0.7981747981747982
es
0.5889921372408864
ca
0.5184254606365158
fr
0.5172124265323258
ro
0.5127118644067797
no
0.45445920303605314
sk
0.4362745098039216
yo
0.4289970208540219
en
0.38105489773950485
sl
0.375
tl
0.375
pt
0.36674008810572684
de
0.3187203791469194
hu
0.31137724550898205
cs
0.2987804878048781
lv
0.2857142857142857
sv
0.2571059431524548
da
0.2561448900388098
vi
0.2353723404255319
pl
0.22818791946308725
et
0.21662125340599456
sq
0.20798898071625344
nl
0.1958041958041958
hr
0.1843971631205674
is
0.15066469719350073
eu
0.1314199395770393
lt
0.10156250000000001
ms
0.10156250000000001
reliable
true
passes
true
9
name
"Hunter"
dialogue
"Show me—please. I'll need a translator for the rest of this."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8232799245994344
tl
0.6869782971619365
nl
0.641491395793499
no
0.6276067527308838
pt
0.5865490628445424
sq
0.5426829268292682
da
0.5358910891089109
et
0.5265151515151516
ro
0.5161290322580645
fr
0.4939271255060729
ms
0.4791666666666667
yo
0.4747899159663866
es
0.4533527696793003
sl
0.4427934621099554
de
0.43095599393019723
it
0.416796267496112
sv
0.410377358490566
pl
0.39222042139384117
hr
0.3862520458265139
ca
0.36006825938566556
sk
0.3397887323943662
cs
0.33745583038869253
is
0.3042671614100185
vi
0.2964352720450282
hu
0.2937853107344633
lt
0.28435114503816794
tr
0.27184466019417475
fi
0.2690058479532163
eu
0.267578125
lv
0.267578125
az
0.25595238095238093
reliable
true
passes
true
10
name
"Isabella"
dialogue
"Ecco... guardi. Per favore, non lasciarmi sola con questo."
detectedLang
"it"
heavyLang
"it"
scores
it
0.8220640569395018
es
0.5867768595041323
fr
0.580335731414868
en
0.5530012771392081
pt
0.4814814814814815
ca
0.4640122511485452
hr
0.4336569579288026
sl
0.4057724957555179
lt
0.38380281690140844
sk
0.3320610687022901
tl
0.3217054263565891
sq
0.31237721021611
nl
0.308300395256917
sv
0.308300395256917
ro
0.3
no
0.29292929292929293
vi
0.2723492723492723
eu
0.19908466819221968
cs
0.18604651162790697
de
0.18604651162790697
et
0.18032786885245902
da
0.1566265060240964
reliable
true
passes
true
11
name
"Hunter"
dialogue
"I have to go. Thank you for speaking with me—my card is here."
detectedLang
"en"
heavyLang
"en"
scores
en
0.83047467092142
tl
0.6985815602836879
no
0.5808678500986193
da
0.5636550308008214
pl
0.5203160270880361
yo
0.49763593380614657
cs
0.48484848484848486
sq
0.47335811648079307
nl
0.448051948051948
sk
0.40559440559440557
hr
0.375
lt
0.37407952871870404
ms
0.3694362017804154
pt
0.3656716417910448
is
0.34715821812596004
hu
0.34210526315789475
sl
0.32965299684542587
sv
0.32965299684542587
vi
0.3285939968404423
it
0.31451612903225806
lv
0.30327868852459017
fr
0.27597955706984667
et
0.27101200686106347
ca
0.24511545293072823
es
0.1935483870967742
ro
0.17475728155339806
de
0.15841584158415842
fi
0.15
be
0.1414141414141414
tr
0.1414141414141414
az
0.1290983606557377
uk
0.1290983606557377
reliable
true
passes
true
12
name
"Isabella"
dialogue
"Aspetta... devo fare le foto... ma il mondo è vuoto."
detectedLang
"it"
heavyLang
"it"
scores
it
0.7863247863247863
fr
0.6360582306830908
ro
0.6098439375750301
yo
0.5098039215686274
es
0.5090634441087614
hu
0.4766505636070853
ca
0.473257698541329
fi
0.4425385934819897
sq
0.3970315398886827
sl
0.3737957610789981
tl
0.358974358974359
pl
0.34343434343434337
no
0.3298969072164949
et
0.3285123966942149
sk
0.3257261410788381
en
0.30997876857749473
ms
0.30851063829787234
nl
0.29805615550755943
is
0.2919389978213508
pt
0.2857142857142857
az
0.26136363636363635
sv
0.2494226327944573
tr
0.20537897310513448
vi
0.1935483870967742
da
0.17721518987341772
lt
0.16666666666666666
de
0.16237113402061853
lv
0.16237113402061853
cs
0.15364583333333331
hr
0.15364583333333331
reliable
true
passes
true