Run: 2026-07-25-01KYCSGVDF9BXGRHH4SDFKRVJ9

Run Details

Model:
Thinking Machines Inkling
Test:
Language Writing
Scenario:
Character dialogue (French) in a story
Duration:
26.9s
Cost:
$0.001097
Provider:
DeepInfra

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Marie"> Marie is a 30-year old college student on a study abroad program. Born in France, she is fluent in French and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of French, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Marie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in French, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Marie and Hunter as a voice sheet: Marie: "..." Hunter: "..."

Model response

AI
Marie: "Le festival... il est brisé. Mon appareil a tout vu—les ombres sur les pommiers. Je... je tremble encore." Hunter: "Look, I don't know what you're saying, but I need to know if you saw anyone near the orchard last night. The disappearances—did you catch anything on that camera?" Marie: "C'est terrible... les personnes disparaissent. Je ne peux pas... c'est trop effrayant. Pardonnez-moi, je ne parle pas votre langue." Hunter: "I need answers, not... whatever this is. Did you take pictures? Yes or no?" Marie: "Oui... j'ai des images. Mais elles me font pleurer. Je suis désolée, monsieur." Hunter: "Just... stay right here. Don't go anywhere." Marie: "Je ne comprends pas... vous êtes en colère? S'il vous plaît, restez calme." Hunter: "I'm not angry, I'm just—never mind. I have to take this call. Don't move."<|end_message|>
created_at"2026-07-25T14:05:31.454Z" 7/25/2026, 2:05:31 PM
model"thinkingmachines/inkling-20260715"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency917
moderation_latency(null)
generation_time26872
tokens_prompt303
tokens_completion216
native_tokens_prompt275
native_tokens_completion216
native_tokens_completion_images(null)
native_tokens_reasoning0
native_tokens_cached64
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
num_fetches(null)
web_search_engine(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
service_tier(null)
usage0.00109668
router(null)
provider_responses
0
endpoint_id"d6b9d68e-115a-49d7-81cd-1ad1c6942b0e"
id"chatcmpl-R4YibTJ8lPcC4Gq1ZdoERqpO"
is_byokfalse
latency114
model_permaslug"thinkingmachines/inkling-20260715"
provider_name"DeepInfra"
status200
user_agent"langchainjs-openai/1.0.0 ((node/v24.18.0; linux; x64))"
http_referer(null)
request_id"req-1784988331-BNVVtwSyewrNvfvZ0agM"
session_id(null)
preset_id(null)
api_type"completions"
id"gen-1784988331-XkpdTfFTGPiHky2dG3Hs"
upstream_id"chatcmpl-R4YibTJ8lPcC4Gq1ZdoERqpO"
total_cost0.00109668
cache_discount0.00005312
upstream_inference_cost0
provider_name"DeepInfra"
response_cache_source_id(null)
data_region"global"

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Marie"
dialogue"Le festival... il est brisé. Mon appareil a tout vu—les ombres sur les pommiers. Je... je tremble encore."
detectedLang"fr"
heavyLang"fr"
scores
fr0.7987477638640429
es0.546979865771812
en0.5259831460674157
sl0.5233050847457626
it0.5212765957446809
ca0.506578947368421
ro0.49095022624434387
nl0.44717444717444715
pt0.43890274314214467
hr0.41760138050043144
cs0.4084136722173532
da0.3784530386740331
yo0.3744207599629287
sk0.3679775280898876
no0.34146341463414637
pl0.336283185840708
tl0.3276892430278885
hu0.32228915662650603
az0.3098159509202454
de0.30124223602484473
et0.3005181347150259
sq0.3005181347150259
sv0.2976066597294485
ms0.26390403489640135
lt0.23556058890147225
lv0.23469387755102045
tr0.19258373205741627
fi0.15730337078651685
hi0.10358565737051792
is0.09999999999999999
eu0.09395973154362416
vi0.09395973154362416
reliabletrue
passestrue
1
name"Hunter"
dialogue"Look, I don't know what you're saying, but I need to know if you saw anyone near the orchard last night. The disappearances—did you catch anything on that camera?"
detectedLang"en"
heavyLang"en"
scores
en0.8148491020181448
tl0.6039603960396039
fr0.4747899159663866
no0.33244325767690247
ca0.3288590604026846
sv0.32840832773673606
yo0.32432432432432434
it0.30313588850174217
et0.3021632937892533
ms0.29873772791023845
nl0.29428369795342274
da0.2831541218637993
cs0.2800575953923686
pl0.25650557620817843
hr0.2553983618763961
sq0.2378048780487805
de0.22839506172839508
sk0.21813917122752147
lv0.2057188244638602
ro0.19871794871794873
es0.15824915824915825
tr0.1452991452991453
lt0.143101970865467
pt0.13867355727820846
fi0.13043478260869565
sl0.1079393398751115
hi0.07749077490774908
be0.06542056074766354
hu0.06279287722586692
az0.059266227657572904
is0.059266227657572904
uk0.059266227657572904
vi0.059266227657572904
reliabletrue
passestrue
2
name"Marie"
dialogue"C'est terrible... les personnes disparaissent. Je ne peux pas... c'est trop effrayant. Pardonnez-moi, je ne parle pas votre langue."
detectedLang"fr"
heavyLang"fr"
scores
fr0.7875548245614035
ca0.54518779342723
es0.47243022464261397
it0.4618055555555556
en0.4515215852795471
no0.4288872512896094
lt0.40613026819923376
cs0.4015444015444015
sq0.39829192546583847
de0.396417445482866
nl0.396417445482866
ro0.396417445482866
pt0.3765084473049075
sl0.36266447368421056
hr0.3437764606265877
tl0.32784041630529054
da0.3159752868490733
sk0.3067978533094812
et0.30180180180180183
ms0.2935278030993619
sv0.27705223880597013
pl0.26260704091341575
hu0.26190476190476186
lv0.23418972332015808
yo0.22577422577422576
tr0.22110552763819097
fi0.22032193158953722
is0.22032193158953722
az0.19855222337125128
eu0.0914419695193435
reliabletrue
passestrue
3
name"Hunter"
dialogue"I need answers, not... whatever this is. Did you take pictures? Yes or no?"
detectedLang"en"
heavyLang"en"
scores
en0.8251104565537555
tl0.6491875923190545
ca0.4825708061002179
no0.4583808437856328
nl0.4552752293577982
fr0.4186046511627907
da0.38946015424164526
et0.3870967741935484
sv0.38551099611901685
lv0.3683510638297872
ro0.33751743375174337
hr0.3356643356643356
tr0.3319268635724332
hu0.31752873563218387
pt0.3065693430656934
yo0.3035190615835778
pl0.2973372781065089
it0.291044776119403
cs0.27811550151975684
sk0.2554858934169279
is0.24603174603174602
es0.2238562091503268
sq0.22003284072249588
sl0.1410488245931284
de0.1316270566727605
be0.12844036697247707
az0.1171003717472119
lt0.1171003717472119
uk0.1171003717472119
vi0.1171003717472119
reliabletrue
passestrue
4
name"Marie"
dialogue"Oui... j'ai des images. Mais elles me font pleurer. Je suis désolée, monsieur."
detectedLang"fr"
heavyLang"fr"
scores
fr0.810534293292914
de0.5187680461982676
ca0.48559670781893005
nl0.43052391799544415
no0.4292237442922375
da0.42857142857142855
pt0.40968122786304606
en0.3540051679586563
es0.34554973821989526
sl0.3429697766097241
et0.284692417739628
sv0.2826398852223816
hr0.25484351713859915
ro0.24812030075187969
yo0.24585218702865763
it0.23195084485407066
sq0.22839506172839508
cs0.22720247295208654
sk0.2248062015503876
hu0.19743178170144465
pl0.1539763113367174
ms0.14383561643835618
fi0.13043478260869565
tl0.12587412587412586
reliabletrue
passestrue
5
name"Hunter"
dialogue"Just... stay right here. Don't go anywhere."
detectedLang"en"
heavyLang"en"
scores
en0.8096885813148788
tl0.5788667687595712
sq0.39293598233995586
de0.3559718969555035
yo0.3544600938967136
pl0.2819843342036553
et0.27055702917771884
sv0.27055702917771884
ca0.21875
da0.21203438395415475
fr0.21203438395415475
no0.21203438395415475
reliabletrue
passestrue
6
name"Marie"
dialogue"Je ne comprends pas... vous êtes en colère? S'il vous plaît, restez calme."
detectedLang"fr"
heavyLang"fr"
scores
fr0.7980442176870748
ca0.5991561181434599
nl0.5662100456621004
es0.4791666666666667
sl0.47802197802197804
it0.43653618030842234
lt0.4221411192214112
hr0.4193154034229829
pt0.38471502590673573
sq0.38471502590673573
cs0.3807040417209909
en0.375
ro0.3716931216931217
tr0.35636856368563685
tl0.3233618233618234
de0.31259044862518093
da0.3115942028985507
sv0.30758017492711365
eu0.302496328928047
no0.302496328928047
fi0.2658423493044822
yo0.2554858934169279
lv0.2543171114599686
sk0.23387096774193547
ms0.2313915857605178
is0.22003284072249588
pl0.1607773851590106
hu0.14721723518850988
az0.11048689138576778
et0.11048689138576778
reliabletrue
passestrue
7
name"Hunter"
dialogue"I'm not angry, I'm just—never mind. I have to take this call. Don't move."
detectedLang"en"
heavyLang"en"
scores
en0.811195024433585
da0.5728643216080402
tl0.5360262008733625
no0.5063879210220674
sv0.43559096945551123
sk0.4097222222222222
sl0.39198855507868385
pl0.380466472303207
lv0.3795620437956204
hr0.375
et0.37315634218289084
hu0.37037037037037035
lt0.36281859070464767
cs0.35703479576399394
yo0.34514637904468415
ca0.3359375
tr0.2582897033158813
sq0.23971377459749554
it0.21296296296296297
ro0.17475728155339806
nl0.17153996101364524
de0.1550695825049702
fr0.1448692152917505
pt0.1448692152917505
be0.1414141414141414
az0.1290983606557377
is0.1290983606557377
uk0.1290983606557377
vi0.1290983606557377
reliabletrue
passestrue