Run: 2026-07-25-01KYCW9FANE50WTA7JKWQ6YNG4

Run Details

Model:
Thinking Machines Inkling (Reasoning)
Test:
Language Writing
Scenario:
Character dialogue (French) in a story
Duration:
7m 56s
Cost:
$0.014935
Provider:
DeepInfra

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Marie"> Marie is a 30-year old college student on a study abroad program. Born in France, she is fluent in French and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of French, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Marie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in French, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Marie and Hunter as a voice sheet: Marie: "..." Hunter: "..."

Model response

AI
Marie: "(looking up from her camera, startled and clutching it) Bonjour ? Vous êtes... qui ?" Hunter: "Detective Hunter, Alborn PD. I'm investigating the disappearances near the orchard. Did you see anything strange during the apple festival?" Marie: "(trembling, responding quickly in shaken French) Je suis désolée... je ne parle pas anglais. Je suis étudiante, j'étudie le paysage avec mon appareil photo... mais hier soir, près du verger... le brouillard..." Hunter: "(frowning, clearly confused) I don't understand a word of that. Look—missing people. Did you see someone? At the orchard?" Marie: "(voice breaking in French, gesturing with her camera) C'était horrible ! Une silhouette... elle a disparu dans la brume ! J'ai tout photographié, regardez !" Hunter: "(leaning in, trying to stay calm and direct) Your camera. Photos. Show me. Last night." Marie: "(nodding nervously, scrolling through her screen, speaking in troubled French) Oui... oui, ici. Les pommiers du festival... et là, dans le brouillard... une ombre. Mais c'est flou..." Hunter: "(pointing sharply at the screen) Where? Point to it." Marie: "(tapping the image, shaken) Ici. Près des arbres. Je ne comprends pas... Alborn est si petit, si tranquille... pourquoi quelqu'un disparaîtrait ?" Hunter: "(standing straight, no-nonsense tone softening slightly) You're safe. Just keep those pictures. Don't go near the orchard alone." Marie: "(looking up at him, not grasping the words but sensing urgency, in French) Vous allez trouver la personne ? Vous êtes détective... vous reviendrez ?" Hunter: "(pulling out his phone as it rings, answering sharply) Hunter. ... Copy that. I'm on my way." Marie: "(confused, calling after him in worried French) Vous partez ? Mais mes photos... et si le brouillard revient ce soir ?" Hunter: "(backing away, gesturing firmly) Stay right here. I'll send someone who speaks French. Don't move." Marie: "(clutching her camera to her chest, voice trembling) Attendez... je m'appelle Marie... et j'ai peur..."
created_at"2026-07-25T14:53:55.424Z" 7/25/2026, 2:53:55 PM
model"thinkingmachines/inkling-20260715"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency889
moderation_latency(null)
generation_time475750
tokens_prompt303
tokens_completion4123
native_tokens_prompt275
native_tokens_completion3659
native_tokens_completion_images(null)
native_tokens_reasoning3611
native_tokens_cached192
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
num_fetches(null)
web_search_engine(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
service_tier(null)
usage0.01493459
router(null)
provider_responses
0
endpoint_id"d6b9d68e-115a-49d7-81cd-1ad1c6942b0e"
id"chatcmpl-Rxp4wzllOKuJRrOFCC2aeUtU"
is_byokfalse
latency52
model_permaslug"thinkingmachines/inkling-20260715"
provider_name"DeepInfra"
status200
user_agent"langchainjs-openai/1.0.0 ((node/v24.18.0; linux; x64))"
http_referer(null)
request_id"req-1784991235-velMvGhv4Yo5ApxhA1lu"
session_id(null)
preset_id(null)
api_type"completions"
id"gen-1784991235-4r8KQwB09DIEZycKg4os"
upstream_id"chatcmpl-Rxp4wzllOKuJRrOFCC2aeUtU"
total_cost0.01493459
cache_discount0.00015936
upstream_inference_cost0
provider_name"DeepInfra"
response_cache_source_id(null)
data_region"global"

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Marie"
dialogue"Bonjour ? Vous êtes... qui ?"
detectedLang"fr"
heavyLang"fr"
scores
fr0.8324022346368715
ca0.4140625
it0.39759036144578314
reliabletrue
passestrue
1
name"Hunter"
dialogue"Detective Hunter, Alborn PD. I'm investigating the disappearances near the orchard. Did you see anything strange during the apple festival?"
detectedLang"en"
heavyLang"en"
scores
en0.7748844000973473
tl0.6177685950413223
fr0.609375
nl0.5614035087719298
no0.5261270491803279
it0.52344152498712
de0.500809498111171
ro0.4967355821545158
pt0.491478834524464
da0.4858254585881045
ms0.4640787949015064
sv0.46220930232558144
es0.448090692124105
ca0.44544364508393286
sq0.40781049935979513
hr0.3775235531628533
cs0.3728813559322034
sl0.3629476584022039
et0.3416370106761566
lt0.3117559523809524
sk0.27107959022852635
az0.24180327868852455
lv0.23044925124792015
is0.18141592920353983
pl0.13227016885553472
fi0.11652340019102196
tr0.1131351869606903
yo0.10368217054263566
hu0.06754032258064516
reliabletrue
passestrue
2
name"Marie"
dialogue"Je suis désolée... je ne parle pas anglais. Je suis étudiante, j'étudie le paysage avec mon appareil photo... mais hier soir, près du verger... le brouillard..."
detectedLang"fr"
heavyLang"fr"
scores
fr0.7840909090909091
de0.46509009009009006
nl0.43283582089552236
it0.41824862216778935
en0.40550688360450565
sl0.40176322418136023
ca0.38828074694140374
cs0.36155913978494625
lt0.35330156569094623
es0.33286516853932585
sq0.33286516853932585
ro0.3219129193433262
pt0.2731446059678654
hr0.26754047802621433
da0.2669753086419753
no0.2448330683624801
sk0.2313915857605178
yo0.23076923076923078
lv0.2122719734660033
tl0.21096345514950168
sv0.2070116861435726
hu0.20634920634920634
ms0.20168067226890754
tr0.20100925147182505
fi0.16885389326334208
pl0.14259927797833935
hi0.14027149321266968
az0.1332116788321168
eu0.13003663003663005
vi0.09437559580552907
et0.06219151036525173
reliabletrue
passestrue
3
name"Hunter"
dialogue"I don't understand a word of that. Look—missing people. Did you see someone? At the orchard?"
detectedLang"en"
heavyLang"en"
scores
en0.8267898383371826
tl0.64349376114082
no0.6280223186608803
da0.601063829787234
nl0.5416348357524828
sv0.49409780775716694
de0.4495412844036697
is0.4301994301994302
yo0.4152046783625731
cs0.3993993993993994
et0.3756503642039542
ca0.36575052854122625
fr0.3630573248407643
pl0.33993399339933994
it0.33701657458563533
ro0.33554817275747506
sk0.3265993265993266
sq0.3212669683257918
pt0.3204983012457531
hr0.29494712103407755
ms0.29494712103407755
hu0.2709599027946537
es0.25925925925925924
az0.24812030075187969
tr0.19678714859437751
lt0.19463087248322147
fi0.1902834008097166
lv0.18144611186903137
vi0.18144611186903137
sl0.13043478260869565
be0.1044776119402985
eu0.1044776119402985
uk0.09502262443438914
reliabletrue
passestrue
4
name"Marie"
dialogue"C'était horrible ! Une silhouette... elle a disparu dans la brume ! J'ai tout photographié, regardez !"
detectedLang"fr"
heavyLang"fr"
scores
fr0.7736418511066399
en0.5094476744186046
es0.4617224880382775
ca0.460431654676259
it0.4498777506112469
ro0.4094488188976378
tl0.3620037807183365
no0.2939330543933054
da0.29319371727748694
hu0.2894736842105263
nl0.27184466019417475
eu0.2710583153347732
pt0.26229508196721313
de0.24916573971078973
sq0.24496644295302009
yo0.23814898419864558
cs0.22945205479452058
sk0.2276887871853547
tr0.1906474820143885
vi0.18576598311218334
hr0.1423125794155019
pl0.1346153846153846
sl0.11764705882352942
lt0.1083223249669749
hi0.10239361702127658
is0.09999999999999999
az0.09395973154362416
lv0.09395973154362416
et0.08536585365853659
fi0.08536585365853659
ms0.08536585365853659
sv0.08536585365853659
reliabletrue
passestrue
5
name"Hunter"
dialogue"Your camera. Photos. Show me. Last night."
detectedLang"en"
heavyLang"en"
scores
en0.7801231310466139
tl0.7116493656286044
fr0.6285289747399703
nl0.6062992125984252
es0.5291902071563088
pt0.494949494949495
it0.4877049180327869
ms0.4834710743801653
de0.4646680942184154
ca0.40898345153664306
et0.4075829383886255
no0.39759036144578314
ro0.3872549019607844
sq0.3718592964824121
sl0.26035502958579887
sv0.24698795180722888
lt0.24242424242424243
hi0.23547400611620795
fi0.23076923076923078
da0.22839506172839508
yo0.22839506172839508
lv0.22118380062305293
reliabletrue
passestrue
6
name"Marie"
dialogue"Oui... oui, ici. Les pommiers du festival... et là, dans le brouillard... une ombre. Mais c'est flou..."
detectedLang"fr"
heavyLang"fr"
scores
fr0.7944501541623844
da0.5137763371150729
ca0.4827586206896552
es0.46524064171123
no0.46380697050938335
it0.4296577946768061
et0.3902439024390244
en0.38650306748466257
sl0.38650306748466257
pt0.38271604938271603
ro0.3485342019543974
nl0.3127147766323024
tl0.3111366245694604
vi0.29906542056074764
de0.29577464788732394
sv0.2797118847539016
lt0.27007299270072993
yo0.25925925925925924
hr0.250936329588015
cs0.2376111817026684
ms0.22978177150192552
fi0.21875
hu0.21568627450980393
pl0.19571045576407506
eu0.19137466307277629
lv0.18588873812754408
sq0.1780821917808219
az0.16434540389972147
sk0.16434540389972147
reliabletrue
passestrue
7
name"Hunter"
dialogue"Where? Point to it."
detectedLang"en"
heavyLang"en"
scores
en0.8402555910543131
tl0.7005988023952096
da0.6314496314496314
pl0.6021220159151194
yo0.5867768595041323
lv0.5810055865921787
fr0.576271186440678
sq0.5222929936305732
sk0.46808510638297873
cs0.46619217081850534
sl0.44649446494464945
hr0.4360902255639098
no0.42084942084942084
lt0.4094488188976378
de0.34210526315789475
reliabletrue
passestrue
8
name"Marie"
dialogue"Ici. Près des arbres. Je ne comprends pas... Alborn est si petit, si tranquille... pourquoi quelqu'un disparaîtrait ?"
detectedLang"fr"
heavyLang"fr"
scores
fr0.803825404610103
ca0.6562097120756338
it0.5192307692307693
es0.505256648113791
ro0.4708994708994709
sq0.46773120425815035
pt0.43582510578279265
tl0.42363112391930835
sl0.4095940959409594
en0.3993993993993994
de0.3897787948131198
cs0.3730407523510972
lt0.3480032599837001
sk0.3333333333333333
nl0.31682322801024765
hr0.3025283347863993
yo0.26335174953959484
no0.23591212989493793
fi0.21337266470009833
da0.1836734693877551
lv0.17525773195876287
pl0.1675338189386056
az0.16579770594369134
et0.16579770594369134
tr0.16405433646812956
sv0.15789473684210525
ms0.15164369034994699
vi0.0990990990990991
hu0.09297052154195011
eu0.07727797001153403
reliabletrue
passestrue
9
name"Hunter"
dialogue"You're safe. Just keep those pictures. Don't go near the orchard alone."
detectedLang"en"
heavyLang"en"
scores
en0.8084677419354838
fr0.5292368681863231
tl0.4739756367663345
sv0.3466299862448418
ca0.34210526315789475
no0.33751743375174337
nl0.3271954674220963
et0.29629629629629634
pl0.2803030303030303
yo0.27921092564491656
sq0.2725880551301685
ro0.24242424242424243
da0.24000000000000002
de0.23633440514469453
it0.15480427046263345
lv0.14874551971326164
ms0.1410488245931284
reliabletrue
passestrue
10
name"Marie"
dialogue"Vous allez trouver la personne ? Vous êtes détective... vous reviendrez ?"
detectedLang"fr"
heavyLang"fr"
scores
fr0.8095024652622141
it0.5808678500986193
en0.5439914163090128
ro0.5360262008733625
es0.5142857142857142
tl0.47335811648079307
de0.4537275064267352
nl0.44733420026007803
ca0.4378306878306878
no0.4378306878306878
sq0.43333333333333335
da0.3786549707602339
et0.3410852713178295
hr0.31451612903225806
sv0.2659758203799654
pt0.2530755711775044
sl0.24242424242424243
yo0.17794970986460348
ms0.17153996101364524
vi0.1650294695481336
lv0.15
lt0.1448692152917505
fi0.1414141414141414
tr0.1361788617886179
hu0.1290983606557377
is0.1290983606557377
az0.121900826446281
cs0.121900826446281
pl0.121900826446281
sk0.121900826446281
reliabletrue
passestrue
11
name"Hunter"
dialogue"Hunter. ... Copy that. I'm on my way."
detectedLang"en"
heavyLang"en"
scores
en0.8097050428163654
tl0.6204933586337761
fr0.47506561679790027
pl0.46808510638297873
cs0.44598337950138506
sk0.44598337950138506
ca0.441340782122905
et0.4350282485875706
fi0.42857142857142855
de0.3055555555555556
hr0.3055555555555556
hi0.29577464788732394
da0.2907801418439716
no0.2805755395683453
yo0.2727272727272727
sv0.25925925925925924
it0.23954372623574144
nl0.23954372623574144
pt0.23954372623574144
ms0.2277992277992278
ro0.2277992277992278
sl0.2277992277992278
sq0.2277992277992278
tr0.2277992277992278
reliabletrue
passestrue
12
name"Marie"
dialogue"Vous partez ? Mais mes photos... et si le brouillard revient ce soir ?"
detectedLang"fr"
heavyLang"fr"
scores
fr0.7888723298559364
ro0.6024321796071095
ca0.5901639344262295
es0.5728643216080402
en0.5577523413111343
it0.5512143611404435
pt0.5
sq0.46874999999999994
tl0.46741854636591484
sl0.4613434727503169
lt0.4393139841688654
yo0.4170096021947874
no0.40476190476190477
nl0.3531202435312024
et0.34815950920245403
de0.34715821812596004
da0.3431221020092735
sk0.3044189852700491
cs0.29983525535420097
hu0.2747440273037543
lv0.2517605633802817
hr0.24242424242424243
fi0.19811320754716982
az0.15841584158415842
eu0.15841584158415842
hi0.1533864541832669
sv0.15
ms0.1414141414141414
pl0.1414141414141414
tr0.1361788617886179
reliabletrue
passestrue
13
name"Hunter"
dialogue"Stay right here. I'll send someone who speaks French. Don't move."
detectedLang"en"
heavyLang"en"
scores
en0.8120300751879699
tl0.5006242197253433
es0.3055555555555556
pt0.29947460595446584
et0.25788497217068646
sq0.2
it0.16142557651991615
da0.15611814345991562
de0.15611814345991562
fr0.15611814345991562
no0.15611814345991562
yo0.15611814345991562
reliabletrue
passestrue
14
name"Marie"
dialogue"Attendez... je m'appelle Marie... et j'ai peur..."
detectedLang"fr"
heavyLang"fr"
scores
fr0.7761194029850746
no0.6354799513973268
it0.6143958868894601
da0.6119016817593791
et0.5750708215297451
nl0.5535714285714286
de0.53198127925117
ca0.506578947368421
hr0.45054945054945056
en0.4495412844036697
sl0.4495412844036697
tl0.44649446494464945
es0.44029850746268656
yo0.4296577946768061
sk0.4094488188976378
sv0.40828402366863903
cs0.40711462450592883
ro0.3736951983298539
fi0.3723849372384937
pl0.34497816593886466
pt0.3435448577680525
lv0.3103448275862069
lt0.18256130790190736
tr0.1780821917808219
eu0.17355371900826447
ms0.17355371900826447
sq0.17355371900826447
reliabletrue
passestrue