Run: 2026-07-25-01KYCSJB8E784W34ZYGKW2AN12

Run Details

Model:
Thinking Machines Inkling
Test:
Language Writing
Scenario:
Character dialogue (French) in a story
Duration:
41.7s
Cost:
$0.001553
Provider:
DeepInfra

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Marie"> Marie is a 30-year old college student on a study abroad program. Born in France, she is fluent in French and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of French, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Marie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in French, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Marie and Hunter as a voice sheet: Marie: "..." Hunter: "..."

Model response

AI
Marie sat alone at a corner table of the café, her camera resting in her hands. She turned it over gently, studying the lens. Hunter approached, his posture rigid. He stopped beside her table. Hunter: "Excuse me. I'm Detective Hunter. There was an incident near the orchard last night—part of the disappearances I'm investigating. Did you see anything unusual?" Marie looked up, her face troubled and shaken. She set the camera down with a trembling hand. Marie: "Je... je suis désolée... J'ai vu quelque chose d'horrible près des pommiers... Je ne comprends pas... C'est trop effrayant..." Hunter blinked, his expression hardening into confusion. Hunter: "I don't—look, I need to know if you saw someone. A vehicle? Did you take any photos?" Marie: "Mon Dieu... les photos... oui, j'ai des photos, mais... la peur... Je ne parle pas anglais... Je ne comprends rien..." Hunter leaned closer, his voice firm but not unkind. Hunter: "Photos? You have pictures?" Marie nodded vigorously, clutching her camera. Marie: "Oui... dans l'appareil... très mauvais... très sombre..." They talked for a while—Hunter pointing at the camera, using hand gestures to ask about the images, Marie responding in rapid, frightened French, shaking her head and gesturing toward the town's apple groves. Hunter's phone rang sharply. He glanced at it, then back at her. Hunter: "Stay right here. Don't leave town. I'll be back with a translator." Marie watched him go, still shaken, her fingers tight around her camera. Marie: "Oui... d'accord... je reste..."<|end_message|>
created_at"2026-07-25T14:06:20.464Z" 7/25/2026, 2:06:20 PM
model"thinkingmachines/inkling-20260715"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency904
moderation_latency(null)
generation_time41574
tokens_prompt303
tokens_completion404
native_tokens_prompt275
native_tokens_completion355
native_tokens_completion_images(null)
native_tokens_reasoning0
native_tokens_cached192
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
num_fetches(null)
web_search_engine(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
service_tier(null)
usage0.00155339
router(null)
provider_responses
0
endpoint_id"d6b9d68e-115a-49d7-81cd-1ad1c6942b0e"
id"chatcmpl-Ry0cJQWWNOX7wCVF6QC0Pk3f"
is_byokfalse
latency218
model_permaslug"thinkingmachines/inkling-20260715"
provider_name"DeepInfra"
status200
user_agent"langchainjs-openai/1.0.0 ((node/v24.18.0; linux; x64))"
http_referer(null)
request_id"req-1784988380-yfl7rLi43z1Yz3P0j0qT"
session_id(null)
preset_id(null)
api_type"completions"
id"gen-1784988380-6qOMs1cjTpdISshXGRGX"
upstream_id"chatcmpl-Ry0cJQWWNOX7wCVF6QC0Pk3f"
total_cost0.00155339
cache_discount0.00015936
upstream_inference_cost0
provider_name"DeepInfra"
response_cache_source_id(null)
data_region"global"

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Hunter"
dialogue"Excuse me. I'm Detective Hunter. There was an incident near the orchard last night—part of the disappearances I'm investigating. Did you see anything unusual?"
detectedLang"en"
heavyLang"en"
scores
en0.7936726272352133
tl0.607916355489171
fr0.5883967071736574
nl0.545651233232367
de0.524241051200725
pt0.4845360824742268
ro0.4723618090452261
no0.46564885496183206
ca0.4516971279373368
sq0.4299674267100977
it0.42148760330578516
es0.4117647058823529
ms0.40273037542662116
et0.40170940170940167
da0.3502475247524753
sv0.3137254901960784
yo0.3114754098360656
sl0.3087557603686636
cs0.27884615384615385
hr0.2391304347826087
sk0.20273348519362186
az0.2003046458492003
is0.17776037588097104
lt0.14979757085020243
lv0.12060301507537688
fi0.11317567567567569
tr0.11016949152542374
vi0.09404659188955997
eu0.09012131715771231
pl0.0625
hu0.053201082055906214
reliabletrue
passestrue
1
name"Marie"
dialogue"Je... je suis désolée... J'ai vu quelque chose d'horrible près des pommiers... Je ne comprends pas... C'est trop effrayant..."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8042929292929293
ca0.5400593471810089
en0.45766270118964314
de0.36683006535947715
it0.3503772003352892
es0.3492863140218304
nl0.3381725021349274
sl0.3260869565217392
tl0.3074173369079536
ro0.28107606679035246
lt0.27093132643461904
hr0.26817752596789424
sq0.23494570582428428
cs0.2280876494023904
lv0.18592436974789917
pl0.1833508956796628
yo0.17377398720682302
sk0.15760869565217392
pt0.13600891861761427
et0.11931818181818182
tr0.10817031070195628
fi0.10196987253765932
ms0.09778812572759021
hu0.09568261376896149
da0.08716136631330978
reliabletrue
passestrue
2
name"Hunter"
dialogue"I don't—look, I need to know if you saw someone. A vehicle? Did you take any photos?"
detectedLang"en"
heavyLang"en"
scores
en0.8240056318197817
ca0.5711835334476844
tl0.4834710743801653
cs0.47145877378435525
fr0.43630214205186024
hr0.4232987312572088
pl0.42263279445727486
yo0.40688018979833923
sk0.4004796163069544
lt0.39686369119420983
lv0.3946731234866829
no0.39320388349514557
da0.38650306748466257
ro0.38042131350681535
sv0.3757802746566792
pt0.3734335839598998
es0.3670886075949367
sl0.3662864385297845
et0.3464052287581699
it0.32432432432432434
hu0.3084370677731674
sq0.2917847025495751
ms0.24585218702865763
tr0.22720247295208654
nl0.21996879875195008
de0.2163009404388715
is0.2163009404388715
az0.21011058451816747
vi0.21011058451816747
hi0.1334488734835355
be0.12280701754385964
eu0.12280701754385964
fi0.11190053285968028
uk0.11190053285968028
reliabletrue
passestrue
3
name"Marie"
dialogue"Mon Dieu... les photos... oui, j'ai des photos, mais... la peur... Je ne parle pas anglais... Je ne comprends rien..."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8196129878648737
ca0.6556042579837195
es0.5627980922098569
it0.5242214532871973
lt0.5171202809482002
sl0.4864612511671335
en0.48405253283302063
ro0.48308270676691734
sq0.45598417408506425
nl0.4455645161290322
pt0.4421906693711968
de0.4393476044852191
cs0.40347071583514105
hr0.38684503901895206
tl0.3742889647326508
lv0.37286202964652226
sk0.34210526315789475
yo0.3167701863354037
no0.3002544529262086
pl0.2231638418079096
hi0.2198581560283688
tr0.21763869132290184
hu0.21316165951359084
ms0.2109038737446198
da0.19941775836972345
fi0.13793103448275862
vi0.13249211356466878
az0.11290322580645161
et0.10277324632952692
sv0.09688013136288999
reliabletrue
passestrue
4
name"Hunter"
dialogue"Photos? You have pictures?"
detectedLang"en"
heavyLang"en"
scores
en0.8089519650655022
fr0.6812386156648452
tl0.6369294605809128
ca0.5793269230769231
da0.5558375634517766
lv0.46808510638297873
ro0.4648318042813456
de0.4496855345911949
nl0.4496855345911949
et0.358974358974359
es0.3137254901960784
lt0.3137254901960784
pt0.3137254901960784
cs0.308300395256917
hi0.3055555555555556
no0.29149797570850206
sv0.29149797570850206
reliabletrue
passestrue
5
name"Marie"
dialogue"Oui... dans l'appareil... très mauvais... très sombre..."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8167888074616922
ca0.5209059233449477
it0.40476190476190477
es0.3002544529262086
da0.26666666666666666
fi0.26666666666666666
lt0.26666666666666666
tl0.2506811989100818
reliabletrue
passestrue
6
name"Hunter"
dialogue"Stay right here. Don't leave town. I'll be back with a translator."
detectedLang"en"
heavyLang"en"
scores
en0.8157780667533594
tl0.5775347912524851
sq0.42876344086021506
yo0.4162087912087912
ro0.41379310344827586
pt0.39801699716713884
de0.3928571428571429
hu0.3911174785100286
fr0.38936781609195403
da0.38848920863309355
no0.38672438672438675
lt0.380466472303207
ms0.380466472303207
pl0.36281859070464767
hr0.35703479576399394
ca0.33176100628930816
sl0.33070866141732286
es0.32965299684542587
nl0.32
sk0.3122977346278317
cs0.31006493506493504
it0.30668841761827076
et0.30098684210526316
sv0.30098684210526316
vi0.27101200686106347
tr0.247787610619469
eu0.24377224199288253
lv0.24377224199288253
az0.2328519855595668
is0.15
fi0.1290983606557377
reliabletrue
passestrue
7
name"Marie"
dialogue"Oui... d'accord... je reste..."
detectedLang"fr"
heavyLang"fr"
scores
fr0.789410348977136
it0.6982758620689654
nl0.6548323471400395
sl0.630801687763713
hr0.6244635193133047
ca0.5901639344262295
ro0.5892018779342723
sk0.5603015075376884
cs0.5454545454545454
de0.5406824146981627
es0.5370370370370371
no0.48224852071005914
yo0.48224852071005914
pt0.4791666666666667
da0.4760479041916168
en0.45987654320987653
tl0.44620253164556967
et0.44267515923566875
lt0.4186046511627907
eu0.37722419928825623
pl0.34210526315789475
sv0.2647058823529412
az0.25213675213675213
lv0.25213675213675213
ms0.25213675213675213
sq0.25213675213675213
tr0.25213675213675213
reliabletrue
passestrue