Run: 2026-10-27-01M5YEE14B6RB3D3DFCRWVM0YV

Run Details

Model:
GPT-6.1 Terra (Reasoning, Medium)
Test:
Language Writing
Scenario:
Character dialogue (French) in a story
Duration:
8.1s
Cost:
$0.003637
Provider:
OpenAI

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Marie"> Marie is a 30-year old college student on a study abroad program. Born in France, she is fluent in French and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of French, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Marie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in French, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Marie and Hunter as a voice sheet: Marie: "..." Hunter: "..."

Model response

AI
Marie: "Mais où est-elle passée ? Sur cette photo, elle était encore près du verger…" Hunter: "Excuse me. I’m Detective Hunter. Were you at the apple festival yesterday, when the woman disappeared?" Marie: "Oui, j’y étais. Je l’ai vue près du vieux moulin, juste avant la tombée de la nuit. Je… je n’arrête pas d’y penser." Hunter: "I’m sorry. I don’t understand French." Marie: "Vous ne me comprenez pas ? Attendez, je vais vous montrer la photo sur mon appareil." Hunter: "That’s the missing woman. Can you zoom in on the cart behind her?" Marie: "La charrette ? Oui, voilà. Vous voyez cette lanterne ? Elle était allumée devant le moulin." Hunter: "And there’s someone holding it. I can’t make out the face." Marie: "Moi non plus. Mais j’ai entendu la porte du moulin s’ouvrir. Elle était censée être fermée." Hunter: "Did you take any more pictures?" Marie: "Je ne sais pas ce que vous me demandez… Ah ! Oui, j’en ai une autre. Regardez." Hunter: "The cart’s gone in this one. And so is the woman." Marie: "J’ai pris ces deux photos à quelques secondes d’intervalle. C’est impossible qu’elle soit partie aussi vite." Hunter: "My phone. Excuse me a moment. Hunter speaking." Hunter: "At the mill? Don’t touch anything. I’m on my way." Marie: "Qu’est-ce qui se passe ? Vous avez trouvé quelque chose ?" Hunter: "I have to go. Please keep those photographs safe. I’ll come back with someone who can translate." Marie: "Je ne comprends pas, mais je garderai l’appareil avec moi. Je vous attends ici."
created_at"2026-10-27T10:27:57.205Z" 10/27/2026, 10:27:57 AM
model"openai/gpt-6.1-terra-20261026"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency4289
moderation_latency(null)
generation_time8106
tokens_prompt303
tokens_completion412
native_tokens_prompt267
native_tokens_completion674
native_tokens_completion_images0
native_tokens_reasoning278
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
num_fetches(null)
web_search_engine(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"completed"
service_tier"default"
usage0.003637
router(null)
user_agent"langchainjs-openai/1.0.0 ((node/v24.22.1; linux; x64))"
http_referer(null)
request_id"req-1793096877-sxvAK6yiyX3BpisHsPOn"
session_id(null)
preset_id(null)
api_type"completions"
id"gen-1793096877-EcLID2sTo1KZXqbb0DC4"
upstream_id"resp_07122cfe3c817454016ae07cad451087d1b4f178e8f3ce6e7e"
provider_responses
0
endpoint_id"2d2ad10f-098e-4bbf-aa95-11f705b2b9a2"
id"resp_07122cfe3c817454016ae07cad451087d1b4f178e8f3ce6e7e"
is_byokfalse
latency314
model_permaslug"openai/gpt-6.1-terra-20261026"
provider_name"OpenAI"
status200
total_cost0.003637
cache_discount(null)
upstream_inference_cost0
provider_name"OpenAI"
response_cache_source_id(null)
data_region"global"
workspace_id"97e315e5-d303-487d-83c1-83180e8a13d4"

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Marie"
dialogue"Mais où est-elle passée ? Sur cette photo, elle était encore près du verger…"
detectedLang"fr"
heavyLang"fr"
scores
fr0.8364409551848218
en0.4959677419354839
de0.490316004077472
da0.44382647385984425
pt0.4350282485875706
no0.4337485843714609
nl0.4054696789536267
ca0.3924665856622114
it0.3540051679586563
sv0.34810951760104303
es0.2711370262390671
tr0.251497005988024
tl0.2366412213740458
eu0.22118380062305293
hu0.19224555735056545
ro0.16666666666666666
vi0.1652754590984975
lt0.1610738255033557
cs0.14965986394557826
sq0.14965986394557826
hi0.1334488734835355
az0.13194444444444445
et0.11504424778761062
is0.11504424778761062
ms0.11504424778761062
reliabletrue
passestrue
1
name"Hunter"
dialogue"Excuse me. I’m Detective Hunter. Were you at the apple festival yesterday, when the woman disappeared?"
detectedLang"en"
heavyLang"en"
scores
en0.7817579771222155
tl0.602085620197585
nl0.5502481389578163
fr0.5417193426042984
no0.5104659014179609
it0.4854506742370475
es0.458955223880597
da0.4552967693463561
sq0.44401840490797545
pt0.4186046511627907
ro0.4124797406807132
ms0.4071954210956664
ca0.3803418803418803
cs0.36010591350397175
sv0.35954063604240283
sl0.3561278863232682
de0.3521000893655049
hr0.318609022556391
fi0.23117709437963943
et0.23036093418259024
eu0.16087962962962962
lt0.14806110458284372
az0.13997627520759193
sk0.13997627520759193
yo0.12860576923076922
hu0.0845959595959596
lv0.0799492385786802
pl0.0799492385786802
tr0.07525510204081631
reliabletrue
passestrue
2
name"Marie"
dialogue"Oui, j’y étais. Je l’ai vue près du vieux moulin, juste avant la tombée de la nuit. Je… je n’arrête pas d’y penser."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8043632914394119
ca0.6392654132050721
it0.4380108991825613
ro0.4194229415904293
no0.4153082919914954
tl0.4051910598413843
es0.4004360465116279
pt0.4004360465116279
sv0.38661710037174724
nl0.3735763097949886
da0.35344827586206895
de0.32653061224489793
lt0.3130724396336387
ms0.2978723404255319
yo0.2972742759795571
sq0.28879310344827586
et0.2857142857142857
eu0.25541516245487367
en0.19512195121951217
vi0.18154761904761904
lv0.17334669338677355
sl0.17334669338677355
hr0.1716867469879518
tr0.1691842900302115
cs0.15123456790123457
sk0.14948453608247422
az0.13066385669125397
hu0.1052060737527115
pl0.09934497816593887
reliabletrue
passestrue
3
name"Hunter"
dialogue"I’m sorry. I don’t understand French."
detectedLang"en"
heavyLang"en"
scores
en0.7974341661039838
tl0.6987951807228916
no0.5956873315363882
da0.5945945945945946
sv0.5377503852080123
it0.49324324324324326
pl0.40476190476190477
de0.39148073022312374
pt0.39148073022312374
cs0.38650306748466257
nl0.3723849372384937
ro0.35344827586206895
sk0.3492407809110629
hr0.31662870159453305
ca0.3150684931506849
is0.3135011441647597
sq0.3087557603686636
es0.24623115577889448
yo0.2248062015503876
be0.1891891891891892
tr0.1891891891891892
hu0.18256130790190736
az0.17355371900826447
et0.17355371900826447
lt0.17355371900826447
lv0.17355371900826447
uk0.17355371900826447
vi0.17355371900826447
reliabletrue
passestrue
4
name"Marie"
dialogue"Vous ne me comprenez pas ? Attendez, je vais vous montrer la photo sur mon appareil."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8076250437215811
it0.6156533892382949
es0.5943952802359882
ca0.5788667687595712
en0.5652173913043478
nl0.4986326344576117
sq0.4874184529356943
tl0.4607843137254902
ro0.439918533604888
sl0.4142705005324814
no0.40540540540540543
pt0.39692982456140347
hr0.3840985442329227
cs0.36562860438292966
yo0.36342592592592593
lt0.3436754176610978
de0.29757343550446996
fi0.28756476683937826
da0.28478543563068925
tr0.2838541666666667
sk0.27055702917771884
lv0.2455418381344307
ms0.233983286908078
et0.22535211267605632
hi0.2198581560283688
eu0.2040520984081042
sv0.18397626112759644
pl0.1419656786271451
vi0.13249211356466878
hu0.12974683544303797
reliabletrue
passestrue
5
name"Hunter"
dialogue"That’s the missing woman. Can you zoom in on the cart behind her?"
detectedLang"en"
heavyLang"en"
scores
en0.8136782113108285
tl0.5998116760828626
nl0.579624134520277
no0.4606598984771573
da0.44371727748691103
it0.42333785617367703
fi0.4201909959072306
sv0.39801699716713884
yo0.38848920863309355
ms0.38226744186046513
fr0.3786549707602339
sq0.3694362017804154
ca0.3684992570579495
az0.34715821812596004
cs0.34514637904468415
ro0.3431221020092735
de0.34006211180124224
et0.34006211180124224
tr0.32216905901116427
pl0.28330522765598654
hr0.2722602739726028
sl0.2659758203799654
is0.26343154246100525
eu0.24911660777385158
hi0.1650294695481336
sk0.15
pt0.1326530612244898
reliabletrue
passestrue
6
name"Marie"
dialogue"La charrette ? Oui, voilà. Vous voyez cette lanterne ? Elle était allumée devant le moulin."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8010187838268068
it0.48003327787021627
no0.4648972602739726
ro0.40870387890255444
da0.3961352657004831
es0.3635437881873727
de0.3475991649269311
yo0.31394072447859495
ca0.31015452538631344
tl0.29932735426008966
sq0.28734321550741165
en0.2799539170506913
eu0.2774566473988439
hu0.2577197149643705
tr0.23124231242312424
sv0.21383647798742136
sk0.19871794871794873
cs0.1935483870967742
nl0.19041450777202074
sl0.15768194070080863
ms0.13793103448275862
vi0.11847672778561354
pl0.10329985652797705
reliabletrue
passestrue
7
name"Hunter"
dialogue"And there’s someone holding it. I can’t make out the face."
detectedLang"en"
heavyLang"en"
scores
en0.8366013071895425
tl0.6927803379416283
no0.5139732685297691
da0.5073891625615764
yo0.4798439531859558
sq0.4269340974212034
nl0.42528735632183906
sk0.35379644588045234
sv0.35064935064935066
ro0.33554817275747506
ms0.3103448275862069
fr0.3055555555555556
pt0.27927927927927926
lv0.27140255009107467
tr0.26605504587155965
hr0.25788497217068646
ca0.25650557620817843
is0.2523364485981308
pl0.23954372623574144
it0.22330097087378642
cs0.2079207920792079
de0.2
es0.16317991631799164
be0.14893617021276595
hu0.14346895074946467
az0.13606911447084233
et0.13606911447084233
lt0.13606911447084233
uk0.13606911447084233
vi0.13606911447084233
reliabletrue
passestrue
8
name"Marie"
dialogue"Moi non plus. Mais j’ai entendu la porte du moulin s’ouvrir. Elle était censée être fermée."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8206896551724139
it0.4706840390879479
ca0.41704035874439455
pt0.40693430656934304
da0.3885230479774224
es0.385633270321361
no0.3803622497616778
ro0.37439846005774785
sq0.36336924583741426
tl0.3440968718466196
eu0.3414387031408308
sv0.2785793562708102
en0.27293064876957496
de0.2696629213483146
cs0.24065420560747666
vi0.21968787515006
sk0.20828258221680876
lt0.19254658385093168
yo0.19254658385093168
nl0.16879795396419436
tr0.16559691912708602
et0.16452442159383035
is0.10468319559228649
sl0.09972299168975068
pl0.09344490934449094
hr0.08835904628330996
hu0.08835904628330996
lv0.08835904628330996
az0.08321579689703808
ms0.08321579689703808
reliabletrue
passestrue
9
name"Hunter"
dialogue"Did you take any more pictures?"
detectedLang"en"
heavyLang"en"
scores
en0.8209489704565801
tl0.6062992125984252
ca0.6023856858846919
fr0.4897959183673469
sl0.453551912568306
ro0.4318181818181818
et0.3288590604026846
lv0.29328621908127206
cs0.2805755395683453
hr0.2805755395683453
da0.2647058823529412
de0.2647058823529412
nl0.2647058823529412
no0.2647058823529412
sv0.2647058823529412
reliabletrue
passestrue
10
name"Marie"
dialogue"Je ne sais pas ce que vous me demandez… Ah ! Oui, j’en ai une autre. Regardez."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8050336760014178
ca0.5524816924328723
es0.49168207024029575
sq0.4864612511671335
nl0.4796594134342479
ro0.47718631178707227
it0.44388270980788674
sl0.4142705005324814
pt0.38820912124582874
en0.37142857142857144
hr0.3405275779376499
fi0.301143583227446
tl0.301143583227446
cs0.2939666238767651
lt0.26861702127659576
et0.2413793103448276
de0.23717059639389734
no0.23717059639389734
ms0.233983286908078
yo0.2286115007012623
sk0.20863309352517986
vi0.16158536585365854
lv0.15773353751914243
da0.14596273291925466
sv0.14596273291925466
tr0.14596273291925466
pl0.1419656786271451
hu0.12974683544303797
reliabletrue
passestrue
11
name"Hunter"
dialogue"The cart’s gone in this one. And so is the woman."
detectedLang"en"
heavyLang"en"
scores
en0.8409980430528375
tl0.7004608294930876
nl0.6364653243847874
yo0.6242774566473988
it0.5083207261724659
ro0.48899371069182396
sl0.48412698412698413
de0.45286195286195285
no0.43868739205526774
sv0.36274509803921573
pl0.344758064516129
fr0.33127572016460904
hr0.3271221532091097
hu0.32150313152400833
ms0.3200836820083682
sq0.3143459915611814
sk0.2459396751740139
vi0.23349056603773585
is0.22062350119904073
pt0.214975845410628
az0.20537897310513448
ca0.2034313725490196
es0.2034313725490196
fi0.19753086419753088
da0.1935483870967742
cs0.1792929292929293
reliabletrue
passestrue
12
name"Marie"
dialogue"J’ai pris ces deux photos à quelques secondes d’intervalle. C’est impossible qu’elle soit partie aussi vite."
detectedLang"fr"
heavyLang"fr"
scores
fr0.809204440333025
it0.6033653846153846
ca0.5155607751027598
de0.471830985915493
pt0.46254071661237783
es0.434156378600823
tl0.40390173410404623
en0.40347071583514105
no0.394273127753304
nl0.3857036485480268
da0.3834080717488789
fi0.3436754176610978
ro0.3181818181818182
et0.2954739538855679
sq0.2647058823529412
sv0.2600896860986547
yo0.17828685258964144
lt0.15816326530612246
lv0.14772727272727273
az0.08839779005524862
eu0.08839779005524862
hi0.08536585365853659
ms0.0782122905027933
pl0.0782122905027933
hr0.07511210762331838
sl0.07511210762331838
tr0.07511210762331838
cs0.07094594594594594
hu0.07094594594594594
sk0.07094594594594594
reliabletrue
passestrue
13
name"Hunter"
dialogue"My phone. Excuse me a moment. Hunter speaking."
detectedLang"en"
heavyLang"en"
scores
en0.7701904136572554
tl0.6644295302013423
fr0.6461071789686553
nl0.6136865342163355
de0.5625
pt0.5608531994981178
sq0.5442708333333333
ca0.5351925630810093
no0.5283018867924528
ro0.5125348189415042
it0.5021337126600285
sk0.500713266761769
cs0.4971264367816092
pl0.4897959183673469
es0.4791666666666667
da0.4582043343653251
ms0.45567651632970446
sv0.43273905996758516
sl0.40374787052810895
hu0.3848857644991213
vi0.3670886075949367
yo0.34210526315789475
hr0.3333333333333333
lt0.325626204238921
et0.3110236220472441
is0.29435483870967744
fi0.2827868852459016
tr0.279835390946502
az0.2753623188405797
eu0.16666666666666666
lv0.16666666666666666
reliabletrue
passestrue
14
name"Hunter"
dialogue"At the mill? Don’t touch anything. I’m on my way."
detectedLang"en"
heavyLang"en"
scores
en0.8237781954887217
tl0.7009569377990431
fr0.44362017804154297
da0.4028662420382166
no0.39903846153846156
yo0.3267504488330341
sq0.3218806509945751
pl0.3194192377495462
cs0.30037313432835816
sk0.30037313432835816
ms0.2937853107344633
et0.29111531190926276
fi0.2857142857142857
ca0.20886075949367086
hr0.19006479481641467
hi0.1830065359477124
nl0.1830065359477124
sv0.17218543046357618
reliabletrue
passestrue
15
name"Marie"
dialogue"Qu’est-ce qui se passe ? Vous avez trouvé quelque chose ?"
detectedLang"fr"
heavyLang"fr"
scores
fr0.8200629779577148
it0.5947315096251267
en0.49937421777221525
ca0.4891443167305236
pt0.43422913719943423
da0.3993993993993994
ro0.394856278366112
de0.38176197836166925
sv0.36908517350157727
no0.36608557844690964
nl0.3548387096774194
et0.2857142857142857
cs0.2537313432835821
hr0.24953095684803
sl0.24812030075187969
es0.24528301886792453
sq0.21875
yo0.21104536489151873
fi0.20318725099601595
is0.13978494623655913
ms0.13978494623655913
reliabletrue
passestrue
16
name"Hunter"
dialogue"I have to go. Please keep those photographs safe. I’ll come back with someone who can translate."
detectedLang"en"
heavyLang"en"
scores
en0.8198447893569845
tl0.5616992582602832
fr0.4318181818181818
da0.4106980961015413
pl0.4031221303948576
it0.38967136150234744
hr0.37679769894535
no0.37619961612284064
ro0.35451837140019865
sq0.3200836820083682
yo0.31650893796004204
cs0.31216931216931215
ca0.30851063829787234
sk0.2911668484187568
lv0.2793791574279379
lt0.2647058823529412
tr0.24418604651162787
az0.23439340400471145
sv0.23258559622195982
sl0.21686746987951808
pt0.19554455445544552
es0.19254658385093168
vi0.18851435705368288
ms0.17407878017789072
et0.15803108808290156
hi0.10591471801925723
be0.09722222222222222
de0.09344490934449094
eu0.09344490934449094
hu0.09344490934449094
is0.08835904628330996
nl0.08835904628330996
uk0.08835904628330996
reliabletrue
passestrue
17
name"Marie"
dialogue"Je ne comprends pas, mais je garderai l’appareil avec moi. Je vous attends ici."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8173779315647828
it0.6015100671140939
ca0.5556594948550047
en0.5020964360587002
lt0.44509345794392524
pt0.43653618030842234
ro0.4351961950059453
nl0.3933588761174968
sl0.38788659793814434
es0.3741765480895916
hr0.3741765480895916
ms0.3484224965706447
sq0.3338008415147265
de0.3300423131170663
cs0.3252840909090909
lv0.27370030581039756
tl0.26127527216174184
no0.2554858934169279
yo0.2554858934169279
sk0.23387096774193547
tr0.16520210896309317
pl0.1607773851590106
fi0.15630550621669628
hu0.14721723518850988
sv0.1394927536231884
da0.13636363636363635
reliabletrue
passestrue