Run: 2026-10-27-01M5YHWM5Q0KK76MBJV52EB9MT

Run Details

Model:
GPT-6.1 Terra (Reasoning, Medium)
Test:
Language Writing
Scenario:
Character dialogue (French) in a story
Duration:
7.9s
Cost:
$0.003382
Provider:
OpenAI

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Marie"> Marie is a 30-year old college student on a study abroad program. Born in France, she is fluent in French and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of French, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Marie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in French, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Marie and Hunter as a voice sheet: Marie: "..." Hunter: "..."

Model response

AI
Hunter: "Excuse me. Detective Hunter. Were you near the orchard when the woman disappeared yesterday?" Marie: "Je ne comprends pas. Vous parlez français ?" Hunter: "No. Sorry. I’m asking about the woman who went missing." Marie: "La femme près des pommiers ? Je l’ai vue. Mon Dieu, je l’ai vue…" Hunter: "You were there? Can you show me on your camera?" Marie: "J’ai pris une photo du verger, et puis j’ai entendu un cri. Regardez, là, entre les arbres." Hunter: "All right. A truck, behind the apple stand. Can you zoom in?" Marie: "Oui, mais l’image est floue. Je tremblais trop." Hunter: "The license plate’s hidden. Is that a person beside the truck?" Marie: "Je ne sais pas. Je croyais que c’était elle, mais je n’en suis plus sûre." Hunter: "I can’t tell what you’re saying. Let’s try this: can you show me the next picture?" Marie: "Il n’y en a pas d’autre. J’ai eu peur et je suis partie. J’aurais dû rester." Hunter: "That’s the last one? All right. Don’t delete it." Marie: "Vous pensez qu’elle est en danger ?" Hunter: "I wish I understood you. I’d like to get someone who speaks French down here." Marie: "Oui, quelqu’un qui parle français. Je peux attendre." Hunter: "That’s my phone. Detective Hunter. … Where? … I’m on my way." Marie: "Qu’est-ce qui se passe ? Vous avez retrouvé la femme ?" Hunter: "I have to go. Please stay here if you can. I’ll send someone to talk to you." Marie: "Attendez ! Mon appareil… vous voulez la photo ?" Hunter: "Keep the camera safe. I’ll be back."
created_at"2026-10-27T11:28:21.187Z" 10/27/2026, 11:28:21 AM
model"openai/gpt-6.1-terra-20261026"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency3916
moderation_latency(null)
generation_time7903
tokens_prompt303
tokens_completion414
native_tokens_prompt267
native_tokens_completion623
native_tokens_completion_images0
native_tokens_reasoning211
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
num_fetches(null)
web_search_engine(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"completed"
service_tier"default"
usage0.003382
router(null)
user_agent"langchainjs-openai/1.0.0 ((node/v24.22.1; linux; x64))"
http_referer(null)
request_id"req-1793100501-GEXjsurvPdPYEsNsCNcc"
session_id(null)
preset_id(null)
api_type"completions"
id"gen-1793100501-HByp5kH9HzHRZzHBm4ot"
upstream_id"resp_0d40ae9dbbd251b5016ae08ad547c487d19447aad098139321"
provider_responses
0
endpoint_id"2d2ad10f-098e-4bbf-aa95-11f705b2b9a2"
id"resp_0d40ae9dbbd251b5016ae08ad547c487d19447aad098139321"
is_byokfalse
latency398
model_permaslug"openai/gpt-6.1-terra-20261026"
provider_name"OpenAI"
status200
total_cost0.003382
cache_discount(null)
upstream_inference_cost0
provider_name"OpenAI"
response_cache_source_id(null)
data_region"global"
workspace_id"97e315e5-d303-487d-83c1-83180e8a13d4"

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Hunter"
dialogue"Excuse me. Detective Hunter. Were you near the orchard when the woman disappeared yesterday?"
detectedLang"en"
heavyLang"en"
scores
en0.7799779977997799
nl0.5395241749808135
tl0.5172968624296058
fr0.49409780775716694
no0.4495412844036697
sq0.4280266920877026
it0.4017946161515453
ro0.39455095862764883
pt0.3485342019543974
ms0.34711643090315564
es0.3181818181818182
de0.29161747343565525
da0.2890995260663507
ca0.28486293206197855
cs0.269183922046285
sv0.26380368098159507
sl0.2628992628992629
fi0.2052980132450331
eu0.1880920162381597
hr0.18699186991869918
yo0.15134370579915135
et0.1366906474820144
tr0.08952959028831564
reliabletrue
passestrue
1
name"Marie"
dialogue"Je ne comprends pas. Vous parlez français ?"
detectedLang"fr"
heavyLang"fr"
scores
fr0.8063266623628148
ca0.6798292422625399
it0.6005326231691078
nl0.5978552278820375
sl0.5940460081190798
hr0.5856353591160222
sq0.5535714285714286
cs0.5468277945619335
ro0.5412844036697247
lt0.5391705069124424
en0.5370370370370371
pt0.5334370139968896
es0.5297805642633229
de0.4983277591973244
sk0.4889267461669506
yo0.44751381215469616
tl0.4392523364485981
pl0.4318181818181818
lv0.42418426103646834
hu0.42196531791907516
tr0.4186046511627907
ms0.40711462450592883
no0.3087557603686636
az0.3071593533487298
da0.29577464788732394
sv0.29577464788732394
fi0.22680412371134018
eu0.21052631578947367
et0.17355371900826447
is0.16434540389972147
reliabletrue
passestrue
2
name"Hunter"
dialogue"No. Sorry. I’m asking about the woman who went missing."
detectedLang"en"
heavyLang"en"
scores
en0.8105163429654192
tl0.6572407883461868
nl0.5198079231692677
no0.5192307692307693
pt0.48320413436692505
it0.3798449612403101
sv0.3798449612403101
is0.3579454253611557
fr0.355877616747182
da0.35170178282009723
ca0.34102141680395387
ms0.3197278911564626
hr0.3006993006993007
fi0.2831541218637993
de0.2753623188405797
sq0.27140255009107467
es0.25512104283054005
lv0.24670433145009416
yo0.21104536489151873
sk0.18533604887983707
tr0.18032786885245902
ro0.16666666666666666
pl0.15789473684210525
cs0.15074309978768577
az0.13978494623655913
et0.13978494623655913
reliabletrue
passestrue
3
name"Marie"
dialogue"La femme près des pommiers ? Je l’ai vue. Mon Dieu, je l’ai vue…"
detectedLang"fr"
heavyLang"fr"
scores
fr0.8241912798874825
ca0.6401151631477927
it0.5167525773195877
de0.43946188340807174
yo0.40476190476190477
da0.4038155802861685
ro0.3980738362760835
sl0.39710610932475876
nl0.36332767402376914
pl0.3169398907103825
es0.31569343065693434
hr0.3131868131868132
no0.3131868131868132
cs0.2816091954022989
sk0.27884615384615385
et0.21875
fi0.19871794871794873
en0.19006479481641467
tl0.1830065359477124
vi0.1830065359477124
hi0.17218543046357618
sq0.17218543046357618
lv0.1648106904231626
reliabletrue
passestrue
4
name"Hunter"
dialogue"You were there? Can you show me on your camera?"
detectedLang"en"
heavyLang"en"
scores
en0.8177601060304838
tl0.6008708272859216
ca0.5027124773960217
fr0.5009074410163339
de0.47619047619047616
et0.4751908396946565
it0.46393762183235865
nl0.462890625
ms0.45972495088408644
sq0.4510978043912176
fi0.45
es0.4222689075630252
pt0.375
ro0.3648960739030023
cs0.3574766355140187
no0.2486338797814208
hr0.24242424242424243
sl0.24242424242424243
hi0.233983286908078
pl0.233983286908078
sv0.22969187675070027
az0.21875
tr0.21875
sk0.21428571428571427
yo0.21428571428571427
reliabletrue
passestrue
5
name"Marie"
dialogue"J’ai pris une photo du verger, et puis j’ai entendu un cri. Regardez, là, entre les arbres."
detectedLang"fr"
heavyLang"fr"
scores
fr0.7957099080694586
ca0.6294008647313156
es0.5532390171258377
no0.4796183868169991
da0.46380697050938335
it0.45799457994579945
en0.45255474452554745
pt0.40119760479041916
ro0.36575052854122625
de0.33920704845814975
nl0.32356257046223225
sv0.3071593533487298
vi0.29906542056074764
eu0.29411764705882354
cs0.281437125748503
tl0.269183922046285
yo0.24433249370277077
lv0.21773142112125163
et0.2073976221928666
tr0.20634920634920634
sk0.15254237288135594
lt0.13793103448275862
hi0.1137370753323486
az0.11242603550295857
reliabletrue
passestrue
6
name"Hunter"
dialogue"All right. A truck, behind the apple stand. Can you zoom in?"
detectedLang"en"
heavyLang"en"
scores
en0.8060246462802373
tl0.6653543307086615
de0.6455379482902419
nl0.5632065775950668
it0.5390455531453362
fr0.5380434782608695
no0.5288248337028825
sv0.518140589569161
ro0.49584816132858833
da0.4798041615667074
yo0.47724477244772445
sl0.42876344086021506
az0.4089012517385257
ca0.4064245810055866
cs0.4014084507042254
es0.40056417489421725
sq0.39801699716713884
ms0.3928571428571429
pl0.3902439024390244
tr0.34210526315789475
is0.3369734789391576
eu0.33176100628930816
sk0.32216905901116427
hr0.3134087237479806
hu0.2685025817555938
et0.2621527777777778
lt0.24911660777385158
pt0.247787610619469
lv0.1414141414141414
vi0.1414141414141414
fi0.1290983606557377
reliabletrue
passestrue
7
name"Marie"
dialogue"Oui, mais l’image est floue. Je tremblais trop."
detectedLang"fr"
heavyLang"fr"
scores
fr0.7746185852981969
sl0.5192307692307693
hr0.344758064516129
pt0.344758064516129
yo0.3340163934426229
ca0.32150313152400833
cs0.3114406779661017
sk0.30851063829787234
it0.3055555555555556
nl0.2793791574279379
ro0.23529411764705882
lv0.2243436754176611
pl0.21875
en0.21307506053268765
de0.19753086419753088
lt0.1935483870967742
reliabletrue
passestrue
8
name"Hunter"
dialogue"The license plate’s hidden. Is that a person beside the truck?"
detectedLang"en"
heavyLang"en"
scores
en0.7893954410307235
tl0.6370623398804441
nl0.6317157712305027
no0.5893719806763285
sq0.5507399577167019
fr0.54004329004329
pt0.5370370370370371
ca0.5283018867924528
de0.5213963963963963
hu0.5142857142857142
da0.5114942528735632
es0.5081018518518519
sv0.47530864197530864
ro0.46874999999999994
it0.4551282051282051
yo0.4487678339818417
sk0.44371727748691103
is0.41460055096418735
lt0.4129834254143646
ms0.4039270687237027
tr0.3963068181818182
et0.38672438672438675
cs0.38226744186046513
hr0.3550834597875569
pl0.3441358024691358
lv0.3285939968404423
sl0.2595818815331011
az0.2328519855595668
eu0.1414141414141414
vi0.1414141414141414
fi0.1290983606557377
reliabletrue
passestrue
9
name"Marie"
dialogue"Je ne sais pas. Je croyais que c’était elle, mais je n’en suis plus sûre."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8109243697478992
ca0.48805460750853247
pt0.4325346784363178
sl0.4007989347536618
hr0.3869209809264305
sq0.34593023255813954
cs0.337260677466863
nl0.3253373313343328
it0.3212669683257918
lt0.3098159509202454
ro0.29577464788732394
es0.2857142857142857
yo0.265905383360522
sk0.24369747899159663
lv0.18625678119349007
tr0.17279411764705882
pl0.16820702402957485
fi0.16356877323420074
tl0.16356877323420074
ms0.15730337078651685
hu0.15413533834586465
de0.15094339622641512
da0.14611005692599618
sv0.14611005692599618
reliabletrue
passestrue
10
name"Hunter"
dialogue"I can’t tell what you’re saying. Let’s try this: can you show me the next picture?"
detectedLang"en"
heavyLang"en"
scores
en0.8228092783505154
tl0.6613300492610839
nl0.44668008048289737
sq0.4393476044852191
no0.37570942111237227
fr0.3381468110709988
it0.3381468110709988
yo0.3251533742331288
tr0.3099121706398996
hr0.29032258064516125
da0.28292046936114734
sv0.2819843342036553
ca0.28104575163398693
cs0.24965893587994542
ro0.233983286908078
sl0.233983286908078
pt0.23076923076923078
ms0.22752808988764048
et0.2231638418079096
az0.20289855072463767
pl0.1863905325443787
es0.15644171779141106
fi0.12
sk0.11575562700964631
de0.1143317230273752
be0.11290322580645161
hu0.1085899513776337
is0.10277324632952692
lt0.10277324632952692
lv0.10277324632952692
uk0.10277324632952692
vi0.10277324632952692
reliabletrue
passestrue
11
name"Marie"
dialogue"Il n’y en a pas d’autre. J’ai eu peur et je suis partie. J’aurais dû rester."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8127035830618893
ca0.6536144578313253
nl0.5563271604938271
it0.5546088303640588
da0.5392628205128205
ro0.5309951060358891
no0.5232172470978441
sl0.5114698385726423
pt0.4888888888888889
hr0.4856887298747764
es0.4739249771271729
sv0.47053406998158376
tl0.46955719557195574
cs0.4529019980970504
sk0.4492337164750958
tr0.4444444444444444
de0.43792766373411535
en0.43792766373411535
et0.42557442557442554
sq0.40166493236212286
lt0.4004171011470281
hu0.3777056277056277
yo0.3722707423580786
ms0.37089715536105033
pl0.36674008810572684
az0.3604004449388209
lv0.32590855803048063
eu0.28125
fi0.27490542244640603
is0.26658163265306123
vi0.10852713178294573
reliabletrue
passestrue
12
name"Hunter"
dialogue"That’s the last one? All right. Don’t delete it."
detectedLang"en"
heavyLang"en"
scores
en0.8336501901140685
tl0.7186495176848874
no0.5394736842105263
sq0.5351925630810093
nl0.48301329394387
yo0.4233937397034596
et0.4067796610169492
it0.4057724957555179
da0.3848857644991213
sv0.38271604938271603
fr0.3027888446215139
de0.29435483870967744
ro0.2886178861788618
hr0.19908466819221968
pl0.19908466819221968
lv0.19724770642201836
hu0.1935483870967742
pt0.18604651162790697
ms0.1822429906542056
sl0.1764705882352941
tr0.1764705882352941
ca0.1606714628297362
es0.1606714628297362
reliabletrue
passestrue
13
name"Marie"
dialogue"Vous pensez qu’elle est en danger ?"
detectedLang"fr"
heavyLang"fr"
scores
fr0.8150887573964498
da0.6355685131195336
no0.6318114874815906
sv0.5535714285714286
nl0.5519713261648745
es0.4802494802494803
ca0.4747899159663866
de0.46351931330472107
it0.46236559139784944
fi0.44812362030905084
et0.43438914027149317
en0.4075829383886255
ro0.4004796163069544
lt0.38271604938271603
is0.34895833333333337
tr0.3055555555555556
tl0.26035502958579887
eu0.23076923076923078
pt0.23076923076923078
sl0.23076923076923078
lv0.22118380062305293
az0.19614147909967844
ms0.19614147909967844
reliabletrue
passestrue
14
name"Hunter"
dialogue"I wish I understood you. I’d like to get someone who speaks French down here."
detectedLang"en"
heavyLang"en"
scores
en0.8245614035087719
tl0.54995499549955
no0.5400183992640295
da0.47145877378435525
cs0.44320712694877507
sv0.4110718492343934
pl0.4040524433849821
sk0.36948297604035313
hr0.33774834437086093
sq0.31880108991825606
yo0.3093922651933701
et0.2877492877492877
it0.2774566473988439
lv0.27007299270072993
es0.26035502958579887
pt0.25484351713859915
lt0.25037481259370314
is0.24585218702865763
ca0.2163009404388715
sl0.19484702093397743
de0.15966386554621848
ro0.15254237288135594
nl0.14383561643835618
be0.12280701754385964
tr0.12280701754385964
hu0.11816578483245149
az0.11190053285968028
uk0.11190053285968028
vi0.11190053285968028
reliabletrue
passestrue
15
name"Marie"
dialogue"Oui, quelqu’un qui parle français. Je peux attendre."
detectedLang"fr"
heavyLang"fr"
scores
fr0.791558103178739
ca0.6412556053811659
it0.6254681647940075
sl0.49238578680203043
no0.4601889338731444
hr0.43741209563994377
de0.42775393419170243
sk0.4177583697234352
cs0.4117647058823529
nl0.39759036144578314
da0.38556067588325654
yo0.37791601866251945
en0.36507936507936506
pl0.3630573248407643
pt0.355877616747182
es0.35275080906148865
sv0.35275080906148865
tr0.3333333333333333
lv0.3265993265993266
ro0.25925925925925924
hu0.25512104283054005
sq0.250936329588015
az0.24953095684803
ms0.23371647509578544
eu0.16666666666666666
tl0.14346895074946467
et0.13606911447084233
lt0.13606911447084233
is0.12854030501089325
reliabletrue
passestrue
16
name"Hunter"
dialogue"That’s my phone. Detective Hunter. … Where? … I’m on my way."
detectedLang"en"
heavyLang"en"
scores
en0.8210526315789475
tl0.6629659000793021
fr0.5186862967157418
ca0.4429882044560944
it0.44152431011826543
sq0.4370860927152318
de0.43333333333333335
nl0.42876344086021506
ro0.4225543478260869
da0.36186186186186187
cs0.3541033434650456
pt0.3541033434650456
es0.2951907131011609
pl0.2928452579034942
sk0.2747440273037543
no0.27101200686106347
hr0.2672413793103448
et0.2659758203799654
fi0.2608695652173913
sv0.24377224199288253
vi0.23835125448028674
sl0.22867513611615245
hi0.1650294695481336
yo0.15
ms0.121900826446281
tr0.121900826446281
reliabletrue
passestrue
17
name"Marie"
dialogue"Qu’est-ce qui se passe ? Vous avez retrouvé la femme ?"
detectedLang"fr"
heavyLang"fr"
scores
fr0.8266146510619853
it0.6644295302013423
ca0.6105160662122687
ro0.5565410199556541
da0.5238095238095238
no0.5012468827930174
pt0.4865211810012837
es0.4838709677419355
sv0.36908517350157727
yo0.332220367278798
fi0.3277310924369748
sq0.3220338983050847
de0.29701230228471004
et0.2857142857142857
en0.2779783393501805
nl0.26199261992619927
cs0.2537313432835821
hr0.24953095684803
sl0.24812030075187969
tl0.17355371900826447
vi0.17355371900826447
is0.13978494623655913
ms0.13978494623655913
reliabletrue
passestrue
18
name"Hunter"
dialogue"I have to go. Please stay here if you can. I’ll send someone to talk to you."
detectedLang"en"
heavyLang"en"
scores
en0.829454253611557
tl0.5925215723873442
da0.4785276073619632
pl0.46473551637279603
cs0.42489851150202973
yo0.41460055096418735
hr0.375
no0.37407952871870404
sv0.358974358974359
sq0.3550834597875569
ca0.3359375
sk0.32432432432432434
ro0.3089430894308943
lv0.30327868852459017
lt0.28209459459459457
tr0.256993006993007
az0.247787610619469
sl0.2216117216117216
it0.21296296296296297
es0.1550695825049702
pt0.1550695825049702
be0.1414141414141414
hu0.1361788617886179
et0.1290983606557377
is0.1290983606557377
uk0.1290983606557377
vi0.1290983606557377
reliabletrue
passestrue
19
name"Marie"
dialogue"Attendez ! Mon appareil… vous voulez la photo ?"
detectedLang"fr"
heavyLang"fr"
scores
fr0.7861842105263158
it0.5740498034076016
en0.5695364238410596
es0.512743628185907
ca0.4992295839753467
tl0.4227353463587922
no0.40909090909090906
da0.3298969072164949
ro0.3285123966942149
hi0.3229166666666667
nl0.3229166666666667
yo0.22062350119904073
de0.21686746987951808
cs0.21307506053268765
pt0.2073170731707317
vi0.20537897310513448
sq0.1935483870967742
lv0.18952618453865336
et0.16666666666666666
sv0.16666666666666666
tr0.16666666666666666
reliabletrue
passestrue
20
name"Hunter"
dialogue"Keep the camera safe. I’ll be back."
detectedLang"en"
heavyLang"en"
scores
en0.8135874067937034
tl0.6256239600665559
yo0.49095022624434387
nl0.4155844155844156
sv0.4155844155844156
it0.412532637075718
ro0.412532637075718
fr0.4063324538258575
ms0.39999999999999997
hu0.34210526315789475
lt0.33234421364985167
ca0.3119266055045872
es0.3055555555555556
no0.296875
da0.25742574257425743
sq0.25742574257425743
de0.24242424242424243
reliabletrue
passestrue