Run: 2026-02-17-01KHNFSRSFQTM1ZVXXZN15QGM9

Run Details

Model:
Arcee AI: Trinity Large (Preview)
Test:
Language Writing
Scenario:
Character dialogue (French) in a story
Duration:
6.7s
Cost:
$0.000000
Provider:
Arcee AI

Evaluation summary

Score Evaluator
Details Link
77.78% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Marie"> Marie is a 30-year old college student on a study abroad program. Born in France, she is fluent in French and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of French, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Marie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in French, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Marie and Hunter as a voice sheet: Marie: "..." Hunter: "..."

Model response

AI
Marie: "Oh, hello. I'm sorry, I don't speak English very well. Parlez-vous français?" Hunter: "Uh, no. I don't speak French. I'm Detective Hunter. I'm investigating the recent disappearances in town. Can you tell me what you saw the night of the festival?" Marie: "Je suis désolée, I don't understand. The night of the festival, I was taking photos. I saw... I don't know the word in English. Il y avait quelque chose de bizarre." Hunter: "Something strange? Can you describe it?" Marie: "Oui, c'était... Comment dire? C'était une silhouette sombre. Je n'ai pas pu voir le visage. C'était effrayant." Hunter: "A dark figure? You couldn't see the face? That is scary. Did you get a photo of it?" Marie: "Oui, j'ai pris une photo. Attendez, je vais vous montrer." Hunter: "Okay, let me see... Hmm, this is interesting. The figure is blurry, but it looks like... Hold on, I'm getting a call. I have to go, but I'll be in touch. Merci, Marie." Marie: "De rien, Detective. Au revoir."
created_at"2026-02-17T09:44:51.201814+00:00" 2/17/2026, 9:44:51 AM
model"arcee-ai/trinity-large-preview:free"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency396
moderation_latency(null)
generation_time6645
tokens_prompt316
tokens_completion264
native_tokens_prompt268
native_tokens_completion266
native_tokens_completion_images(null)
native_tokens_reasoning0
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0
router(null)
provider_responses
0
id"9cf4590bb119c977-IAD"
status200
is_byokfalse
latency289
endpoint_id"239c00d5-c404-4d17-b243-6a645212dc95"
provider_name"Arcee AI"
model_permaslug"arcee-ai/trinity-large-preview"
api_type"completions"
id"gen-1771321484-7Kgo0r2bUIvw04Ij2Y9A"
upstream_id"9cf4590bb119c977-IAD"
total_cost0
cache_discount(null)
upstream_inference_cost0
provider_name"Arcee AI"

Evaluation details

Result Evaluator Details Meta Data
77.78% Parse dialogue n/a
dialogue
0
name"Marie"
dialogue"Oh, hello. I'm sorry, I don't speak English very well. Parlez-vous français?"
detectedLang"en"
heavyLang"en"
scores
en0.7244094488188976
tl0.541083916083916
fr0.5253164556962026
it0.4892996108949417
no0.4659206510681587
da0.45426195426195426
sv0.4491080797481637
ca0.4385026737967915
hr0.4006849315068493
pt0.3794326241134752
ro0.3651753325272068
de0.35503685503685506
sq0.3379571248423708
nl0.33375634517766495
pl0.33375634517766495
cs0.3119266055045872
sk0.2895805142083897
es0.2837653478854025
hu0.279835390946502
is0.2738589211618257
az0.27184466019417475
ms0.2698191933240611
tr0.2677824267782427
lv0.2563739376770538
yo0.24132947976878616
sl0.2081447963800905
et0.1935483870967742
lt0.1935483870967742
fi0.15048543689320387
eu0.13223140495867766
be0.11764705882352942
uk0.10714285714285714
vi0.10714285714285714
reliabletrue
passesfalse
1
name"Hunter"
dialogue"Uh, no. I don't speak French. I'm Detective Hunter. I'm investigating the recent disappearances in town. Can you tell me what you saw the night of the festival?"
detectedLang"en"
heavyLang"en"
scores
en0.8014335528864781
tl0.6499316939890711
fr0.5707705192629816
pt0.5606515216459493
it0.5604631217838766
nl0.5558925476603119
ca0.5458573327425786
no0.5272140221402214
ro0.5196813495782567
es0.49357707509881427
sv0.48048656867714135
da0.4553666312433581
ms0.44654427645788336
hr0.4305555555555555
sq0.42577030812324934
de0.4231851435002813
sl0.42057659694742794
cs0.41159586681974747
sk0.35696361355081563
yo0.3139223560910308
az0.30976430976430974
pl0.28918169209431344
et0.28521617852161785
lv0.2812061711079944
lt0.2694226657163222
tr0.22289613343442002
is0.220532319391635
fi0.16121112929623568
hu0.11561691113028472
be0.0639269406392694
uk0.057904411764705885
vi0.057904411764705885
reliabletrue
passestrue
2
name"Marie"
dialogue"Je suis désolée, I don't understand. The night of the festival, I was taking photos. I saw... I don't know the word in English. Il y avait quelque chose de bizarre."
detectedLang"en"
heavyLang"en"
scores
en0.7538764459758799
fr0.7022923489133671
nl0.5680345572354212
tl0.5400183992640295
no0.5389580451821115
de0.5313964386129335
da0.49238578680203043
sv0.47616553169198533
it0.45085118066996155
yo0.44842801985659125
ro0.423963133640553
sq0.405116002379536
pl0.3950393224440411
ca0.3943064809206541
es0.37146448774355756
sl0.36908517350157727
hr0.36828806064434616
ms0.36183790682833444
cs0.34340118187787255
pt0.33377748167888077
sk0.3311036789297659
az0.30699930699930694
tr0.25261584454409564
is0.22898997686969932
lt0.21197793538219067
et0.20382165605095542
hu0.18765231519090173
lv0.164578111946533
vi0.13867355727820846
fi0.12510936132983377
hi0.07149489322191271
be0.06542056074766354
eu0.06542056074766354
uk0.059266227657572904
reliabletrue
passesfalse
3
name"Hunter"
dialogue"Something strange? Can you describe it?"
detectedLang"en"
heavyLang"en"
scores
en0.8181216931216932
es0.5807926829268293
tl0.5807926829268293
fr0.44889779559118237
da0.416135881104034
no0.40860215053763443
pt0.39692982456140347
ca0.39293598233995586
ro0.39293598233995586
de0.3834080717488789
nl0.3764172335600907
cs0.3692660550458715
it0.36342592592592593
lv0.36194895591647336
sq0.34523809523809523
ms0.33894230769230765
az0.3309002433090025
tr0.3309002433090025
hr0.2445054945054945
sk0.24242424242424243
sl0.24242424242424243
pl0.22096317280453256
yo0.21652421652421652
sv0.207492795389049
is0.19590643274853803
lt0.19590643274853803
et0.17664670658682635
reliabletrue
passestrue
4
name"Marie"
dialogue"Oui, c'était... Comment dire? C'était une silhouette sombre. Je n'ai pas pu voir le visage. C'était effrayant."
detectedLang"fr"
heavyLang"fr"
scores
fr0.7919556171983356
it0.49324324324324326
nl0.44237918215613387
tl0.4350282485875706
yo0.3670886075949367
de0.36507936507936506
en0.34994582881906827
ca0.3464052287581699
sl0.3258426966292135
hu0.3181818181818182
es0.2831541218637993
hr0.2805755395683453
cs0.25925925925925924
sk0.25742574257425743
lt0.25
ro0.24623115577889448
no0.24433249370277077
sq0.24146649810366622
da0.22580645161290325
sv0.2197659297789337
pl0.20844327176781002
lv0.14772727272727273
ms0.12280701754385964
tr0.12023460410557184
et0.11242603550295857
az0.09502262443438914
reliabletrue
passestrue
5
name"Hunter"
dialogue"A dark figure? You couldn't see the face? That is scary. Did you get a photo of it?"
detectedLang"en"
heavyLang"en"
scores
en0.818213296398892
fr0.5856353591160222
tl0.5434782608695653
yo0.5047169811320754
ro0.4755244755244755
nl0.4553941908713693
is0.4040862656072645
no0.38452520515826494
sq0.373508353221957
hu0.37125748502994016
cs0.362089914945322
pt0.3526510480887793
it0.34944237918215615
et0.3073878627968338
da0.29435483870967744
de0.29435483870967744
ca0.2886178861788618
es0.2768595041322314
lv0.2290748898678414
ms0.21171171171171171
sv0.21171171171171171
sk0.1984732824427481
hr0.1758241758241758
pl0.16666666666666666
sl0.14634146341463414
lt0.13509060955518945
hi0.12790697674418602
tr0.12790697674418602
az0.11764705882352942
eu0.11764705882352942
vi0.11764705882352942
fi0.10714285714285714
reliabletrue
passestrue
6
name"Marie"
dialogue"Oui, j'ai pris une photo. Attendez, je vais vous montrer."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8145204027556969
en0.5483870967741935
no0.44178628389154706
it0.4186046511627907
es0.40273037542662116
cs0.40170940170940167
da0.4006849315068493
de0.3996569468267582
hr0.396551724137931
yo0.38811188811188807
ca0.3848857644991213
tl0.38271604938271603
nl0.36823104693140796
sk0.36823104693140796
sv0.36479128856624315
sl0.33078393881453155
pt0.3027888446215139
tr0.26160337552742613
pl0.20634920634920634
hi0.18032786885245902
lv0.1784037558685446
et0.1566265060240964
fi0.14425427872860636
ro0.14425427872860636
sq0.14425427872860636
reliabletrue
passestrue
7
name"Hunter"
dialogue"Okay, let me see... Hmm, this is interesting. The figure is blurry, but it looks like... Hold on, I'm getting a call. I have to go, but I'll be in touch. Merci, Marie."
detectedLang"en"
heavyLang"en"
scores
en0.7952917093142272
tl0.5888157894736842
it0.5592772146319965
no0.5333644423705086
fr0.5329285380663241
da0.5224450811843362
yo0.5143273433705683
ro0.49974987493746875
pl0.48480164863472436
nl0.46207638515330823
sl0.45593035908596297
ca0.4520547945205479
sq0.44536882972823066
cs0.43438914027149317
pt0.4308480364257257
sv0.42954934398174555
hr0.4262765347102696
es0.4075829383886255
et0.4040524433849821
de0.3950393224440411
lt0.39172749391727496
hu0.38537185003073143
ms0.3710691823899371
lv0.36020473448496476
sk0.35358758888170655
fi0.29676511954992973
is0.2753623188405797
tr0.22360248447204967
eu0.22178988326848248
az0.22118380062305293
vi0.1638795986622074
hi0.07749077490774908
be0.06542056074766354
uk0.059266227657572904
reliabletrue
passestrue
8
name"Marie"
dialogue"De rien, Detective. Au revoir."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8003992015968064
ro0.7652582159624414
en0.6835443037974683
ca0.6649916247906198
es0.6649916247906198
pt0.6575342465753424
tl0.6023856858846919
nl0.6
da0.5726495726495726
no0.5594713656387665
it0.5454545454545454
sq0.5249406175771971
sv0.47506561679790027
de0.4301994301994302
cs0.4065281899109792
hr0.39759036144578314
sl0.39759036144578314
tr0.3288590604026846
hu0.3265993265993266
yo0.3197278911564626
eu0.25925925925925924
sk0.24528301886792453
az0.23954372623574144
ms0.23954372623574144
reliabletrue
passestrue