Run: 2026-02-17-01KHNEZ5WZ97J1STMVAV1HB0M5

Run Details

Model:
Arcee AI: Trinity Large (Preview)
Test:
Language Writing
Scenario:
Character dialogue (Spanish) in a story
Duration:
5.6s
Cost:
$0.000000
Provider:
Arcee AI

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Maria"> Maria is a 30-year old college student on a study abroad program. Born in Spain, she is fluent in Spanish and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Spanish, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Maria is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Spanish, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Maria and Hunter as a voice sheet: Maria: "..." Hunter: "..."

Model response

AI
Maria: (looking down at her camera, shaking her head) "No, no, no... esto no puede estar pasando." Hunter: (approaching Maria's table) "Excuse me, miss? I'm Detective Hunter with the Alborn PD. I was hoping I could ask you a few questions about the festival last night." Maria: (looking up, startled) "¿Qué? No hablo inglés." Hunter: (frowning) "I'm sorry, I don't speak Spanish. Do you understand any English?" Maria: (shaking her head) "No, lo siento. No hablo inglés." Hunter: (sighing) "Okay, well, I'm investigating some strange disappearances that happened during the festival. Did you see or hear anything unusual last night?" Maria: (looking troubled) "Sí, vi algo... pero no puedo explicarlo. Fue muy extraño." Hunter: (looking confused) "I'm sorry, I didn't catch that. Did you see something strange?" Maria: (nodding) "Sí, sí, vi algo muy extraño. No puedo explicarlo en inglés." Hunter: (rubbing his temples) "Okay, okay, let's try this. Can you write down what you saw? I can translate it later." Maria: (nodding eagerly) "Sí, sí, puedo hacer eso." Hunter: (handing Maria a notepad and pen) "Great, thank you. I really appreciate your help with this." (Maria starts writing on the notepad while Hunter looks on) (Phone rings) Hunter: (answering the phone) "Hunter. Yeah, I'm on it. Be there in five." (Hangs up) Hunter: (to Maria) "I'm sorry, I have to go. But please, if you think of anything else, give me a call. Here's my card." (Hands Maria his business card) Maria: (taking the card, nodding) "Sí, sí, lo haré. Gracias, Detective." Hunter: (smiling) "Thank you for your help, miss. I'll be in touch." (Hunter walks away as Maria looks down at the card, then back at her camera)
created_at"2026-02-17T09:30:18.799995+00:00" 2/17/2026, 9:30:18 AM
model"arcee-ai/trinity-large-preview:free"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency272
moderation_latency(null)
generation_time5458
tokens_prompt317
tokens_completion471
native_tokens_prompt268
native_tokens_completion452
native_tokens_completion_images(null)
native_tokens_reasoning0
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0
router(null)
provider_responses
0
id"9cf443c6049581c4-IAD"
status200
is_byokfalse
latency173
endpoint_id"239c00d5-c404-4d17-b243-6a645212dc95"
provider_name"Arcee AI"
model_permaslug"arcee-ai/trinity-large-preview"
api_type"completions"
id"gen-1771320612-0E5qFAlX30r6UphcrHqP"
upstream_id"9cf443c6049581c4-IAD"
total_cost0
cache_discount(null)
upstream_inference_cost0
provider_name"Arcee AI"

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Maria"
dialogue"No, no, no... esto no puede estar pasando."
detectedLang"es"
heavyLang"es"
scores
es0.8405103668261563
pt0.7194950911640954
ca0.6472663139329806
tl0.6183206106870229
lv0.5381062355658198
it0.51338199513382
eu0.5085995085995086
en0.494949494949495
hr0.48320413436692505
no0.46949602122015915
pl0.42196531791907516
lt0.37694704049844235
ms0.3265993265993266
sk0.3127147766323024
tr0.3055555555555556
is0.3006993006993007
sv0.2857142857142857
de0.26199261992619927
ro0.26199261992619927
sq0.26199261992619927
reliabletrue
passestrue
1
name"Hunter"
dialogue"Excuse me, miss? I'm Detective Hunter with the Alborn PD. I was hoping I could ask you a few questions about the festival last night."
detectedLang"en"
heavyLang"en"
scores
en0.7928653624856157
tl0.6191282268303004
fr0.5971351835273053
it0.5488721804511278
nl0.513250405624662
pt0.5016611295681063
no0.4972067039106145
ca0.4889267461669506
da0.46619217081850534
ro0.4571773220747889
sq0.44237918215613387
es0.42711648631444943
ms0.40750493745885447
sv0.40476190476190477
cs0.3894165535956581
hr0.36575052854122625
de0.3580599144079886
sl0.3529834651329979
et0.35251798561151076
yo0.34497816593886466
sk0.26229508196721313
pl0.24623115577889448
hu0.24369747899159663
lt0.2314261315115286
az0.21807124239791487
tr0.18625678119349007
fi0.18256130790190736
lv0.17883211678832117
is0.13294797687861273
vi0.1287512100677638
be0.07216494845360825
eu0.07216494845360825
uk0.06542056074766354
reliabletrue
passestrue
2
name"Maria"
dialogue"¿Qué? No hablo inglés."
detectedLang"es"
heavyLang"es"
scores
es0.8115577889447235
pt0.589041095890411
ca0.5867768595041323
tr0.5253164556962026
it0.511400651465798
lv0.46619217081850534
en0.4094488188976378
hu0.40711462450592883
hr0.402390438247012
no0.39271255060728744
sk0.3775933609958506
fr0.3697478991596639
tl0.34782608695652173
et0.33920704845814975
pl0.3333333333333333
reliabletrue
passestrue
3
name"Hunter"
dialogue"I'm sorry, I don't speak Spanish. Do you understand any English?"
detectedLang"en"
heavyLang"en"
scores
en0.8019366197183099
no0.5730550284629982
da0.5643756050338818
sv0.526813880126183
tl0.4845360824742268
cs0.47058823529411764
de0.43820224719101125
pl0.4353826850690088
hr0.4238156209987196
sq0.4238156209987196
ro0.412532637075718
sk0.3943472409152086
ca0.37586685159500693
nl0.3644067796610169
pt0.3626062322946175
it0.32330827067669177
vi0.27884615384615385
yo0.2682926829268293
hu0.23469387755102045
is0.23339011925042585
sl0.21052631578947367
ms0.13793103448275862
be0.1346153846153846
tr0.1346153846153846
az0.12280701754385964
et0.12280701754385964
lt0.12280701754385964
lv0.12280701754385964
uk0.12280701754385964
reliabletrue
passestrue
4
name"Maria"
dialogue"No, lo siento. No hablo inglés."
detectedLang"es"
heavyLang"es"
scores
es0.8180163785259327
pt0.6884735202492211
it0.6774193548387096
ca0.6031746031746031
lt0.5121951219512195
sk0.49238578680203043
tl0.48186528497409326
tr0.453551912568306
yo0.4065281899109792
lv0.3957703927492447
en0.34210526315789475
hu0.33993399339933994
hr0.33554817275747506
no0.3265993265993266
cs0.3197278911564626
vi0.3127147766323024
fr0.3055555555555556
et0.2779783393501805
pl0.2727272727272727
reliabletrue
passestrue
5
name"Hunter"
dialogue"Okay, well, I'm investigating some strange disappearances that happened during the festival. Did you see or hear anything unusual last night?"
detectedLang"en"
heavyLang"en"
scores
en0.8044462741869082
tl0.6650211565585332
fr0.5338567222767419
nl0.504434011476265
no0.4774477447744775
ms0.4629734313171283
da0.45150115473441105
pt0.43720379146919436
et0.41066997518610426
de0.38828074694140374
it0.3811074918566776
sv0.3807040417209909
ca0.3466299862448418
ro0.3457300275482094
es0.34392265193370164
hr0.34210526315789475
sq0.33797909407665505
cs0.33473389355742295
lt0.3060628195763331
sl0.29681717246484085
sk0.2658423493044822
az0.23694779116465864
lv0.22575387123064386
is0.17748917748917747
yo0.16003536693191867
pl0.12923923006416133
fi0.11380597014925374
hu0.06588003933136675
tr0.058473736372646176
reliabletrue
passestrue
6
name"Maria"
dialogue"Sí, vi algo... pero no puedo explicarlo. Fue muy extraño."
detectedLang"es"
heavyLang"es"
scores
es0.8215135649690624
ca0.5824053452115813
pt0.5786516853932584
it0.5013297872340425
en0.4993324432576769
sv0.4377811094452773
ro0.4186046511627907
fr0.40664556962025317
tl0.39222042139384117
nl0.37395659432387307
no0.37290969899665555
sk0.3093922651933701
de0.2829827915869981
yo0.2829827915869981
da0.27466150870406186
lv0.258893280632411
hr0.21218487394957983
vi0.21052631578947367
tr0.19006479481641467
pl0.16666666666666666
sl0.1591928251121076
cs0.15540540540540537
reliabletrue
passestrue
7
name"Hunter"
dialogue"I'm sorry, I didn't catch that. Did you see something strange?"
detectedLang"en"
heavyLang"en"
scores
en0.8121131741821397
tl0.6064814814814815
it0.46741854636591484
da0.44078947368421056
no0.44078947368421056
sv0.41460055096418735
et0.4072524407252441
cs0.38494934876989867
de0.36661698956780925
fr0.36186186186186187
hr0.3491577335375191
pl0.32432432432432434
sq0.3122977346278317
pt0.2951907131011609
nl0.28087986463620984
ro0.2796610169491525
sk0.2735042735042735
ms0.24911660777385158
ca0.24511545293072823
lv0.23835125448028674
is0.23423423423423423
lt0.23423423423423423
tr0.2328519855595668
az0.22303473491773307
sl0.17153996101364524
yo0.169921875
es0.1550695825049702
be0.1414141414141414
hu0.1361788617886179
uk0.1290983606557377
vi0.1290983606557377
reliabletrue
passestrue
8
name"Maria"
dialogue"Sí, sí, vi algo muy extraño. No puedo explicarlo en inglés."
detectedLang"es"
heavyLang"es"
scores
es0.8111425873465533
ca0.6265172735760971
pt0.5967741935483871
fr0.5510662177328844
it0.531615925058548
sv0.5238095238095238
nl0.4851994851994852
en0.48320413436692505
no0.47506561679790027
da0.42028985507246375
ro0.40298507462686567
tr0.3311036789297659
sk0.29577464788732394
de0.27007299270072993
yo0.27007299270072993
sl0.2673992673992674
is0.250936329588015
lv0.24670433145009416
hu0.2047713717693837
hr0.20159680638722555
vi0.2
fi0.17355371900826447
tl0.16666666666666666
et0.16142557651991615
eu0.15789473684210525
pl0.15789473684210525
cs0.14712153518123666
reliabletrue
passestrue
9
name"Hunter"
dialogue"Okay, okay, let's try this. Can you write down what you saw? I can translate it later."
detectedLang"en"
heavyLang"en"
scores
en0.7965738758029979
tl0.575134168157424
no0.4405182567726737
nl0.4391971664698937
ro0.42073170731707316
it0.40624999999999994
da0.38391699092088194
sq0.3807040417209909
ca0.3790849673202614
sv0.37335092348284965
hr0.3683510638297872
pl0.36412315930388217
cs0.33751743375174337
de0.31948424068767906
fr0.31948424068767906
sk0.31358381502890176
lv0.31259044862518093
et0.31059506531204645
tr0.3065693430656934
lt0.2983751846381093
az0.2952522255192878
yo0.2554858934169279
ms0.250788643533123
pt0.24121405750798725
vi0.24121405750798725
sl0.21617161716171615
es0.1394927536231884
hi0.13793103448275862
be0.12844036697247707
eu0.12361623616236161
hu0.12361623616236161
is0.1171003717472119
uk0.1171003717472119
reliabletrue
passestrue
10
name"Maria"
dialogue"Sí, sí, puedo hacer eso."
detectedLang"es"
heavyLang"es"
scores
es0.83991462113127
yo0.6231155778894472
fr0.39999999999999997
ca0.39759036144578314
reliabletrue
passestrue
11
name"Hunter"
dialogue"Great, thank you. I really appreciate your help with this."
detectedLang"en"
heavyLang"en"
scores
en0.829622898682417
tl0.6073298429319371
it0.507227332457293
ro0.484181568088033
cs0.3961352657004831
ms0.3644067796610169
ca0.358974358974359
vi0.3567753001715266
no0.35233160621761656
sq0.35233160621761656
hr0.35008665511265163
da0.34554973821989526
pl0.3397887323943662
es0.3119266055045872
pt0.30037313432835816
tr0.2816091954022989
et0.27184466019417475
sk0.2704280155642024
sv0.2690058479532163
az0.251497005988024
lt0.251497005988024
lv0.251497005988024
fr0.20886075949367086
yo0.1883116883116883
be0.15730337078651685
hu0.1515837104072398
de0.14383561643835618
is0.14383561643835618
sl0.14383561643835618
uk0.14383561643835618
nl0.1359447004608295
reliabletrue
passestrue
12
name"Hunter"
dialogue"Hunter. Yeah, I'm on it. Be there in five."
detectedLang"en"
heavyLang"en"
scores
en0.8232647814910027
de0.6002906976744186
yo0.5592948717948718
tl0.5378151260504201
sq0.44779116465863456
nl0.4433198380566802
sl0.4364754098360656
it0.43298969072164945
ro0.4222689075630252
fr0.39692982456140347
sv0.39159292035398224
pl0.3792325056433409
ca0.3648960739030023
et0.358974358974359
fi0.3529411764705882
ms0.3276283618581907
hu0.298469387755102
lt0.289405684754522
hr0.24242424242424243
lv0.23822714681440443
az0.233983286908078
hi0.233983286908078
da0.22969187675070027
no0.22096317280453256
cs0.21428571428571427
sk0.21428571428571427
pt0.1863905325443787
tr0.17664670658682635
reliabletrue
passestrue
13
name"Hunter"
dialogue"I'm sorry, I have to go. But please, if you think of anything else, give me a call. Here's my card."
detectedLang"en"
heavyLang"en"
scores
en0.8235755358076321
tl0.6100519930675911
da0.4951383694839192
cs0.4734789391575663
pl0.45608380338436744
yo0.4412251655629139
no0.4298986486486487
sk0.42748091603053434
nl0.4026548672566372
sq0.4021257750221435
it0.3835616438356164
hr0.3522072936660269
ro0.3276892430278885
pt0.3270189431704885
es0.31402439024390244
sv0.3084016393442623
sl0.30698151950718683
fr0.3048403707518023
ca0.2887249736564805
lv0.2741935483870968
lt0.2694805194805195
is0.2516629711751663
ms0.25
hu0.24832962138084633
et0.24665178571428573
de0.1818181818181818
tr0.17883211678832117
fi0.16974169741697415
az0.1646039603960396
vi0.1646039603960396
be0.09395973154362416
eu0.09395973154362416
uk0.08536585365853659
reliabletrue
passestrue
14
name"Maria"
dialogue"Sí, sí, lo haré. Gracias, Detective."
detectedLang"es"
heavyLang"es"
scores
es0.7752247752247753
ca0.6656760772659733
pt0.6370967741935484
en0.5746691871455577
it0.5697896749521989
fr0.560546875
yo0.5588235294117647
ro0.5283018867924528
tl0.5033112582781457
cs0.39999999999999997
is0.30769230769230765
pl0.30769230769230765
sq0.29245283018867924
vi0.2879746835443038
da0.27184466019417475
de0.27184466019417475
nl0.267100977198697
no0.26229508196721313
hr0.22945205479452058
sl0.22945205479452058
sv0.22945205479452058
reliabletrue
passestrue
15
name"Hunter"
dialogue"Thank you for your help, miss. I'll be in touch."
detectedLang"en"
heavyLang"en"
scores
en0.8197115384615384
tl0.5978552278820375
yo0.39759036144578314
da0.3464052287581699
no0.34497816593886466
nl0.34210526315789475
sl0.33920704845814975
ms0.33774834437086093
de0.3288590604026846
it0.3288590604026846
vi0.3258426966292135
ro0.3212669683257918
hu0.2805755395683453
fr0.27184466019417475
lt0.27184466019417475
sv0.2628992628992629
pt0.2227979274611399
az0.21875
pl0.21875
cs0.20634920634920634
reliabletrue
passestrue