Run: 2026-02-17-01KHNG5REFAB4BPV3C11VA7A8H

Run Details

Model:
Arcee AI: Trinity Large (Preview)
Test:
Language Writing
Scenario:
Character dialogue (Spanish) in a story
Duration:
12.4s
Cost:
$0.000000
Provider:
Arcee AI

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Maria"> Maria is a 30-year old college student on a study abroad program. Born in Spain, she is fluent in Spanish and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Spanish, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Maria is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Spanish, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Maria and Hunter as a voice sheet: Maria: "..." Hunter: "..."

Model response

AI
Maria: (Looking at her camera, lost in thought) "Ay, Dios mío... ¿Qué está pasando aquí? ¿Por qué están desapareciendo tantas personas?" (Oh my God... What's happening here? Why are so many people disappearing?) Hunter: (Approaching Maria) "Excuse me, miss. I'm Detective Hunter. I'm investigating the recent disappearances in town. Do you have any information that might help?" Maria: (Startled, looks up at Hunter) "¿Qué? ¿Qué está diciendo?" (What? What are you saying?) Hunter: (Confused) "I'm sorry, I don't understand. Do you speak English?" Maria: (Realizing the language barrier, shakes her head) "No, lo siento. No hablo inglés." (No, I'm sorry. I don't speak English.) Hunter: (Sighs, tries to communicate through gestures) "Disappeared... people... missing... you see anything?" Maria: (Nods, understanding his gestures) "Sí, sí. Vi algo extraño anoche. Un hombre... desapareció." (Yes, yes. I saw something strange last night. A man... disappeared.) Hunter: (Excited, pulls out his notebook) "What did you see? Can you describe it?" Maria: (Nervously, in Spanish) "Fue muy extraño. El hombre estaba caminando por la calle, y de repente, desapareció. Como si se hubiera desvanecido en el aire." (It was very strange. The man was walking down the street, and suddenly, he disappeared. As if he had vanished into thin air.) Hunter: (Looking confused, shakes his head) "I'm sorry, I still don't understand. Is there someone who can translate?" Maria: (Shrugs, looking troubled) "No lo sé. No entiendo por qué esto está sucediendo." (I don't know. I don't understand why this is happening.) (Hunter's phone rings. He answers it, listens for a moment, then hangs up.) Hunter: (To Maria) "I'm sorry, I have to go. But I'll be back. Can you stay here? I'll find someone to translate." Maria: (Nods, looking worried) "Sí, estaré aquí. Por favor, encuentre la verdad." (Yes, I'll be here. Please, find the truth.) Hunter: (Nods, then leaves the cafe)
created_at"2026-02-17T09:51:29.723789+00:00" 2/17/2026, 9:51:29 AM
model"arcee-ai/trinity-large-preview:free"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency268
moderation_latency(null)
generation_time12312
tokens_prompt317
tokens_completion532
native_tokens_prompt268
native_tokens_completion512
native_tokens_completion_images(null)
native_tokens_reasoning0
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0
router(null)
provider_responses
0
id"9cf462a310d5c99b-IAD"
status200
is_byokfalse
latency166
endpoint_id"239c00d5-c404-4d17-b243-6a645212dc95"
provider_name"Arcee AI"
model_permaslug"arcee-ai/trinity-large-preview"
api_type"completions"
id"gen-1771321876-oZnyo0XGJhvEGoMujWFF"
upstream_id"9cf462a310d5c99b-IAD"
total_cost0
cache_discount(null)
upstream_inference_cost0
provider_name"Arcee AI"

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Maria"
dialogue"Ay, Dios mío... ¿Qué está pasando aquí? ¿Por qué están desapareciendo tantas personas?"
detectedLang"es"
heavyLang"es"
scores
es0.8031496062992126
pt0.7039827771797632
ca0.5820668693009119
tl0.494485294117647
it0.4816211121583412
lt0.4575936883629191
ms0.4364754098360656
lv0.4264859228362878
sq0.38752783964365256
sv0.358974358974359
et0.32926829268292684
tr0.30203045685279184
cs0.289405684754522
ro0.28756476683937826
sk0.28756476683937826
en0.28664072632944226
de0.2838541666666667
hu0.25876010781671155
eu0.25271739130434784
fr0.22644163150492264
az0.21763869132290184
nl0.21652421652421652
no0.19941775836972345
da0.19825072886297376
pl0.19117647058823528
is0.18154761904761904
hr0.09688013136288999
reliabletrue
passestrue
1
name"Hunter"
dialogue"Excuse me, miss. I'm Detective Hunter. I'm investigating the recent disappearances in town. Do you have any information that might help?"
detectedLang"en"
heavyLang"en"
scores
en0.8047298763289217
tl0.6527777777777778
fr0.6392785571142284
nl0.5839112343966713
pt0.5702005730659025
ro0.5372750642673522
sv0.5346432264736298
da0.533678756476684
it0.5205114544485883
de0.517426273458445
ca0.5150862068965517
no0.47765525246662793
sq0.4746059544658494
sl0.4727592267135325
es0.4498777506112469
cs0.438552713661884
ms0.4043679682329583
hr0.39759036144578314
sk0.38313913639479097
yo0.3653032440056418
pl0.3348115299334811
et0.27768860353130015
lt0.27184466019417475
az0.267100977198697
lv0.24114671163575044
fi0.1935483870967742
is0.13294797687861273
eu0.12959381044487428
tr0.12536443148688048
vi0.10979228486646886
zh0.07881269191402251
hu0.06542056074766354
reliabletrue
passestrue
2
name"Maria"
dialogue"¿Qué? ¿Qué está diciendo?"
detectedLang"es"
heavyLang"es"
scores
es0.829738933030647
pt0.7169811320754716
it0.5912806539509536
ca0.43396226415094336
cs0.3670886075949367
et0.33920704845814975
fr0.33920704845814975
nl0.33920704845814975
sk0.33920704845814975
reliabletrue
passestrue
3
name"Hunter"
dialogue"I'm sorry, I don't understand. Do you speak English?"
detectedLang"en"
heavyLang"en"
scores
en0.7994652406417112
no0.5828698553948832
da0.5772266065388951
tl0.5300751879699248
sv0.5288944723618091
cs0.5161290322580645
pl0.4806094182825485
hr0.4688385269121813
sk0.438622754491018
de0.4140625
pt0.40570522979397783
sq0.4009584664536741
ro0.3862520458265139
it0.3644067796610169
nl0.3218806509945751
vi0.3169398907103825
yo0.3055555555555556
ca0.2690058479532163
is0.267578125
sl0.24242424242424243
ms0.1610738255033557
be0.15730337078651685
tr0.15730337078651685
hu0.1515837104072398
az0.14383561643835618
et0.14383561643835618
lt0.14383561643835618
lv0.14383561643835618
uk0.14383561643835618
reliabletrue
passestrue
4
name"Maria"
dialogue"No, lo siento. No hablo inglés."
detectedLang"es"
heavyLang"es"
scores
es0.8180163785259327
pt0.6884735202492211
it0.6774193548387096
ca0.6031746031746031
lt0.5121951219512195
sk0.49238578680203043
tl0.48186528497409326
tr0.453551912568306
yo0.4065281899109792
lv0.3957703927492447
en0.34210526315789475
hu0.33993399339933994
hr0.33554817275747506
no0.3265993265993266
cs0.3197278911564626
vi0.3127147766323024
fr0.3055555555555556
et0.2779783393501805
pl0.2727272727272727
reliabletrue
passestrue
5
name"Hunter"
dialogue"Disappeared... people... missing... you see anything?"
detectedLang"en"
heavyLang"en"
scores
en0.8146035367940673
tl0.5343839541547278
ms0.46808510638297873
nl0.46369636963696376
et0.4196428571428571
is0.3186582809224318
it0.3186582809224318
fr0.3143459915611814
da0.2995689655172413
eu0.2995689655172413
sq0.23529411764705882
sv0.22802850356294538
no0.2034313725490196
cs0.1935483870967742
fi0.1935483870967742
ca0.181360201511335
de0.181360201511335
az0.16666666666666666
pt0.16666666666666666
reliabletrue
passestrue
6
name"Maria"
dialogue"Sí, sí. Vi algo extraño anoche. Un hombre... desapareció."
detectedLang"es"
heavyLang"es"
scores
es0.7927031509121061
ca0.6727748691099475
pt0.5398773006134969
fr0.5370370370370371
it0.5347394540942928
yo0.4038155802861685
ro0.37810945273631835
sv0.37080536912751677
lv0.3081180811808118
de0.3042671614100185
sk0.3029739776951673
en0.29775280898876405
da0.27466150870406186
no0.251497005988024
vi0.21052631578947367
hu0.20886075949367086
eu0.19700214132762314
tl0.19700214132762314
nl0.17943107221006563
ms0.17035398230088497
tr0.17035398230088497
cs0.15540540540540537
reliabletrue
passestrue
7
name"Hunter"
dialogue"What did you see? Can you describe it?"
detectedLang"en"
heavyLang"en"
scores
en0.8343151693667158
es0.5738636363636364
ca0.44168734491315137
et0.43037974683544306
tl0.4063324538258575
pt0.31402439024390244
ro0.31402439024390244
lv0.27652733118971057
sq0.27652733118971057
cs0.25742574257425743
az0.2549668874172185
tr0.2549668874172185
yo0.2524916943521595
fr0.2474916387959866
it0.2474916387959866
reliabletrue
passestrue
8
name"Maria"
dialogue"Fue muy extraño. El hombre estaba caminando por la calle, y de repente, desapareció. Como si se hubiera desvanecido en el aire."
detectedLang"es"
heavyLang"es"
scores
es0.8243559718969555
ca0.6702088677171125
pt0.6698459280997798
it0.5802238805970149
ro0.5647969052224371
fr0.5588235294117647
sq0.4495412844036697
tl0.4409937888198758
da0.4260204081632653
no0.4182288299935359
sk0.4027869940278699
en0.3856655290102389
eu0.3635077793493635
sv0.3576017130620985
nl0.34782608695652173
de0.3343195266272189
yo0.3161094224924012
tr0.28514694201747415
cs0.2647058823529412
hu0.2628992628992629
sl0.26108374384236455
fi0.2474916387959866
hr0.18330308529945552
pl0.17883211678832117
et0.16974169741697415
vi0.16820702402957485
lt0.1420400381315539
ms0.1346153846153846
is0.12959381044487428
lv0.07312049433573636
az0.06542056074766354
reliabletrue
passestrue
9
name"Hunter"
dialogue"I'm sorry, I still don't understand. Is there someone who can translate?"
detectedLang"en"
heavyLang"en"
scores
en0.8095065312046444
no0.5599329421626152
da0.5295698924731184
sv0.512987012987013
de0.4902912621359223
nl0.470766129032258
it0.4444444444444444
tl0.421806167400881
is0.4160177975528365
sq0.4061085972850679
hr0.3958573072497123
ro0.38668224299065423
ca0.3558282208588957
pl0.3429286608260325
pt0.32950191570881227
cs0.3208279430789133
sk0.29906542056074764
hu0.29624664879356566
tr0.2857142857142857
yo0.2827868852459016
az0.27486187845303867
lt0.27285318559556787
lv0.27285318559556787
es0.22794117647058826
vi0.22337278106508876
et0.18856259659969088
fr0.13223140495867766
be0.11764705882352942
eu0.11317567567567569
uk0.10714285714285714
ms0.10102739726027396
sl0.10102739726027396
reliabletrue
passestrue
10
name"Maria"
dialogue"No lo sé. No entiendo por qué esto está sucediendo."
detectedLang"es"
heavyLang"es"
scores
es0.8258306538049303
pt0.74
ca0.6065375302663438
it0.5504840940525588
fr0.4227353463587922
yo0.40693430656934304
en0.375
sk0.34077079107505076
lv0.2872807017543859
sq0.2857142857142857
is0.27455357142857145
hr0.23708920187793428
ro0.2316784869976359
no0.22985781990521328
fi0.21875
vi0.21875
tr0.21307506053268765
cs0.2111650485436893
tl0.19753086419753088
et0.19154228855721395
nl0.19154228855721395
pl0.1875
reliabletrue
passestrue
11
name"Hunter"
dialogue"I'm sorry, I have to go. But I'll be back. Can you stay here? I'll find someone to translate."
detectedLang"en"
heavyLang"en"
scores
en0.8100578871201157
tl0.5830023828435266
da0.512987012987013
pl0.4553941908713693
yo0.43910256410256415
hr0.4281045751633987
no0.42748091603053434
cs0.41536748329621387
it0.4020501138952164
lt0.39724454649827784
sq0.36823104693140796
ca0.3558282208588957
sk0.3371212121212121
pt0.32950191570881227
ro0.3286445012787723
lv0.32432432432432434
tr0.2857142857142857
az0.27486187845303867
sv0.27285318559556787
hu0.2595204513399154
sl0.25531914893617025
fr0.24242424242424243
es0.22794117647058826
vi0.22337278106508876
et0.18856259659969088
be0.11764705882352942
de0.11317567567567569
eu0.11317567567567569
is0.10714285714285714
nl0.10714285714285714
uk0.10714285714285714
ms0.10102739726027396
reliabletrue
passestrue
12
name"Maria"
dialogue"Sí, estaré aquí. Por favor, encuentre la verdad."
detectedLang"es"
heavyLang"es"
scores
es0.8131340096102511
ca0.7543859649122807
pt0.6694995278564685
it0.5818399044205496
fr0.5726495726495726
ro0.5478036175710594
sq0.49275362318840576
no0.41471571906354515
en0.4077834179357022
yo0.4067796610169492
nl0.328214971209213
da0.3110236220472441
eu0.24406047516198706
az0.20634920634920634
tl0.1935483870967742
tr0.1935483870967742
vi0.1935483870967742
de0.18604651162790697
cs0.1822429906542056
sl0.1566265060240964
sv0.1566265060240964
reliabletrue
passestrue