Run: 2026-02-17-01KHNFK7CJE77TSFPG3QH2BVAG

Run Details

Model:
Arcee AI: Trinity Mini
Test:
Language Writing
Scenario:
Character dialogue (Spanish) in a story
Duration:
3.2s
Cost:
$0.000117
Provider:
Clarifai

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Maria"> Maria is a 30-year old college student on a study abroad program. Born in Spain, she is fluent in Spanish and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Spanish, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Maria is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Spanish, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Maria and Hunter as a voice sheet: Maria: "..." Hunter: "..."

Model response

AI
Maria: "Los desaparecimientos... están haciendo que todo el mundo teme. Hoy, no puedo tomar fotos como antes." Hunter: "I'm sorry, I don't understand Spanish." Maria: "¡Por favor, no me dejes aquí solo! Quiero ayudar, pero no sé cómo." Hunter: "I'm not following you. What are you trying to say?" Maria: "No entiendo... ¿Dónde está mi familia? ¿Y los otros?" Hunter: "I need to take this call."
created_at"2026-02-17T09:41:13.460115+00:00" 2/17/2026, 9:41:13 AM
model"arcee-ai/trinity-mini-20251201"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency55
moderation_latency(null)
generation_time3170
tokens_prompt317
tokens_completion806
native_tokens_prompt269
native_tokens_completion696
native_tokens_completion_images(null)
native_tokens_reasoning692
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0.000116505
router(null)
provider_responses
0
id"187beb8b61c64c02902984bb94485bc6"
status200
is_byokfalse
latency55
endpoint_id"73d82c49-90ae-4223-a860-83ed0810821f"
provider_name"Clarifai"
model_permaslug"arcee-ai/trinity-mini-20251201"
api_type"completions"
id"gen-1771321269-sFr11p8xej8MoZrkwRxM"
upstream_id"187beb8b61c64c02902984bb94485bc6"
total_cost0.000116505
cache_discount(null)
upstream_inference_cost0
provider_name"Clarifai"

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Maria"
dialogue"Los desaparecimientos... están haciendo que todo el mundo teme. Hoy, no puedo tomar fotos como antes."
detectedLang"es"
heavyLang"es"
scores
es0.8201438848920863
pt0.7400501972032987
ca0.6312309257375381
tl0.4105691056910569
fr0.36514886164623467
it0.3623570800351803
lt0.36179577464788737
pl0.3444846292947558
de0.3336397058823529
hu0.32808155699721964
sk0.318609022556391
lv0.2676767676767676
en0.2579324462640737
ro0.25564681724846
tr0.24479166666666666
no0.24083769633507857
cs0.240041928721174
sv0.2352320675105485
da0.22954303931987244
nl0.22542735042735043
eu0.21621621621621623
hr0.1881298992161254
sq0.18539325842696627
et0.16184971098265896
fi0.09600997506234414
ms0.09600997506234414
is0.08919597989949749
sl0.0845959595959596
az0.07525510204081631
reliabletrue
passestrue
1
name"Hunter"
dialogue"I'm sorry, I don't understand Spanish."
detectedLang"en"
heavyLang"en"
scores
en0.786158631415241
no0.6549560853199498
da0.6501272264631043
sv0.609375
de0.5036101083032491
nl0.48405253283302063
tl0.47115384615384615
ro0.4701348747591522
it0.4387755102040817
sq0.4376278118609407
pl0.4258872651356994
cs0.4073275862068965
sk0.3692660550458715
hr0.3357487922705314
ca0.3341404358353511
hu0.3341404358353511
is0.3325242718446602
pt0.26666666666666666
yo0.2403314917127072
be0.20289855072463767
tr0.20289855072463767
az0.1863905325443787
et0.1863905325443787
lt0.1863905325443787
lv0.1863905325443787
uk0.1863905325443787
vi0.1863905325443787
reliabletrue
passestrue
2
name"Maria"
dialogue"¡Por favor, no me dejes aquí solo! Quiero ayudar, pero no sé cómo."
detectedLang"es"
heavyLang"es"
scores
es0.8060344827586207
ca0.6031746031746031
pt0.5778611632270169
it0.5495495495495496
sq0.4325346784363178
en0.3697478991596639
no0.35988620199146515
tl0.34971098265895956
sl0.3382352941176471
fr0.265905383360522
pl0.2647058823529412
nl0.24874791318864775
lv0.225473321858864
is0.21465968586387435
hr0.18330308529945552
et0.17431192660550457
sk0.16820702402957485
tr0.16356877323420074
yo0.16044776119402984
ms0.15730337078651685
fi0.14285714285714285
ro0.13793103448275862
da0.1262135922330097
sv0.1262135922330097
reliabletrue
passestrue
3
name"Hunter"
dialogue"I'm not following you. What are you trying to say?"
detectedLang"en"
heavyLang"en"
scores
en0.84
tl0.6742671009771987
cs0.4106090373280943
ro0.33035714285714285
yo0.3135011441647597
pl0.3103448275862069
sk0.3055555555555556
lv0.2890995260663507
sl0.28741092636579574
hr0.27884615384615385
no0.2665036674816626
da0.25742574257425743
lt0.25742574257425743
it0.20634920634920634
nl0.20634920634920634
tr0.20634920634920634
reliabletrue
passestrue
4
name"Maria"
dialogue"No entiendo... ¿Dónde está mi familia? ¿Y los otros?"
detectedLang"es"
heavyLang"es"
scores
es0.8225272124940841
pt0.6770025839793281
ca0.6355685131195336
it0.5421245421245421
fr0.5198463508322664
en0.4230769230769231
pl0.4075829383886255
sk0.39999999999999997
ro0.38825448613376834
sl0.35344827586206895
hr0.3231046931407942
no0.3181818181818182
cs0.31066176470588236
tr0.29906542056074764
sv0.28435114503816794
nl0.2829827915869981
de0.27884615384615385
tl0.2732558139534884
lv0.258893280632411
vi0.20718816067653278
fi0.19527896995708155
lt0.19006479481641467
yo0.19006479481641467
hu0.1847826086956522
sq0.17943107221006563
da0.1758241758241758
et0.17035398230088497
eu0.1591928251121076
reliabletrue
passestrue
5
name"Hunter"
dialogue"I need to take this call."
detectedLang"en"
heavyLang"en"
scores
en0.8421052631578948
tl0.6945010183299388
pl0.635036496350365
hr0.6296296296296297
no0.6287128712871286
da0.6183206106870229
cs0.6113989637305699
yo0.5989304812834225
sk0.576271186440678
et0.5738636363636364
sl0.5702005730659025
lv0.5522388059701493
lt0.526813880126183
ca0.4791666666666667
sv0.4791666666666667
sq0.471830985915493
it0.43396226415094336
ro0.375
be0.3181818181818182
tr0.3181818181818182
hu0.3087557603686636
az0.29577464788732394
is0.29577464788732394
uk0.29577464788732394
vi0.29577464788732394
reliabletrue
passestrue