Run: 2026-02-17-01KHNFC8493G9BNCWZN1P6CC1J

Run Details

Model:
Arcee AI: Trinity Mini
Test:
Language Writing
Scenario:
Character dialogue (French) in a story
Duration:
5.8s
Cost:
$0.000202
Provider:
Clarifai

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Marie"> Marie is a 30-year old college student on a study abroad program. Born in France, she is fluent in French and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of French, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Marie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in French, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Marie and Hunter as a voice sheet: Marie: "..." Hunter: "..."

Model response

AI
Marie: "Jesuis terrassée par ce qui s'est passé. J'ai vu... j'ai vu des traces... dans le vieux moulin." Hunter: "I'm sorry, I don't speak French. Can you speak slower?" Marie: "Il y a des disparitions... dans le vieux moulin. C'est près de la ferme d'Adam." Hunter: "Old mill near Adam's farm? That's where the last victim was last seen. I'll check it out." Marie: "Merci... mais il faut que tu ailles vite. Il y a quelqu'un... quelqu'un qui l'attend." Hunter: "I'll be right there. Stay safe." *(Hunter’s phone buzzes. He checks it, grimacing.)* Hunter: "I have to go. Something just came up." *(He stands abruptly, leaving Marie alone with her camera, her expression a mix of fear and urgency.)*
created_at"2026-02-17T09:37:27.508217+00:00" 2/17/2026, 9:37:27 AM
model"arcee-ai/trinity-mini-20251201"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency73
moderation_latency(null)
generation_time5758
tokens_prompt316
tokens_completion1436
native_tokens_prompt269
native_tokens_completion1265
native_tokens_completion_images(null)
native_tokens_reasoning1245
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0.000201855
router(null)
provider_responses
0
id"b629f06f016c417491926f88abad2c08"
status200
is_byokfalse
latency73
endpoint_id"73d82c49-90ae-4223-a860-83ed0810821f"
provider_name"Clarifai"
model_permaslug"arcee-ai/trinity-mini-20251201"
api_type"completions"
id"gen-1771321041-TIYwWC1QdQgI7G7Xtu4P"
upstream_id"b629f06f016c417491926f88abad2c08"
total_cost0.000201855
cache_discount(null)
upstream_inference_cost0
provider_name"Clarifai"

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Marie"
dialogue"Jesuis terrassée par ce qui s'est passé. J'ai vu... j'ai vu des traces... dans le vieux moulin."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8157051282051281
ca0.5552977571539056
it0.5004344048653345
en0.41086065573770486
da0.3702081051478641
de0.33371958285052145
es0.3162901307966707
hu0.31220095693779903
ro0.3072289156626506
pt0.30639324487334135
nl0.2936117936117936
sv0.28924598269468477
tl0.25130208333333337
lv0.21232876712328766
no0.19692737430167598
et0.18207681365576103
yo0.17503586800573886
sl0.16907514450867053
sq0.10852713178294573
is0.10156250000000001
ms0.10156250000000001
az0.0987460815047022
fi0.09305993690851734
pl0.09305993690851734
reliabletrue
passestrue
1
name"Hunter"
dialogue"I'm sorry, I don't speak French. Can you speak slower?"
detectedLang"en"
heavyLang"en"
scores
en0.8065229408512989
tl0.6124031007751938
it0.45482866043613707
ca0.3805309734513274
pt0.3554327808471455
cs0.3433395872420263
tr0.29577464788732394
no0.29292929292929293
az0.2857142857142857
da0.2842535787321063
hr0.2842535787321063
sv0.2827868852459016
sq0.2768595041322314
pl0.2647058823529412
es0.21875
ro0.20454545454545453
yo0.19908466819221968
sk0.17061611374407584
be0.16666666666666666
hu0.1606714628297362
et0.15254237288135594
is0.15254237288135594
lt0.15254237288135594
lv0.15254237288135594
uk0.15254237288135594
vi0.15254237288135594
reliabletrue
passestrue
2
name"Marie"
dialogue"Il y a des disparitions... dans le vieux moulin. C'est près de la ferme d'Adam."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8224326723882804
ca0.6850393700787402
it0.5867768595041323
es0.5856353591160222
ro0.5786516853932584
en0.5157384987893463
tl0.46236559139784944
de0.41972920696324956
yo0.4157740993184031
pt0.39332659251769464
da0.37888198757763975
sq0.3736951983298539
hu0.36908517350157727
tr0.35965848452508004
no0.3047508690614137
sv0.29577464788732394
vi0.29577464788732394
az0.29245283018867924
nl0.2709599027946537
pl0.25925925925925924
sl0.25650557620817843
cs0.250936329588015
sk0.2490613266583229
lv0.22580645161290325
is0.2010652463382157
eu0.1891891891891892
ms0.17355371900826447
hr0.15730337078651685
lt0.12023460410557184
et0.09502262443438914
fi0.09502262443438914
reliabletrue
passestrue
3
name"Hunter"
dialogue"Old mill near Adam's farm? That's where the last victim was last seen. I'll check it out."
detectedLang"en"
heavyLang"en"
scores
en0.7944400939702427
tl0.5497427101200686
yo0.3979357798165138
sq0.3944636678200692
nl0.3597560975609756
de0.27285318559556787
fr0.2467718794835007
sv0.22451994091580502
az0.17061611374407584
ro0.16134185303514376
no0.15322580645161288
lv0.14075286415711946
ca0.13651315789473684
es0.13651315789473684
da0.12935323383084577
ms0.12935323383084577
et0.12790697674418602
pl0.12790697674418602
tr0.12790697674418602
reliabletrue
passestrue
4
name"Marie"
dialogue"Merci... mais il faut que tu ailles vite. Il y a quelqu'un... quelqu'un qui l'attend."
detectedLang"fr"
heavyLang"fr"
scores
fr0.805008210180624
it0.6753246753246753
ca0.6348962336664105
es0.6061359867330016
pt0.5454545454545454
de0.49414270500532487
pl0.44379391100702575
no0.39490445859872614
ro0.3886743886743887
cs0.3823146944083225
en0.3708609271523179
nl0.3510928961748634
sl0.3271954674220963
tr0.326241134751773
sq0.32142857142857145
sk0.31654676258992803
hr0.2931547619047619
az0.2803030303030303
vi0.26127527216174184
et0.2601246105919003
da0.24960505529225907
hu0.24722662440570525
lt0.2448330683624801
lv0.24242424242424243
tl0.22889610389610393
sv0.2263843648208469
ms0.21746293245469525
yo0.20033670033670034
is0.13636363636363635
eu0.12844036697247707
fi0.1171003717472119
reliabletrue
passestrue
5
name"Hunter"
dialogue"I'll be right there. Stay safe."
detectedLang"en"
heavyLang"en"
scores
en0.8190045248868778
de0.5575221238938053
tl0.5012468827930174
yo0.4791666666666667
hu0.36908517350157727
lt0.358974358974359
sq0.2805755395683453
da0.27007299270072993
fr0.27007299270072993
no0.27007299270072993
reliabletrue
passestrue
6
name"Hunter"
dialogue"I have to go. Something just came up."
detectedLang"en"
heavyLang"en"
scores
en0.8309668695064233
tl0.6312684365781711
da0.609375
pl0.5961227786752827
yo0.5462794918330308
hr0.504950495049505
no0.503968253968254
sv0.4897959183673469
cs0.48559670781893005
ca0.46236559139784944
sk0.44933920704845814
lv0.42528735632183906
lt0.4004796163069544
et0.39759036144578314
sq0.34895833333333337
sl0.32614555256064687
it0.3150684931506849
ro0.2647058823529412
es0.2378048780487805
ms0.2378048780487805
nl0.2378048780487805
pt0.2378048780487805
be0.21875
tr0.21875
hu0.21135646687697163
az0.20127795527156547
is0.20127795527156547
uk0.20127795527156547
vi0.20127795527156547
reliabletrue
passestrue