Run: 2026-02-17-01KHNGZ8Y81PZQ52GN7FY5Y3G4

Run Details

Model:
Arcee AI: Trinity Mini
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
5.9s
Cost:
$0.000157
Provider:
Clarifai

Evaluation summary

Score Evaluator
Details Link
54.55% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
**Voice Sheet Dialogue:** **Selvi:** (Looking up from her camera, eyes wide with distress) "Kya hua? Kya hua?" (What happened? What happened?) **Hunter:** (Leaning against the cafe table, brow furrowed) "Selvi? Are you okay? You look... shaken. What's going on?" **Selvi:** (Voice trembling, speaking rapidly in Hindi) "Main... main nahi jaanti! Main nahi jaanti kya hua!" (I... I don't know! I don't know what happened!) **Hunter:** (Stares, utterly confused, hand gesturing for her to repeat) "Excuse me? I'm sorry, I don't understand. Can you... speak slower? Or... use English?" **Selvi:** (Shakes her head violently, tears welling) "Nahi! Hindi mein! Hindi mein!" (No! In Hindi! In Hindi!) **Hunter:** (Sighs, pinches the bridge of his nose, trying to process) "Look, I know this is scary, but I need you to tell me what you saw. What happened at the festival grounds?" **Selvi:** (Whispers, staring at her hands) "Main... main dekha nahi... main nahi dekha kya hua." (I... I didn't see... I didn't see what happened.) **Hunter:** (Leans in, voice low but urgent) "Selvi, you were there. You saw something. Tell me. Please." **Selvi:** (Looks up, eyes pleading, speaking brokenly) "Main... main... aisa nahi tha... main nahi jaanti kya hua." (I... it wasn't like that... I don't know what happened.) **Hunter:** (Stands abruptly, pulling out his phone) "Hold on. I need to take this." (He answers the call, voice clipped) "Detective Hunter. Yes. New lead? Alborn? Now? Understood. On my way." **Hunter:** (Turns to Selvi, face grim) "Sorry, Selvi. I have to go. Stay here. Don't move. I'll be back." (He walks away quickly, leaving her alone in the cafe, still clutching her camera, looking lost and terrified.) **End Scene.**
created_at"2026-02-17T10:05:19.103538+00:00" 2/17/2026, 10:05:19 AM
model"arcee-ai/trinity-mini-20251201"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency76
moderation_latency(null)
generation_time5712
tokens_prompt315
tokens_completion1031
native_tokens_prompt274
native_tokens_completion963
native_tokens_completion_images(null)
native_tokens_reasoning579
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0.00015678
router(null)
provider_responses
0
id"eb7f6f25760d4fa59125e8d7d4a54676"
status200
is_byokfalse
latency76
endpoint_id"73d82c49-90ae-4223-a860-83ed0810821f"
provider_name"Clarifai"
model_permaslug"arcee-ai/trinity-mini-20251201"
api_type"completions"
id"gen-1771322713-APig8BUA5dSCPK9Ra1oW"
upstream_id"eb7f6f25760d4fa59125e8d7d4a54676"
total_cost0.00015678
cache_discount(null)
upstream_inference_cost0
provider_name"Clarifai"

Evaluation details

Result Evaluator Details Meta Data
54.55% Parse dialogue n/a
dialogue
0
name"Selvi"
dialogue"Kya hua? Kya hua?"
detectedLang""
heavyLang"tl"
scores
reliablefalse
passesfalse
1
name"Hunter"
dialogue"Selvi? Are you okay? You look... shaken. What's going on?"
detectedLang"en"
heavyLang"en"
scores
en0.7976338729763387
tl0.5303468208092486
fi0.4444444444444444
no0.3701550387596899
ca0.3512974051896207
et0.32150313152400833
cs0.3200836820083682
ro0.3128964059196617
nl0.27455357142857145
da0.2562929061784897
fr0.2511520737327189
hr0.21307506053268765
sv0.2111650485436893
hi0.20537897310513448
pl0.20537897310513448
sk0.1875
yo0.1875
reliabletrue
passestrue
2
name"Selvi"
dialogue"Main... main nahi jaanti! Main nahi jaanti kya hua!"
detectedLang"eu"
heavyLang"tl"
scores
eu0.5238095238095238
et0.46619217081850534
it0.42084942084942084
en0.39759036144578314
fr0.3697478991596639
lt0.3697478991596639
ms0.34782608695652173
de0.34210526315789475
lv0.3333333333333333
cs0.3087557603686636
hr0.3087557603686636
ro0.3087557603686636
sk0.3087557603686636
sl0.3087557603686636
sq0.3087557603686636
tl0.3087557603686636
tr0.3087557603686636
reliablefalse
passesfalse
3
name"Hunter"
dialogue"Excuse me? I'm sorry, I don't understand. Can you... speak slower? Or... use English?"
detectedLang"en"
heavyLang"en"
scores
en0.7943156320119671
no0.5278969957081545
tl0.5262704565030146
da0.4821092278719397
sv0.4335736354273944
it0.34911242603550297
sq0.33894230769230765
cs0.3268053855569155
de0.3251533742331288
nl0.3226600985221675
ro0.3002544529262086
ca0.28104575163398693
hr0.27726675427069647
pl0.27055702917771884
pt0.25474254742547425
fr0.23504867872044508
sk0.22644163150492264
et0.2231638418079096
ms0.22096317280453256
tr0.2109038737446198
az0.20289855072463767
is0.19941775836972345
es0.15644171779141106
sl0.13793103448275862
yo0.13657770800627944
fi0.12
be0.11290322580645161
hu0.1085899513776337
lt0.10277324632952692
lv0.10277324632952692
uk0.10277324632952692
vi0.10277324632952692
reliabletrue
passestrue
4
name"Selvi"
dialogue"Nahi! Hindi mein! Hindi mein!"
detectedLang"tl"
heavyLang"tl"
scores
tl0.7566909975669099
eu0.6226415094339622
de0.5555555555555556
it0.504950495049505
is0.494949494949495
et0.4845360824742268
sq0.46524064171123
hi0.43820224719101125
reliabletrue
passesfalse
5
name"Hunter"
dialogue"Look, I know this is scary, but I need you to tell me what you saw. What happened at the festival grounds?"
detectedLang"en"
heavyLang"en"
scores
en0.8201956271576524
tl0.6474901297236323
no0.5554765291607398
da0.52217125382263
fr0.4658119658119659
nl0.4503078276165347
cs0.44493783303730017
sq0.43946188340807174
it0.4349005424954792
hr0.421831637372803
yo0.4191449814126394
ms0.41369606003752346
et0.4013409961685824
sv0.39729990356798456
sl0.38785504407443677
ca0.35500515995872034
pl0.34141201264488935
sk0.3400211193241816
lt0.31917211328976036
pt0.3161925601750547
hu0.3154435925520263
ro0.31394072447859495
es0.3131868131868132
lv0.284077892325315
az0.22456575682382132
is0.19871794871794873
fi0.18086500655307994
be0.10071942446043164
de0.10071942446043164
tr0.10071942446043164
uk0.09156976744186046
vi0.09156976744186046
reliabletrue
passestrue
6
name"Selvi"
dialogue"Main... main dekha nahi... main nahi dekha kya hua."
detectedLang"eu"
heavyLang"tl"
scores
eu0.5238095238095238
en0.39759036144578314
fr0.3697478991596639
de0.34210526315789475
reliablefalse
passesfalse
7
name"Hunter"
dialogue"Selvi, you were there. You saw something. Tell me. Please."
detectedLang"en"
heavyLang"en"
scores
en0.809368191721133
tl0.4372990353697749
ms0.4281045751633987
sq0.39236111111111116
fi0.34579439252336447
no0.3445692883895131
es0.33962264150943394
de0.3371212121212121
pt0.3217054263565891
da0.24242424242424243
ro0.2222222222222222
et0.21348314606741572
fr0.20634920634920634
sl0.2009132420091324
nl0.1935483870967742
it0.18604651162790697
cs0.1822429906542056
ca0.18032786885245902
reliabletrue
passestrue
8
name"Selvi"
dialogue"Main... main... aisa nahi tha... main nahi jaanti kya hua."
detectedLang"sq"
heavyLang"tl"
scores
sq0.4791666666666667
eu0.4520547945205479
et0.3957703927492447
it0.35275080906148865
en0.3311036789297659
fr0.3055555555555556
lt0.3055555555555556
ms0.2857142857142857
de0.2805755395683453
lv0.2727272727272727
cs0.250936329588015
hr0.250936329588015
ro0.250936329588015
sk0.250936329588015
sl0.250936329588015
tl0.250936329588015
tr0.250936329588015
reliablefalse
passesfalse
9
name"Hunter"
dialogue"Detective Hunter. Yes. New lead? Alborn? Now? Understood. On my way."
detectedLang"en"
heavyLang"en"
scores
en0.7923790913531998
tl0.6181491464510332
fr0.5046620046620046
no0.5023419203747073
da0.5017584994138335
sv0.49162679425837325
cs0.46941323345817726
ro0.46540880503144655
ca0.4429882044560944
de0.43408788282290284
sk0.4209809264305177
it0.4097222222222222
nl0.4039270687237027
pl0.37407952871870404
pt0.3541033434650456
hr0.3348982785602504
sq0.33176100628930816
sl0.30327868852459017
es0.2951907131011609
et0.2659758203799654
fi0.2608695652173913
yo0.24511545293072823
ms0.21731123388581952
hi0.1650294695481336
tr0.121900826446281
reliabletrue
passestrue
10
name"Hunter"
dialogue"Sorry, Selvi. I have to go. Stay here. Don't move. I'll be back."
detectedLang"en"
heavyLang"en"
scores
en0.7880233174350821
da0.5565410199556541
tl0.5238095238095238
yo0.5067817509247842
pl0.4798439531859558
no0.464524765729585
lt0.4108983799705449
hr0.3893129770992366
cs0.3710691823899371
sq0.36908517350157727
ca0.34959349593495936
it0.34959349593495936
sk0.33774834437086093
lv0.3162393162393162
hu0.3150684931506849
sv0.25650557620817843
sl0.23224568138195778
fi0.21568627450980393
pt0.2
ro0.1836734693877551
be0.14893617021276595
tr0.14893617021276595
az0.13606911447084233
et0.13606911447084233
is0.13606911447084233
uk0.13606911447084233
vi0.13606911447084233
reliabletrue
passestrue