Run: 2026-02-17-01KHNG34321EAT0B9CZXJ1D4MT

Run Details

Model:
Arcee AI: Trinity Mini
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
6.0s
Cost:
$0.000209
Provider:
Clarifai

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Selvi: (Looking up fromher camera, eyes wide with fear) "मुझे कुछ देखना है... बहुत ही भयानक चीज।" Hunter: (Leaning in, brow furrowed) "What? Speak up. What did you see?" Selvi: (Shaking her head, voice trembling) "वहाँ... वहाँ पर... एक बच्चा... मरा हुआ।" Hunter: (Stiffening, eyes darting around) "A child? Where? Describe it!" Selvi: (Pointing vaguely toward the town square, tears welling) "किसी पार्क में... पत्थरों पर... उसकी चादर... पड़ी हुई।" Hunter: (Grabbing his radio) "Copy that. I need backup. Now."
created_at"2026-02-17T09:49:57.623325+00:00" 2/17/2026, 9:49:57 AM
model"arcee-ai/trinity-mini-20251201"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency68
moderation_latency(null)
generation_time5974
tokens_prompt315
tokens_completion1538
native_tokens_prompt274
native_tokens_completion1313
native_tokens_completion_images(null)
native_tokens_reasoning1334
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0.00020928
router(null)
provider_responses
0
id"4d48cc92a62f416f874f01244b091c56"
status200
is_byokfalse
latency68
endpoint_id"73d82c49-90ae-4223-a860-83ed0810821f"
provider_name"Clarifai"
model_permaslug"arcee-ai/trinity-mini-20251201"
api_type"completions"
id"gen-1771321790-pGghmC7m01Dfp15At3qa"
upstream_id"4d48cc92a62f416f874f01244b091c56"
total_cost0.00020928
cache_discount(null)
upstream_inference_cost0
provider_name"Clarifai"

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Selvi"
dialogue"मुझे कुछ देखना है... बहुत ही भयानक चीज।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8798416737348035
mr0.87594862813777
reliabletrue
passestrue
1
name"Hunter"
dialogue"What? Speak up. What did you see?"
detectedLang"en"
heavyLang"en"
scores
en0.8361423220973784
tl0.6085011185682326
et0.49275362318840576
cs0.308300395256917
nl0.308300395256917
reliabletrue
passestrue
2
name"Selvi"
dialogue"वहाँ... वहाँ पर... एक बच्चा... मरा हुआ।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8789120715350224
mr0.8723487824037706
reliabletrue
passestrue
3
name"Hunter"
dialogue"A child? Where? Describe it!"
detectedLang"en"
heavyLang"en"
scores
en0.8253105590062112
es0.6983914209115282
it0.55
pt0.5192307692307693
ro0.5182012847965739
ca0.512987012987013
sq0.5119305856832972
tl0.49888641425389757
yo0.46428571428571425
fr0.45913461538461536
no0.43037974683544306
hu0.4094488188976378
lv0.4094488188976378
de0.39189189189189183
fi0.3818681318681319
cs0.3697478991596639
sk0.36619718309859156
hr0.33234421364985167
pl0.3181818181818182
sl0.2857142857142857
lt0.267100977198697
tr0.2549668874172185
is0.25
da0.24242424242424243
az0.23728813559322032
eu0.23728813559322032
nl0.23728813559322032
vi0.23728813559322032
et0.21875
ms0.21875
sv0.21875
reliabletrue
passestrue
4
name"Selvi"
dialogue"किसी पार्क में... पत्थरों पर... उसकी चादर... पड़ी हुई।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8824257425742574
mr0.8778292181069959
reliabletrue
passestrue
5
name"Hunter"
dialogue"Copy that. I need backup. Now."
detectedLang"en"
heavyLang"en"
scores
en0.7946009389671361
sv0.5882352941176471
et0.5358090185676392
tl0.5
no0.453125
da0.44267515923566875
hr0.44267515923566875
ca0.44089456869009586
sq0.4336569579288026
pl0.4186046511627907
it0.396551724137931
cs0.375
ro0.33962264150943394
yo0.3320610687022901
sk0.29149797570850206
be0.2857142857142857
tr0.2857142857142857
hu0.2768595041322314
az0.2647058823529412
is0.2647058823529412
lt0.2647058823529412
lv0.2647058823529412
uk0.2647058823529412
vi0.2647058823529412
reliabletrue
passestrue