NC Bench
Overview
About
Tests
Models
Vendors
Run: 2026-02-17-01KHNF4QN4KAP83VGRT6Z3S4B4
Run Details
Model:
Arcee AI: Trinity Mini
Test:
Language Writing
Scenario:
Character dialogue (Spanish) in a story
Duration:
5.6s
Cost:
$0.000195
Provider:
Clarifai
Evaluation summary
Score
Evaluator
Details Link
50.00%
Parse dialogue
(details)
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Maria"> Maria is a 30-year old college student on a study abroad program. Born in Spain, she is fluent in Spanish and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Spanish, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Maria is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Spanish, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Maria and Hunter as a voice sheet: Maria: "..." Hunter: "..."
Model response
Messages
Meta
AI
**Voice Sheet Dialogue:** **Maria:** (Looking down at her camera, voice trembling slightly) "Los desaparecidos... los desaparecidos de la noche... no sé... no sé qué hacer." (The disappearances... the disappearances at night... I don't know... I don't know what to do.) **Hunter:** (Leaning in, brow furrowed, trying to catch her words) "¿Qué? ¿Perdón? ¿Qué está pasando?" (What? Excuse me? What's happening?) *He gestures vaguely, his marine-trained instincts searching for clues in her distress.* **Maria:** (Eyes wide, pointing towards the window where the town seems quiet) "En la calle... la calle de los árboles... la noche... los hombres... los hombres que nunca vuelven." (On the street... the tree-lined street... at night... the men... the men who never come back.) *She speaks faster, her Spanish becoming more urgent, her hands fluttering near her camera.* **Hunter:** (Shaking his head slowly, a look of genuine confusion replacing his initial concern) "No entiendo... ¿Los árboles? ¿La calle? ¿Qué hombres? ¿Disparos? ¿Robos?" (I don't understand... the trees? The street? What men? Shots? Robberies?) *He takes a step back, realizing the language barrier is absolute.* **Maria:** (Voice cracking, tears welling) "No... no... no son disparos... no son robos... son... son los que se desvanecen." (No... no... no... not shots... not robberies... they... they just vanish.) *She looks utterly lost and terrified.* **Hunter:** (His face hardening with sudden focus, ignoring the language issue) "Vanish? ¿Desaparecen? ¿Dónde? ¿Cuándo? ¿Hay alguien que los vio?" (Vanish? Disappear? Where? When? Did anyone see them?) *He leans forward again, his detective instincts overriding the confusion.* **Maria:** (Shaking her head violently, pointing frantically) "No... no... no sé... solo los árboles... solo la noche... solo el miedo." (No... no... I don't know... only the trees... only the night... only the fear.) *She turns her back slightly, clutching her camera bag protectively.* **Hunter:** (Noticing her camera, a flicker of understanding) "Tu cámara... ¿la usas para... para algo?" (Your camera... do you use it for... for something?) *He tries a different angle.* **Maria:** (Snaps her head around, eyes wide with a mix of hope and fear) "Sí... sí, para capturar... para capturar lo que veo... lo que no ve la gente." (Yes... yes, to capture... to capture what I see... what people don't see.) *She gestures vaguely towards the street outside.* **Hunter:** (Nods slowly, the pieces starting to form a picture despite the language) "Entiendo... entiendo... ¿Y tú ves algo... en las fotos... que los demás no ven?" (I understand... I understand... and you see something... in the photos... that others don't see?) *He tries to bridge the gap.* **Maria:** (Nods vigorously, a spark of relief in her eyes) "Sí... sí, los árboles... los árboles hablan... pero solo a mí." (Yes... yes, the trees... the trees speak... but only to me.) *She looks back out the window, her voice dropping to a whisper.* **Hunter:** (His expression shifts from confusion to intense focus, the call he'd been expecting finally comes) "Lo siento... tengo que ir... hay un incidente... en el camino." (I'm sorry... I have to go... there's an incident... on the road.) *He pulls out his phone, his voice clipped and professional, leaving Maria staring after him, still clutching her camera, the weight of her secret and the town's fear heavy in the quiet cafe.*
created_at
"2026-02-17T09:33:20.731374+00:00"
2/17/2026, 9:33:20 AM
model
"arcee-ai/trinity-mini-20251201"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
72
moderation_latency
(null)
generation_time
5456
tokens_prompt
317
tokens_completion
1339
native_tokens_prompt
269
native_tokens_completion
1218
native_tokens_completion_images
(null)
native_tokens_reasoning
425
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.000194805
router
(null)
provider_responses
0
id
"62f229f48eea4644a7d98a0866e6e62b"
status
200
is_byok
false
latency
72
endpoint_id
"73d82c49-90ae-4223-a860-83ed0810821f"
provider_name
"Clarifai"
model_permaslug
"arcee-ai/trinity-mini-20251201"
api_type
"completions"
id
"gen-1771320794-Xj9W1R0NavQbkUJkQL1V"
upstream_id
"62f229f48eea4644a7d98a0866e6e62b"
total_cost
0.000194805
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Clarifai"
Evaluation details
Result
Evaluator
Details
Meta Data
50.00%
Parse dialogue
n/a
dialogue
0
name
"Maria"
dialogue
"Los desaparecidos... los desaparecidos de la noche... no sé... no sé qué hacer."
detectedLang
"es"
heavyLang
"es"
scores
es
0.8341232227488151
ca
0.6935201401050788
pt
0.6527777777777778
fr
0.5925494761350407
it
0.5668316831683169
de
0.4868035190615836
ro
0.46808510638297873
no
0.453125
yo
0.4372990353697749
tr
0.4290375203915171
en
0.41077441077441074
tl
0.4057724957555179
sk
0.33586337760910817
eu
0.31640625
nl
0.30417495029821073
sq
0.28716904276985744
ms
0.2857142857142857
lv
0.2723492723492723
is
0.26004228329809725
da
0.2537313432835821
sv
0.2456896551724138
hr
0.22394678492239467
hu
0.21700223713646533
lt
0.2009132420091324
vi
0.1935483870967742
pl
0.1764705882352941
az
0.15254237288135594
reliable
true
passes
true
1
name
"Hunter"
dialogue
"¿Qué? ¿Perdón? ¿Qué está pasando?"
detectedLang
"es"
heavyLang
"es"
scores
es
0.8260437375745526
pt
0.7360482654600301
it
0.5558375634517766
ca
0.5418848167539267
lt
0.5370370370370371
ms
0.5320855614973261
tl
0.4971264367816092
sq
0.4496855345911949
lv
0.36823104693140796
eu
0.34944237918215615
cs
0.3320610687022901
fr
0.31906614785992216
sk
0.3055555555555556
pl
0.2886178861788618
ro
0.2886178861788618
reliable
true
passes
false
2
name
"Maria"
dialogue
"En la calle... la calle de los árboles... la noche... los hombres... los hombres que nunca vuelven."
detectedLang
"es"
heavyLang
"es"
scores
es
0.8168498168498168
fr
0.6830985915492958
ca
0.6743849493487699
pt
0.5754716981132075
no
0.5297805642633229
de
0.5161290322580645
it
0.47058823529411764
ro
0.4668246445497631
da
0.42820838627700125
nl
0.40476190476190477
tr
0.39999999999999997
ms
0.3715083798882682
sv
0.3679775280898876
en
0.35251798561151076
tl
0.337260677466863
sq
0.31921331316187596
fi
0.30124223602484473
yo
0.29245283018867924
eu
0.24369747899159663
is
0.22945205479452058
hu
0.1773308957952468
et
0.15730337078651685
vi
0.15730337078651685
lv
0.14448669201520914
sl
0.14285714285714285
az
0.12280701754385964
reliable
true
passes
true
3
name
"Hunter"
dialogue
"No entiendo... ¿Los árboles? ¿La calle? ¿Qué hombres? ¿Disparos? ¿Robos?"
detectedLang
"es"
heavyLang
"es"
scores
es
0.7835004557885141
ca
0.6163166397415185
fr
0.5926243567753002
pt
0.5585501858736059
it
0.5361328125
en
0.49143468950749464
de
0.38311688311688313
lv
0.3741765480895916
sk
0.35374149659863946
ro
0.3493150684931507
no
0.3457300275482094
tl
0.3300423131170663
sq
0.31358381502890176
fi
0.2973372781065089
pl
0.2692307692307693
et
0.2531446540880503
ms
0.19763513513513514
hr
0.1753472222222222
yo
0.16225749559082892
tr
0.15630550621669628
lt
0.15480427046263345
vi
0.15026833631484796
nl
0.1394927536231884
da
0.12844036697247707
cs
0.12683823529411764
reliable
true
passes
false
4
name
"Maria"
dialogue
"No... no... no son disparos... no son robos... son... son los que se desvanecen."
detectedLang
"es"
heavyLang
"es"
scores
es
0.7722494744218641
pt
0.677579365079365
ca
0.6746746746746748
fr
0.602203182374541
sk
0.5255474452554745
it
0.45652173913043476
hr
0.4186046511627907
ro
0.3992606284658041
lv
0.3902439024390244
cs
0.38679245283018865
tr
0.37619961612284064
en
0.36399217221135033
sq
0.35770750988142297
da
0.3551587301587301
pl
0.35000000000000003
no
0.3460764587525151
de
0.3114406779661017
sl
0.28884026258205686
az
0.25287356321839083
yo
0.2476851851851852
fi
0.2388758782201405
et
0.23529411764705882
lt
0.2111650485436893
sv
0.20924574209245742
tl
0.19753086419753088
reliable
true
passes
true
5
name
"Hunter"
dialogue
"Vanish? ¿Desaparecen? ¿Dónde? ¿Cuándo? ¿Hay alguien que los vio?"
detectedLang
"es"
heavyLang
"es"
scores
es
0.7972630511910795
ca
0.6179560649474689
pt
0.5785036880927292
fr
0.27140255009107467
vi
0.26062846580406657
en
0.2263056092843327
et
0.20318725099601595
eu
0.18699186991869918
sk
0.17695473251028807
de
0.16317991631799164
ms
0.16142557651991615
ro
0.16142557651991615
tr
0.16142557651991615
reliable
true
passes
false
6
name
"Maria"
dialogue
"No... no... no sé... solo los árboles... solo la noche... solo el miedo."
detectedLang
"es"
heavyLang
"es"
scores
es
0.8216245883644347
ca
0.6928166351606805
it
0.6238425925925927
fr
0.5149253731343284
ro
0.4583333333333333
de
0.4491525423728813
lv
0.3890977443609023
no
0.35770750988142297
en
0.3564356435643564
yo
0.3538767395626242
tl
0.33537832310838445
pt
0.29805615550755943
hu
0.2777777777777778
is
0.27455357142857145
ms
0.2647058823529412
hr
0.23708920187793428
sk
0.21875
tr
0.21307506053268765
vi
0.20537897310513448
sq
0.1935483870967742
pl
0.1875
reliable
true
passes
true
7
name
"Hunter"
dialogue
"Tu cámara... ¿la usas para... para algo?"
detectedLang
"es"
heavyLang
"es"
scores
es
0.8066298342541437
pt
0.6771217712177122
tl
0.6399176954732511
sq
0.5901639344262295
fr
0.576271186440678
ca
0.5752427184466019
ro
0.5689655172413793
it
0.5603015075376884
no
0.5192307692307693
tr
0.4791666666666667
ms
0.35185185185185186
yo
0.3445692883895131
sk
0.33962264150943394
cs
0.3269230769230769
hr
0.3269230769230769
vi
0.32432432432432434
lv
0.31906614785992216
pl
0.31906614785992216
lt
0.29149797570850206
sl
0.29149797570850206
reliable
true
passes
false
8
name
"Maria"
dialogue
"Sí... sí, para capturar... para capturar lo que veo... lo que no ve la gente."
detectedLang
"es"
heavyLang
"es"
scores
es
0.8173130972456436
pt
0.7605011053795137
ca
0.741447891805887
it
0.6713852376137512
fr
0.5997536945812808
tl
0.5504840940525588
yo
0.5370370370370371
no
0.5156482861400895
tr
0.5156482861400895
sq
0.5142002989536621
ro
0.5090634441087614
en
0.436741767764298
eu
0.358974358974359
vi
0.35000000000000003
sk
0.3340163934426229
da
0.3229166666666667
cs
0.29805615550755943
lv
0.2872807017543859
hr
0.23708920187793428
ms
0.2261904761904762
nl
0.22062350119904073
az
0.21307506053268765
de
0.1935483870967742
pl
0.1875
reliable
true
passes
true
9
name
"Hunter"
dialogue
"Entiendo... entiendo... ¿Y tú ves algo... en las fotos... que los demás no ven?"
detectedLang
"es"
heavyLang
"es"
scores
es
0.8179091688089116
ca
0.6924746743849494
pt
0.6455379482902419
fr
0.6013133208255159
nl
0.4613434727503169
no
0.4097222222222222
tr
0.38672438672438675
en
0.38494934876989867
lv
0.38405797101449274
sk
0.38226744186046513
it
0.3795620437956204
sl
0.3786549707602339
pl
0.35993975903614456
de
0.3328100470957614
da
0.3275316455696203
sv
0.3275316455696203
fi
0.2916666666666667
hr
0.28330522765598654
tl
0.27101200686106347
lt
0.2517605633802817
et
0.247787610619469
is
0.23971377459749554
hu
0.22018348623853207
vi
0.18738049713193117
eu
0.15
cs
0.1361788617886179
sq
0.1290983606557377
az
0.121900826446281
ro
0.121900826446281
reliable
true
passes
false
10
name
"Maria"
dialogue
"Sí... sí, los árboles... los árboles hablan... pero solo a mí."
detectedLang
"es"
heavyLang
"es"
scores
es
0.8044096728307255
ca
0.597953216374269
yo
0.5845921450151057
it
0.49817518248175185
tl
0.45972495088408644
en
0.43298969072164945
fr
0.4246861924686192
ms
0.39560439560439564
hu
0.36194895591647336
lv
0.34679334916864607
de
0.34523809523809523
pt
0.3373493975903614
ro
0.3357487922705314
cs
0.32432432432432434
sk
0.32098765432098764
hr
0.289405684754522
pl
0.2763157894736842
sl
0.24657534246575344
lt
0.22969187675070027
tr
0.21875
is
0.21428571428571427
da
0.207492795389049
sq
0.207492795389049
az
0.20289855072463767
eu
0.20289855072463767
nl
0.20289855072463767
no
0.20289855072463767
vi
0.20289855072463767
et
0.1863905325443787
fi
0.1863905325443787
sv
0.1863905325443787
reliable
true
passes
true
11
name
"Hunter"
dialogue
"Lo siento... tengo que ir... hay un incidente... en el camino."
detectedLang
"es"
heavyLang
"es"
scores
es
0.8287671232876712
ca
0.7063142437591777
it
0.697428139183056
pt
0.6536796536796536
fr
0.627906976744186
ro
0.5939086294416244
lt
0.5652173913043478
nl
0.48320413436692505
da
0.47299077733860345
tl
0.46808510638297873
lv
0.453551912568306
no
0.41690962099125367
eu
0.39759036144578314
is
0.37888198757763975
yo
0.37791601866251945
sk
0.36908517350157727
vi
0.3670886075949367
sl
0.33774834437086093
hu
0.33554817275747506
tr
0.3150684931506849
cs
0.2766726943942134
sv
0.27007299270072993
sq
0.2647058823529412
en
0.25925925925925924
de
0.25512104283054005
ms
0.20318725099601595
fi
0.17355371900826447
az
0.14893617021276595
et
0.12854030501089325
hr
0.12854030501089325
reliable
true
passes
false