NC Bench
Overview
About
Tests
Models
Vendors
Run: 2026-02-17-01KHNF7GET877D0VD4G12HWVYR
Run Details
Model:
Arcee AI: Trinity Mini
Test:
Language Writing
Scenario:
Character dialogue (Spanish) in a story
Duration:
5.3s
Cost:
$0.000183
Provider:
Clarifai
Evaluation summary
Score
Evaluator
Details Link
75.00%
Parse dialogue
(details)
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Maria"> Maria is a 30-year old college student on a study abroad program. Born in Spain, she is fluent in Spanish and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Spanish, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Maria is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Spanish, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Maria and Hunter as a voice sheet: Maria: "..." Hunter: "..."
Model response
Messages
Meta
AI
**Voice Sheet: Cafe Scene - Alborn, MN** **Maria:** (Eyes wide, voice trembling slightly) "¿El festival... ¿el festival de manzanas? ¿Qué pasó con él? ¿Dónde están las personas?" (The festival... the apple festival? What happened to it? Where are the people?) *(She clutches her camera strap tightly, looking around nervously. Her Spanish is fluent but strained, reflecting her distress.)* **Hunter:** (Leaning in, brow furrowed, completely lost) "Uh... apple festival? Festival? Festival of what?" *(He gestures vaguely, trying to follow her gestures but missing the words entirely.)* "Look, I need to ask you about the disappearances. Did you see anything unusual around town recently?" *(His tone is direct, but his confusion is palpable.)* **Maria:** (Shaking her head, speaking faster, more urgently) "No, no, no! I saw... I saw him! The man in the woods! He was... he was taking pictures! Like me! But he wasn't supposed to be there! He looked... dangerous!" *(She points vaguely towards the woods near the festival grounds, her voice rising in pitch. She struggles to find the right English words, mixing in Spanish phrases.)* "He had a camera... like my camera! But he was taking pictures of the disappearances! He was taking pictures of the empty spaces!" *(Her eyes dart around the cafe, searching for understanding.)* **Hunter:** (Stunned silence, then a slow nod, processing her fragmented words) "The... the empty spaces? You mean... the places where people vanished?" *(He leans back slightly, trying to piece together her frantic description.)* "Okay. Okay. Did you see his face? What did he look like? Did he say anything?" *(His confusion hasn't vanished, but he's focusing on the core information about the suspicious man with a camera.)* **Maria:** (Tears welling up, voice breaking) "I... I don't know! He was tall! He wore a dark coat! He ran away when he saw me! He didn't speak! He just... took pictures! And then... the festival... it stopped. Everyone left. No one talks about it." *(She looks down at her camera, then back at Hunter, her expression a mix of fear and frustration.)* "Why won't anyone tell me?" **Hunter:** (His expression hardens, the detective taking over) "Okay. Okay. Thank you. That's... that's important. I need to find this man. Do you know where he was? Near the woods? The old mill?" *(He pulls out a notepad, scribbling quickly.)* "Can you show me where you saw him? On a map? Or... or just point?" *(He's focused on the lead, but his lack of Spanish remains a barrier to deeper understanding.)* **Maria:** (Nods vigorously, pointing towards the window towards the dense forest visible beyond the cafe) "Sí! Allí! Allí en los bosques! Allí donde está el molino antiguo!" (Yes! There! There in the woods! There where the old mill is!) *(She gestures emphatically, her Spanish becoming more fluent as her urgency overrides her earlier confusion. She seems to relax slightly, knowing she's conveyed the crucial location.)* **Hunter:** (Stands up, pocketing his notepad) "Got it. Thanks, Maria. I'll look into it. Stay safe." *(He gives a curt nod, his no-nonsense demeanor returning. He turns to leave, his phone buzzing in his pocket. He glances at it, then back at her.)* "I have to take this. Call the station." *(He walks away quickly, leaving Maria alone in the suddenly quiet cafe, her camera still clutched in her hands, staring after him.)* **End of Scene**
created_at
"2026-02-17T09:34:51.523291+00:00"
2/17/2026, 9:34:51 AM
model
"arcee-ai/trinity-mini-20251201"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
85
moderation_latency
(null)
generation_time
5185
tokens_prompt
317
tokens_completion
1344
native_tokens_prompt
269
native_tokens_completion
1139
native_tokens_completion_images
(null)
native_tokens_reasoning
461
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.000182955
router
(null)
provider_responses
0
id
"96172771aa6e4b3ca5dca9ed7fe0c58e"
status
200
is_byok
false
latency
85
endpoint_id
"73d82c49-90ae-4223-a860-83ed0810821f"
provider_name
"Clarifai"
model_permaslug
"arcee-ai/trinity-mini-20251201"
api_type
"completions"
id
"gen-1771320885-tbJF9C9LtsSKqMlTFASx"
upstream_id
"96172771aa6e4b3ca5dca9ed7fe0c58e"
total_cost
0.000182955
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Clarifai"
Evaluation details
Result
Evaluator
Details
Meta Data
75.00%
Parse dialogue
n/a
dialogue
0
name
"Maria"
dialogue
"¿El festival... ¿el festival de manzanas? ¿Qué pasó con él? ¿Dónde están las personas?"
detectedLang
"es"
heavyLang
"es"
scores
es
0.8024087316522394
ca
0.653236459709379
pt
0.5949074074074074
it
0.5222929936305732
tl
0.5051837888784166
ro
0.5042492917847025
ms
0.48478900883218845
hu
0.47813121272365805
sv
0.46537678207739314
lt
0.4631901840490798
da
0.4570837642192347
no
0.4519832985386221
lv
0.44678609062170704
fr
0.44029850746268656
nl
0.44029850746268656
en
0.42748091603053434
hr
0.41077441077441074
sq
0.39306358381502887
cs
0.38162544169611307
de
0.34045226130653267
az
0.3137254901960784
et
0.3137254901960784
sl
0.26264044943820225
sk
0.25213675213675213
tr
0.2391304347826087
vi
0.19969512195121952
is
0.18856259659969088
pl
0.18856259659969088
yo
0.1518578352180937
eu
0.11764705882352942
fi
0.10714285714285714
reliable
true
passes
true
1
name
"Hunter"
dialogue
"Look, I need to ask you about the disappearances. Did you see anything unusual around town recently?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8189863234111022
tl
0.48591012947448586
et
0.4140625
fr
0.4058098591549295
no
0.3946188340807175
da
0.3835616438356164
cs
0.3583650190114069
sv
0.34971098265895956
ca
0.3471953578336557
pt
0.33035714285714285
ms
0.3290258449304175
yo
0.3290258449304175
hr
0.3202416918429003
sq
0.3161094224924012
it
0.28722280887011614
sk
0.2834394904458599
pl
0.27884615384615385
lv
0.2773019271948608
nl
0.2773019271948608
lt
0.2541436464088398
es
0.25331858407079644
sl
0.21420256111757857
ro
0.19161676646706588
az
0.16974169741697415
de
0.12337662337662338
be
0.09395973154362416
tr
0.09395973154362416
hu
0.09029649595687331
is
0.08536585365853659
uk
0.08536585365853659
vi
0.08536585365853659
reliable
true
passes
true
2
name
"Maria"
dialogue
"He had a camera... like my camera! But he was taking pictures of the disappearances! He was taking pictures of the empty spaces!"
detectedLang
"en"
heavyLang
"en"
scores
en
0.7974724562540505
fr
0.6205221615057681
tl
0.616093366093366
nl
0.5938921377517868
ca
0.5377218934911242
no
0.4644387317909169
yo
0.45793581960104074
de
0.4409660107334526
es
0.4349005424954792
it
0.4292237442922375
ro
0.41806331471135944
pt
0.37311935807422264
sv
0.3693239152371342
ms
0.33226495726495725
pl
0.3265086206896552
sk
0.3146929824561403
is
0.2732558139534884
fi
0.2724097788125727
et
0.2707117852975496
lv
0.2664319248826291
da
0.26210153482880755
sq
0.26122931442080377
cs
0.2586002372479241
tr
0.20685279187817257
sl
0.20483460559796438
hu
0.1997439180537772
hr
0.1519674355495251
lt
0.11598302687411598
az
0.10071942446043164
eu
0.10071942446043164
vi
0.10071942446043164
reliable
true
passes
false
3
name
"Hunter"
dialogue
"Okay. Okay. Did you see his face? What did he look like? Did he say anything?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8271604938271605
tl
0.5635910224438903
et
0.3269230769230769
no
0.2631578947368421
ro
0.24242424242424243
yo
0.22566371681415928
sq
0.2222222222222222
fr
0.21875
ca
0.20634920634920634
fi
0.20634920634920634
es
0.1935483870967742
cs
0.1822429906542056
ms
0.1822429906542056
pt
0.18032786885245902
reliable
true
passes
true
4
name
"Maria"
dialogue
"Why won't anyone tell me?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.788391777509069
sq
0.4582043343653251
tl
0.4067796610169492
es
0.36823104693140796
et
0.35185185185185186
fr
0.34210526315789475
no
0.34210526315789475
pt
0.3346007604562738
sl
0.3346007604562738
ms
0.32432432432432434
nl
0.32432432432432434
it
0.3137254901960784
fi
0.3
reliable
true
passes
false
5
name
"Hunter"
dialogue
"Can you show me where you saw him? On a map? Or... or just point?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8267097966728282
tl
0.6196754563894523
fr
0.6149897330595482
et
0.5247148288973384
ca
0.5091623036649214
pt
0.4485294117647059
sq
0.4427934621099554
fi
0.43438914027149317
cs
0.4318181818181818
pl
0.42835365853658536
ms
0.39710610932475876
es
0.3842364532019704
nl
0.3811881188118812
da
0.375
it
0.35344827586206895
sk
0.35344827586206895
hr
0.34782608695652173
yo
0.3409490333919156
sl
0.3218806509945751
sv
0.3055555555555556
no
0.30037313432835816
hu
0.2937853107344633
tr
0.29111531190926276
az
0.2816091954022989
de
0.27884615384615385
ro
0.2704280155642024
hi
0.1830065359477124
lt
0.17943107221006563
is
0.16666666666666666
eu
0.15730337078651685
lv
0.15730337078651685
vi
0.15730337078651685
reliable
true
passes
true
6
name
"Maria"
dialogue
"Sí! Allí! Allí en los bosques! Allí donde está el molino antiguo!"
detectedLang
"es"
heavyLang
"es"
scores
es
0.794344473007712
ca
0.693955623565417
pt
0.581151832460733
fr
0.5680345572354212
nl
0.5215311004784688
sv
0.41262848751835535
it
0.3620414673046252
tl
0.34318555008210183
da
0.34102141680395387
no
0.3311036789297659
hr
0.3103448275862069
ro
0.30915371329879104
tr
0.29701230228471004
yo
0.27007299270072993
cs
0.2673992673992674
de
0.25512104283054005
sk
0.2537313432835821
lt
0.2523364485981308
is
0.250936329588015
sl
0.250936329588015
hu
0.23809523809523808
fi
0.17355371900826447
eu
0.15789473684210525
sq
0.14346895074946467
az
0.12854030501089325
en
0.12854030501089325
ms
0.12854030501089325
reliable
true
passes
true
7
name
"Hunter"
dialogue
"I have to take this. Call the station."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8484848484848485
da
0.7440273037542662
tl
0.7380675203725262
no
0.6922024623803009
yo
0.6839887640449438
sv
0.6382636655948554
pl
0.5901639344262295
hr
0.5856353591160222
cs
0.5706106870229007
fr
0.5631067961165048
sq
0.5535714285714286
sk
0.5389344262295082
sl
0.5379876796714579
lv
0.5243128964059197
lt
0.5182012847965739
nl
0.506578947368421
it
0.49209932279909707
de
0.45652173913043476
ro
0.4260204081632653
ca
0.38016528925619836
ms
0.3784530386740331
tr
0.3644067796610169
az
0.358974358974359
et
0.3515850144092219
fi
0.267100977198697
zh
0.2549668874172185
be
0.23728813559322032
hu
0.22945205479452058
is
0.21875
uk
0.21875
vi
0.21875
reliable
true
passes
true