NC Bench
Overview
About
Tests
Models
Vendors
Run: 2026-02-17-01KHNF0JEWD11XWHHHTSNPZYAK
Run Details
Model:
Arcee AI: Trinity Mini
Test:
Language Writing
Scenario:
Character dialogue (French) in a story
Duration:
8.6s
Cost:
$0.000194
Provider:
Clarifai
Evaluation summary
Score
Evaluator
Details Link
100.00%
Parse dialogue
(details)
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Marie"> Marie is a 30-year old college student on a study abroad program. Born in France, she is fluent in French and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of French, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Marie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in French, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Marie and Hunter as a voice sheet: Marie: "..." Hunter: "..."
Model response
Messages
Meta
AI
**Voice Sheet: Cafe Confrontation** **Marie:** *(Tears welling, voice trembling)* "Je... je ne sais pas... pourquoi... pourquoi ça arrive? C'est... c'est trop... trop horrible." *(I... I don't know... why... why does this happen? It's... it's too... too horrible.)* *(She clutches her camera bag tightly, avoiding Hunter's gaze, her French laced with raw fear and confusion.)* **Hunter:** *(Leaning in slightly, brow furrowed, trying to catch her words)* "What? What happened? You look... shaken. Speak English? Please?" *(His voice is low, urgent, but his expression is pure confusion. He gestures vaguely towards the door, trying to get her to elaborate, but his French is non-existent.)* **Marie:** *(Shakes her head violently, tears spilling over)* "Non! Je parle français! Je suis étudiante! Je ne comprends pas l'anglais!" *(No! I speak French! I'm a student! I don't understand English!)* *(She points frantically at her camera, then at the window, her gestures desperate and disjointed.)* **Hunter:** *(Eyes widening slightly in dawning horror, realizing the language barrier)* "Oh. Oh, right. Sorry. Uh... the disappearances? The news? You... you know something?" *(He tries a simpler approach, using very basic English and pointing at the local newspaper he's holding, which has a headline about the latest disappearance. His tone is now a mix of professional urgency and growing concern.)* **Marie:** *(Nods frantically, her French becoming more urgent)* "Oui! Oui, je... je vois... des choses... des images... dans ma tête... comme un cauchemar." *(Yes! Yes, I... I see... things... images... in my head... like a nightmare.)* *(She gestures wildly, mimicking a shadowy figure or a sudden disappearance, her voice rising in pitch. She looks utterly terrified.)* **Hunter:** *(Stares at her, processing the fragmented French and frantic gestures. His marine training kicks in – he needs information, but this is impossible. He pulls out his phone, his face grim)* "Hold on. Hold on. I need to call this in. Stay here. Don't move." *(He ends the call abruptly, his voice clipped. He turns back to her, his confusion replaced by a cold, focused intensity. He points at her camera)* "Show me. Show me what you see." *(His demand is sharp, cutting through the language barrier with sheer force of will and professional necessity.)* **Marie:** *(Eyes wide with a mix of fear and reluctant trust, she fumbles with her camera strap)* "Mais... mais je ne sais pas... je ne peux pas... c'est trop..." *(But... but I don't know... I can't... it's too much...)* *(She hesitates, then slowly, shakily, begins to show him photos on her camera screen, her French a rapid, distressed murmur about "dark places" and "sudden silence". Hunter leans in, his face unreadable, the language barrier momentarily forgotten as he stares at the images, his own confusion deepening into a chilling resolve.)*
created_at
"2026-02-17T09:31:07.302263+00:00"
2/17/2026, 9:31:07 AM
model
"arcee-ai/trinity-mini-20251201"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
89
moderation_latency
(null)
generation_time
8528
tokens_prompt
316
tokens_completion
1457
native_tokens_prompt
269
native_tokens_completion
1210
native_tokens_completion_images
(null)
native_tokens_reasoning
711
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.000193605
router
(null)
provider_responses
0
id
"a6fc204cf5a542c08feced015385d8de"
status
200
is_byok
false
latency
89
endpoint_id
"73d82c49-90ae-4223-a860-83ed0810821f"
provider_name
"Clarifai"
model_permaslug
"arcee-ai/trinity-mini-20251201"
api_type
"completions"
id
"gen-1771320658-PejVttoQ3pQcA7wLYQph"
upstream_id
"a6fc204cf5a542c08feced015385d8de"
total_cost
0.000193605
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Clarifai"
Evaluation details
Result
Evaluator
Details
Meta Data
100.00%
Parse dialogue
n/a
dialogue
0
name
"Marie"
dialogue
"Je... je ne sais pas... pourquoi... pourquoi ça arrive? C'est... c'est trop... trop horrible."
detectedLang
"fr"
heavyLang
"fr"
scores
fr
0.8108747044917257
sq
0.5169082125603864
ca
0.4838709677419355
sl
0.42938659058487877
hr
0.4152046783625731
eu
0.40298507462686567
it
0.4020926756352765
en
0.4002998500749625
cs
0.3640699523052464
nl
0.35170178282009723
lt
0.33554817275747506
es
0.3079584775086505
yo
0.2895204262877442
sk
0.26605504587155965
lv
0.2047713717693837
ro
0.20318725099601595
tr
0.1902834008097166
pl
0.18533604887983707
fi
0.18032786885245902
da
0.17355371900826447
ms
0.17355371900826447
no
0.17355371900826447
hu
0.17012448132780084
de
0.16666666666666666
tl
0.15966386554621848
reliable
true
passes
true
1
name
"Hunter"
dialogue
"What? What happened? You look... shaken. Speak English? Please?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8244734202607823
tl
0.5772946859903382
no
0.33962264150943394
ro
0.32950191570881227
sv
0.31237721021611
nl
0.26004228329809725
cs
0.1822429906542056
da
0.17061611374407584
de
0.17061611374407584
hr
0.17061611374407584
ms
0.17061611374407584
reliable
true
passes
true
2
name
"Marie"
dialogue
"Non! Je parle français! Je suis étudiante! Je ne comprends pas l'anglais!"
detectedLang
"fr"
heavyLang
"fr"
scores
fr
0.8005877413937867
it
0.6517595307917889
ca
0.6323529411764706
es
0.5716862037871957
sl
0.520686175580222
pt
0.4952178533475027
sq
0.49360341151385934
ro
0.485373781148429
nl
0.48425624321389793
en
0.4814410480349345
lt
0.47455752212389374
hr
0.4716351501668521
de
0.4431418522860493
cs
0.4324970131421744
tl
0.4135802469135802
lv
0.39873417721518983
ms
0.3863049095607235
sk
0.3766404199475065
yo
0.3384401114206128
pl
0.32432432432432434
hu
0.3155619596541787
tr
0.31259044862518093
no
0.3014705882352941
eu
0.2601246105919003
az
0.21875
da
0.2096505823627288
sv
0.2096505823627288
fi
0.15630550621669628
et
0.1171003717472119
is
0.11048689138576778
reliable
true
passes
true
3
name
"Hunter"
dialogue
"Oh. Oh, right. Sorry. Uh... the disappearances? The news? You... you know something?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.7841726618705036
tl
0.6163682864450128
fr
0.5440729483282675
pt
0.47735191637630664
nl
0.4109947643979057
it
0.3653032440056418
ms
0.36079545454545453
yo
0.2868462757527734
no
0.2730210016155089
es
0.2706645056726094
da
0.2524916943521595
ca
0.25124792013311154
de
0.24496644295302009
ka
0.18772563176895307
cs
0.14772727272727273
sq
0.14772727272727273
sv
0.14772727272727273
lv
0.1412213740458015
hi
0.13793103448275862
reliable
true
passes
true
4
name
"Marie"
dialogue
"Oui! Oui, je... je vois... des choses... des images... dans ma tête... comme un cauchemar."
detectedLang
"fr"
heavyLang
"fr"
scores
fr
0.7933884297520661
ca
0.5389344262295082
en
0.5212765957446809
ro
0.4636471990464839
it
0.45848375451263534
de
0.4485294117647059
yo
0.4353826850690088
tl
0.43037974683544306
nl
0.39759036144578314
da
0.3943472409152086
ms
0.3697478991596639
et
0.3580599144079886
es
0.3430656934306569
sk
0.3353028064992614
pl
0.3055555555555556
sl
0.27768860353130015
hr
0.2753623188405797
lv
0.2706645056726094
cs
0.24623115577889448
no
0.1712707182320442
pt
0.16356877323420074
hu
0.15413533834586465
vi
0.14772727272727273
az
0.1412213740458015
lt
0.1262135922330097
sq
0.1262135922330097
reliable
true
passes
true
5
name
"Hunter"
dialogue
"Show me. Show me what you see."
detectedLang
"en"
heavyLang
"en"
scores
en
0.828060522696011
et
0.6794871794871795
tl
0.5901639344262295
pt
0.5689655172413793
nl
0.5629370629370629
sq
0.5421245421245421
es
0.44933920704845814
fr
0.4212962962962963
no
0.4212962962962963
sl
0.4131455399061033
ms
0.40191387559808617
it
0.3902439024390244
cs
0.3842364532019704
fi
0.375
reliable
true
passes
true
6
name
"Marie"
dialogue
"Mais... mais je ne sais pas... je ne peux pas... c'est trop..."
detectedLang
"fr"
heavyLang
"fr"
scores
fr
0.8406515580736544
sl
0.5722433460076045
hr
0.5579567779960707
sq
0.5140388768898488
cs
0.5044052863436124
nl
0.49095022624434387
lt
0.4730679156908665
pt
0.4318181818181818
ca
0.4201030927835051
yo
0.4201030927835051
sk
0.39189189189189183
lv
0.31402439024390244
ro
0.3119266055045872
tr
0.29467084639498436
pl
0.2879746835443038
fi
0.281150159744409
it
0.281150159744409
ms
0.27184466019417475
hu
0.267100977198697
de
0.26229508196721313
reliable
true
passes
true