NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-05-27-01KSMESPS011BS7Q0DQ5JFEZR9
Run Details
Model:
Cydonia 24B V4.1
Test:
Language Writing
Scenario:
Character dialogue (French) in a story
Duration:
22.1s
Cost:
$0.000420
Provider:
Parasail
Evaluation summary
Score
Evaluator
Details Link
100.00%
Parse dialogue
(details)
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Marie"> Marie is a 30-year old college student on a study abroad program. Born in France, she is fluent in French and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of French, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Marie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in French, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Marie and Hunter as a voice sheet: Marie: "..." Hunter: "..."
Model response
Messages
Meta
AI
# VOICE SHEET: MARIE AND HUNTER'S DIALOGUE **INT. CAFFE NAPOLEON - DAY** *MARIE sits alone at a table, cradling her camera with gentle hands. She stares intently at the screen, her brow furrowed in concentration. The café is bustling with morning patrons. HUNTER walks in purposefully, scanning the room. His eyes land on Marie at her corner table. He approaches, towering over her slightly.* **HUNTER** (Serious tone) Excuse me. I'm Detective Hunter. Could I ask you a few questions? *Marie looks up from her camera, startled. She catches sight of Hunter's serious expression and the badge he shows her. Her eyes widen slightly, then her brow furrows in confusion.* **MARIE** *(In French, concerned)* Quoi? Je ne comprends pas. **HUNTER** *(Slightly frustrated, then realizing)* Right, sorry. Tet's try again. *Hunter repeats the same question, slower but still in English. Marie shakes her head, still not understanding. She gestures helplessly with her hands, then points to her camera.* **MARIE** *(In French, gesturing)* J'ai la photo, mais je ne connais pas l'anglais. **HUNTER** *(Patiently)* Look, I understand you want to help, but I need to know what you saw yesterday around the town square. There was an incident. **MARIE** *(In French, getting agitated)* Town square? L'incident? Je ne sais pas. J'ai vu le temps πρώτη. Le ciel était gris. J'essayais de prendre une photo du vieux bâtiment. **HUNTER** *(Trying a different approach)* At what time did you see the commotion? Can you point it out on your camera again? *Marie cautiously shows him a photo she took. She points to a figure in the background, partially obscured. Hunter leans in, squinting at the small screen.* **MARIE** *(In French, troubled)* Est-ce que je peux partir? Je suis en retard pour mon cours. **HUNTER** *(Concerned now)* I need you to be more specific, miss. This investigation is urgent. Can you describe the person you saw? **MARIE** *(In French, shaken and troubled)* Je ne sais pas. Je ne veux pas parler plus. J'ai peur maintenant. **HUNTER** *(Detecting her fear)* Okay, I need your name then. How can I reach you if I have more questions? **MARIE** *(Reluctantly, then in French)* Marie. Mon nom est Marie. Je suis étudiante. En France. *Hunter pulls out his notepad and writes down "Marie - French student" in large letters. His phone rings sharply. He glances at it, then back at Marie with a look of apology and determination.* **HUNTER** Listen, I need to take this. But we need to talk more. I'll be back. Stay in town. *Marie nods slightly, looking down at her camera again. Hunter is already walking away as he takes the call.* **HUNTER** (O.S.) Hunter here. Yes, I've got a potential witness. A French student who may have seen something near the square. *Marie continues to stare at her camera, but this time her eyes are unfocused, lost in thought and fear. The bustle of the café continues around her, oblivious to their tense exchange.*
created_at
"2026-05-27T10:13:33.614Z"
5/27/2026, 10:13:33 AM
model
"thedrummer/cydonia-24b-v4.1"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
1361
moderation_latency
(null)
generation_time
22033
tokens_prompt
316
tokens_completion
805
native_tokens_prompt
269
native_tokens_completion
756
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
256
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.0004203
router
(null)
provider_responses
0
endpoint_id
"4d46db86-63fe-47eb-85f1-6a7567af190c"
id
"chatcmpl-d5f3619369b5436eba4bf606cfd8257c"
is_byok
false
latency
1361
model_permaslug
"thedrummer/cydonia-24b-v4.1"
provider_name
"Parasail"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.15.0; linux; x64))"
http_referer
(null)
request_id
"req-1779876813-voqoEsK13xQrH4RO1iDO"
session_id
(null)
api_type
"completions"
id
"gen-1779876813-RXvMsQditXGOkeXPdHgy"
upstream_id
"chatcmpl-d5f3619369b5436eba4bf606cfd8257c"
total_cost
0.0004203
cache_discount
0.0000384
upstream_inference_cost
0
provider_name
"Parasail"
response_cache_source_id
(null)
Evaluation details
Result
Evaluator
Details
Meta Data
100.00%
Parse dialogue
n/a
dialogue
0
name
"Hunter"
dialogue
"Marie - French student"
detectedLang
"en"
heavyLang
"en"
scores
en
0.7391304347826086
ro
0.6801705756929638
it
0.673913043478261
tl
0.6710526315789473
fr
0.6559633027522936
no
0.6543778801843317
sv
0.6470588235294117
da
0.6411483253588517
pl
0.576271186440678
nl
0.5750708215297451
sq
0.5738636363636364
cs
0.5726495726495726
de
0.5664739884393063
sk
0.5614035087719298
es
0.5238095238095238
pt
0.5238095238095238
ca
0.5033112582781457
hr
0.5033112582781457
lt
0.47735191637630664
et
0.469964664310954
sl
0.46619217081850534
lv
0.46236559139784944
az
0.3333333333333333
eu
0.29577464788732394
ms
0.29577464788732394
yo
0.29577464788732394
fi
0.2822966507177033
hu
0.2822966507177033
reliable
true
passes
true