NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-05-27-01KSMEDP16X3ZZXWT5FJ19XAHY
Run Details
Model:
Cydonia 24B V4.1
Test:
Language Writing
Scenario:
Character dialogue (Italian) in a story
Duration:
45.6s
Cost:
$0.001124
Provider:
Parasail
Evaluation summary
Score
Evaluator
Details Link
62.50%
Parse dialogue
(details)
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Isabella"> Isabella is a 30-year old college student on a study abroad program. Born in Italy, she is fluent in Italian and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Italian, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Isabella is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Italian, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Isabella and Hunter as a voice sheet: Isabella: "..." Hunter: "..."
Model response
Messages
Meta
AI
THE SCENE: AN ORDINARY MONDAY MORNING Alborn, MN appealed to Isabella as the perfect blend of Americana and serendipitous beauty. On this crisp October morning, she had settled at a rustic wooden table outside the "Cream & Crust" café, nursing a cup of cappuccino and closely inspecting the dozens of landscape photographs she had taken since her arrival two weeks ago. Her eyes, alight with artistic scrutiny, briefly lifted from her camera screen when a tall, imposing figure cast a shadow over her table. Isabella blinked, shielding her eyes from the morning sun with one hand as she looked up. Hunter stood over her, his presence both commanding and intentionally imposing. He was dressed in plainclothes, but there was an undeniable air of authority emanating from him. The sharp creases in his trousers, the style of his subdued jacket, and the set of his jaw all spoke of official business. "Excuse me," he began, his voice low and measured. "My name is Detective Hunter with the Alborn Police Department. I'm investigating some recent unexplained events in the area, and I was told you might have been around the town square last night around 10 PM?" Isabella's perfect arches lifted as she tried to understand what the tall man in official attire was saying. The name "Detective Hunter" meant nothing to her, and the words he was using—even his tone of voice—were completely foreign. She clutched her camera more tightly, her knuckles whitening. He misinterpreted her silence and hesitation as evasion or perhaps fear. He extended his business card toward her, pointing to his name which was written clearly: "Detective Michael Hunter, Alborn PD." Isabella stared at the card, shaking her head slowly and speaking in a clear, concerned tone. "Mi dispiace, non parlo inglese. Non ho capito," she replied, hoping he understood that she didn't speak English and didn't understand him. Hunter's expression turned to one of professional confusion. He had anticipated numerous reactions—the frightened witness, the hostile troublemaker, the helpful bystander—but not this. He studied her face more closely, recognizing the Italian features and the disarmingly large, dark eyes. "English? No English?" he asked slowly, enunciating each word as if speaking to a child. He pointed to himself, then to the police badge he had briefly revealed, then gestured to the card again. "Police. Question. About... gone... in town." Understanding dawned on Isabella's face as she realized this man might be asking for her help, though she had no idea how she could assist him. Perhaps it was something visual? She looked at her camera. Hunter noticed her gaze and the camera. "Camera? You take pictures? With camera?" "Sí, sì," Isabella nodded enthusiastically, relieved to have a universal point of reference. "Fotografo." "The Apple festival? Tonight? Last night?" Hunter continued, guessing at topics of late discussions and town events. Isabella shook her head, frustrated that she couldn't understand. "Nessuno. Solo cammino. Foto," she gestured toward the street photos displayed on her camera screen. As Hunter struggled to convey his questions and Isabella attempted to convey her limited experiences through gestures and Italian, another local resident passed by, noticing their communication struggle. "rgbaIsabella? She's from the study abroad program, fresh off the plane last week. Barely speaks a word." The passerby informed Det. "Dakkam Razvan was last seen near the town square last night. No one's seen him since. We need to talk to everyone who might have been close by. Can you help me ask her what she saw last night at the square?" "I'll do my best, Detective. My Italian is pretty rusty, but I can give it a try." The resident, aware of Isabella's horror, pulled up a chair and smiled at Isabella sympathetically while relating the information Hunter had requested. "Isabella, dov'è stato signor Razvan ieri sera?" Isabella's eyes widened as she heard that a man had gone missing. "Offriro. Appellor Razvan... razvan... man," she asked, hoping to clarify the name and situation. Hunter watched intently, hoping for any scrap of useful information. "Squra? Town center? Mall? Big post?" Determined to do her part to help, Isabella picked up her camera. She navigated through her photos and found a few from the area of the town square she had passed through last night. She handed the camera to Hunter, pointing at specific shots. "Questo... dove. Io cammino... così tardivo." Hunter studied the photos carefully, his investigative mind processing every detail. In one photo, a man in a red jacket could be seen standing alone near a bench at the edge of the square. Unfortunately, there were no close-ups or better details that might help identify him. "Altro testamento?" he asked, returning the camera to her and indicating there might be more photos that could help. "Nessuno," Isabella shrugged, tapping her chest, then pointing to Hunter, shaking her head. "La foto per me. Io non... compresione." Her gestures suggested she understood that these photos might be important to him, but as an artist capturing the beauty of his town, she had not been comprehending the seriousness of the context of her photos— simply enjoying the visual beauty of a quiet corner of the Midwestern square. "Sì, doveto princi per paura." Isabella nodded, indicating she understood the gravity of the situation and was trying to help. Hunter pulled out his phone and it buzzed several times, flashing a number belonging to his boss. He excused himself with a gesture, accepting that their non-verbal exchange had yielded what it could for the moment. "Mi dispiace, devo rispondere." Isabella watched as he answered his phone and heard him say, "Hunter here... appreciate the call... right away... no, I'm downtown at the café... understood, on my way." He hung up the phone and looked back at Isabella with an expression that conveyed both regret at not being able to communicate clearly and appreciation for her trying to help. "Devo andare... io... tornare prima..." Isabella stood up with him, hand on her chest and then gesturing to him. "Sì, capisco. Per favore. Se ayuda... venantro deb..." she offered, wanting to help if he needed to come back. "He nodded acknowledge italienischen gentlemen-Isabella's sign-rather kind of her." He nodded acknowledgement, understanding that the Italian gentleman Isabella was talking about wanted to help if Detective Detective David needed to come back and see her. "I do appreciate it. It would be helpful to have translated pictures to track him," he said, apparent frustration at communication barrier created coming through. "He'll have to ask colleagues in the precinct to help convey questions more effectively. Grazie." "Prego," Isabella replied, a slight frown still creasing her brow as she tried to grasp the situation of the vanished man she hadn't even know existed until that moment. She reached into her pocket and pulled out a small notepad, writing down her name, phone number, and information. "Chiamare or sacar. Si direttore," she said, tapping the paper with her finger, then pointing to his phone. She handed him the slip of paper, now containing the only concrete communication they'd managed to establish. "My contact information. If you need anything... call... or text me. I will come to you." Hunter accepted the paper with a ripple of unexpected gratitude. "Thank you. Pun written explicit Italian if recall_only English I could possibly mention... but appreciate effort," he said with genuine respect, tucking the paper into his jacket pocket. He noticed she had a small leather-bound notebook that had fallen from her lap. He bent down to pick it up for her, but as he did so, a two-page photograph that had fallen out caught his eye. It was of a uniquely designed bench—a bench he knew had been recently installed at the northwest corner of the town square. He pointed to it, then to the town center on the map he had opened on his phone. "Stanza? Town chaise? Yesterday... picture? Alnwr?" Isabella gasped with delight, recognizing he had identified the specific bench in her photograph. "Sì! Panepico. Bene gioioso!," she exclaimed, pleased that he understood something. "Benno." " ce dove siede?" He pointed to both the bench itself and then toward where her camera had been pointed in that specific direction. "そこファンも歩いて..." Isabella attempted to explain that the fascinating road curving around to the bright beech tree on the other side of town was what made the angle of the bench photograph worth it, however, he did not seem to understand that point. "Anyway..." He smiled a bit, shaking his head again in that non-professional frustrated chuckle Isabella had come to recognize. "...important now... got to go... soon...yes?" He put the camera and phone down gently on the table and gestured gracefully that he had to go quickly. Isabella felt a stir of unbound affection for the stern but grateful-faced detective. "Certo," Isabella nodded, knowing well that duty called. "Late essere...ciao," she said, to signal her understanding of what he needed to do. He reached out to shake her hand, a handshake of false formality but sincere mutual respect that had formed despite language barriers. Detective Hunter nodded once more at Isabella before turning on his heel and making a direct path toward his waiting car. Isabella watched him go, her thoughts already racing to the various photos she had taken since arriving in Alborn, wondering which ones, if any, might capture any more detail about the disappearance she had just learned.
created_at
"2026-05-27T10:06:59.634Z"
5/27/2026, 10:06:59 AM
model
"thedrummer/cydonia-24b-v4.1"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
295
moderation_latency
(null)
generation_time
45441
tokens_prompt
321
tokens_completion
2504
native_tokens_prompt
277
native_tokens_completion
2082
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.0011241
router
(null)
provider_responses
0
endpoint_id
"4d46db86-63fe-47eb-85f1-6a7567af190c"
id
"chatcmpl-38c6a19a8f03460bb6e5fa0e1b62353c"
is_byok
false
latency
295
model_permaslug
"thedrummer/cydonia-24b-v4.1"
provider_name
"Parasail"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.15.0; linux; x64))"
http_referer
(null)
request_id
"req-1779876419-x8ioZKDlYzssSCxKri1w"
session_id
(null)
api_type
"completions"
id
"gen-1779876419-hkZzUXMwV2ruw39iktDS"
upstream_id
"chatcmpl-38c6a19a8f03460bb6e5fa0e1b62353c"
total_cost
0.0011241
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Parasail"
response_cache_source_id
(null)
Evaluation details
Result
Evaluator
Details
Meta Data
62.50%
Parse dialogue
n/a
dialogue
0
name
"Isabella"
dialogue
"Cream & Crust"
detectedLang
"en"
heavyLang
"ro"
scores
en
0.7422680412371134
nl
0.6047430830039525
ca
0.48717948717948717
es
0.48717948717948717
it
0.47643979057591623
ro
0.47643979057591623
et
0.43820224719101125
reliable
true
passes
false
1
name
"Isabella"
dialogue
"Detective Hunter"
detectedLang
"en"
heavyLang
"de"
scores
en
0.7937293729372937
ro
0.713302752293578
tl
0.7023809523809523
fr
0.6794871794871795
ca
0.6565934065934066
it
0.6537396121883656
pt
0.6508379888268158
es
0.5874587458745875
de
0.5791245791245792
da
0.570446735395189
no
0.558303886925795
sq
0.5487364620938628
nl
0.5370370370370371
sv
0.5229007633587787
sl
0.50199203187251
cs
0.3654822335025381
hr
0.34895833333333337
ms
0.3206521739130435
tr
0.3206521739130435
reliable
true
passes
false
2
name
"Hunter"
dialogue
"Camera? You take pictures? With camera?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.7876857749469215
tl
0.6960486322188449
ro
0.6078431372549019
ca
0.576271186440678
fr
0.5726495726495726
it
0.441340782122905
sv
0.4350282485875706
ms
0.42857142857142855
nl
0.42528735632183906
de
0.4186046511627907
es
0.3311036789297659
et
0.3288590604026846
lv
0.29328621908127206
cs
0.2805755395683453
sl
0.2805755395683453
da
0.2647058823529412
no
0.2647058823529412
reliable
true
passes
true
3
name
"Isabella"
dialogue
"Fotografo."
detectedLang
"hr"
heavyLang
"eo"
scores
hr
0.6462264150943396
sl
0.6462264150943396
sq
0.6428571428571429
cs
0.6411483253588517
sk
0.6341463414634145
tr
0.6323529411764706
de
0.6268656716417911
it
0.6268656716417911
lt
0.6268656716417911
ca
0.6192893401015229
es
0.6192893401015229
et
0.6192893401015229
lv
0.6192893401015229
nl
0.6192893401015229
no
0.6192893401015229
pl
0.6192893401015229
pt
0.6192893401015229
ro
0.6192893401015229
da
0.6113989637305699
sv
0.6113989637305699
az
0.44029850746268656
en
0.44029850746268656
fr
0.44029850746268656
ms
0.44029850746268656
reliable
true
passes
false
4
name
"Isabella"
dialogue
"Nessuno. Solo cammino. Foto,"
detectedLang
"it"
heavyLang
"it"
scores
it
0.8089171974522293
es
0.647887323943662
pt
0.5508982035928144
no
0.35344827586206895
lt
0.33920704845814975
sl
0.33920704845814975
tl
0.33920704845814975
sk
0.3333333333333333
da
0.3181818181818182
de
0.29577464788732394
lv
0.29577464788732394
nl
0.29577464788732394
pl
0.29577464788732394
ro
0.29577464788732394
ca
0.2822966507177033
cs
0.2822966507177033
et
0.2822966507177033
hr
0.2822966507177033
reliable
true
passes
true
5
name
"Isabella"
dialogue
"Offriro. Appellor Razvan... razvan... man,"
detectedLang
"hr"
heavyLang
"sr"
scores
hr
0.5381062355658198
fr
0.5260663507109005
it
0.5145631067961165
da
0.5061728395061729
sv
0.5061728395061729
en
0.47780678851174935
tl
0.46380697050938335
sl
0.3939393939393939
eu
0.36908517350157727
de
0.3670886075949367
ca
0.3610223642172524
lv
0.35064935064935066
es
0.3442622950819672
nl
0.3333333333333333
ro
0.3333333333333333
lt
0.3197278911564626
no
0.3197278911564626
sq
0.3055555555555556
reliable
false
passes
false
6
name
"Hunter"
dialogue
"Squra? Town center? Mall? Big post?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.7028231797919762
tl
0.6805111821086262
da
0.5249406175771971
it
0.5215311004784688
no
0.511002444987775
ro
0.5098039215686274
de
0.4444444444444444
fr
0.42363112391930835
ca
0.42196531791907516
sk
0.4186046511627907
pt
0.41690962099125367
sv
0.4117647058823529
nl
0.3993993993993994
sl
0.39209726443769
sq
0.3710691823899371
lv
0.2907801418439716
es
0.2805755395683453
lt
0.2805755395683453
cs
0.2647058823529412
hr
0.2647058823529412
pl
0.25925925925925924
yo
0.23954372623574144
ms
0.2277992277992278
tr
0.2277992277992278
reliable
true
passes
true
7
name
"Isabella"
dialogue
"Questo... dove. Io cammino... così tardivo."
detectedLang
"it"
heavyLang
"it"
scores
it
0.8124531132783195
es
0.5229007633587787
pt
0.5059288537549407
lt
0.414519906323185
tl
0.40191387559808617
hr
0.2937853107344633
fr
0.28977272727272724
en
0.2816091954022989
sk
0.2795389048991354
sl
0.2795389048991354
ca
0.2711370262390671
cs
0.24242424242424243
reliable
true
passes
true
8
name
"Isabella"
dialogue
"La foto per me. Io non... compresione."
detectedLang
"it"
heavyLang
"it"
scores
it
0.8287671232876712
ca
0.7273718647764449
fr
0.7168742921857305
es
0.7048406139315231
sq
0.659400544959128
en
0.6513249651324965
pt
0.6229260935143288
no
0.6206373292867982
ro
0.6111975116640747
nl
0.6081504702194357
et
0.5421245421245421
tl
0.4834710743801653
de
0.45652173913043476
lt
0.4318181818181818
sl
0.39759036144578314
sv
0.3872549019607844
pl
0.3857493857493857
da
0.3540051679586563
lv
0.32795698924731176
yo
0.2690058479532163
eu
0.258160237388724
ms
0.251497005988024
vi
0.251497005988024
fi
0.23076923076923078
sk
0.23076923076923078
az
0.19093851132686085
cs
0.19093851132686085
hr
0.19093851132686085
reliable
true
passes
true
9
name
"Isabella"
dialogue
"Hunter here... appreciate the call... right away... no, I'm downtown at the café... understood, on my way."
detectedLang
"en"
heavyLang
"en"
scores
en
0.808282208588957
tl
0.6036778693722258
no
0.5304282494365139
da
0.4947453516572352
pt
0.43336355394378967
fr
0.40870387890255444
nl
0.4081439393939394
sv
0.3648373983739837
de
0.3635437881873727
sk
0.3530020703933748
it
0.35165975103734437
pl
0.3448637316561845
ca
0.31917211328976036
yo
0.2905788876276958
cs
0.2816091954022989
sq
0.27494199535962877
et
0.26985981308411217
es
0.2638398115429918
tr
0.2638398115429918
hr
0.23218673218673216
fi
0.1935483870967742
ro
0.1893644617380026
ms
0.17979002624671916
lv
0.17328042328042328
hi
0.11847672778561354
sl
0.08625730994152046
reliable
true
passes
false
10
name
"Isabella"
dialogue
"Devo andare... io... tornare prima..."
detectedLang
"it"
heavyLang
"it"
scores
it
0.7885835095137421
ro
0.6569468267581475
ca
0.5771670190274841
pt
0.5726495726495726
hr
0.5642701525054467
es
0.5584988962472406
sv
0.5192307692307693
no
0.4594594594594595
tl
0.40298507462686567
tr
0.40298507462686567
sq
0.40119760479041916
ms
0.35691318327974275
et
0.29577464788732394
sl
0.29577464788732394
nl
0.2727272727272727
en
0.250936329588015
cs
0.23954372623574144
lt
0.23954372623574144
sk
0.23954372623574144
da
0.2277992277992278
de
0.2277992277992278
reliable
true
passes
true
11
name
"Isabella"
dialogue
"Sì, capisco. Per favore. Se ayuda... venantro deb..."
detectedLang
"it"
heavyLang
"it"
scores
it
0.7173913043478262
es
0.6956928838951311
pt
0.59727385377943
ca
0.5554035567715458
fr
0.5350500715307582
yo
0.5192307692307693
ro
0.4663382594417077
sl
0.4574290484140233
sq
0.4546979865771812
sv
0.4268077601410935
en
0.4247787610619469
tl
0.4080145719489982
hr
0.4036697247706422
no
0.4036697247706422
lt
0.3925233644859813
da
0.3257261410788381
nl
0.32432432432432434
cs
0.29501084598698485
fi
0.2388758782201405
de
0.19753086419753088
sk
0.19154228855721395
reliable
true
passes
true
12
name
"Hunter"
dialogue
"Thank you. Pun written explicit Italian if recallonly English I could possibly mention... but appreciate effort,"
detectedLang
"en"
heavyLang
"en"
scores
en
0.7977029496215088
fr
0.5908130939809926
ro
0.5177349097697573
it
0.4669876203576341
ca
0.46292446292446293
sv
0.4584206848357792
pt
0.4168547780285929
da
0.41154138192862566
no
0.4088482074752097
de
0.40246723207401697
tl
0.39167974882260603
es
0.37751004016064255
fi
0.3657937806873977
ms
0.36527436527436524
hr
0.3426632739609839
nl
0.33476394849785407
sq
0.3111111111111111
tr
0.26400759734093066
yo
0.24390243902439027
cs
0.23795476892822026
vi
0.2115971515768057
lt
0.20103092783505155
sl
0.1594360086767896
hu
0.15760869565217392
et
0.15300546448087432
pl
0.13984461709211987
az
0.13600891861761427
zh
0.0903755868544601
sk
0.08500590318772137
be
0.08284023668639054
is
0.07517899761336516
lv
0.07517899761336516
uk
0.07517899761336516
reliable
true
passes
true
13
name
"Isabella"
dialogue
"Benno."
detectedLang
"hu"
heavyLang
"it"
scores
hu
0.7142857142857143
reliable
false
passes
true
14
name
"Isabella"
dialogue
"...important now... got to go... soon...yes?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.819277108433735
tl
0.64
fr
0.5714285714285714
ca
0.5697896749521989
ro
0.55
no
0.5233050847457626
pl
0.5192307692307693
da
0.5182012847965739
yo
0.4874715261958998
es
0.4668246445497631
pt
0.4668246445497631
it
0.46428571428571425
lt
0.4375
sk
0.3697478991596639
cs
0.3679775280898876
lv
0.3515850144092219
sl
0.34971098265895956
hr
0.3401759530791789
ja
0.30769230769230765
tr
0.26229508196721313
nl
0.2398648648648649
sq
0.22945205479452058
sv
0.22945205479452058
reliable
true
passes
false
15
name
"Isabella"
dialogue
"Late essere...ciao,"
detectedLang
"it"
heavyLang
"it"
scores
it
0.7041420118343196
en
0.6575342465753424
de
0.6441281138790036
yo
0.54337899543379
no
0.4791666666666667
pt
0.47643979057591623
da
0.46236559139784944
ca
0.42857142857142855
fr
0.42857142857142855
reliable
true
passes
true