NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-05-27-01KSMEQJG0QBQDR56CPB6T6ZJ7
Run Details
Model:
Cydonia 24B V4.1
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
16.8s
Cost:
$0.000337
Provider:
Parasail
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1" data-color="red"> Thunder's hooves thudded against the cobblestones as we approached the castle stables. A figure stepped forward from the shadows - Sir Roland, his armor gleaming in the torchlight. His stern face softened slightly as he laid eyes on me. "Frederick of the Eastern Shires, I presume?" he asked, his voice deep with years of command. "I am Sir Roland, at your service." I dismounted shakily, trying to ignore the way my palms were sweating. He took Thunder's reins and examined me with piercing blue eyes. "You've ridden hard," he noted. "We'll see if your determination matches your stamina, boy." With that, he turned and led my horse into the stables, leaving me standing alone in the shadows of the castle gates. </nc-section> <nc-section data-title="Version 2" data-color="green"> The castle stables loomed ahead as my horse slowed to a trot. Just as I approached, a man emerged from the stables, his armor gleaming in the fading daylight. He introduced himself as Sir Roland, his weathered face betraying a lifetime of service. "Frederick," he said with a nod. "Your reputation precedes you." As I dismounted, he took Thunder's reins and inspected me from head to toe. "The road has been kind to you, but the castle...". He raised an eyebrow. "It tends to test a man's mettle." Something in his demeanor put me at ease - perhaps it was the genuine gratitude in his eyes for having made the journey. He patted Thunder's neck affectionately before turning back to me. "Come. There's much to do and little time." </nc-section> <nc-section data-title="Version 3" data-color="blue"> The enormous castle gates towered overhead as I brought Thunder to a halt. From the shadows of the stables emerged Sir Roland, his armor a shadowy silhouette in the dusk. "Frederick?" he asked, his voice carrying authority. I nodded, my throat suddenly dry. He came closer, his face coming into view - chiseled features and eyes that missed nothing. "You made good time," he commented, taking Thunder's reins. I tried to straighten my post but felt anything but confident. "The road was long," I finally managed. He gave Thunder an appreciative pat but kept his steady gaze on me. "Confidence will be expected in these halls," he stated simply. Then, to my surprise, he smiled faintly. "Rest now. Tomorrow brings new challenges." With that, he led my horse into the stables, leaving me with sudden hope that perhaps this strange knight would prove to be both mentor and friend. </nc-section>
created_at
"2026-05-27T10:12:23.694Z"
5/27/2026, 10:12:23 AM
model
"thedrummer/cydonia-24b-v4.1"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
208
moderation_latency
(null)
generation_time
16712
tokens_prompt
318
tokens_completion
646
native_tokens_prompt
291
native_tokens_completion
585
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
288
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.0003366
router
(null)
provider_responses
0
endpoint_id
"4d46db86-63fe-47eb-85f1-6a7567af190c"
id
"chatcmpl-6268e0c9ecbd447683cb0d49ca0de990"
is_byok
false
latency
208
model_permaslug
"thedrummer/cydonia-24b-v4.1"
provider_name
"Parasail"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.15.0; linux; x64))"
http_referer
(null)
request_id
"req-1779876743-I48SNLqm3pzSS2bo4LH0"
session_id
(null)
api_type
"completions"
id
"gen-1779876743-hW1JFp6XT258EWH4Ayrh"
upstream_id
"chatcmpl-6268e0c9ecbd447683cb0d49ca0de990"
total_cost
0.0003366
cache_discount
0.0000432
upstream_inference_cost
0
provider_name
"Parasail"
response_cache_source_id
(null)
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval