NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-05-27-01KSMEZR3FCKJ9N9K0KA0F1163
Run Details
Model:
Cydonia 24B V4.1
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
29.3s
Cost:
$0.000421
Provider:
Parasail
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1" data-color="red"> Approaching the castle gates, I saw a tall figure emerge from the shadows of the stables. Sir Roland, the local knight, stood briefly bathed in torchlight, his armor gleaming like blood in the evening glow. I reined Thunder to a stop, dismounting swiftly. "Welcome, young squire," Sir Roland said, his voice deep and gravelly. "I am Sir Roland of Ironhold. You must be Frederick. I've been expecting you." "Sir," I replied, bowing respectfully. "It's an honor to meet you. The journey was long but uneventful." "The King has spoken highly of your potential," Sir Roland continued, his eyes assessing me. "But potential means nothing without discipline. The coming days will test your resolve like never before, boy." "Yes, Sir Roland," I nodded, already feeling the weight of his expectations settling on my shoulders. </nc-section> <nc-section data-title="Version 2" data-color="green"> The moment I dismounted near the castle stables, a figure in polished plate armor emerged from the shadows. Sir Roland, the local knight, approached with steady, purposeful steps. "Frederick," he announced, his voice carrying across the stone courtyard. "I trust your travels were without incident." "All is well, Sir Roland," I answered, bowing my head. "Thank you for your congratulations." His eyes narrowed slightly. "I've sent word of your arrival to the castle. Early nights will be our new friend for some time." I glanced around the bustling stable area, noticing the palpable energy of knights and squires coming and going. The sound of swords being sharpened and armor being tended filled the air. "This castle looks to be quite busy, sir," I observed. "We are preparing for dark times," Sir Roland replied cryptically. "Your training will not be idyllic, Frederick. But perhaps the fates will smile upon you." </nc-section> <nc-section data-title="Version 3" data-color="blue"> The stable yard buzzed with activity when Thunder and I arrived. Sir Roland, arms crossed over his chestplate, was inspecting weapons as they were brought inside. He looked up as we approached, his eyes locking onto me with unnerving intensity. "Frederick," he acknowledged, not exactly warmly. "The stable boys will see to your horse. Come with me." His direct approach took me slightly off guard. I followed him toward the castle keep, the gravel crunching under our feet. "The castle goes through preparations," Sir Roland explained, his tone matter-of-fact. "There will be work for a squire before you even touch a sword." "But sir, I came to—" "No more words until you've earned them," he interrupted. "A squire's duty is service before pride. Your sword arm will have its turn, but boots must be cleaned, messages delivered, and early mornings spent sweating before our training begins." Looking at the massive castle before us, I realized my expectations of grand heroics might need to be scaled back. Learning discipline seemed to be my first real test. </nc-section>
created_at
"2026-05-27T10:16:51.579Z"
5/27/2026, 10:16:51 AM
model
"thedrummer/cydonia-24b-v4.1"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
214
moderation_latency
(null)
generation_time
29138
tokens_prompt
318
tokens_completion
788
native_tokens_prompt
291
native_tokens_completion
668
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.0004213
router
(null)
provider_responses
0
endpoint_id
"4d46db86-63fe-47eb-85f1-6a7567af190c"
id
"chatcmpl-709380be86954e0a955b825f4faedd6a"
is_byok
false
latency
214
model_permaslug
"thedrummer/cydonia-24b-v4.1"
provider_name
"Parasail"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.15.0; linux; x64))"
http_referer
(null)
request_id
"req-1779877011-mXktDeaLDMcHHc0acpkD"
session_id
(null)
api_type
"completions"
id
"gen-1779877011-0oXGxseP3Nr5xUvmibPC"
upstream_id
"chatcmpl-709380be86954e0a955b825f4faedd6a"
total_cost
0.0004213
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Parasail"
response_cache_source_id
(null)
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval