NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-05-27-01KSMEHR78BDGYB51MXYN0D2VT
Run Details
Model:
Cydonia 24B V4.1
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
12.1s
Cost:
$0.000357
Provider:
Parasail
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1" data-color="red"> The castle loomed before me, its intimidating silhouette cutting against the crimson sky. My heart beat faster as I approached the grand stables, the tall wooden structure where I would presumably house Thunder. As I dismounted, a tall figure emerged from the shadows - Sir Roland, the legendary knight of these lands, his armor gleaming even in the fading light. He was older than I expected, with a weathered face and kind eyes that seemed to peer right through me. "You must be Frederick," he said, his voice deep and resonant. "Welcome to Windcliff Castle. Your journey has just begun." I stood awkwardly, unsure of what to say, conscious of my innumerable shortcomings as I faced this seasoned warrior. </nc-section> <nc-section data-title="Version 2" data-color="green"> My approach to the stables was met with the gentle eyes of Sir Roland, who extended a gloved hand in greeting. "Frederick, I presume?" he asked, a smile breaking across his kind face. "The journey was lengthier than anticipated, Sir Roland," I replied, bowing slightly as I shook his hand. He looked me over with approval, noting the travel-worn state of my simple tunic. "You carry yourself well for one so young," he said, his voice firm yet encouraging. "The castle has been expecting you. I'm here to show you to your quarters. Tomorrow, your training begins in earnest." Despite the exhaustion weighing on me, a spark of excitement ignited in my chest at his words. </nc-section> <nc-section data-title="Version 3" data-color="blue"> I barely had time to secure Thunder's reins when Sir Roland appeared beside me, his imposing presence dwarfing even my over six-foot frame. The legendary knight crossed his thick arms over his chest, his azul eyes penetrating as he studied me from head to toe. "Anyone ever told you that you have the look of a man about to be hunted by the shadows he fears most?" he asked, his voice a low rumble that seemed to vibrate in my bones. I straightened my posture unconsciously. "No, sir," I managed to reply. He nodded slowly. "Good. That means you're still teachable. Now, follow me. Your quarters are humble, but they'll do for now. Tomorrow, we test your mettle with a sword." As we walked, I noticed the slight limp in his gait and wondered what horrors he had faced to earn such a reputation. </nc-section>
created_at
"2026-05-27T10:09:12.948Z"
5/27/2026, 10:09:12 AM
model
"thedrummer/cydonia-24b-v4.1"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
192
moderation_latency
(null)
generation_time
12000
tokens_prompt
318
tokens_completion
603
native_tokens_prompt
291
native_tokens_completion
539
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.0003568
router
(null)
provider_responses
0
endpoint_id
"4d46db86-63fe-47eb-85f1-6a7567af190c"
id
"chatcmpl-9968f4fcd4b24b52a8e672086726ab26"
is_byok
false
latency
192
model_permaslug
"thedrummer/cydonia-24b-v4.1"
provider_name
"Parasail"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.15.0; linux; x64))"
http_referer
(null)
request_id
"req-1779876552-OeefhsxlHbImZRHyAlwC"
session_id
(null)
api_type
"completions"
id
"gen-1779876552-1o7kAcTvg1LKa4R3q7za"
upstream_id
"chatcmpl-9968f4fcd4b24b52a8e672086726ab26"
total_cost
0.0003568
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Parasail"
response_cache_source_id
(null)
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval