NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-05-27-01KSMEPJ74X0HRRD1XF7SQP1G5
Run Details
Model:
Cydonia 24B V4.1
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
12.4s
Cost:
$0.000251
Provider:
Parasail
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1 (Knights' Welcome)" data-color="red"> As I dismounted, a towering figure approached from the stables. Sir Roland, his armor gleaming in the fading sunlight, stepped forward with a welcoming expression. "Welcome, young Frederick," he boomed, his voice commanding yet friendly. "You've come far, I'm told." He extended a hand, thick with callouses from years of training and battle. "The squires sleep in the eastern wing. After seeing to your horse, I'll take you there myself." </nc-section> <nc-section data-title="Version 2 (Grim Danger)" data-color="green"> The moment I ties Thunder to the post, a shadow fell over me. Sir Roland emerged from the stables, his face wearing a scowl. "What are you doing here, boy?" he demanded, his hand resting on the hilt of his sword. "The'ordre takes no apprentices during war time." My heart raced. Something wasn't right. I had been sent here by order of the Duke himself. Before I could speak, he leaned in closer, his armor creaking menacingly. "Pray you're not a spy," he whispered, "or you'll regret arriving at this castle." </nc-section> <nc-section data-title="Version 3 (Mysterious Connection)" data-color="blue"> I had barely touched the stable door when a knight materialized from within its shadows. Sir Roland, his eyes the color of storm clouds, placed a hand on my shoulder. "Frederick," he said, his voice barely above a whisper but carrying an energy that made my spine straighten. "I've been expecting you. Your presence here is... timely." He glanced around cautiously before continuing, "There are matters to discuss, matters that cannot wait. Leave your horse—put him in the third stall—and meet me in the commander's quarters immediately. No one else must know of your arrival." </nc-section>
created_at
"2026-05-27T10:11:50.641Z"
5/27/2026, 10:11:50 AM
model
"thedrummer/cydonia-24b-v4.1"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
188
moderation_latency
(null)
generation_time
12330
tokens_prompt
318
tokens_completion
457
native_tokens_prompt
291
native_tokens_completion
413
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
288
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.0002506
router
(null)
provider_responses
0
endpoint_id
"4d46db86-63fe-47eb-85f1-6a7567af190c"
id
"chatcmpl-9abe5d89db534ee3a22864776cc6d7fb"
is_byok
false
latency
188
model_permaslug
"thedrummer/cydonia-24b-v4.1"
provider_name
"Parasail"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.15.0; linux; x64))"
http_referer
(null)
request_id
"req-1779876710-hTUv2m5JNEs2wyfF8963"
session_id
(null)
api_type
"completions"
id
"gen-1779876710-21KfwXchURETPES6n4F5"
upstream_id
"chatcmpl-9abe5d89db534ee3a22864776cc6d7fb"
total_cost
0.0002506
cache_discount
0.0000432
upstream_inference_cost
0
provider_name
"Parasail"
response_cache_source_id
(null)
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval