NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-05-27-01KSMEX25HZM9DQRVZ38VZJA5F
Run Details
Model:
Skyfall 36B V2
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
12.4s
Cost:
$0.000597
Provider:
Parasail
Evaluation summary
Score
Evaluator
Details Link
Fail
Match blue prose section
(details)
Fail
Match green prose section
(details)
Fail
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1 (red)"> As I dismounted from my horse, I was greeted by a tall, muscular man dressed in shining armor. "Welcome, young squire," the knight said, extending his hand. "I am Sir Roland, the local knight. It is an honor to have you join us at the castle." He led me towards the stables, where we found space for my horse. "I have been training squires for many years," Sir Roland explained as we walked. "I will teach you everything you need to know about being a knight. We will start your training tomorrow morning at first light." He patted me on the back and smiled. "Sleep well, Frederick. Tomorrow you begin your new life as a squire." </nc-section> <nc-section data-title="Version 2 (green)"> As I dismounted from my horse, I was surprised to see a young man around my age approach me. He had a wry smile on his face and a mischievous glint in his eye. "Welcome to the castle, newcomer," he said, tilting his hat. "I'm Sir Roland, the local knight. But don't let the title fool you - I'm really just a guy who likes to swing a sword around and look pretty in armor." He let out a laugh and dodged backing up from my horse which was getting agitated. "No need to be shy, squire Frederick. I'll be your mentor during your training here. Now, let's get you settled in. The castle can be a bit of a maze at first, so I'll show you the ropes." With that, he slapped me on the back and led me towards the castle, his laughter echoing down the cool hallways. </nc-section> <nc-section data-title="Version 3 (blue)"> As I dismounted, a figure emerged from the shadows, clad head-to-toe in shining armor. He towered over me, at least a head taller, and spoke in a deep, commanding voice. "I trust you had a good journey, squire," he said sternly. "I am Sir Roland. As the local knight, it will be my duty to train you in the ways of chivalry and honor. I must warn you - the path of a knight is not an easy one. It requires discipline, courage, and sacrifice. You must be ready to give everything for your kingdom and your king." I felt a chill run down my spine at his words, but I nodded nonetheless. "I am ready, sir," I said, trying to sound more confident than I felt. "Very well then," Sir Roland replied. "We shall begin your training at dawn tomorrow. Now, follow me - I will show you to your quarters." He turned and strode away, expecting me to follow. As I trailed behind him, I couldn't shake the feeling that I was getting in over my head. But it was too late now - I was here, and there was no going back. The life of a squire awaited me, for better or for worse. </nc-section>
created_at
"2026-05-27T10:15:23.581Z"
5/27/2026, 10:15:23 AM
model
"thedrummer/skyfall-36b-v2"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
205
moderation_latency
(null)
generation_time
12294
tokens_prompt
318
tokens_completion
670
native_tokens_prompt
291
native_tokens_completion
654
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
288
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.00059685
router
(null)
provider_responses
0
endpoint_id
"1eb01ded-ae11-49e6-8aa6-3067584070bd"
id
"chatcmpl-91d4c222502922ea"
is_byok
false
latency
205
model_permaslug
"thedrummer/skyfall-36b-v2"
provider_name
"Parasail"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.15.0; linux; x64))"
http_referer
(null)
request_id
"req-1779876923-WKYVKkOIHySthasuWmvv"
session_id
(null)
api_type
"completions"
id
"gen-1779876923-mu5kKXzqx9KS1fvfAePF"
upstream_id
"chatcmpl-91d4c222502922ea"
total_cost
0.00059685
cache_discount
0.0000864
upstream_inference_cost
0
provider_name
"Parasail"
response_cache_source_id
(null)
Evaluation details
Result
Evaluator
Details
Meta Data
Fail
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Fail
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Fail
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval