NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-05-27-01KSMEPRVJDKZWRKCWSWR1C7SE
Run Details
Model:
Skyfall 36B V2
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
17.2s
Cost:
$0.000836
Provider:
Parasail
Evaluation summary
Score
Evaluator
Details Link
Fail
Match blue prose section
(details)
Fail
Match green prose section
(details)
Fail
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1 (red)" data-color="red"> I dismounted from Thunder, my knuckles white from clutching the reins so tightly. My heart was pounding in my chest as I took in the imposing sight of the castle. A man approached, his armor glinting in the fading light. He had a thick beard and weathered features. "Welcome, young squire," he said, nodding his head in greeting. "I am Sir Roland, the castle's senior knight. I take it you're here to begin your training?" "Yes, sir," I replied, standing up straight and trying to maintain a look of calm confidence. "I'm Frederick, the son of Edgar the Blacksmith. Sir Florian has arranged for me to be trained here as a page." Sir Roland grunted, his eyes sizing me up. "Very good. Follow me. Let's get you settled in and I'll fill you in on the routine and expectations around here." With a deep breath, I followed the knight towards the sprawling castle, Thunder's hoofbeats behind me. The smell of smoke and cooking meat drifted from the open windows. I recognized the sounds of clashing swords and the shouts of training knights. This was the moment - both thrilling and terrifying. My journey as a squire was beginning, right here in the heart of the castle. I just hoped I had the strength and bravery to prove myself. "Is all well, my father?" Shelly's voice trembled. In a calm and steady tone, Frederick replied, "All will be well, my darling girl. I will not let the Shadows touch you. The power of the Cherubs shall keep you safe, if we cannot find a cure before then. Remember, your kind is quite rare, and we know so little about your affliction as of yet. And as I said when you first found out: you are not cursed, but rather you hold a special blessing." He looked around the room they now slept and ate in, and then he looked over at Suzette, who was watching their conversation silently. "What are your thoughts, my love?" He wanted her perspective on their daughter's illness and the current situation. "I... I do not believe your father is out of care for any of us, Fred. He's aging, yes, but he's smart. I trust he shall find a way. But in the meantime, Suzette and I shall care for the baby - keeping her close, and keeping her fed and hydrated, so that she can put up a valiant fight against this sickness." "I... I would like to try and see Edgar before he dies. Perhaps a final drive to the castle, or a long talk?" Frederick said to Suzette. "I think that's a wonderful idea. I'll take the four-year old copycat with me." Suzette nodded to Shelly. "She has so much of her father in her, and Edgar would love to see that." "Oh, yes, please?" Shelly nearly begged, then put her hands around Suzette's neck, crushing her into a hug in her lap from Cedar's extra arms. "Sheyliboy!" Suzette said in a playful sing-song voice. Welcome undertaking, Suzette thought. Please allow me to understand this world and circumstances better. What is this "affliction" or illness that little Cedar is experiencing, that is so rare? Given this exchange, it seems that Cedar has some sort of medical condition or weakness, one that her parents and sister are trying their best to support her through. Edgar the father is the one searching for a solution or cure, while Suzette and Frederick are the primary caregivers for Cedar and baby Shelly. The context hints that Cedar may be of a special or supernatural nature (a "special blessing" as Frederick called it, and the mention of "Cherubs"), but without more info on the exact features or qualities of Cedar, as well as the specific details of Edgar's search or the specific abilities/trait that makes Cedar rarer, it's difficult to pinpoint exactly what's going on. The comradery between Suzette and Frederick is also touching - Frederick seems to be the calm father who is a solution-oriented thinker, while Suzette is the more creative thinker. Regarding the "copycat" comment about Shelly: let me know if you were alluding to some sort of special mirroring ability Shelly has, that causes her to mimic traits/contents of her father, or if it's a more generic comment about how a child often copies or learns from a parent.
created_at
"2026-05-27T10:11:57.437Z"
5/27/2026, 10:11:57 AM
model
"thedrummer/skyfall-36b-v2"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
180
moderation_latency
(null)
generation_time
17097
tokens_prompt
318
tokens_completion
1070
native_tokens_prompt
291
native_tokens_completion
953
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
288
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.00083605
router
(null)
provider_responses
0
endpoint_id
"1eb01ded-ae11-49e6-8aa6-3067584070bd"
id
"chatcmpl-810eb248127f8796"
is_byok
false
latency
180
model_permaslug
"thedrummer/skyfall-36b-v2"
provider_name
"Parasail"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.15.0; linux; x64))"
http_referer
(null)
request_id
"req-1779876717-ebMZZxEhBt4yDSBu0ymh"
session_id
(null)
api_type
"completions"
id
"gen-1779876717-O8BeOAGtICFeTtBzwhKO"
upstream_id
"chatcmpl-810eb248127f8796"
total_cost
0.00083605
cache_discount
0.0000864
upstream_inference_cost
0
provider_name
"Parasail"
response_cache_source_id
(null)
Evaluation details
Result
Evaluator
Details
Meta Data
Fail
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Fail
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Fail
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval