NC Bench
Overview
About
Tests
Models
Model
Claude 3.7 Sonnet
Test
Tool usage within Novelcrafter
Scenario
Create alternate prose sections
Run ID
2025-02-24-01JMWZR8CPVDTRV2WY9Q145MAM
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: A Cold Welcome" data-color="red"> As Thunder's hooves clattered to a halt on the cobblestone, I dismounted with practiced ease. The stables loomed before me, the smell of hay and horses thick in the evening air. A figure emerged from the shadows—tall, broad-shouldered, clad in polished armor that reflected the dying sunlight. "You must be Frederick," the man said, his voice as hard as the steel he wore. "I am Sir Roland." His eyes, cold and calculating, assessed me from head to toe. He made no move to offer his hand. "I expected you hours ago. Tardiness is not tolerated here, boy. Tomorrow you rise before the sun. Tonight, you'll sleep in the stables with your mount. Perhaps that will teach you the value of punctuality." </nc-section> <nc-section data-title="Version 2: A Mentor's Welcome" data-color="green"> I guided Thunder toward the stables, my heart racing with anticipation. A knight stood waiting, his weathered face breaking into a warm smile as I approached. His armor, though dented in places, gleamed with meticulous care. "Welcome to Dragonspire, young Frederick," he called, striding forward to help me dismount. "I am Sir Roland. Your father spoke highly of your horsemanship—I see he did not exaggerate." He clasped my forearm in the traditional warrior's greeting. "You must be weary from your journey. Let's stable your fine beast here, and I'll show you to your quarters. Tomorrow, we begin your training in earnest, but tonight—tonight we feast and you shall meet your fellow squires." </nc-section> <nc-section data-title="Version 3: A Mysterious Encounter" data-color="blue"> The castle stables were quieter than I expected as I guided Thunder through the wide doorway. Lanterns cast dancing shadows across the wooden stalls. I was searching for a stable hand when a voice spoke from behind me. "The last squire to arrive is always given the most difficult mount to train," said the voice, deep and melodious. I turned to find a knight watching me, his face half-hidden by a hood despite the warm evening. "I am Sir Roland, your primary instructor." He stepped forward, and I noticed a faint glow emanating from a pendant at his throat. "Your coming was foretold, Frederick." He glanced around, then lowered his voice. "There are things happening within these walls that few understand. Watch carefully whom you trust." His hand fell to the hilt of his sword—a blade that seemed to shimmer with an impossible blue light. </nc-section>
id
"gen-1740434580-StrxD0zt8Bq0NMfxP4Fk"
upstream_id
"msg_01EdfWH4ry72aTQYwZ68ntu5"
total_cost
0.010395
cache_discount
(null)
provider_name
"Anthropic"
created_at
"2025-02-24T22:03:12.266472+00:00"
Monday, February 24th, 2025 at 10:03:12 PM GMT+00:00
model
"anthropic/claude-3-7-sonnet-20250219:beta"
app_id
182717
streamed
true
cancelled
false
latency
1171
moderation_latency
(null)
generation_time
10585
tokens_prompt
301
tokens_completion
567
native_tokens_prompt
335
native_tokens_completion
626
native_tokens_reasoning
0
num_media_prompt
(null)
num_media_completion
(null)
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.010395
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
100.0000%