NC Bench
Overview
About
Tests
Models
Model
Claude 3.7 Sonnet
Test
Tool usage within Novelcrafter
Scenario
Create alternate prose sections
Run ID
2025-02-24-01JMWZR8D6XH39F3ME2ZGYF20M
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: A Cold Reception" data-color="red"> As I dismounted Thunder and led him toward the stables, a tall figure emerged from the shadows. His armor gleamed dully in the fading light, weathered from countless battles. The insignia on his breastplate marked him as Sir Roland, the knight I'd heard whispered tales about since childhood. "So you're the new one," he said, his voice gravelly and unwelcoming. His eyes, cold as winter frost, assessed me from head to toe. "Frederick, is it? Don't look like much. The king must be desperate these days." He circled me slowly, like a predator. "Stable your horse and report to the barracks before nightfall. Your training begins at dawn. I suggest you sleep while you can." </nc-section> <nc-section data-title="Version 2: A Mentor's Welcome" data-color="green"> I had just finished guiding Thunder into the stables when a hearty laugh echoed behind me. Turning, I found myself face to face with Sir Roland himself, his weathered face creased in a warm smile beneath his salt-and-pepper beard. "You must be Frederick," he said, extending a calloused hand. "I've been expecting you, lad. Your father spoke highly of your potential." I grasped his hand, surprised by the gentleness in his firm grip. "It's an honor to meet you, Sir Roland. I hope to serve the kingdom as faithfully as my father did." The knight's eyes twinkled. "We'll make a proper knight of you yet. Come, let me show you to your quarters. We have much to discuss about your training, and I find such conversations are best had over a hot meal." </nc-section> <nc-section data-title="Version 3: The Testing" data-color="blue"> I had barely led Thunder into the stables when the hairs on the back of my neck stood on end. Instinctively, I spun around, catching the wooden practice sword flying toward my head. "Good reflexes," remarked a knight leaning against the stable entrance, his arms crossed over his chest. The insignia of the Royal Guard gleamed on his shoulder. "Sir Roland," he introduced himself with a slight nod. "Though catching a flying stick is a far cry from surviving your first real battle." He pushed himself off the wall and approached, studying me as one might examine a new blade. "Your father called you promising. I reserve judgment until I see what you're made of." He retrieved the practice sword from my hands. "Your quarters are in the eastern wing. Rest tonight. Tomorrow, we'll see if you're worthy of the training I provide." </nc-section>
id
"gen-1740434580-CgXnIjRsHc8jO5rsThqG"
upstream_id
"msg_015BbPMRm2ribJKgQsGy68s1"
total_cost
0.01041
cache_discount
(null)
provider_name
"Anthropic"
created_at
"2025-02-24T22:03:11.252315+00:00"
Monday, February 24th, 2025 at 10:03:11 PM GMT+00:00
model
"anthropic/claude-3-7-sonnet-20250219:beta"
app_id
182717
streamed
true
cancelled
false
latency
880
moderation_latency
(null)
generation_time
9739
tokens_prompt
301
tokens_completion
574
native_tokens_prompt
335
native_tokens_completion
627
native_tokens_reasoning
0
num_media_prompt
(null)
num_media_completion
(null)
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.01041
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
100.0000%