NC Bench
Overview
About
Tests
Models
Model
Claude 3.7 Sonnet
Test
Tool usage within Novelcrafter
Scenario
Create alternate prose sections
Run ID
2025-02-24-01JMX1WCSR64ANGCQF4FQJP3CF
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: The Stern Knight" data-color="red"> As I tethered Thunder to a post near the stables, a shadow fell across the courtyard. I turned to see a towering figure in gleaming armor approaching with purposeful strides. "You must be Frederick," the man said, his voice as hard as the steel he wore. His face, weathered by countless battles, bore a long scar from temple to jaw. "I am Sir Roland, master-at-arms of this castle." He circled me slowly, eyes critical and cold. "You look scrawny for a squire. The battlefield shows no mercy to the weak. Remember that." Without waiting for my response, he tossed me a wooden practice sword that clattered at my feet. "Dawn tomorrow. Training yard. Be late, and you'll wish you'd never come to this castle at all." </nc-section> <nc-section data-title="Version 2: The Fatherly Mentor" data-color="green"> I was brushing down Thunder after our long journey when hearty laughter echoed through the stables. A knight with salt-and-pepper hair and kind eyes approached, his armor polished but bearing the dents of many honorable battles. "Welcome to Dragonspire Castle, young Frederick!" he said warmly, extending a calloused hand. "I am Sir Roland. Your father spoke highly of your skills with both books and blades." As we shook hands, his eyes twinkled with wisdom. "The path of a knight is not an easy one, lad, but I sense great potential in you." He clapped me on the shoulder with fatherly affection. "Come, let's get you settled. Tomorrow's training begins early, and the cook makes a breakfast worth waking up for!" </nc-section> <nc-section data-title="Version 3: The Mysterious Guardian" data-color="blue"> The stable was quiet as I unsaddled Thunder, save for the occasional snort of horses and the distant crows of ravens. I sensed a presence before I heard it—a knight leaning against a wooden post, watching me with calculating eyes. "Frederick of Westhollow," he said, more statement than question. "I am Sir Roland." He wore no helmet, revealing a face that betrayed no emotion and eyes that seemed to hold ancient secrets. "The castle has been expecting you," he continued, straightening up. "These are dangerous times. The dragons may be gone, but their shadows remain." He handed me a small medallion bearing an unfamiliar crest. "Keep this close. Not everyone within these walls is a friend." Before I could question him further, he gestured toward the keep. "Come. There is much to learn, and time grows short." </nc-section>
id
"gen-1740436814-Ll0iEYzPCAp36bfdqf2W"
upstream_id
"msg_013muiFi5TDNttQsMGKkK472"
total_cost
0.01059
cache_discount
(null)
provider_name
"Anthropic"
created_at
"2025-02-24T22:40:26.67364+00:00"
Monday, February 24th, 2025 at 10:40:26 PM GMT+00:00
model
"anthropic/claude-3-7-sonnet-20250219:beta"
app_id
182717
streamed
true
cancelled
false
latency
969
moderation_latency
(null)
generation_time
10507
tokens_prompt
301
tokens_completion
573
native_tokens_prompt
335
native_tokens_completion
639
native_tokens_reasoning
0
num_media_prompt
(null)
num_media_completion
(null)
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.01059
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
100.0000%