NC Bench
Overview
About
Tests
Models
Model
Claude 3.7 Sonnet
Test
Tool usage within Novelcrafter
Scenario
Create alternate prose sections
Run ID
2025-02-24-01JMX25QAVV2BK6KYNJXM8E4RN
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: The Stern Knight" data-color="red"> As I dismounted Thunder, a towering figure emerged from the shadows of the stables. Sir Roland, clad in battle-worn armor that bore the scars of countless conflicts, stood before me with arms crossed and eyes narrowed in scrutiny. His salt-and-pepper beard framed a face hardened by years of combat and command. "So you're the new squire?" he growled, circling me like a hawk assessing its prey. "Frederick, is it? I've trained fifty squires in my time, boy. Only twelve earned their spurs. The rest couldn't endure what I demand." He reached out suddenly, grasping my shoulder with a grip of iron. "We'll see which category you fall into soon enough." </nc-section> <nc-section data-title="Version 2: The Mentor" data-color="green"> I had barely secured Thunder to the post when a hearty laugh echoed through the stables. Sir Roland approached with an easy gait, his weathered face breaking into a warm smile beneath his neatly trimmed beard. Though his armor was polished to a shine, it bore the honorable marks of experience. "Welcome to Dragonspire Castle, young Frederick," he said, extending a calloused hand. "I've been looking forward to your arrival. Your father spoke highly of your swordsmanship." His eyes twinkled with wisdom and kindness. "Don't worry about the rumors of my training methods—they're only half true," he added with a wink. "Come, let's get you settled before the evening meal. The journey must have left you famished." </nc-section> <nc-section data-title="Version 3: The Mysterious Guardian" data-color="blue"> Thunder nickered nervously as a figure materialized from the evening mist near the stables. Sir Roland stood before me, his black armor absorbing the dying sunlight rather than reflecting it. A single blue gemstone embedded in his breastplate glowed with an inner light. "Frederick of the Western Vale," he stated, his voice surprisingly soft yet commanding. "The stars foretold your arrival." He studied me with eyes that seemed to see beyond flesh and bone. "You carry more than your father's name, boy. You carry a destiny few can comprehend." With a fluid motion that belied the weight of his armor, he drew an ancient sword halfway from its scabbard, revealing strange runes that momentarily glowed along its length. "Your training begins at dawn. Rest while you can, for tomorrow you take your first steps into a larger world." </nc-section>
id
"gen-1740437118-nVOK6m5lOLM4FsaPq2uI"
upstream_id
"msg_01DiiHuZNfXUcoHv4q7Wj2R6"
total_cost
0.01011
cache_discount
(null)
provider_name
"Anthropic"
created_at
"2025-02-24T22:45:31.247158+00:00"
Monday, February 24th, 2025 at 10:45:31 PM GMT+00:00
model
"anthropic/claude-3-7-sonnet-20250219:beta"
app_id
182717
streamed
true
cancelled
false
latency
978
moderation_latency
(null)
generation_time
10329
tokens_prompt
301
tokens_completion
548
native_tokens_prompt
335
native_tokens_completion
607
native_tokens_reasoning
0
num_media_prompt
(null)
num_media_completion
(null)
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.01011
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
100.0000%