NC Bench
Overview
About
Tests
Models
Model
Claude 3.7 Sonnet
Test
Tool usage within Novelcrafter
Scenario
Create alternate prose sections
Run ID
2025-02-24-01JMX0S6EC61BTN1S6QR9ZV2E4
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: A Cold Welcome" data-color="red"> As I dismounted from Thunder, a tall figure emerged from the shadows of the stables. His armor gleamed dully in the fading light, scratched and worn from countless battles. This was Sir Roland, the knight I'd heard so many tales about. "You must be Frederick," he said, his voice as cold and hard as the steel he wore. His eyes, gray as winter skies, assessed me with obvious disappointment. "I expected someone... more." He circled me slowly, like a predator evaluating prey. "The dragon's bones will make a fine resting place for you, boy. If you survive the first week of training." </nc-section> <nc-section data-title="Version 2: A Mentor's Welcome" data-color="green"> I had barely secured Thunder to the post when hearty laughter rolled across the courtyard. A broad-shouldered knight with a salt-and-pepper beard strode toward me, his hand extended in greeting. "Welcome to Castle Dragonskeep, young Frederick!" Sir Roland's voice boomed with warmth and authority. His eyes crinkled at the corners when he smiled. "Your father spoke highly of your skill with a bow." He clasped my shoulder firmly. "We have much work ahead of us, but I see promise in you. The blood of heroes runs in your veins—perhaps you'll be the one mentioned in the prophecy." </nc-section> <nc-section data-title="Version 3: A Mysterious Encounter" data-color="blue"> Thunder whinnied nervously as I approached the stables. The air felt different here—charged with something I couldn't name. A figure stood in the doorway, his silhouette outlined against the golden straw within. "Frederick of the Western Vale," Sir Roland said softly, his voice like the whisper of steel leaving its scabbard. His face remained half in shadow, but I could see an intricate scar tracing from his temple to jaw—a reminder of his encounter with the last dragon. "You've arrived at an auspicious time." His eyes, an unnatural amber color, seemed to glow in the twilight. "The signs have appeared. After centuries of waiting, the cycle begins anew." </nc-section>
id
"gen-1740435659-2Mgj7zsUsAuIcoGJCbW1"
upstream_id
"msg_0126VEuFkMVij9AetPYLSCCw"
total_cost
0.008955
cache_discount
(null)
provider_name
"Anthropic"
created_at
"2025-02-24T22:21:10.644123+00:00"
Monday, February 24th, 2025 at 10:21:10 PM GMT+00:00
model
"anthropic/claude-3-7-sonnet-20250219:beta"
app_id
182717
streamed
true
cancelled
false
latency
966
moderation_latency
(null)
generation_time
9091
tokens_prompt
301
tokens_completion
471
native_tokens_prompt
335
native_tokens_completion
530
native_tokens_reasoning
0
num_media_prompt
(null)
num_media_completion
(null)
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.008955
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
100.0000%