NC Bench
Overview
About
Tests
Models
Model
Claude 3.7 Sonnet
Test
Tool usage within Novelcrafter
Scenario
Create alternate prose sections
Run ID
2025-02-24-01JMX148V0GRC9QAYRAE4MN6ZQ
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: A Cold Reception" data-color="red"> I guided Thunder toward the stables, my arms aching from the long journey. As I dismounted, a tall figure emerged from the shadows. He wore polished armor that reflected the dying sunlight, and a weathered face marked by a jagged scar across his left cheek. "You must be Frederick," he said, his voice sharp as steel. "I am Sir Roland. I expected you hours ago." His cold eyes assessed me, finding me wanting. "The stable boy will tend to your horse. Gather your belongings and follow me. Time is precious, and you've wasted enough of mine already." </nc-section> <nc-section data-title="Version 2: A Mentor's Welcome" data-color="green"> As I led Thunder toward the water trough, a hearty laugh echoed across the courtyard. A knight with a salt-and-pepper beard and kind eyes approached, his walk casual yet commanding. "Well met, young Frederick!" he called out, extending a calloused hand. "I am Sir Roland. Your father spoke highly of you in his letters." He helped me unsaddle Thunder, his movements efficient and practiced. "You must be famished after your journey. Let's stable this magnificent beast, and then we'll find you a hot meal. Tomorrow, we begin your training at dawn—but tonight, you rest." </nc-section> <nc-section data-title="Version 3: A Mysterious Encounter" data-color="blue"> I had just finished watering Thunder when I felt a presence behind me. Turning, I found myself face to face with a knight whose reputation had spread throughout the seven kingdoms. Sir Roland's armor was unlike any I'd seen—adorned with strange runes that seemed to shimmer with an inner light. "Frederick," he said simply, his voice quiet yet somehow filling the stable. "I've been waiting for you." His eyes, unusually violet in color, studied me intently. "There are forces at work in this kingdom that few understand. Your arrival was foretold." He glanced at the setting sun. "The last dragon stirs from its slumber, and you, young squire, may be more important than you know." </nc-section>
id
"gen-1740436022-ZWgVGwSqRQucuVp9QpFP"
upstream_id
"msg_01MSwopiaqqEcCF7WYfcd2uL"
total_cost
0.00876
cache_discount
(null)
provider_name
"Anthropic"
created_at
"2025-02-24T22:27:12.070526+00:00"
Monday, February 24th, 2025 at 10:27:12 PM GMT+00:00
model
"anthropic/claude-3-7-sonnet-20250219:beta"
app_id
182717
streamed
true
cancelled
false
latency
943
moderation_latency
(null)
generation_time
8156
tokens_prompt
301
tokens_completion
469
native_tokens_prompt
335
native_tokens_completion
517
native_tokens_reasoning
0
num_media_prompt
(null)
num_media_completion
(null)
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.00876
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
100.0000%