NC Bench
Overview
About
Tests
Models
Model
Claude 3.7 Sonnet
Test
Tool usage within Novelcrafter
Scenario
Create alternate prose sections
Run ID
2025-02-24-01JMX2CM17EV4QGE0SYPVDQBWE
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: A Cold Welcome" data-color="red"> As I dismounted Thunder, a stern voice echoed from the shadows of the stable. "You're late, boy." Sir Roland emerged, his weathered face twisted in a scowl beneath his silver-streaked beard. The knight's armor gleamed despite the dim light, polished to perfection like his reputation for breaking squires. His cold eyes assessed me from head to toe, finding every flaw in my travel-worn appearance. "Frederick of Westmere, I presume? I expected better." He circled me like a predator, his hand resting casually on the pommel of his sword. "The journey from your village takes three days. You've taken five. In battle, such tardiness would cost lives." I swallowed hard, knowing my first impression was already shattered beyond repair. </nc-section> <nc-section data-title="Version 2: A Mentor's Welcome" data-color="green"> "Ho there, young Frederick!" A booming voice called out as I led Thunder toward the water trough. A broad-shouldered knight with kind eyes and laugh lines stepped forward, extending a calloused hand. "Sir Roland, at your service. Welcome to Castle Dragonspire." His grip was firm but welcoming as he shook my hand. "I've been expecting you, lad. Your father spoke highly of your swordsmanship in his letters." My heart swelled with pride. "You knew my father, sir?" "Aye, fought alongside him in the Crimson Campaign." Sir Roland's eyes twinkled with memories. "If you've half his spirit, you'll make a fine knight someday. Come, let's get your horse settled, and I'll show you to your quarters. Training begins at dawn tomorrow." </nc-section> <nc-section data-title="Version 3: A Mysterious Encounter" data-color="blue"> I was brushing Thunder down when I felt a presence behind me. Turning quickly, I found myself face to face with a tall knight whose armor bore the scars of countless battles. His right hand was missing two fingers, and a thin scar ran from his left eye to his jaw. "Frederick." It wasn't a question. His voice was quiet, almost a whisper, yet it commanded attention. "Sir Roland?" I asked, bowing awkwardly. The knight nodded once, his eyes never leaving mine. There was something unnerving in his gaze—something that seemed to look through me rather than at me. "You've arrived on an auspicious day," he said, glancing skyward. "The red moon rises tonight. Not seen in a hundred years." He pressed something cold and metallic into my palm. "Keep this close. The old magic stirs, and the castle has ears." Before I could examine the object or ask what he meant, Sir Roland melted back into the shadows, leaving me alone with more questions than answers. </nc-section>
id
"gen-1740437344-FC9Km9Ov9XKFazk1TIfi"
upstream_id
"msg_01AvWueHh1xRRzUHHo5PAr9o"
total_cost
0.01128
cache_discount
(null)
provider_name
"Anthropic"
created_at
"2025-02-24T22:49:18.145995+00:00"
Monday, February 24th, 2025 at 10:49:18 PM GMT+00:00
model
"anthropic/claude-3-7-sonnet-20250219:beta"
app_id
182717
streamed
true
cancelled
false
latency
1039
moderation_latency
(null)
generation_time
11810
tokens_prompt
301
tokens_completion
610
native_tokens_prompt
335
native_tokens_completion
685
native_tokens_reasoning
0
num_media_prompt
(null)
num_media_completion
(null)
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.01128
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
100.0000%