NC Bench
Overview
About
Tests
Models
Model
Claude 3.0 Sonnet
Test
Tool usage within Novelcrafter
Scenario
Create alternate prose sections
Run ID
2024-08-09-01J4VTB7Z8ETX5XEYVXXDVWFWY
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1" data-color="red"> As I dismounted Thunder and handed the reins to a stable boy, a tall figure approached me from the shadows of the stable. Sir Roland emerged, his silver armor gleaming in the fading sunlight. He was an imposing man, with a thick beard and piercing blue eyes that seemed to bore into my soul. "You must be the new squire," he said gruffly. "I am Sir Roland, master-at-arms of this castle. From this day forward, you will train under my watchful eye. The path of knighthood is arduous and unforgiving. Are you prepared to give your blood, sweat, and tears to become a true warrior?" I swallowed hard and nodded, suddenly feeling very small before this legend of a knight. "Yes, sir. I am ready." </nc-section> <nc-section data-title="Version 2" data-color="green"> The stable doors creaked open, and a tall, barrel-chested man stepped out, his face creased with laugh lines. A sword hung at his side, the pommel worn smooth by years of use. This could only be the renowned Sir Roland. "Well, well, you must be young Frederick!" he boomed, clapping me on the shoulder with a meaty hand. "Welcome to our humble castle, lad. I've been expecting you." He gestured towards the stables with a sweep of his arm. "These will be your new quarters for the time being. Get settled in, and we'll begin your training at first light. Just a word of warning – I may be getting on in years, but I won't go easy on you!" Sir Roland let out a hearty laugh that put me instantly at ease. Perhaps this knight wasn't as fearsome as the tales suggested. </nc-section> <nc-section data-title="Version 3" data-color="blue"> The shadow of a man fell across the dusty ground in front of me. I turned to find myself face-to-face with a legend – Sir Roland, the most celebrated knight in the kingdom's history. His face was lined with battle scars, testimony to the countless fights he had endured. "You're the new recruit, I presume," he said, eyeing me up and down with a critical gaze. "Let's get one thing straight – I don't coddle anyone. If you want to become a knight under my tutelage, you'll need to be prepared to push beyond your limits every single day." I met his intense stare without flinching. "I'm ready, Sir Roland. I won't let you down." A ghost of a smile played across the old knight's weathered features. "We'll see about that. Welcome to your new life, boy. From this day forth, you leave your old self behind." </nc-section>
id
"gen-1OYCA2ALPY6PBUkkhxpQ738rB63u"
total_cost
0.010725
upstream_id
"msg_01DknUCZWnSqPoREDRLoxohM"
created_at
"2024-08-09T14:58:20.80758+00:00"
Friday, August 9th, 2024 at 2:58:20 PM GMT+00:00
model
"anthropic/claude-3-sonnet:beta"
app_id
182717
streamed
true
cancelled
false
provider_name
"Anthropic"
latency
964
moderation_latency
(null)
generation_time
12556
finish_reason
"end_turn"
tokens_prompt
302
tokens_completion
595
native_tokens_prompt
335
native_tokens_completion
648
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.010725
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
100.0000%