NC Bench
Overview
About
Tests
Models
Model
Claude 3.5 Sonnet
Test
Tool usage within Novelcrafter
Scenario
Create alternate prose sections
Run ID
2024-08-09-01J4VTCB0PESRJ52ANE1TV4J5P
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
Certainly! I'll create three alternate prose sections that continue the story, each with a different approach to Sir Roland greeting Frederick near the stables. <nc-section data-title="Version 1: Stern Welcome" data-color="red"> As I dismounted from Thunder, a tall figure emerged from the shadows of the stables. His armor gleamed in the fading light, and his stern face was etched with battle scars. "You must be Frederick," he said, his voice gruff and commanding. "I am Sir Roland. You're late, squire. In this castle, tardiness is not tolerated." His piercing gaze made me shrink back, and I knew immediately that my training would be far from easy. </nc-section> <nc-section data-title="Version 2: Friendly Encounter" data-color="green"> I had barely set foot on the ground when a hearty laugh echoed from the stables. A knight with a bushy beard and twinkling eyes approached, leading a chestnut mare. "Welcome, young Frederick!" he boomed cheerfully. "I'm Sir Roland, and I'll be overseeing your training." He clapped me on the shoulder, nearly knocking me over. "Don't look so nervous, lad. We'll make a fine knight of you yet!" His warmth immediately put me at ease, and I felt a spark of excitement for the journey ahead. </nc-section> <nc-section data-title="Version 3: Mysterious Mentor" data-color="blue"> As I tended to Thunder, I felt a presence behind me. Turning, I saw a figure leaning against the stable door, shrouded in a dark cloak. "Frederick," he said softly, pushing back his hood to reveal a face both youthful and ancient. "I am Sir Roland." His eyes seemed to glow with an otherworldly light. "Your arrival marks the beginning of a great destiny, young squire. Are you prepared for the trials that await?" A shiver ran down my spine, and I sensed that my training would involve far more than swordplay and chivalry. </nc-section>
id
"gen-PkVEbAFyWMfGggA61lhWSYHM2R55"
total_cost
0.008265
upstream_id
"msg_015wkHHiBX1rn96WAQMEW3LQ"
created_at
"2024-08-09T14:58:57.268039+00:00"
Friday, August 9th, 2024 at 2:58:57 PM GMT+00:00
model
"anthropic/claude-3.5-sonnet:beta"
app_id
182717
streamed
true
cancelled
false
provider_name
"Anthropic"
latency
2372
moderation_latency
(null)
generation_time
11757
finish_reason
"end_turn"
tokens_prompt
302
tokens_completion
433
native_tokens_prompt
335
native_tokens_completion
484
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.008265
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
100.0000%