NC Bench
Overview
About
Tests
Models
Model
Claude 3.5 Sonnet (new)
Test
Tool usage within Novelcrafter
Scenario
Create alternate prose sections
Run ID
2024-11-04-01JBW92GAP8VNWEXXQM1MY8VP4
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: A Stern Welcome" data-color="red"> As I dismounted Thunder, a towering figure emerged from the stables. Sir Roland, clad in polished armor that reflected the dying sunlight, fixed me with a steely gaze. "So, you're the new squire," he growled, his scarred face betraying years of battle. "I hope you're ready for pain, boy. Training under me isn't for the weak." His calloused hand gripped my shoulder with frightening strength, and I fought to hide my trembling. </nc-section> <nc-section data-title="Version 2: A Fatherly Greeting" data-color="green"> The stable doors creaked open, and out stepped Sir Roland, his weathered face breaking into a warm smile. "Welcome, young Frederick!" he called out, his voice rich and encouraging. "I've been expecting you." The legendary knight's eyes twinkled with kindness as he helped me tend to Thunder, sharing stories of his own first days as a squire. Perhaps this wouldn't be so intimidating after all. </nc-section> <nc-section data-title="Version 3: A Mysterious Encounter" data-color="blue"> I had barely touched ground when Sir Roland materialized from the shadows of the stable entrance. His piercing eyes studied me intently, and a strange amulet at his throat pulsed with an eerie blue light. "The dragon dreams spoke of your arrival," he said cryptically, leaving me wondering what he meant. "Come, we have much to discuss, and time grows short with each passing sunset." </nc-section>
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
100.0000%