NC Bench
Overview
About
Tests
Models
Model
GPT-4o Mini (temp=0)
Test
Tool usage within Novelcrafter
Scenario
Create alternate prose sections
Run ID
2024-08-09-01J4VTAP7GG5ZJEJ15ZSWS8MEV
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: A Warm Welcome" data-color="red"> As I dismounted, the scent of hay and leather filled the air. Just then, a tall figure emerged from the shadows of the stables. Sir Roland, the local knight, approached with a broad smile. His armor gleamed in the fading light, and his presence was both imposing and reassuring. "Welcome, young squire," he said, extending a hand. "I trust your journey was swift? Here, you will learn the ways of the sword and the honor of knighthood." His voice was deep and warm, and I felt a surge of excitement at the prospect of training under such a renowned warrior. </nc-section> <nc-section data-title="Version 2: A Cautious Encounter" data-color="green"> As I stepped off Thunder, I noticed a figure leaning against the stable door. It was Sir Roland, his expression unreadable. He wore a weathered cloak that seemed to blend with the shadows. "So, the new squire has arrived," he said, his tone measured. "You must understand, training here is not for the faint of heart. Many have come before you, and few have succeeded." I felt a knot tighten in my stomach, but I stood tall, determined to prove myself. "I am ready, Sir Roland," I replied, my voice steady despite the uncertainty swirling within me. </nc-section> <nc-section data-title="Version 3: A Mysterious Greeting" data-color="blue"> As I approached the stables, a figure emerged from the dim light, cloaked in shadows. It was Sir Roland, his eyes glinting with a mix of curiosity and caution. "Ah, the new squire," he said, his voice low and gravelly. "You come at a time of great change. The kingdom is restless, and the winds whisper of ancient powers awakening." I felt a chill run down my spine, but I couldn't help but be intrigued. "What do you mean, Sir?" I asked, eager to learn more. He stepped closer, his gaze piercing. "You will soon discover that your training will be intertwined with the fate of the realm. Are you prepared for what lies ahead?" </nc-section>
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
100.0000%