NC Bench
Overview
About
Tests
Models
Model
GPT-4o Mini (temp=0)
Test
Tool usage within Novelcrafter
Scenario
Create alternate prose sections
Run ID
2024-08-09-01J4VTAW89KPGWE6MVDN7C6K6Z
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: A Warm Welcome" data-color="red"> As I dismounted, the scent of hay and leather filled the air. Just then, Sir Roland, the local knight known for his valor and wisdom, approached me with a broad smile. "Welcome, young squire!" he boomed, his voice echoing off the stable walls. "I trust your journey was swift? Here, you will learn not just the art of combat, but the honor that comes with it." His presence was imposing, yet his kind eyes reassured me that I was in good hands. </nc-section> <nc-section data-title="Version 2: A Cautious Encounter" data-color="green"> As I stepped off Thunder, I noticed Sir Roland leaning against the stable door, arms crossed and a skeptical look on his face. "So, you’re the new squire," he said, his tone measured. "Many have come before you, eager to prove themselves. But remember, it takes more than just bravery to become a knight." I felt a knot tighten in my stomach, but I nodded, determined to show him I was worthy of the title. </nc-section> <nc-section data-title="Version 3: A Mysterious Warning" data-color="blue"> I had barely settled Thunder in the stable when Sir Roland emerged from the shadows, his expression grave. "Frederick," he said, his voice low, "there are whispers in the wind. Dark forces are stirring, and your training will be more crucial than you realize." He glanced around as if expecting someone to overhear. "Stay vigilant, for the path of a knight is fraught with peril." I felt a chill run down my spine, the weight of his words settling heavily on my shoulders. </nc-section>
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
100.0000%