NC Bench
Overview
About
Tests
Models
Model
Sao10K L3.1 70B Hanami x1
Test
Tool usage within Novelcrafter
Scenario
Create alternate prose sections
Run ID
2024-10-09-01J9SRF7QE6H54WSE3BSPV22XF
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1 (Red)" data-color="red"> As I dismounted Thunder, I saw Sir Roland approaching from the stables. He was a tall, imposing man clad in red armor, his face weathered from years of battle. His crimson cape billowed behind him, and his hand rested on the hilt of his sword. "Ah, young Frederick, I see you've arrived," he boomed. His deep voice echoed through the courtyard. "Come, let me show you to your quarters. There will be no rest for you tonight." </nc-section> <nc-section data-title="Version 2 (Green)" data-color="green"> Sir Roland emerged from the stables, his green surcoat gleaming in the fading light. "Well met, Squire Frederick!" he called out, his voice warm and friendly. "Welcome to Castle Everwood. I trust your journey here was uneventful?" He strode towards me, extending a gauntleted hand. "I'm sure you're eager to get settled in. The servants will see to your baggage and horse. In the meantime, let me show you to your chambers. We'll have time for a proper greeting at dinner." </nc-section> <nc-section data-title="Version 3 (Blue)" data-color="blue"> Sir Roland emerged from the shadowed archway of the stables, his blue armor glinting as he moved into the fading light. "Frederick," he said, his voice deep and commanding. "It's good to see you." He clasped my shoulder with a mailed fist. "I trust your journey was smooth? Good. There's much to do before dinner. First, let's see to your horse and gear. Then I'll show you to your rooms." He turned to lead the way, his blue cloak fluttering behind him. I followed, my heart pounding with excitement at the prospect of beginning my training as a knight.
Evaluation details
Result
Evaluator
Details
Meta Data
Fail
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
66.6667%