NC Bench
Overview
About
Tests
Models
Model
Sao10K L3.1 70B Hanami x1
Test
Tool usage within Novelcrafter
Scenario
Create alternate prose sections
Run ID
2024-10-09-01J9SPBXB01CBWZYHCGZ9666AB
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1" data-color="red"> As I dismounted Thunder, a gruff voice called out from beside the stables. "Well met, young Frederick!" It was Sir Roland, the kingdom's most renowned knight. He strode forward, his armor clanking. "Welcome to the castle. I trust your journey was uneventful?" He eyed me appraisingly, taking in my travel-worn clothes and road dust. "We'll have you cleaned up and settled in no time." </nc-section> <nc-section data-title="Version 2" data-color="green"> I had barely tethered Thunder to a post before a figure emerged from the stables. It was Sir Roland, the legendary knight, his plate armor gleaming in the fading light. He extended a gauntleted hand in greeting. "Frederick, my boy! It's an honor to finally meet you in person. I hope the road from your village was kind to you." His bushy eyebrows furrowed with concern as he took in my bedraggled appearance. "But you look exhausted. Come, let's get you inside. A hot meal and bath await." </nc-section> <nc-section data-title="Version 3" data-color="blue"> As I led Thunder to the stables, Sir Roland stepped out to greet me. He towered over me, his broad shoulders squared. "Ah, Frederick. The young squire from the south. I've heard much about you." His eyes crinkled as he smiled. "I see the journey has left its mark on you, though. We'd better get you fed and settled. The road to knighthood is not for the faint of heart." He clapped me on the back and guided me towards the castle's great hall.
Evaluation details
Result
Evaluator
Details
Meta Data
Fail
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
66.6667%