NC Bench
Overview
About
Tests
Models
Model
MN GRAND Gutenberg Lyra4 12B Madness
Test
Tool usage within Novelcrafter
Scenario
Create alternate prose sections
Run ID
2024-10-16-01JAAPMQ2EPFG5TYEZ7S6TNMPY
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
Version 1 (red): As I approached the stables, a tall knight emerged. His armor gleamed in the fading light and his sword hung at his hip. He strode over to me with a confident gait. "You must be the new squire," he said, eyeing my travel-worn clothes. "I am Sir Roland, Captain of the Guard. Welcome to Ravenscar Castle." I dismounted and bowed respectfully. "Thank you, sir. I am Frederick. I've ridden for days to reach this place." Sir Roland nodded curtly. "Aye, the journey is long from the capital. Well met, Frederick." He gestured to the stables. "You can stable your mount there. The servants will take your bags to the barracks. Come, I'll show you the way to the great hall. You can freshen up and then sup with the men before turning in for the night." As I followed the knight, I couldn't help but marvel at the castle's imposing stone walls and soaring towers. Ravenscar was a bastion against the savage northlands, a last redoubt of civilization in an age of darkness and dragons. And now I would call it home, at least until I earned my spurs and rode out to face the monsters that threatened the realm myself one day...
Evaluation details
Result
Evaluator
Details
Meta Data
Fail
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Fail
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Fail
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
0.0000%