NC Bench
Overview
About
Tests
Models
Model
MythoMax 13B
Test
Tool usage within Novelcrafter
Scenario
Create alternate prose sections
Run ID
2024-08-09-01J4VTA563Y4QAKBGK8F36CSSN
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
Near the stables, Frederick dismounted and slowly walked towards the castle walls. His heart pounded with excitement and anticipation. He looked around, taking in the sights and sounds of the bustling castle. As he approached the main courtyard, he heard the familiar clinking of metal on metal. Turning towards the sound, he saw Sir Roland, the local knight, polishing his sword. "Good evening, young squire," Sir Roland said, not looking up from his work. "What brings you to my humble abode?" "I'm Frederick," Frederick replied, offering a respectful bow. "I've arrived to begin my training as a knight at this esteemed castle." Sir Roland set his sword down and turned to face Frederick. "Welcome, Frederick," he said warmly. "I've heard good things about you. We'll start you off with some sparring lessons tomorrow morning. Get some rest tonight." With that, Sir Roland returned to his work, leaving Frederick to make his way to the quarters assigned to him for the duration of his training. Version 1: As Frederick approached the stables, he could see the large oak doors creaking open. A man emerged, his armor shining in the setting sun. It was Sir Roland, the local knight. Sir Roland watched as Frederick made his way over to him, his stallion Thunder tossing its head in acknowledgement. "Good evening, young squire. What brings you to my humble abode?" Sir Roland asked, his voice booming in the silence. Frederick paused, taking a deep breath to steady his nerves. "I've arrived to begin my training as a knight at this esteemed castle," Frederick replied, offering a respectful bow. Sir Roland studied Frederick for a moment before nodding his head. "Welcome, Frederick. I've heard good things about you. We'll start you off with some sparring lessons tomorrow morning. Get some rest tonight." With that, Sir Roland turned and made his way back into the stables, leaving Frederick to watch him go. Version 2: As the sun began to set over the castle walls, Frederick dismounted and tied his steed to a nearby post. He could feel the excitement building within him as he made his way to the stables. As he approached, he heard the familiar clinking of swords and armor. The door creaked open, revealing Sir Roland, the local knight, standing in front of him. "Good evening, young squire," Sir Roland said, offering a warm smile. "What brings you to my humble abode?" Frederick took a deep breath, his heart pounding in his chest. "I've arrived to begin my training as a knight at this esteemed castle," he replied, offering a respectful bow. Sir Roland nodded approvingly. "Welcome, Frederick. I've heard good things about you. We'll start you off with some sparring lessons tomorrow morning. Get some rest tonight." With that, Sir Roland turned and walked back into the stables, leaving Frederick to find his way to his quarters. As he walked away, Frederick couldn't help but feel a sense of awe at the incredible adventure that lay before him. Version 3: The sun was setting over the castle, casting long shadows across the stone walls. Far away, Frederick could hear the faint music of laughter and the clinking of plates. He dismounted and tied his horse to a post, his mind already racing with anticipation. As he approached the stables, he heard the familiar clatter of metal on metal. The door creaked open, revealing Sir Roland, the local knight, standing in the doorway. "Good evening, young squire," Sir Roland boomed, his voice echoing through the stables. "What brings you to my humble abode?" Frederick paused, his heart pounding in his chest. "I've arrived to begin my training as a knight at this esteemed castle," he replied, offering a respectful bow. Sir Roland studied Frederick for a moment before nodding approvingly. "Welcome, Frederick. I've heard good things about you. We'll start you off with some sparring lessons tomorrow morning. Get some rest tonight." With that, Sir Roland turned and disappeared back into the shadows of the stables, leaving Frederick to find his way to his quarters on his own. As he walked away, Frederick couldn't help but feel a sense of awe at the incredible adventure that lay ahead of him.
id
"gen-16TDxag2fOmSBl8jFgzqXeGfKEdI"
total_cost
0.000168861
upstream_id
"cmpl-218339b33e454f40ace84ba03ffaa659"
created_at
"2024-08-09T14:57:55.956997+00:00"
Friday, August 9th, 2024 at 2:57:55 PM GMT+00:00
model
"gryphe/mythomax-l2-13b"
app_id
182717
streamed
false
cancelled
false
provider_name
"Novita"
latency
24223
moderation_latency
(null)
generation_time
0
finish_reason
"stop"
tokens_prompt
295
tokens_completion
898
native_tokens_prompt
371
native_tokens_completion
1048
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.000168861
Evaluation details
Result
Evaluator
Details
Meta Data
Fail
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Fail
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Fail
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
0.0000%