NC Bench
Overview
About
Tests
Models
Model
MythoMax 13B
Test
Tool usage within Novelcrafter
Scenario
Create alternate prose sections
Run ID
2024-08-09-01J4VTBTE0F79QY7BYFN9N60CZ
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
Frederick rode up to the castle gates and dismounted from Thunder. He tied the horse to a post and approached the guards standing at attention. They eyed him up and down, taking in his worn cloak and sturdy boots. "State your business," one of the guards said gruffly. "I am Frederick, here to begin my training as a squire," Frederick replied, trying to sound confident despite his nervousness. The guards exchanged glances before one of them nodded. "Very well. Follow me." Frederick fell into step behind the guard, his heart pounding in his chest. As they walked towards the castle, Frederick couldn't help but admire the architecture - tall towers, intricate carvings, and stained-glass windows that cast colorful patterns on the stone floor. The guard led him to the stables, where Frederick could hear the whinnies and snorts of horses. He steeled himself before pushing open the door and facing Sir Roland, the local knight. "You must be Frederick," Sir Roland said, eyeing him up and down. "Welcome to the kingdom. Your training begins today." Version 1 (Red): As Frederick approached the castle gates, his stomach churned with nerves. He tied his horse to a post and made his way towards the guard station. The guards eyed him suspiciously as he identified himself. They clearly weren't used to seeing new faces around these parts. One of the guards motioned for Frederick to follow him, leading him through winding corridors and up flights of stairs. They eventually arrived at a large, ornate door, which the guard opened with a flourish. Inside, Frederick found himself face-to-face with the local knight, Sir Roland. The knight's armor glinted in the candlelight as he rose from his throne-like chair. "You must be Frederick," he rumbled. "Welcome to the kingdom. Your training begins now." Frederick swallowed hard as Sir Roland approached him, a look of determination on his face. "Are you ready for what lies ahead, boy?" Version 2 (Green): As Frederick walked towards the castle gates, he felt a sense of anticipation mixed with nervousness. He dismounted from his horse and tied it to a post, taking in the grandeur of the castle before him. The guards at the gate eyed him warily, but when he identified himself as Frederick, here to begin his training as a squire, they seemed to relax a little. They led him through winding corridors and up creaky staircases, towards the knight's quarters. Upon entering the room, Frederick's heart skipped a beat. There sat Sir Roland, the fearsome and respected knight of the kingdom, wearing full armor. His eyes pierced through Frederick as he rose to his feet, and Frederick felt a surge of determination course through him. "You must be Frederick," Sir Roland said, his voice deep and commanding. "Welcome to the kingdom. Your training begins now." Frederick nodded, trying to conceal his nerves. "Yes, sir. I am ready for whatever comes my way." Version 3 (Blue): As Frederick neared the castle, his thoughts raced with excitement and trepidation. He dismounted from his horse and approached the foreboding gates, feeling the weight of his worn cloak and sturdy boots. The guards eyed him warily, but upon hearing his identity, they stepped aside and nodded in acknowledgment. As Frederick walked towards the knight's quarters, he couldn't help but marvel at the opulence and splendor of the castle: towering spires, intricately carved arches, and stained-glass windows that cast colorful shimmers on the stone floors. Finally, he reached the door to the knight's quarters, his heart pounding in his chest. He took a deep breath and pushed the door open, stepping inside. There, sitting upon a throne-like chair, was Sir Roland, garbed in shining armor. "You must be Frederick," Sir Roland rumbled, his voice resonating through the room. "Welcome to the kingdom. Your training begins now." Frederick stood tall, squaring his shoulders. "Yes, sir," he replied, his voice steady despite the trembling in his gut. "I am ready for this journey."
id
"gen-4LNjI672OiPgx2Qf9aAGfdPs9KLA"
total_cost
0.0002804
upstream_id
"fe2fff1e-3293-4573-975a-5cdd028963be"
created_at
"2024-08-09T14:58:34.08199+00:00"
Friday, August 9th, 2024 at 2:58:34 PM GMT+00:00
model
"gryphe/mythomax-l2-13b"
app_id
182717
streamed
false
cancelled
false
provider_name
"Fireworks"
latency
7859
moderation_latency
(null)
generation_time
0
finish_reason
"stop"
tokens_prompt
295
tokens_completion
863
native_tokens_prompt
370
native_tokens_completion
1032
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.0002804
Evaluation details
Result
Evaluator
Details
Meta Data
Fail
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Fail
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Fail
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
0.0000%