Model

MythoMax 13B

Test

Tool usage within Novelcrafter

Scenario

Create alternate prose sections

Run ID

2024-08-09-01J4VTAA2KZVH5QPFJAD2A3260

Model input

System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)

Model response

AI
Version 1 (red): As I approached, the great wooden doors swung open to reveal a burly knight dressed in full armor. Sir Roland nodded to me in acknowledgment and led me towards the stables. The horses inside were magnificent, their coats shining in the fading light of day. "Welcome, Frederick," he said, extending his hand for me to shake. "You'll be well-trained here. These beasts are some of the best in the land." Version 2 (green): Frederick dismounted and was immediately greeted by a rugged knight with a strong grip. Sir Roland's armor shimmered in the evening light. "Glad to have you with us," he boomed, leading Frederick to the stable. Horses snorted and whinnied, eager for attention. "You'll find these ones are quite special. They've been trained by the best hands." Sir Roland paused, a twinkle in his eye. "And so have their riders." Frederick felt a thrill of excitement course through him at the prospect of learning from such fine equine warriors. He nodded vigorously, hoping to impress his new master. Version 3 (blue): A local knight named Sir Roland offered a firm handshake as Frederick dismounted near the stable. The smell of hay and horses filled the air. "You've picked a fine bunch here," Frederick complimented the knight, admiring the horses within. "I've heard they're some of the best in the land." Sir Roland chuckled, his armor reflecting a combination of pride and weariness. "More than just their skill is what makes them great. These mounts have been tended to by the finest
id"gen-ea8bblkD6BRM2mLaaoFcAABZ7RIJ" 
total_cost0.000869625
upstream_id"5fa85d4fCFzts1Q2" 
created_at"2024-08-09T14:57:55.237322+00:00" Friday, August 9th, 2024 at 2:57:55 PM GMT+00:00
model"gryphe/mythomax-l2-13b" 
app_id182717
streamedfalse
cancelledfalse
provider_name"Mancer" 
latency18500
moderation_latency(null)
generation_time0
finish_reason"length" 
tokens_prompt295
tokens_completion337
native_tokens_prompt371
native_tokens_completion402
num_media_prompt(null)
num_media_completion(null)
origin"https://ncbench.com/" 
usage0.000869625

Evaluation details

Result Evaluator Details Meta Data
Fail Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Fail Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Fail Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
0.0000%