NC Bench
Overview
About
Tests
Models
Model
MythoMax 13B
Test
Tool usage within Novelcrafter
Scenario
Create alternate prose sections
Run ID
2024-08-09-01J4VTAA2KZVH5QPFJAD2A3260
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
Version 1 (red): As I approached, the great wooden doors swung open to reveal a burly knight dressed in full armor. Sir Roland nodded to me in acknowledgment and led me towards the stables. The horses inside were magnificent, their coats shining in the fading light of day. "Welcome, Frederick," he said, extending his hand for me to shake. "You'll be well-trained here. These beasts are some of the best in the land." Version 2 (green): Frederick dismounted and was immediately greeted by a rugged knight with a strong grip. Sir Roland's armor shimmered in the evening light. "Glad to have you with us," he boomed, leading Frederick to the stable. Horses snorted and whinnied, eager for attention. "You'll find these ones are quite special. They've been trained by the best hands." Sir Roland paused, a twinkle in his eye. "And so have their riders." Frederick felt a thrill of excitement course through him at the prospect of learning from such fine equine warriors. He nodded vigorously, hoping to impress his new master. Version 3 (blue): A local knight named Sir Roland offered a firm handshake as Frederick dismounted near the stable. The smell of hay and horses filled the air. "You've picked a fine bunch here," Frederick complimented the knight, admiring the horses within. "I've heard they're some of the best in the land." Sir Roland chuckled, his armor reflecting a combination of pride and weariness. "More than just their skill is what makes them great. These mounts have been tended to by the finest
id
"gen-ea8bblkD6BRM2mLaaoFcAABZ7RIJ"
total_cost
0.000869625
upstream_id
"5fa85d4fCFzts1Q2"
created_at
"2024-08-09T14:57:55.237322+00:00"
Friday, August 9th, 2024 at 2:57:55 PM GMT+00:00
model
"gryphe/mythomax-l2-13b"
app_id
182717
streamed
false
cancelled
false
provider_name
"Mancer"
latency
18500
moderation_latency
(null)
generation_time
0
finish_reason
"length"
tokens_prompt
295
tokens_completion
337
native_tokens_prompt
371
native_tokens_completion
402
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.000869625
Evaluation details
Result
Evaluator
Details
Meta Data
Fail
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Fail
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Fail
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
0.0000%