NC Bench
Overview
About
Tests
Models
Model
MythoMax 13B
Test
Tool usage within Novelcrafter
Scenario
Create alternate prose sections
Run ID
2024-08-09-01J4VT96X5VXMHYYXPYT9PGEWM
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
Version 1 (red): As I dismounted from Thunder, Sir Roland, the local knight, approached me. His armor glistened in the fading light. "Welcome, Frederick," he said with a nod. "I've heard good things about you." I bowed my head respectfully. "Thank you, sir. It's an honor to be here." He motioned towards the stables. "You'll be staying here while you train. Is Thunder well taken care of?" "Yes, sir," I replied. "He's well-fed and rested." Sir Roland smiled. "Good, good. Come with me then." Version 2 (green): As I approached the castle, the thundering sound of hooves caught my attention. A lone knight cloaked in armor galloped towards me, his horse's mane and tail streaming behind him. "Sire!" I exclaimed, dropping to one knee in greeting. The knight dismounted and removed his helmet, revealing the familiar face of Sir Roland. "Rise, Frederick," he said, offering me a hand up. "It's good to see you again." I stood up, feeling a wave of relief wash over me. "It's good to be here, sir. This place holds many memories for me." Sir Roland smiled. "Then let us begin making new ones." Version 3 (blue): The castle loomed in the distance as I journeyed towards it. My pack felt heavy on my back, filled with provisions for my stay. As I drew nearer, I noticed a group of people gathered around the stables. I rode up to the knight in charge, a middle-aged man with a stern demeanor. "I am Frederick, squire to the kingdom," I announced. "And what brings you here?" he asked, looking me over. "I am here to begin my training," I replied. "Sir Roland has been expecting me." The knight nodded curtly. "Follow me. Your horse can rest here for now." I dismounted and followed Nev into the castle. I felt a sense of excitement and anticipation as I made my way towards my chambers. Tomorrow would be the beginning of a new chapter in my life.
id
"gen-OOCU7c0BuR4Feh9zMUwaV0sc53To"
total_cost
0.00024219
upstream_id
"8b08989b41ba8797-IAD"
created_at
"2024-08-09T14:57:05.06371+00:00"
Friday, August 9th, 2024 at 2:57:05 PM GMT+00:00
model
"gryphe/mythomax-l2-13b"
app_id
182717
streamed
false
cancelled
false
provider_name
"Together"
latency
4145
moderation_latency
(null)
generation_time
0
finish_reason
"eos"
tokens_prompt
295
tokens_completion
445
native_tokens_prompt
371
native_tokens_completion
526
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.00024219
Evaluation details
Result
Evaluator
Details
Meta Data
Fail
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Fail
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Fail
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
0.0000%