NC Bench
Overview
About
Tests
Models
Model
Hermes 2 Theta 8B
Test
Tool usage within Novelcrafter
Scenario
Create alternate prose sections
Run ID
2024-08-09-01J4VT9TYBCQKC00HRPT6JA6FW
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Continuing the Story" data-color="red"> The moment I dismounted Thunder, the local knight, Sir Roland, greeted me with a warm smile and a firm handshake. “Welcome to the castle, young Frederick,” he said. “I trust your journey was uneventful.” I nodded, still taking in the unfamiliar sights and sounds of the bustling courtyard. “Please, follow me to the stables. We’ll get your gear settled, and then I’ll show you to your quarters.” As we walked, Sir Roland asked me about my training so far. I told him about my time as a squire under the tutelage of Sir Edward, and he listened intently, nodding occasionally.</nc-section> <nc-section data-title="Continuing the Story" data-color="green"> As I led Thunder to the stables, I spotted Sir Roland approaching me. He was a large, imposing figure, with a thick beard and piercing blue eyes. “Ah, Frederick, you must be eager to begin your training,” he said, clapping me on the back. “Let’s get you settled in, and then I’ll take you to meet the rest of the knights.” His booming voice carried across the courtyard, and heads turned to follow our progress. I felt a mix of excitement and nerves as I followed him through the castle corridors, his stories of past battles and glorious deeds filling my ears.</nc-section> <nc-section data-title="Continuing the Story" data-color="blue"> As I entered the courtyard, I was met by the familiar figure of Sir Roland, who warmly greeted me with a firm embrace. “Welcome to our humble abode, young Frederick,” he said, his voice echoing off the stone walls. “I trust the journey was kind to you.” He beckoned me to follow him towards the stables, where Thunder was already being tended to by the stable hands. As we walked, he regaled me with tales of his own training and adventures, provoking laughter and making me feel more at ease in my new surroundings.</nc-section>
id
"gen-j2bKZBWFFE17Bk1m7gAiqSCEX9Sl"
total_cost
0.000546
upstream_id
"5fa85d42SoTKwhis"
created_at
"2024-08-09T14:57:34.228479+00:00"
Friday, August 9th, 2024 at 2:57:34 PM GMT+00:00
model
"nousresearch/hermes-2-theta-llama-3-8b"
app_id
182717
streamed
false
cancelled
false
provider_name
"Mancer"
latency
13024
moderation_latency
(null)
generation_time
0
finish_reason
"stop"
tokens_prompt
301
tokens_completion
427
native_tokens_prompt
344
native_tokens_completion
428
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.000546
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
100.0000%