NC Bench
Overview
About
Tests
Models
Model
Hermes 2 Theta 8B
Test
Tool usage within Novelcrafter
Scenario
Create alternate prose sections
Run ID
2024-08-09-01J4VTB12A018PDK58J1NRAV99
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Continuing His Journey" data-color="red"> As I approached the stables, a tall figure emerged from the shadows. It was Sir Roland, a seasoned knight with a reputation for valor and skill on the battlefield. He introduced himself with a firm handshake and a grin, his eyes twinkling with warmth. "Fred, you're right on time," he said. "I've been expecting you. Let's get your gear settled and head to the mess hall for dinner. You've got a big day tomorrow." With that, he led me to a cozy room with a glowing fire and the scent of roasting meat. "</nc-section> <nc-section data-title="The Knight's Guide" data-color="green"> Sir Roland strode beside me as we walked to the stables, his armor clinking with each step. "You're going to love it here, Frederick," he said. "The castle is filled with good people, and we're all eager to help you grow into a great knight. First things first, though – we need to get you outfitted with the right equipment. Your horse, a lovely mare named Star, is ready and waiting for you." As we reached the stables, I spotted Star, her coat shining like polished copper in the fading light. She nuzzled my hand, and I knew we'd be good partners. Sir Roland clapped me on the back, "Now, let's get some food in you, and then you can start your new life." </nc-section> <nc-section data-title="The Arrival at Dusk" data-color="blue"> The sinking sun cast a golden glow over the courtyard as I handed Thunder's reigns to a stable hand. Sir Roland met me at the entrance of the castle, his weathered face creasing into a smile. "Fred, lad, it's good to see you. Let's get you settled and then head to the mess for a hearty meal. We have big things to discuss tomorrow, when you'll begin your training." We entered the castle, the warm light spilling from the windows and the aroma of roasting meat and baking bread filling the air. A sense of excitement and belonging washed over me as the knight led me through the labyrinthine hallways to my new home. </nc-section>
id
"gen-j9RTRyP0E85aL1O6GfH83utxK7no"
total_cost
0.0006
upstream_id
"5fa85d66Vs4Ps4w1"
created_at
"2024-08-09T14:58:15.586781+00:00"
Friday, August 9th, 2024 at 2:58:15 PM GMT+00:00
model
"nousresearch/hermes-2-theta-llama-3-8b"
app_id
182717
streamed
false
cancelled
false
provider_name
"Mancer"
latency
15125
moderation_latency
(null)
generation_time
0
finish_reason
"stop"
tokens_prompt
301
tokens_completion
475
native_tokens_prompt
344
native_tokens_completion
476
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.0006
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
100.0000%