NC Bench
Overview
About
Tests
Models
Model
Hermes 3 405B
Test
Tool usage within Novelcrafter
Scenario
Create alternate prose sections
Run ID
2024-08-27-01J69P8JZSDZ1K38EDJ8ER3NVW
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
Here are three alternate prose sections that continue the story: <nc-section data-title="Version 1" data-color="red"> As I approached the stables, I saw a tall, imposing figure waiting for me. It was Sir Roland, the local knight. He had a stern face, with a thick beard and piercing blue eyes. He wore a suit of shining armor, with a sword at his side. "Fredderick," he said, his voice deep and commanding. "Welcome to the castle. I trust your journey was uneventful?" I nodded, trying to hide my nervousness. "Yes, sir. Thank you for having me." Sir Roland nodded curtly. "You'll be training with me from now on. I hope you're ready for the challenge." </nc-section> <nc-section data-title="Version 2" data-color="green"> I dismounted Thunder and led him towards the stables. As I approached, I saw Sir Roland, the local knight, waiting for me. He was a tall man, with broad shoulders and a friendly smile. He wore a simple tunic and breeches, with a sword at his side. "Hello, Frederick," he said, extending his hand. "Welcome to the castle. I'm Sir Roland, and I'll be your mentor during your training." I shook his hand, feeling a sense of relief wash over me. "Thank you, sir. I'm excited to get started." Sir Roland smiled. "I'm glad to hear it. Let's get your horse settled, and then I'll show you around the castle." </nc-section> <nc-section data-title="Version 3" data-color="blue"> As I rode into the stable yard, I saw a man waiting for me. He was tall and slender, with a kind face and a gentle smile. He wore a simple tunic and breeches, with a sword at his side. I recognized him immediately as Sir Roland, the local knight. "Welcome, Frederick," he said, his voice warm and friendly. "I'm Sir Roland, and I'll be your mentor during your training." I dismounted Thunder and bowed deeply. "Thank you, sir. I'm honored to be here." Sir Roland smiled. "The honor is mine, Frederick. I've heard great things about you. I'm looking forward to working with you and seeing what you can accomplish." </nc-section>
id
"gen-zzvJiEaQB6hHUMM7DGy5Bo0Ijzki"
total_cost
0
upstream_id
"chatcmpl-187522e3-9787-408a-8833-4ef2cd851bc8"
created_at
"2024-08-27T10:32:09.955244+00:00"
Tuesday, August 27th, 2024 at 10:32:09 AM GMT+00:00
model
"nousresearch/hermes-3-llama-3.1-405b"
app_id
182717
streamed
true
cancelled
false
provider_name
"Lambda"
latency
924
moderation_latency
(null)
generation_time
19119
finish_reason
"stop"
tokens_prompt
301
tokens_completion
496
native_tokens_prompt
344
native_tokens_completion
497
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
100.0000%