Model

Hermes 3 70B

Test

Tool usage within Novelcrafter

Scenario

Create alternate prose sections

Run ID

2024-08-26-01J68DJFTK7HMN95SF83N9XMDP

Model input

System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)

Model response

AI
<nc-section data-title="Version 1: The Gruff Knight" data-color="red"> As I dismounted Thunder, a burly knight with a bushy beard approached me. "You must be the new squire," he grunted. "I'm Sir Roland. Follow me, lad." He turned on his heel and marched away, expecting me to obey without question. </nc-section> <nc-section data-title="Version 2: The Warm Welcome" data-color="green"> I was greeted by the sight of a kind-faced knight smiling at me from near the stables. "Greetings, young squire!" he called out in a friendly voice. "I am Sir Roland, and I'll be overseeing your training. Welcome to our humble castle." He extended a hand to me. </nc-section> <nc-section data-title="Version 3: The Mysterious Figure" data-color="blue"> As Thunder trotted towards the stables, I noticed a shadowy figure emerge from behind a wall. The figure was clad in a hooded cloak, obscuring their face. "New recruit, eh?" a deep voice rumbled. It took me a moment to realize this must be Sir Roland. </nc-section>
id"gen-sS4OOs9SKtTDTv78X9E3oJAJD2uO" 
total_cost0.0002276
upstream_id"chat-25a79eadae974fb6a62893786b14ca5c" 
created_at"2024-08-26T22:40:50.980358+00:00" Monday, August 26th, 2024 at 10:40:50 PM GMT+00:00
model"nousresearch/hermes-3-llama-3.1-70b" 
app_id182717
streamedtrue
cancelledfalse
provider_name"Hyperbolic" 
latency40
moderation_latency(null)
generation_time8323
finish_reason"stop" 
tokens_prompt309
tokens_completion252
native_tokens_prompt315
native_tokens_completion254
num_media_prompt(null)
num_media_completion(null)
origin"https://ncbench.com/" 
usage0.0002276

Evaluation details

Result Evaluator Details Meta Data
Pass Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
 n/a
Pass Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
 n/a
Pass Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
 n/a
100.0000%