NC Bench
Overview
About
Tests
Models
Model
Hermes 3 70B
Test
Tool usage within Novelcrafter
Scenario
Create alternate prose sections
Run ID
2024-08-26-01J68DEFT9WMW05B2QDMH8RRC3
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: The Mysterious Knight" data-color="red"> As I dismounted Thunder, a tall, imposing figure emerged from the shadows of the stables. It was Sir Roland, the local knight known for his bravery and enigmatic nature. His armor gleamed in the fading light, and his eyes seemed to pierce through me as he approached. "Welcome, young squire," he said, his voice deep and commanding. "I've been expecting you." I swallowed hard, suddenly nervous. There was something about Sir Roland that made me feel both intimidated and intrigued. I had heard whispers of his legendary battles and the secrets he kept hidden behind his stoic facade. </nc-section> <nc-section data-title="Version 2: The Friendly Mentor" data-color="green"> No sooner had I slipped off Thunder's back than Sir Roland, the local knight, came striding over from the stables with a warm smile on his face. He was a stout, middle-aged man with a thick beard and twinkling eyes that instantly put me at ease. "Frederick, my boy!" he exclaimed, clapping me on the shoulder. "Welcome to the castle. I hope you're ready for some hard work and good times." I grinned, feeling a surge of excitement. From the way Sir Roland talked, it seemed like my training was going to be challenging but rewarding. I couldn't wait to get started. </nc-section> <nc-section data-title="Version 3: The Stern disciplinarian" data-color="blue"> I barely had time to stretch my legs before Sir Roland, the local knight, marched over from the stables. His face was stern, his eyes sharp and critical as he looked me up and down. "I hope you're not expecting special treatment, boy," he snapped. "Being a squire is hard work, and I don't have time for slackers or crybabies." I straightened my posture, trying to look as confident as possible. Sir Roland's hard exterior was a bit off-putting, but I knew that he was renowned for turning young squires into skilled knights. I was determined to prove myself worthy of his tutelage. </nc-section>
id
"gen-DDece4ce95sOD6oCPF8xuicsApBl"
total_cost
0.0003104
upstream_id
"chat-aecea1f2ddcf4e518e04a35f5b71d1a0"
created_at
"2024-08-26T22:38:53.780612+00:00"
Monday, August 26th, 2024 at 10:38:53 PM GMT+00:00
model
"nousresearch/hermes-3-llama-3.1-70b"
app_id
182717
streamed
true
cancelled
false
provider_name
"Hyperbolic"
latency
534
moderation_latency
(null)
generation_time
21718
finish_reason
"stop"
tokens_prompt
309
tokens_completion
459
native_tokens_prompt
315
native_tokens_completion
461
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.0003104
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
100.0000%