NC Bench
Overview
About
Tests
Models
Model
Llama 3 Euryale 70B v2.1
Test
Tool usage within Novelcrafter
Scenario
Create alternate prose sections
Run ID
2024-08-09-01J4VTC69YZ6HMR2KSPR5WY3JT
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1 (red)"> <nc-practice-product> As I rode into the castle courtyard, I spotted the tall, proud figure of Sir Roland awaiting me. His armor gleamed in the fading light and his cloak billowed around him. He smiled warmly as I dismounted. "Greetings young Frederick," he said, his voice deep and confident. "Welcome to Castleelcome. I see you made the journey without incident." "Yes, Sir Roland," I replied, bowing slightly. "It's an honor to meet you." His eyes appraised me as he strode over and clapped a hand on my shoulder. "You have a fire in your eyes. The makings of a true warrior. Let us hope it guides you well." With that, he turned and gestured for me to follow. "Come, the stablehands will tend your steed. I shall show you to your quarters." I grinned as I fell into step beside him, eager to begin my path to knighthood. </nc-practice-product> </nc-section> <nc-section data-title="Version 2 (green)"> <nc-practice-product> Sir Roland was there to greet me as I entered the stables, his eyes narrowed. He looked me up and down before speaking. "You're Frederick, I presume? The young man here for training?" I nodded, still somewhat awed to be speaking to the famed knight. "Yes, Sir Roland. An honor to meet you, sir." He grunted. "We shall see if you prove worthy of that honor in time. But first, you'll need to stable your mount properly. That's your first lesson, boy." He strode off without waiting for a response, clearly expecting to be obeyed. I sighed and unsaddled Thunder, knowing this would be a long, hard road to becoming a knight. </nc-practice-product> </nc-section> <nc-section data-title="Version 3 (blue)"> <nc-practice-product> As I guided Thunder through the courtyard gates, the gruff voice of a knight hollered out. "Boy!" I looked up to see Sir Roland scowling at me disapprovingly. "I believe the stablemaster is expecting your steed, Squire," he said sharply. "Yes, Sir Roland," I replied, glancing longingly at the stone castle walls. I would have to negotiate with the stableman later for better accommodations than expected. For now, I gave Thunder a pat and handed him over, watching as the stableman whisked him off. Sir Roland held up a hand, preventing me from following. "A word, Squire. You may be young and untested, but you will conduct yourself accordingly. Understood?" "Of course, Sir Roland." I met his stern gaze evenly. I would prove myself more than just an unruly youth. </nc-practice-product> </nc-section>
id
"gen-T03Amg0naTwnSMQ1YJpQIPM6BICt"
total_cost
0.0013815
upstream_id
"cmpl-abb9aeba3a1f45a4841a23fe9a3c03e4"
created_at
"2024-08-09T14:59:22.693593+00:00"
Friday, August 9th, 2024 at 2:59:22 PM GMT+00:00
model
"sao10k/l3-euryale-70b"
app_id
182717
streamed
false
cancelled
false
provider_name
"Infermatic"
latency
44270
moderation_latency
(null)
generation_time
0
finish_reason
"stop"
tokens_prompt
384
tokens_completion
611
native_tokens_prompt
309
native_tokens_completion
612
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.0013815
Evaluation details
Result
Evaluator
Details
Meta Data
Fail
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Fail
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Fail
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
0.0000%