NC Bench
Overview
About
Tests
Models
Model
Llama 3 Euryale 70B v2.1
Test
Tool usage within Novelcrafter
Scenario
Create alternate prose sections
Run ID
2024-08-09-01J4VTBPPYQKHYCYASD57PAXR4
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1 (red)"> <nc-section data-title="Arrival at the Stables" data-color="red"> As I rode into the castle grounds, I was greeted by the local knight, Sir Roland. He stood tall, his armor glinting in the fading light, a broad smile on his face. "Welcome, young Freddie!" he called out, his voice booming. "I've been expecting you. The Lord is eager to meet his newest squire." </nc-section>Greetings were exchanged and Sir Roland helped me dismount Thunder. He clapped a hand on my shoulder. "Come, let's get your things stowed away in the stable and then I'll show you to your quarters. We'll have you settled in before dinner." </nc-section> </nc-section> <nc-section data-title="Version 2 (green)"> <nc-section data-title="A Knight's Welcome" data-color="green"> I reined in Thunder as we approached the stables. Sir Roland, the gallant knight, strode out to meet me, grinning ear to ear. "Well met, young Frederick! I heard tell of your coming. The Lord awaits." He grabbed my reins. "Let me help you with your steed. Welcome to service at the castle!" </nc-section>Leaving my baggage by the stable door, Sir Roland gestured for me to follow. "Let us head to the keep and announce your arrival. I know you're eager to serve." </nc-section> </nc-section> <nc-section data-title="Version 3 (blue)"> <nc-section data-title="A Hero's Welcome" data-color="blue"> <nc-section data-title="The Stablemaster Greets" data-color="blue"> Sir Roland, the castle's champion knight, emerged from the stables as I rode in. "Greetings!" he called. "I am Sir Roland, the king's champion. Welcome to the royal keep, young Frederick. We've been anticipating your arrival." He took my reins, his eyes appraising me. "You have an impressive mount. Tell me, are you ready to serve your king as loyally?" I nodded. "I am ready, my lord." </nc-section> </nc-section>
id
"gen-AaqkeiNByWyYbBYo3MaAJbxGaboZ"
total_cost
0.001182
upstream_id
"cmpl-149c2bfa9e6d41e9b4bc1ccbc0fea706"
created_at
"2024-08-09T14:58:45.166243+00:00"
Friday, August 9th, 2024 at 2:58:45 PM GMT+00:00
model
"sao10k/l3-euryale-70b"
app_id
182717
streamed
false
cancelled
false
provider_name
"Infermatic"
latency
22743
moderation_latency
(null)
generation_time
0
finish_reason
"stop"
tokens_prompt
384
tokens_completion
478
native_tokens_prompt
309
native_tokens_completion
479
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.001182
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
100.0000%