NC Bench
Overview
About
Tests
Models
Model
Llama 3 Euryale 70B v2.1
Test
Tool usage within Novelcrafter
Scenario
Create alternate prose sections
Run ID
2024-08-09-01J4VT9WQQERHEYXTJ98C5B2T9
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1 (red)"> As I approached the castle gates, a knight stepped out from the shadows. He was tall and muscular, with a stern expression on his face. His armor gleamed in the fading light. "Who goes there?" he called out, resting a hand on the hilt of his sword. I reined in Thunder and announced myself. "Frederick, squire of Lord Baratheon, here to begin my training." The knight's eyes narrowed as he appraised me. "I am Sir Roland of Lockington. Have you journeyed far to reach us, boy?" I nodded, unused to being addressed so abruptly. Sir Roland gestured towards the stables with his sword. "See to your horse, then report to the training yard. Master Sergeant will be expecting you." He turned on his heel and stalked off, leaving me feeling quite flustered by the stern greeting. </nc-section> <nc-section data-title="Version 2 (green)"> I drew up before the castle's mighty gates, a midst a thunderous drumroll echoing behind me. A tall armored knight emerged from the guardpost. "Halt! Identify yourself," he bellowed, hand on sword. I urged Thunder forward. "Frederick, squire of Lord Baratheon. I come to serve and learn, by the king's decree." The knight eyed me keenly. "I am Sir Roland. Welcome to Ravenswood Castle. Dismount and stable that beast. The training ground awaits." </nc-section> <nc-section data-title="Version 3 (blue)"> As I approached, a knight emerged from the portcullis gate, his breastplate glinting like the national emerald. He held up a gauntleted hand. "Halt, stranger! State your name and purpose." I straightened in my saddle. "Frederick, squire to Lord Baratheon, come to find fortune and glory under the king's banner." Sir Roland nodded once. "Stable your steed and report to the bailey. The master-at-arms expects you." </nc-section>
id
"gen-m8sI5hVr8SuRlXSTQVhTYR7Nx36M"
total_cost
0.001134
upstream_id
"cmpl-553f304534a7451faf6da13c820beeb2"
created_at
"2024-08-09T14:57:50.214126+00:00"
Friday, August 9th, 2024 at 2:57:50 PM GMT+00:00
model
"sao10k/l3-euryale-70b"
app_id
182717
streamed
false
cancelled
false
provider_name
"Infermatic"
latency
27076
moderation_latency
(null)
generation_time
0
finish_reason
"stop"
tokens_prompt
384
tokens_completion
446
native_tokens_prompt
309
native_tokens_completion
447
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.001134
Evaluation details
Result
Evaluator
Details
Meta Data
Fail
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Fail
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Fail
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
0.0000%