NC Bench
Overview
About
Tests
Models
Model
Magnum 72B
Test
Tool usage within Novelcrafter
Scenario
Create alternate prose sections
Run ID
2024-08-09-01J4VTDKVVBDV2N8FEQ59R7CSZ
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
Version 1 (red): <nc-section data-title="A Gruff Knight" data-color="red"> Leaning wearily off Thunder, I surveyed the stables, an impressive architectural feat of cut wood and stone. "New squire, eh?" A gruff voice said from behind. Startled, I spun around to see an armored man with a scarred face and blonde mustache, his gauntlets creaking as he moved a short distance away. "Sir Roland," I greeted, bowing my head respectfully. "I am Frederick, come to serve the king." The knight examined me with a piercing gaze from beneath his helmet. "Tenderfoot," he smirked. "Coulda fooled me." Version 2 (green): <nc-section data-title="A Warm Welcome" data-color="green"> Unlatching my saddle, I swung down the front of Thunder gracefully. The pungent smell of hay and manure greeted my sensitive nose. "Ah, ah, sir!" I heard hurriedly. Turning, I found myself face to face with a finely armored knight in shining green and gold armor. His fair-haired face beamed cheerily behind his reflective visor. "Welcome, welcome, welcome!" Sir Roland cried, positively radiating happiness. His arms opened wide in his excitement to embrace the new arrival. With a trill of delight, I trotted into his waiting arm to receive a warm hug. The knight smiled. "Greetings, Frederick! I'm so pleased to make your acquaintance." <nc-section data-title="A Strange Greeting" data-color="blue"> In a daze, I dismounted from my horse and strode towards the imposing stables. "Hm," a peculiar voice growled, grabbing my attention. My curiosity piquing, I turned to the source. There, leaning against the pillars of the stable, was an armored knight with a swarthy face and long dark hair, draped over his back. "Well, well, well," he drawled, flicking a lock of ebony hair over a shoulder. His dark green eyes twinkle with amusement, while his lips quirked into a slight grin. "Visitors, I declare." The knight hopped off his perch slowly, his cape swishing behind him as he approached me. "Sir Roland, at your service, oh new recruit." His short chuckle reverberated in the clearing. "And what's your name, friend?"
id
"gen-RycOv2wzGXMgKNQnhMRmyemWRzC8"
total_cost
0.0034155
upstream_id
"5fa85db5DXT2MA9F"
created_at
"2024-08-09T14:59:51.808025+00:00"
Friday, August 9th, 2024 at 2:59:51 PM GMT+00:00
model
"alpindale/magnum-72b"
app_id
182717
streamed
false
cancelled
false
provider_name
"Mancer"
latency
26743
moderation_latency
(null)
generation_time
0
finish_reason
"stop"
tokens_prompt
301
tokens_completion
504
native_tokens_prompt
306
native_tokens_completion
504
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.0034155
Evaluation details
Result
Evaluator
Details
Meta Data
Fail
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Fail
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Fail
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
0.0000%