NC Bench
Overview
About
Tests
Models
Model
Cohere Command R+ (Apr. 2024)
Test
Tool usage within Novelcrafter
Scenario
Create alternate prose sections
Run ID
2024-08-09-01J4VTBC37CJ1F2QK6AD0KW561
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
## Version 1: Red <nc-section data-title="The Greetings" data-color="red"> As I dismounted from Thunder, my heart raced with excitement. I spotted a tall and imposing figure approaching me near the stables. He was clad in full plate armor, with a crimson cloak billowing in the wind. His visor was up, revealing a weathered face with a stern yet noble countenance. It was Sir Roland, the famed knight of the realm. "Welcome, young squire," Sir Roland boomed, his voice carrying the weight of experience. "I am glad to finally meet you, Frederick. Your reputation precedes you, and I am eager to see what skills you shall bring to our castle." I bowed respectfully, feeling a mix of awe and pride. "Thank you, Sir Roland. I am honored to be here and eager to begin my training. I have heard much about your great deeds and valiance in battle, and I aspire to follow in your footsteps." </nc-section> ## Version 2: Green <nc-section data-title="A Warm Welcome" data-color="green"> The stables loomed ahead, and as I drew closer, a figure emerged. Sir Roland, a legendary knight known for his exploits on the battlefield, stood tall and proud. He wore a suit of gleaming emerald armor, with a green plume adorning his helmet. His eyes sparkled with a warm light as he extended a gauntleted hand in greeting. "Hail, young Frederick! It is a pleasure to meet you at last. I have heard great things about your potential, and I am excited to witness your growth as a squire." I felt a surge of determination as I took his hand, feeling the strength and wisdom within his grip. "Thank you, Sir Roland. It is an honor to be under your guidance. I shall strive to learn all that I can and hopefully one day live up to the tales of your valiant knighthood." </nc-section> ## Version 3: Blue <nc-section data-title="The Promise of Adventure" data-color="blue"> Near the stables, a figure appeared, shrouded in the fading light of dusk. Sir Roland, a stalwart knight clad in azure armor, stepped forward. His voice carried a depth of experience as he addressed me. "Ah, Frederick, it is good to finally lay eyes on you. I've heard tales of your arrival and sense the potential within you. Together, we shall forge a path of valor and chivalry." I felt a rush of anticipation as I replied, "The honor is mine, Sir Roland. Your reputation as a heroic knight precedes you, and I am eager to learn from your vast knowledge. I promise to dedicate myself to the ways of the blade and the ideals of knighthood." </nc-section>
id
"gen-LVLI1ydCww3HsRUvg8wAy2QmfPO6"
total_cost
0.01017
upstream_id
"de9c13a6-fcae-41f6-8bf2-3c979159ecfd"
created_at
"2024-08-09T14:58:28.451966+00:00"
Friday, August 9th, 2024 at 2:58:28 PM GMT+00:00
model
"cohere/command-r-plus"
app_id
182717
streamed
false
cancelled
false
provider_name
"Cohere"
latency
16667
moderation_latency
(null)
generation_time
0
finish_reason
"COMPLETE"
tokens_prompt
302
tokens_completion
588
native_tokens_prompt
300
native_tokens_completion
618
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.01017
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
100.0000%