NC Bench
Overview
About
Tests
Models
Model
Cohere Command R+ (Aug. 2024)
Test
Tool usage within Novelcrafter
Scenario
Create alternate prose sections
Run ID
2024-09-20-01J881H0N271E1CMM2XZN7D6TJ
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
**Version 1: "A Knight's Welcome"** <nc-section data-title="Chapter 2: A Knight's Welcome" data-color="red"> As I dismounted, a figure emerged from the stables, his armor gleaming in the fading light. It was Sir Roland, the renowned knight of the realm. He strode towards me, his expression stern but his eyes held a hint of warmth. "Welcome, young Frederick," he boomed, his voice carrying the weight of experience. "I've been expecting you. It's an honor to have another aspiring warrior join our ranks." I bowed respectfully. "It's an honor to meet you, Sir Roland. I've heard tales of your valor and victories. I hope to learn from your wisdom and one day become a knight worthy of respect." Sir Roland's face softened at my words. "Then you've come to the right place, young squire. The path of a knight is both challenging and rewarding. I shall personally oversee your training and ensure you become a force to be reckoned with."</nc-section> **Version 2: "The Knight's Advice"** <nc-section data-title="Chapter 2: The Knight's Advice" data-color="green"> When I approached the stables, a tall, broad-shouldered man emerged, his armor slightly worn but well-maintained. "Ah, Frederick, you've arrived," he said, his voice deep and friendly. It was Sir Roland, a seasoned knight known for his tactical prowess. I offered a nervous smile. "Sir, it's an honor. I am eager to start my training." Sir Roland laughed, a hearty sound that echoed in the stable yard. "Calm yourself, young squire. The path ahead is long and arduous, but fear not, for the rewards are great. The key to knighthood lies not only in physical prowess but also in knowledge and strategy." He placed a hand on my shoulder. "I will train you, but more importantly, I will guide and mentor you. Together, we shall shape you into a remarkable knight."</nc-section> **Version 3: "The Knight's Duty"** <nc-section data-title="Chapter 2: The Knight's Duty" data-color="blue"> The Stables were bustling with activity as I approached, and amidst the commotion, Sir Roland appeared, his presence commanding attention. I introduced myself, and he greeted me with a nod. "Young Frederick, I presume. I've been tasked with your training, and it is my duty to ensure you're prepared for the challenges ahead." A sense of duty and honor filled his words, and I felt a surge of determination. "Yes, sir! I'm prepared to work tirelessly. I aim to become a knight of great skill and integrity, one who serves the kingdom with honor." Sir Roland smiled, a brief flicker of emotion. "That spirit will serve you well, Frederick. Knighthood is a sacred calling, and with dedication and the right guidance, you shall rise to meet it."</nc-section>
id
"gen-HHdygyQBRAy6rVtQJEzuqFE83ABX"
total_cost
0.00729
upstream_id
"13babfd6-59fd-4b61-972d-162a89e95632"
created_at
"2024-09-20T15:41:51.623952+00:00"
Friday, September 20th, 2024 at 3:41:51 PM GMT+00:00
model
"cohere/command-r-plus-08-2024"
app_id
182717
streamed
true
cancelled
false
provider_name
"Cohere"
latency
121
moderation_latency
(null)
generation_time
16329
finish_reason
"COMPLETE"
tokens_prompt
302
tokens_completion
631
native_tokens_prompt
300
native_tokens_completion
654
native_tokens_reasoning
(null)
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.00729
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
100.0000%