NC Bench
Overview
About
Tests
Models
Model
Cohere Command R+ (Aug. 2024)
Test
Tool usage within Novelcrafter
Scenario
Create alternate prose sections
Run ID
2024-09-20-01J881HMZR894P79MYQ7WB0TXJ
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
## **Chapter 1 Continued:** ### **Version 1: A Warm Welcome (red)** <nc-section data-title="The Knight's Greeting" data-color="red"> As I dismounted near the stable entrance, a tall and robust figure approached me. His armor, bearing the crest of the royal knights, gleamed in the fading light. It was Sir Roland, the renowned warrior known for his valor and skill. "Welcome, young Frederick!" Sir Roland's voice boomed with a friendly tone. "I've been expecting your arrival. You've come to train and become a knight, haven't you?" He clapped me on the shoulder, his eyes twinkling with mirth. "Well, you've come to the right place. Let's get you settled in, and we'll begin your training at the break of dawn." </nc-section> ### **Version 2: A Cautious Encounter (green)** <nc-section data-title="Meeting Sir Roland" data-color="green"> I secured Thunder's reins to a nearby post when a figure emerged from the shadows of the stables, his footsteps echoing on the stone floor. It was Sir Roland, a legend among knights for his prowess in battle. "Greetings, young squire," he said, his deep voice carrying a hint of wariness. "I presume you are Frederick. The castle awaits your service." He eyed me with a mixture of curiosity and caution, as if weighing my worth. "Follow me, and I shall show you the quarters where you'll reside during your training." </nc-section> ### **Version 3: Bonding Over Horseback (blue)** <nc-section data-title="Sir Roland's Welcome" data-color="blue"> Just as I finished untacking Thunder, a familiar voice called out from the stable. "Well, well, who do we have here? A young rider with a fine steed, I see." It was none other than Sir Roland, a seasoned knight and a friend of my father's. "Frederick, my boy! Your father has told me much about your talent with horses. I'd love to hear more about Thunder's journey here." He patted Thunder's neck, and I felt an instant connection with the kindhearted knight. As we talked, I knew that under his guidance, I'd become not just a knight, but a true protector of the kingdom. </nc-section>
id
"gen-V6ltUFV4IxQu6cRFymK5RcaQpMBa"
total_cost
0.00601
upstream_id
"5a386d2f-e85d-4864-a233-e18d14f23fa0"
created_at
"2024-09-20T15:42:05.164067+00:00"
Friday, September 20th, 2024 at 3:42:05 PM GMT+00:00
model
"cohere/command-r-plus-08-2024"
app_id
182717
streamed
true
cancelled
false
provider_name
"Cohere"
latency
64
moderation_latency
(null)
generation_time
8875
finish_reason
"COMPLETE"
tokens_prompt
302
tokens_completion
497
native_tokens_prompt
300
native_tokens_completion
526
native_tokens_reasoning
(null)
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.00601
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
100.0000%