NC Bench
Overview
About
Tests
Models
Model
Cohere Command R+ (Apr. 2024)
Test
Tool usage within Novelcrafter
Scenario
Create alternate prose sections
Run ID
2024-08-09-01J4VTC1DJSFAQV84Y0YGVVHN4
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
## Version 1: Red As I dismounted near the stables, a figure emerged from the shadows. He was tall and broad-shouldered, clad in gleaming armor that shimmered in the fading light. The crest on his chest identified him as Sir Roland, the kingdom's most renowned knight. "Welcome, young squire," Sir Roland said, his voice deep and commanding. "I am Sir Roland, and I will be your mentor during your time here. The kingdom is in need of brave warriors, and I sense great potential in you." The stable hands scurried to tend to my horse, and I followed Sir Roland into the castle proper. The weight of his words rested on my shoulders, filling me with determination. ## Version 2: Green Sir Roland, a seasoned knight with a reputation that preceded him, stepped out from the stables. His armor, a dark green etched with intricate ivy patterns, gleamed like fresh leaves in the sun. A warm smile spread across his face as he extended a hand in greeting. "Frederick, it is a pleasure to finally meet you. I am Sir Roland, and these are my lands and my people. Your journey towards knighthood begins today, and I am here to guide and teach you all that I know. The kingdom expects great things, and we shall not disappoint." His words were encouraging, and I felt a sense of ease as I dismounted and patted Thunder on the flank. The stables buzzed with activity as stable hands readied my horse for the night. ## Version 3: Blue The sound of hooves clopping on stone drew my attention, and I turned to see a man riding towards me. He wore blue armor, a vivid contrast to the pale blue sky. The sigil of a soaring eagle marked him as Sir Roland, a knight of legendary skill and valor. "Well met, young squire," Sir Roland said, his voice carrying the weight of experience. "Your journey has brought you to my domain, and I am honored to play a part in your training. The castle and its environs will be your home for the foreseeable future. Embrace the challenges, for they shall forge you into a warrior worthy of song and tale." His words hung in the air as I swung off Thunder, feeling a mix of excitement and trepidation. The stables buzzed with activity, and I could sense the adventure that awaited me within those castle walls.
id
"gen-A3FtZu5HvSUb75gwVT6wezmT1UrX"
total_cost
0.00864
upstream_id
"f3812fee-966e-4726-9e9e-cca9335d9d0c"
created_at
"2024-08-09T14:58:47.67815+00:00"
Friday, August 9th, 2024 at 2:58:47 PM GMT+00:00
model
"cohere/command-r-plus"
app_id
182717
streamed
false
cancelled
false
provider_name
"Cohere"
latency
14286
moderation_latency
(null)
generation_time
0
finish_reason
"COMPLETE"
tokens_prompt
302
tokens_completion
515
native_tokens_prompt
300
native_tokens_completion
516
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.00864
Evaluation details
Result
Evaluator
Details
Meta Data
Fail
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Fail
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Fail
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
0.0000%