NC Bench
Overview
About
Tests
Models
Model
Claude 3.0 Sonnet
Test
Tool usage within Novelcrafter
Scenario
Create alternate prose sections
Run ID
2024-08-09-01J4VTAA6B8KE620CJTF1B6ANB
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
Here are 3 alternate sections continuing the story: <nc-section data-title="Version 1" data-color="red"> As I dismounted Thunder, a tall figure in shining armor approached. "You must be the new squire," the knight bellowed in a gruff voice. He removed his helmet, revealing a weathered face and close-cropped gray hair. "I am Sir Roland, master of these stables. From this day forward, you will learn the ways of combat and chivalry under my tutelage." He looked me up and down appraisingly. "You've got a lot to learn, boy." </nc-section> <nc-section data-title="Version 2" data-color="green"> I led Thunder into the stables, running my hands along his powerful flanks. A tall, barrel-chested man in armor appeared, a sword sheathed at his side. "Ah, you must be Frederick," he said with a warm smile. "Welcome to the castle." He placed a calloused hand on my shoulder. "I'm Sir Roland, captain of the knights here. It will be an honor to train you in the ways of knighthood - riding, sword-fighting, and service to the kingdom." His eyes twinkled. "Just don't expect me to go easy on you." </nc-section> <nc-section data-title="Version 3" data-color="blue"> The clopping of hooves against cobblestone announced my arrival. A knight emerged from the stables, his armor gleaming. "You there! State your name and business," he barked gruffly. I slid off my horse and dipped into a bow. "Sir Roland? I am Frederick, the new squire sent to train under your guidance." The knight gazed at me silently for a moment, then threw back his head and guffawed. "Ha! So this is the lad I'll be molding into a knight?" He clapped me roughly on the back. "Lucky for you, I show no Quarter when it comes to training. You'll be riding, fighting, and watching over my flasks by winter's end!" </nc-section>
id
"gen-amqDqLTERDbvRk9ZaibJfr2mpS8m"
total_cost
0.00846
upstream_id
"msg_016cjwZcTZ8McXTAWyuCqars"
created_at
"2024-08-09T14:57:47.491835+00:00"
Friday, August 9th, 2024 at 2:57:47 PM GMT+00:00
model
"anthropic/claude-3-sonnet:beta"
app_id
182717
streamed
true
cancelled
false
provider_name
"Anthropic"
latency
983
moderation_latency
(null)
generation_time
9579
finish_reason
"end_turn"
tokens_prompt
302
tokens_completion
454
native_tokens_prompt
335
native_tokens_completion
497
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.00846
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
100.0000%