NC Bench
Overview
About
Tests
Models
Model
Claude 3.0 Sonnet
Test
Tool usage within Novelcrafter
Scenario
Create alternate prose sections
Run ID
2024-08-09-01J4VT96XBJDVGMHY2M453ZTB3
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1" data-color="red"> As I dismounted Thunder, a tall figure emerged from the stables. Sir Roland strode towards me, his armor clanking with each step. His face was weathered from many battles, but his eyes shone with wisdom. "Welcome, young squire," he bellowed. "I am Sir Roland, Knight of the Crimson Dragon. You must be Frederick. I've heard tales of your bravery and skill. The road ahead will not be easy, but I shall guide you on your path to knighthood." </nc-section> <nc-section data-title="Version 2" data-color="green"> I led Thunder to the stables, gently patting his neck. A gruff voice called out, "You must be the new squire." An older man approached, his chain mail clinking softly. Despite his age, Sir Roland carried himself with strength and poise. "Aye, I am Frederick," I replied, giving a short bow. "An honor to meet you, Sir Roland." He gave a warm smile. "The honor is mine, lad. I've trained many squires in my years, but I sense you have a fierce spirit. We'll make a fine knight out of you yet." </nc-section> <nc-section data-title="Version 3" data-color="blue"> The heavy doors of the stables swung open, and a grizzled knight emerged, squinting against the fading sunlight. His tunic bore the emblem of a crimson dragon. "You there, boy!" he barked. "State your name and business." I stood tall, pushing back my shoulders. "I am Frederick, the new squire sent to train under your tutelage, Sir Roland." The knight's stern expression melted into a smile. "Ah, so you're the one. They spoke highly of your potential back at the academy. We'll see if you live up to it, won't we?" </nc-section>
id
"gen-ViV9osY2hlWU7ei3EPEW9NepmNSf"
total_cost
0.00804
upstream_id
"msg_01KZ1drvUDriN7DFJz2GtJdQ"
created_at
"2024-08-09T14:57:10.01586+00:00"
Friday, August 9th, 2024 at 2:57:10 PM GMT+00:00
model
"anthropic/claude-3-sonnet:beta"
app_id
182717
streamed
true
cancelled
false
provider_name
"Anthropic"
latency
982
moderation_latency
(null)
generation_time
8130
finish_reason
"end_turn"
tokens_prompt
302
tokens_completion
418
native_tokens_prompt
335
native_tokens_completion
469
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.00804
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
100.0000%