NC Bench
Overview
About
Tests
Models
Model
Claude 3.0 Sonnet
Test
Tool usage within Novelcrafter
Scenario
Create alternate prose sections
Run ID
2024-08-09-01J4VT9W0SZJ65QKBHA5JZMDB6
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1" data-color="red"> As I dismounted Thunder and led him towards the stables, a tall, broad-shouldered man strode towards me. His armor gleamed in the fading sunlight, and a crimson cloak billowed behind him. This must be Sir Roland, I thought to myself, trying to steady my nerving breaths. "You must be the new squire," he bellowed, his voice carrying an unmistakable air of authority. "Welcome to Dragonwatch Castle. I am Sir Roland, Master of Arms." He looked me up and down appraisingly. "You've got fire in your eyes, lad. That's a good start. But we'll see if you've got what it takes to serve the realm." </nc-section> <nc-section data-title="Version 2" data-color="green"> The stables came into view, and a figure emerged from the shadows, striding towards me with purposeful steps. As he drew closer, I could make out the green tunic and cloak adorned with the kingdom's crest. This weathered warrior could be none other than Sir Roland himself. "Well met, young squire," he said, extending a calloused hand. "The road was kind to you, I trust?" His eyes crinkled at the corners as he smiled warmly. "Dragonwatch keeps few formalities. You may address me simply as Roland." Gesturing towards the castle, he continued, "Come, there is much to learn if you are to take your place among our Order's proud ranks. But first, see that your mount is fed and watered. A knight's bond with his steed is sacred." </nc-section> <nc-section data-title="Version 3" data-color="blue"> Thunder whinnied softly as we approached the stables, and a tall, lean figure emerged from the doorway. Even in the dimming twilight, I could make out the azure cloak and tabard marking him as a knight of the realm. "You'll want to settle your horse first, lad," the man called out in a rich baritone. Up close, I could see the lines etched into his tanned face – a life spent under the open sky. With a few deft movements, he removed Thunder's saddle and bridle. "There's a good lad," he murmured, running a hand along the stallion's flank. "Sir Roland's the name. I'll be overseeing your training here at Dragonwatch. But for now, unsaddle that beast and make him comfortable. We've work enough for you on the morrow." </nc-section>
id
"gen-xkbtfNwQZIMy3KQgQVBy1ZKiT2G2"
total_cost
0.010185
upstream_id
"msg_01PBhmGjC95R9evAeFRJDEZM"
created_at
"2024-08-09T14:57:35.636894+00:00"
Friday, August 9th, 2024 at 2:57:35 PM GMT+00:00
model
"anthropic/claude-3-sonnet:beta"
app_id
182717
streamed
true
cancelled
false
provider_name
"Anthropic"
latency
885
moderation_latency
(null)
generation_time
12343
finish_reason
"end_turn"
tokens_prompt
302
tokens_completion
547
native_tokens_prompt
335
native_tokens_completion
612
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.010185
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
100.0000%