NC Bench
Overview
About
Tests
Models
Model
GPT-4o, May 13th (temp=0)
Test
Tool usage within Novelcrafter
Scenario
Create alternate prose sections
Run ID
2024-08-09-01J4VT96X9SGJBZSRP815K18RX
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: A Stern Welcome" data-color="red"> As Frederick dismounted Thunder, he noticed a tall, imposing figure approaching from the stables. Sir Roland, the local knight, was known for his stern demeanor and unwavering discipline. His armor gleamed in the fading sunlight, and his eyes were sharp and assessing. "Frederick, I presume," Sir Roland said, his voice carrying a tone of authority. "Welcome to the castle. Your training begins at dawn. I expect nothing less than your best effort." Frederick nodded, feeling a mix of excitement and apprehension. "Yes, Sir Roland. I won't disappoint you." "See that you don't," Sir Roland replied, turning on his heel and striding away. Frederick watched him go, determination settling in his heart. He knew he had a lot to prove. </nc-section> <nc-section data-title="Version 2: A Warm Greeting" data-color="green"> Frederick had barely dismounted Thunder when a friendly voice called out to him. Sir Roland, the local knight, approached with a warm smile. His armor, though battle-worn, shone with a sense of pride and history. "Ah, you must be Frederick," Sir Roland said, extending a hand. "Welcome to the castle, young squire. I hope your journey was pleasant." Frederick shook his hand, feeling a wave of relief wash over him. "Thank you, Sir Roland. It was a long ride, but I'm eager to begin my training." "That's the spirit," Sir Roland replied, clapping Frederick on the shoulder. "We'll start tomorrow at dawn. For now, get some rest and settle in. You'll need your strength." Frederick smiled, feeling a sense of belonging. He knew he was in good hands. </nc-section> <nc-section data-title="Version 3: A Mysterious Encounter" data-color="blue"> As Frederick led Thunder towards the stables, he noticed a figure leaning against the stable door, partially hidden in the shadows. Sir Roland, the local knight, stepped forward, his face partially obscured by the dim light. His eyes, however, gleamed with a mysterious intensity. "Frederick, I presume," Sir Roland said, his voice low and enigmatic. "Welcome to the castle. Your training will be unlike anything you've ever experienced." Frederick felt a shiver run down his spine. "Thank you, Sir Roland. I'm ready for whatever lies ahead." "Good," Sir Roland replied, a hint of a smile playing on his lips. "Remember, not everything is as it seems. Keep your wits about you." With that, Sir Roland disappeared into the shadows, leaving Frederick with a sense of intrigue and anticipation. He knew his journey was just beginning, and it would be filled with unexpected challenges. </nc-section>
id
"gen-Zrz1KU1lu1H2gvIE0nD0O0AlxkT2"
total_cost
0.010385
upstream_id
"chatcmpl-9uLL3k89e2LUAG8IwKr1pRaiuwSVz"
created_at
"2024-08-09T14:57:11.027033+00:00"
Friday, August 9th, 2024 at 2:57:11 PM GMT+00:00
model
"openai/gpt-4o-2024-05-13"
app_id
182717
streamed
false
cancelled
false
provider_name
"OpenAI"
latency
10035
moderation_latency
165
generation_time
0
finish_reason
"stop"
tokens_prompt
302
tokens_completion
601
native_tokens_prompt
301
native_tokens_completion
592
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.010385
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
100.0000%