NC Bench
Overview
About
Tests
Models
Model
GPT-4o, Aug. 6th (temp=1)
Test
Tool usage within Novelcrafter
Scenario
Create alternate prose sections
Run ID
2024-08-09-01J4VT9MNXHBBHYG6NF0BTBKN2
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: A Seasoned Knight's Welcome" data-color="red"> As I approached the stables, I spotted a tall, broad-shouldered man dressed in gleaming armor. Sir Roland, the local knight renowned for his valor in battle, stood with an air of authority. His piercing blue eyes settled on me, and he offered a firm nod. "Welcome, young Frederick," he said in a gruff voice. "You've chosen an opportune time to begin your training. The kingdom needs courageous souls like yours." His words, though few, bore the weight of encouragement and a promise of tough days ahead, but the kind of days that forged warriors. </nc-section> <nc-section data-title="Version 2: The Knight's Embrace" data-color="green"> Upon reaching the stables, Sir Roland was already waiting. Unlike the formidable knight stories portrayed, he held a gentle demeanor. With a warm smile, he extended an arm in greeting. "Ah, Frederick, welcome to our humble abode," he said, patting my shoulder amicably. "Life here by the castle can be challenging, but it's also where you'll find your greatest strength. Should you need guidance, you'll find a friend in me." His warmth was reassuring, transforming the intimidating castle into a place that felt almost like home. </nc-section> <nc-section data-title="Version 3: A Somber Introduction" data-color="blue"> As I dismounted Thunder near the stables, Sir Roland approached with a solemn expression. "Frederick, I presume," he stated, his tone neither harsh nor welcoming, but matter-of-fact. His reputation as a stern knight was well known, and his presence was commanding. "The king expects much from his squires, but remember, true strength lies in discipline and honor." His gaze was steady, instilling within me a sense of both duty and an inkling of apprehension. The path ahead was uncertain, yet under his tutelage, I vowed to forge my destiny. </nc-section>
id
"gen-monzAirGFWURpoNBHuFxZusWbIbl"
total_cost
0.0049925
upstream_id
"chatcmpl-9uLLGhRTGaEobmMHySEWV44ICpIjZ"
created_at
"2024-08-09T14:57:19.798199+00:00"
Friday, August 9th, 2024 at 2:57:19 PM GMT+00:00
model
"openai/gpt-4o-2024-08-06"
app_id
182717
streamed
false
cancelled
false
provider_name
"OpenAI"
latency
4815
moderation_latency
224
generation_time
0
finish_reason
"stop"
tokens_prompt
302
tokens_completion
429
native_tokens_prompt
301
native_tokens_completion
424
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.0049925
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
100.0000%