NC Bench
Overview
About
Tests
Models
Model
GPT-4o, Aug. 6th (temp=1)
Test
Tool usage within Novelcrafter
Scenario
Create alternate prose sections
Run ID
2024-08-09-01J4VTCP36TX3KH5S282NV0Q8S
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: A Welcoming Hand" data-color="red"> As Thunder and I neared the stables, a figure emerged from the shadows. Sir Roland, the local knight, stood tall in his gleaming armor. He wore a broad grin beneath his grey beard, and his eyes twinkled with a warmth that instantly put me at ease. "Ah, Frederick!" he called out, his voice booming like a drum. "Welcome to the castle. I see you've quite the steed there." He patted Thunder's flank appreciatively before turning to shake my hand. Despite his intimidating presence, his grip was gentle, a sign of his practiced chivalry. "Come," he beckoned, leading me toward the stables. "There's much to learn and even more to discuss." </nc-section> <nc-section data-title="Version 2: A Solemn Greeting" data-color="green"> As I dismounted Thunder near the stables, Sir Roland approached with purposeful strides. His armor clinked softly with each step, and his demeanor was solemn, radiating the gravity of his station. "Frederick," he addressed me, his voice carrying the weight of authority tempered with kindness. "I've heard tales of your talent. The path of a squire is not easy, but it's a noble one." He paused, resting a steady hand on my shoulder. "You'll find no better place to hone your skills than here. We expect great things from you." With those words, he nodded towards the castle, a silent invitation to follow him into my new life. </nc-section> <nc-section data-title="Version 3: A Jocular Encounter" data-color="blue"> As I approached the stables, Thunder snorted, alerting Sir Roland to our presence. The knight turned, a mischievous glint in his eyes. His armor was splattered with mud from his earlier training session, and a wide grin split his face. "Young Frederick! I hope you're ready for some hard work," he chuckled, giving Thunder an affectionate pat. "Your horse looks as spunky as you do!" He laughed heartily, a sound as robust as a clap of thunder. He gestured towards the castle with a sweeping motion, still chuckling. "Let us waste no time. Adventure and chores await—they're much the same here, after all!" </nc-section>
id
"gen-P5ptWgmUeNOwLeQ2tBD86OraUBLN"
total_cost
0.0057125
upstream_id
"chatcmpl-9uLMtHCB9bnTa95ZoSlvJDjvFJvWg"
created_at
"2024-08-09T14:59:00.581647+00:00"
Friday, August 9th, 2024 at 2:59:00 PM GMT+00:00
model
"openai/gpt-4o-2024-08-06"
app_id
182717
streamed
false
cancelled
false
provider_name
"OpenAI"
latency
5428
moderation_latency
662
generation_time
0
finish_reason
"stop"
tokens_prompt
302
tokens_completion
504
native_tokens_prompt
301
native_tokens_completion
496
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.0057125
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
100.0000%