NC Bench
Overview
About
Tests
Models
Model
GPT-4o, Aug. 6th (temp=1)
Test
Tool usage within Novelcrafter
Scenario
Create alternate prose sections
Run ID
2024-08-09-01J4VTBHVRGQKV15PQA4Z75BYR
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: The Welcoming Knight" data-color="red"> As Thunder slowed to a halt near the stables, a robust figure emerged from the shadows. It was Sir Roland, the local knight, known for his valor and unmatched skill in battle. His armor gleamed even in the dimming light, and his eyes mirrored the depth of the ocean. With a hearty laugh, he clapped a firm hand on Frederick's shoulder. "Welcome, young squire," he said, his voice as strong as the castle's stone walls. "I've heard much about you and your spirit. May your stay here be filled with valor and honor." </nc-section> <nc-section data-title="Version 2: A Word of Caution" data-color="green"> Frederick dismounted Thunder, his boots crunching on the gravel path leading to the stables. There, leaning against a wooden post, was Sir Roland. His expression was stern, yet a hint of warmth flickered in his eyes. "Frederick," he called, his voice as steady as a mountain breeze. "This land has seen many tales, some glorious, some grim. Keep your wits about you, and remember, honor is earned through deeds, not words. Welcome to your new life." He extended his hand, a gesture of both greeting and warning. </nc-section> <nc-section data-title="Version 3: An Unexpected Offer" data-color="blue"> As Frederick guided Thunder into the stable yard, he noticed Sir Roland approaching, his chainmail clinking softly with each step. The knight's smile was wide and genuine, and his presence seemed to bring a sense of peace to the bustling surroundings. "Ah, the young squire we've all been hearing about," he said with a nod. "How about joining me on tomorrow's patrol? There's no better way to learn than seeing the kingdom through the eyes of a knight." Frederick's heart leapt at the unexpected opportunity, knowing this was the beginning of many adventures. </nc-section>
id
"gen-R8rIcTcHh8C2dKtgKoug05tbQ68Y"
total_cost
0.0049625
upstream_id
"chatcmpl-9uLMHLgHLboAkwsdMr5QW8dlvX8hB"
created_at
"2024-08-09T14:58:21.922632+00:00"
Friday, August 9th, 2024 at 2:58:21 PM GMT+00:00
model
"openai/gpt-4o-2024-08-06"
app_id
182717
streamed
false
cancelled
false
provider_name
"OpenAI"
latency
4397
moderation_latency
135
generation_time
0
finish_reason
"stop"
tokens_prompt
302
tokens_completion
424
native_tokens_prompt
301
native_tokens_completion
421
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.0049625
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
100.0000%