NC Bench
Overview
About
Tests
Models
Model
Phi-3 Medium 128k
Test
Tool usage within Novelcrafter
Scenario
Create alternate prose sections
Run ID
2024-08-09-01J4VTAK8H1R9F4TPAWZZ8AF1S
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
Version 1 - Red <nc-section data-title="The Welcome" data-color="red"> A gentle click of the stable door eased my mind as I prepared to dismount from Thunder. Suddenly, I was approached by a towering figure. It was Sir Roland, the local knight, his armor gleaming in the sunset's red hue. His grin was as wide as the grand doors of the castle. "Welcome Frederick, your journey begins here!" he bellowed, enwrapping me in a hearty knightly hug. The warmth of his greeting sparked a flame of anticipation within my heart that I knew would ignite the adventures to come. </nc-section> Version 2 - Green <nc-section data-title="The First Meeting" data-color="green"> Gently, I eased myself off the horse, a comforting wave of relief sweeping over me. The scent of hay mixed with the fresh air while the verdant landscape framed the castle. I barely had a moment to marvel at the scenery when a green surge of energy passed as Sir Roland, a knight of renowned valor and kindness, stepped forward to greet me. His eyes twinkled like emerald stars as he extended a welcoming hand towards me. "Welcome Frederick," he said, his words ringing with genuine warmth. "The castle has been expecting you – your training as a knight shall begin tomorrow." </nc-section> Version 3 - Blue <nc-section data-title="The Encounter" data-color="blue"> As I steered Thunder to a quiet corner near the stables, the castle’s turrets seemed to touch the soft, blue sky. The azure was unbroken, save for the silhouette of a single figure weaving through the crowd of knights preparing for the night watch. As he came closer, I realized it was Sir Roland. The same old white star on his blue-flecked breastplate set him apart even in a sea of gleaming armors. His comforting voice resonated, "Welcome, young Frederick. The road of a knight awaits you."
id
"gen-a5yAF7RsmrFUrKAgd2VLGJcOpxfy"
total_cost
0
upstream_id
"cmpl-ad037483311247babe19fc7e2d1de8f4"
created_at
"2024-08-09T14:57:54.898148+00:00"
Friday, August 9th, 2024 at 2:57:54 PM GMT+00:00
model
"microsoft/phi-3-medium-128k-instruct:free"
app_id
182717
streamed
false
cancelled
false
provider_name
"Azure"
latency
8867
moderation_latency
(null)
generation_time
0
finish_reason
"stop"
tokens_prompt
331
tokens_completion
411
native_tokens_prompt
352
native_tokens_completion
501
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0
Evaluation details
Result
Evaluator
Details
Meta Data
Fail
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
66.6667%