NC Bench
Overview
About
Tests
Models
Model
Phi-3 Mini 128k
Test
Tool usage within Novelcrafter
Scenario
Create alternate prose sections
Run ID
2024-08-09-01J4VTAH74CYB3J6G1KGHAFF76
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: The Encounter" data-color="red"> As Frederick dismounted, Thunder stamped placidly beside him, his coat catching the embers of the setting sun. Before he could greet the castle staff, a tall figure emerged from the stable's gate. Sir Roland, the famed knight, with his armor shining like the blood-red horizon, offered a firm handshake. "Well met, young squire," he boomed in a voice that seemed to echo off the ancient stone walls. "Tis I, Sir Roland. You seem to be a welcome sight at this hour." A thrill of excitement coursed through Frederick's veins. He bowed respectfully and introduced himself, feeling a sense of destiny unfolding before his very eyes. </nc-section> <nc-section data-title="Version 2: Secrets Unfold" data-color="green"> Underneath the leafy boughs of the garden, the knight approached Frederick and motioned for him to follow. The twilight deepened, casting an emerald sheen over the grounds. A whisper in the breeze carried secret stories, and the bushes rustled with hidden knowledge. "Frederick," Sir Roland murmured. "The king has sought you out for a purpose, one that may change the course of our kingdom." He led the way to a secluded pavilion where the true training would begin. "Listen closely, and learn the weight of your duty. It is not only about combat; it's about understanding the essence of bravery." </nc-section> <nc-section data-title="Version 3: Amidst the Shadows" data-color="blue"> They sat near a fountain that mirrored the darkening sky—a pool of shimmering sapphire calm in the heart of the garden. Sir Roland studied Frederick with eyes that pierced much deeper than his blade. "You have much to learn, young squire," he said with a smile that belied the seriousness of his intent. "The path you tread upon is as rich with stories as it is with valor. Today, your sword shall be a faithful companion, and your shield — a keeper of untold secrets. Remember, the truest strength lies in the heart that beats beneath the armor." Frederick felt the gravity of the knight's words, his mind shifting from the typical tales of swordplay to the untold lore of the times ahead.
id
"gen-3pNBSYEJCtHMF6CPNm6B2VEnJ4wC"
total_cost
0
upstream_id
"cmpl-4cfe2998d3904503846b5f2e3540e861"
created_at
"2024-08-09T14:57:50.247674+00:00"
Friday, August 9th, 2024 at 2:57:50 PM GMT+00:00
model
"microsoft/phi-3-mini-128k-instruct:free"
app_id
182717
streamed
false
cancelled
false
provider_name
"Azure"
latency
6328
moderation_latency
(null)
generation_time
0
finish_reason
"stop"
tokens_prompt
331
tokens_completion
482
native_tokens_prompt
352
native_tokens_completion
569
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0
Evaluation details
Result
Evaluator
Details
Meta Data
Fail
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
66.6667%