NC Bench
Overview
About
Tests
Models
Model
Phi-3.5 Mini 128k
Test
Tool usage within Novelcrafter
Scenario
Create alternate prose sections
Run ID
2024-08-26-01J68DE455DCVWV91RCFDKJ8V3
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: The Encounter (Red)" data-color="red"> The fiery hues of the setting sun painted Sir Roland's armor in a glowing red. His imposing figure loomed over Frederick as he approached, the scent of leather and horse still clinging to the air. "Frederick," boomed the knight in a voice that echoed off the ancient stones, "you've arrived at a time of change. The fate of our kingdom rests within your hands, and it is time for a young squire to prove his worth." The words set Frederick's heart racing, not only with determination but also with a touch of fear for the responsibility now thrust upon him. </nc-section> <nc-section data-title="Version 2: The Mentor’s Testament (Green)" data-color="green"> As Sir Roland continued to survey the surroundings, a gentle breeze brought the sweet scent of pines. He paused beside Frederick, casting a sage glance at the young squire. "Frederick of the Green Shire," he began, his voice as steady as the verdant hills they stood upon, "you are to learn the deep woods of honor, valor, and skill. Remember, courage grows like the forest—it takes time, care, and many seasons to truly flourish. I shall teach you, and together we shall face the coming darkness." Inspired, Frederick felt a newfound respect swell within him, eager to absorb the wisdom his mentor offered. </nc-section> <nc-section data-title="Version 3: The Knight's Vow (Blue)" data-color="blue"> Under the azure sky, Sir Roland's silhouette against the castle's luminous stones seemed to be a beacon of resolve. "Frederick, I charge you with a quest," said Roland, his tone imbued with an air of serenity as if his words were painted in strokes of sapphire. "You are to seek out the first fire-element dragon, its breath more lethal than flame, within the twilight Dragon's Cove. Here in this blue domain, secrets abound, and only one of true courage and heart can pierce its veil." With determination shining bright in his eyes, Frederick knew this would be the beginning of his most perilous journey yet.
id
"gen-hio0lg4Gl4qyz7Lydcn6z4BCtY42"
total_cost
0.0000893
upstream_id
"chat-4533efe070f94ed4b144591a5b6de30c"
created_at
"2024-08-26T22:38:32.614643+00:00"
Monday, August 26th, 2024 at 10:38:32 PM GMT+00:00
model
"microsoft/phi-3.5-mini-128k-instruct"
app_id
182717
streamed
true
cancelled
false
provider_name
"Azure"
latency
137
moderation_latency
(null)
generation_time
12820
finish_reason
"stop"
tokens_prompt
331
tokens_completion
457
native_tokens_prompt
353
native_tokens_completion
540
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.0000893
Evaluation details
Result
Evaluator
Details
Meta Data
Fail
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
66.6667%