NC Bench
Overview
About
Tests
Models
Model
Phi-3.5 Mini 128k
Test
Tool usage within Novelcrafter
Scenario
Create alternate prose sections
Run ID
2024-08-26-01J68DB97R73YVC0Q6T1YDZ62D
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: The Encounter (Red)" data-color="red"> As I drew closer to the stables, the intense red hues of the evening sun painted my face with a glowing warmth. Sir Roland stood tall and stern, his armor gleaming under the fading light. His voice, deep and commanding, cut through the quiet of the field. "Frederick, welcome to the Knight's Court," he announced, his words resonating with the weight of countless battles. The knight extended a strong, calloused hand, and I felt my blood stir at the honor of meeting someone of his valiant stature. </nc-section> <nc-section data-title="Version 2: The Introduction (Green)" data-color="green"> Near the stables, a vibrant green shade of nature enveloped me. Underneath the emerald canopy of leaves, Sir Roland motioned for me to approach. Known for his gentle heart despite his chivalrous protection, he offered a warm smile as he said, "Frederick, it's an honor for us both. Your journey begins here." As I took a step forward, a lush feeling of anticipation bloomed within me, eager to learn the knight's wisdom and grow under his tutelage. </nc-section> <nc-section data-title="Version 3: The Prelude (Blue)" data-color="blue"> The cool, serene blue of the setting sun mirrored the calm settling over the stables as I neared Sir Roland. The steadfast knight, with a demeanor as composed as the ocean's depths, looked upon me with gaze softened by years of battles won and stories untold. "Ah, young squire, you've come a long way to join us," he said, his voice a tranquil breeze. It was a promise of the steadfast guidance I yearned for, a bridge between the world I knew and the one that awaited me with the crimson dawn. </nc-section>
id
"gen-xa6oux4WnWqmPhkKPqEBn2JSNO2h"
total_cost
0.0000826
upstream_id
"chat-deca75953d8d46d79909ea0084292618"
created_at
"2024-08-26T22:36:58.291078+00:00"
Monday, August 26th, 2024 at 10:36:58 PM GMT+00:00
model
"microsoft/phi-3.5-mini-128k-instruct"
app_id
182717
streamed
true
cancelled
false
provider_name
"Azure"
latency
150
moderation_latency
(null)
generation_time
11663
finish_reason
"stop"
tokens_prompt
331
tokens_completion
397
native_tokens_prompt
353
native_tokens_completion
473
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.0000826
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
100.0000%