NC Bench
Overview
About
Tests
Models
Model
Qwen 2 7B
Test
Tool usage within Novelcrafter
Scenario
Create alternate prose sections
Run ID
2024-08-09-01J4VTDNCKRWJYSEJJBQ2GJZ48
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
Using <nc-section> tags to modify the continued story text as requested: ### Version 1 (Red) <nc-section data-title="Meeting Sir Roland" data-color="red"> Sir Roland, a seasoned and balding knight, eagerly awaited the arrival of Frederick. He was known throughout the realm for his gravelly voice and strict training regime. As Frederick stepped into the stables' bustling activity, Sir Roland quickly made his way through the crowd, his eyes narrowing at the boy. "Well, well," he spoke in a deep baritone, "if it isn't our new squire. Show some respect, lad." </nc-section> ### Version 2 (Green) <nc-section data-title="Sir Roland's Guidance" data-color="green"> Sir Roland, a gentle giant with an aura of calm, swiftly moved to guide Frederick towards the spotless stalls. The speckled light from the lanterns soothed the scene as they stood in proximity. Sharing a moment, he said, "Welcome Frederick. It won't be easy, but with dedication, anything is possible. Treat this place not just as your second home, for it will shape the warrior you become inside and out." </nc-section> ### Version 3 (Blue) <nc-section data-title="New Trainer's Insight" data-color="blue"> Sir Roland, a seasoned warrior, observed Frederick as he sped through the open field near the castle. A glimpse of speed met him, one of his juniors returning quickly, for training could not start without him at his best. Roland, reaching the stables, saw a mix of pride and caution in Frederick's eyes. "Lad," his voice steady and warm, "this will be challenging, but your heart tells me you've the fire to achieve heights beyond your imagination today. Let us not waste the initial glow of opportunity." </nc-section>
id
"gen-cYxtGJBev451kHNCtqsAGsfCAPdl"
total_cost
0.00010335
upstream_id
"cmpl-32fd7fa2e1064cba91f1910b0e87908c"
created_at
"2024-08-09T14:59:30.729407+00:00"
Friday, August 9th, 2024 at 2:59:30 PM GMT+00:00
model
"qwen/qwen-2-7b-instruct"
app_id
182717
streamed
false
cancelled
false
provider_name
"OctoAI"
latency
4124
moderation_latency
(null)
generation_time
0
finish_reason
"stop"
tokens_prompt
301
tokens_completion
383
native_tokens_prompt
306
native_tokens_completion
383
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.00010335
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
100.0000%