NC Bench
Overview
About
Tests
Models
Model
Qwen 2.5 72B
Test
Tool usage within Novelcrafter
Scenario
Create alternate prose sections
Run ID
2024-09-20-01J881EDG6DAE425HWM441HJM5
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: The Stern Greeting" data-color="red"> As I dismounted Thunder, a tall figure approached from the shadows of the stables. It was Sir Roland, the local knight, his armor gleaming even in the fading light. He crossed his arms and surveyed me with a critical eye. "So, you're the new squire, are you?" he said, his voice gruff and unyielding. "You'll find life here isn't a game. If you can't handle the rigors of training, you might as well turn back now." </nc-section> <nc-section data-title="Version 2: The Welcoming Knight" data-color="green"> As I slipped from Thunder's back, a warm smile greeted me. Sir Roland, the local knight, stepped out from the stables, his armor polished and his demeanor kind. "Welcome, Frederick," he said, extending a hand. "We've been expecting you. I hope your journey was safe. The castle is your home now, and we'll do our best to make you feel welcome." </nc-section> <nc-section data-title="Version 3: The Test of Courage" data-color="blue"> As I tied Thunder to the post, a figure emerged from the stables, his silhouette stark against the dim light. Sir Roland, the local knight, stood with a stern expression. Without a word, he tossed me a heavy saddle and nodded towards the castle. "Prove your worth," he commanded. "Carry that to the stables. If you can manage it, you'll earn your place here." </nc-section>
id
"gen-z5vvlvRuk8yk08St8IJVhndU2IoQ"
total_cost
0.0002596
upstream_id
"chat-11559161588544a9b9770ffc48a3971b"
created_at
"2024-09-20T15:40:17.705192+00:00"
Friday, September 20th, 2024 at 3:40:17 PM GMT+00:00
model
"qwen/qwen-2.5-72b-instruct"
app_id
182717
streamed
true
cancelled
false
provider_name
"Hyperbolic"
latency
295
moderation_latency
(null)
generation_time
7390
finish_reason
"stop"
tokens_prompt
302
tokens_completion
341
native_tokens_prompt
306
native_tokens_completion
343
native_tokens_reasoning
(null)
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.0002596
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
100.0000%