NC Bench
Overview
About
Tests
Models
Model
Llama 3.2 3B
Test
Tool usage within Novelcrafter
Scenario
Create alternate prose sections
Run ID
2024-09-26-01J8PYYBD5KZZGEQ9QHBQT0PZZ
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
Here are the alternate prose sections: ** Version 1 (red)** Sir Roland's voice boomed as he approached, his armor gleaming in the fading light. "Ah, young Frederick, I see you've arrived. Welcome to the castle. I trust you're ready to begin your training?" He eyed the saddle still tied to Thunder's hide, his brow furrowing slightly. "And you've brought a mount, I see. Not many squires can afford that luxury." ** Version 2 (green)** Sir Roland's smile creased his face as he dismounted from his own horse, a gentle giant with a coat of dark brown. "Ah, Frederick, great to finally meet you. We don't get many new faces around here, especially not squire trainees." He extended a meaty hand, his eyes crinkling at the corners. "I trust your journey was uneventful? Any... difficulties on the road?" ** Version 3 (blue)** Sir Roland's weathered face broke into a warm smile as he approached, his eyes crinkling at the corners. The sound of birdsong filled the air as evening settled over the castle grounds. "Ah, Frederick! Welcome home, lad. I trust you're excited to start your journey here." He paused, his gaze taking in the familiar surroundings. "I see you've settled in quickly with your mount, Thunder. A fine horse, indeed."
id
"gen-420zOaQU166bs0o4Xu04jbHYLYtq"
total_cost
0.000032562
upstream_id
"8c92a98323202544-SJC"
created_at
"2024-09-26T10:45:33.335932+00:00"
Thursday, September 26th, 2024 at 10:45:33 AM GMT+00:00
model
"meta-llama/llama-3.2-3b-instruct"
app_id
182717
streamed
true
cancelled
false
provider_name
"Together"
latency
28800
moderation_latency
(null)
generation_time
1782
finish_reason
"eos"
tokens_prompt
384
tokens_completion
294
native_tokens_prompt
308
native_tokens_completion
295
native_tokens_reasoning
(null)
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.000032562
Evaluation details
Result
Evaluator
Details
Meta Data
Fail
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Fail
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Fail
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
0.0000%