NC Bench
Overview
About
Tests
Models
Model
Llama 3.1 Nemotron 70B
Test
Tool usage within Novelcrafter
Scenario
Create alternate prose sections
Run ID
2024-10-16-01JABHWWK57XD2N507FV1BN030
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
Here are three alternate prose sections that continue the story: **Version 1 (red)** <nc-section data-title="A Knight's Boisterous Welcome" data-color="red"> As I dismounted Thunder near the stables, a deep, thunderous voice boomed across the courtyard, making me turn. Sir Roland, the local knight, approached me with a wide grin, his armor gleaming in the fading light. "Ah, young Frederick! By the king's beard, you're as tall as they said! Come, let's get that travel dust off you with a tankard of ale!" He clapped me on the back, nearly sending me stumbling forward. </nc-section> **Version 2 (green)** <nc-section data-title="A Knight's Measured Greeting" data-color="green"> I led Thunder into the stables, where the scent of hay and horseflesh filled the air. As I began to unsaddle my steed, a figure emerged from the shadows. Sir Roland, the veteran knight, approached me with a deliberate stride, his eyes assessing. "Frederick, welcome to our humble castle," he said, his voice low and even. "I trust your journey was uneventful? Come, let us walk among the gardens; I would hear more about your expectations for your training." </nc-section> **Version 3 (blue)** <nc-section data-title="A Knight's Unconventional Encounter" data-color="blue"> As I tended to Thunder's reins near the stables, a commotion erupted from within. A knight, Sir Roland, tumbled out, laughing, with a stable boy perched on his shoulders. The boy was playfully attempting to crown the knight with a twisted hay wreath. Sir Roland spotted me, and his grin widened. "Ah, Frederick! Perfect timing! We're celebrating... well, the fact that young Tom here can still scale my armor." The knight chuckled, and the boy slid off, giggling. "Join us; we'll find more substantial refreshments to toast your arrival." </nc-section>
id
"gen-1729112208-sQPCv76f1jxbBRk5D6V4"
upstream_id
"cmpl-RB4S6gubWbovEhScTEpmxjw7"
total_cost
0.000281
cache_discount
(null)
created_at
"2024-10-16T20:57:04.973365+00:00"
Wednesday, October 16th, 2024 at 8:57:04 PM GMT+00:00
model
"nvidia/llama-3.1-nemotron-70b-instruct"
app_id
182717
streamed
true
cancelled
false
provider_name
"DeepInfra"
latency
175
moderation_latency
(null)
generation_time
15777
finish_reason
"stop"
tokens_prompt
384
tokens_completion
433
native_tokens_prompt
308
native_tokens_completion
433
native_tokens_reasoning
(null)
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.000281
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
100.0000%