NC Bench
Overview
About
Tests
Models
Model
Llama 3.1 Nemotron 70B
Test
Tool usage within Novelcrafter
Scenario
Create alternate prose sections
Run ID
2024-10-16-01JABHZM2674JEEGKA2ND9QYFS
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
Here are three alternate prose sections that continue the story: **Version 1 (Red) - Dramatic Encounter** <nc-section data-title="A Knight's Boisterous Welcome" data-color="red"> As I dismounted Thunder near the stables, a booming voice echoed off the stone walls, making me turn sharply. Sir Roland, the local knight, emerged from the shadows, his broad face split by a wide grin. "By the kingdom's sword, you must be the young Frederick! We've been expecting you, Squire!" He clapped me on the back, nearly sending me stumbling. "Come, let us get the formalities over with, and then... we feast!" </nc-section> **Version 2 (Green) - Whimsical Introduction** <nc-section data-title="A Lighthearted Greeting" data-color="green"> As Thunder nuzzled the stable door, seeking treats, a jovial figure approached us. Sir Roland's eyes twinkled like the stars on a clear night, and his wild, curly hair seemed to have a life of its own. "Ah, Frederick, our newest squire! Welcome to the castle, where chivalry meets chaos." With a flourish, he swept off his helmet, revealing a mischievous glint in his eye. "I trust your journey was uneventful? We can't have our new recruit arriving in a state of disarray... unless, of course, that's your style." </nc-section> **Version 3 (Blue) - Stoic First Meeting** <nc-section data-title="A Measured Reception" data-color="blue"> I led Thunder into the stable courtyard, where Sir Roland awaited, his expression a mask of composed courtesy. His armor, adorned with the kingdom's emblem, gleamed in the fading light. "Greetings, Frederick. I am Sir Roland, your sponsor and mentor during your time here." His voice was firm, yet measured, as he extended a gauntleted hand. "I trust your arrival was without incident. Let us proceed to the great hall, where we will discuss the particulars of your training and the... current state of our kingdom." </nc-section>
id
"gen-1729112297-7im2WrWuQvngSpQ9shSC"
upstream_id
"cmpl-RfyppsrKAbvCrhH87ilBketT"
total_cost
0.0002878
cache_discount
(null)
created_at
"2024-10-16T20:58:30.884481+00:00"
Wednesday, October 16th, 2024 at 8:58:30 PM GMT+00:00
model
"nvidia/llama-3.1-nemotron-70b-instruct"
app_id
182717
streamed
true
cancelled
false
provider_name
"DeepInfra"
latency
73
moderation_latency
(null)
generation_time
12590
finish_reason
"stop"
tokens_prompt
384
tokens_completion
450
native_tokens_prompt
308
native_tokens_completion
450
native_tokens_reasoning
(null)
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.0002878
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
100.0000%