NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-10-13-01M4TBNB6T83VARYN0PB02BAPA
Run Details
Model:
Ember-1 (Reasoning, Max)
Test:
Dialogue tags
Scenario:
Write 500 words with 50% dialogue
Duration:
2m 12s
Cost:
$0.130052
Provider:
Fireworks
Evaluation summary
Score
Evaluator
Details Link
97.63%
Matches word count
(details)
89.86%
Dialogue to Total Word Ratio
(details)
93.7459%
Overall
Model input
User/Human
You are a author of comedic heist books. Please write a 500 word scene that has 50% words of dialogue between two thieves named Molly and Bill who are planning to break into a children's party to steal all the presents. Only include the prose of the scene without any markdown or commentary.
Model response
Messages
Meta
AI
The Blue Plate Diner had seen many things in its forty years—three health code violations, one extremely apologetic raccoon—but never a heist planned over pie. Molly spread the floor plan across the table, weighing down the corners with a meatball sub, a sugar dispenser, and Bill's left hand. "Ow," said Bill. "Fourteen Maplewood Drive," she said. "Party starts at two. Presents hit the dining room table at two-fifteen, after the magician but before the cake." "What's our cover?" "You're the magician." Bill considered this. His résumé, in order, included locksmithing, getaway driving, and one regrettable summer as a mall elf. Magic was not on it. Magic had never been on it. "I don't know magic," he said. "You know the one where you make my patience disappear. Focus. Table's eight feet from the patio door. In and out, ninety seconds." He squinted at the diagram, which Molly had drawn to scale and annotated in three colors of pen, including a small sketch of a dog labeled BISCUIT (BRIBEABLE). One rectangle in the yard concerned him. "What's that?" "Bouncy castle." "We could hide in the bouncy castle." "It's the first place they'd look, Bill. It wobbles." Security, she explained, consisted of the aforementioned Biscuit, a father named Gary who would be emotionally absent at the barbecue, and a single doorbell camera. It was the camera that produced, from Molly's bag, a rainbow wig and a red foam nose. Bill recoiled so hard the sugar dispenser rattled. His history with clowns was well documented, mostly by him, mostly at length. "You know about my thing with clowns," he said. "Your thing is that you are one. It's typecasting. I'm going as a responsible adult—nobody at a children's party has ever made eye contact with the person refilling the juice." "What's the take?" Molly consulted her notes. "One bicycle, red. One games console, shrink-wrapped. Eleven gift bags, contents unknown. One sweater, hand-knitted by the grandmother, with a hundred-dollar bill sewn into the collar." "We're robbing a grandma sweater?" "Family tradition. The kid's uncle told me at the bus stop. People tell me things, Bill. I have a trustworthy face." "You're planning to rob a six-year-old." "Five. He turns six Saturday. Read the briefing." Bill was quiet a moment, turning the foam nose over like a cursed relic. Around them the diner hummed. "Molly," he said finally, "are we the bad guys?" "We're the bad guys' subcontractors. Morally, that's a different form." "Who's the client?" "Does it matter?" "It matters if it's the kid's other grandma." Molly paused, which she never did. "It might be the other grandma." "Family disputes are above our pay grade." "Our pay grade is whatever's in the gift bags." She folded the map, reclaimed her sub, and slid the wig across the table with the gravity of a woman passing sentence. "Party's in four hours. Practice your balloon animals." "I know one balloon animal," Bill said. "A snake." "That's just a balloon." "That's just a balloon," he agreed, and put on the nose.
created_at
"2026-10-13T10:06:51.622Z"
10/13/2026, 10:06:51 AM
model
"fireworks/ember-1-20260923"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
1076
moderation_latency
(null)
generation_time
131522
tokens_prompt
75
tokens_completion
7430
native_tokens_prompt
149
native_tokens_completion
8667
native_tokens_completion_images
(null)
native_tokens_reasoning
7430
native_tokens_cached
148
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.1300524
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1791886011-zjQuKD7VrjvGitN1rZ6c"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1791886011-zJYCHDbA7rhrn9iTwXh1"
upstream_id
"chatcmpl-d1f733872e334477bca7dbf9d609469f"
provider_responses
0
endpoint_id
"b89a2f05-4051-4446-a9b0-7bc8ae7b7c90"
id
"chatcmpl-d1f733872e334477bca7dbf9d609469f"
is_byok
false
latency
1076
model_permaslug
"fireworks/ember-1-20260923"
provider_name
"Fireworks"
status
200
total_cost
0.1300524
cache_discount
0.0003996
upstream_inference_cost
0
provider_name
"Fireworks"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
97.63%
Matches word count
n/a
neededClean
false
words
507
89.86%
Dialogue to Total Word Ratio
Ratio: 51.46%, Deviation: 1.46%
neededClean
false
wordsTotal
513
wordsDialogue
264
93.7459%