Run: 2026-10-13-01M4TBG6Y54KD3S0RYTR3YTAD2

Run Details

Model:
Ember-1 (Reasoning, Max)
Test:
N-Length Sentences
Scenario:
Write sentences with 5 words each
Duration:
16.4s
Cost:
$0.014575
Provider:
Fireworks

Evaluation summary

Score Evaluator
Details Link
100.00% Matches word count (details)

Model input

User/Human
Please write the opening scene of a murder mystery where each sentence has exactly 5 words. Please make sure that each sentence has the same length. Only return the opening itself.

Model response

AI
The rain fell without mercy. Detective Moore arrived at midnight. The mansion loomed before him. Yellow tape marked the door. Inside, someone lay very still. Lord Ashworth would not wake. Blood pooled beneath his chair. The window stood wide open. No footprints marked the carpet. Every door remained locked tight. Six guests waited in silence. One of them was lying. Moore lit his last cigarette. The game had just begun.
created_at"2026-10-13T10:04:03.409Z" 10/13/2026, 10:04:03 AM
model"fireworks/ember-1-20260923"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency580
moderation_latency(null)
generation_time16327
tokens_prompt46
tokens_completion776
native_tokens_prompt123
native_tokens_completion969
native_tokens_completion_images(null)
native_tokens_reasoning776
native_tokens_cached122
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
num_fetches(null)
web_search_engine(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
service_tier(null)
usage0.0145746
router(null)
user_agent"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer(null)
request_id"req-1791885843-mNN6qUeRg6ykIXKf1rez"
session_id(null)
preset_id(null)
api_type"completions"
id"gen-1791885843-mXs1h4yE2dos26OjtBm8"
upstream_id"chatcmpl-d8ce01b4de404f50acf42fbe432cbfde"
provider_responses
0
endpoint_id"b89a2f05-4051-4446-a9b0-7bc8ae7b7c90"
id"chatcmpl-d8ce01b4de404f50acf42fbe432cbfde"
is_byokfalse
latency580
model_permaslug"fireworks/ember-1-20260923"
provider_name"Fireworks"
status200
total_cost0.0145746
cache_discount0.0003294
upstream_inference_cost0
provider_name"Fireworks"
response_cache_source_id(null)
data_region"global"
workspace_id"97e315e5-d303-487d-83c1-83180e8a13d4"

Evaluation details

Result Evaluator Details Meta Data
100.00% Matches word count n/a
neededCleanfalse
sentences14
wordCounts
05
15
25
35
45
55
65
75
85
95
105
115
125
135