Run: 2025-02-24-01JMX07MBGVQ6Y6FTYW82HDR7C

Run Details

Model:
Claude 3.7 Sonnet
Test:
Dialogue tags
Scenario:
Write 200 words with 10% dialogue
Duration:
5.2s
Cost:
$0.000000
Provider:
Anthropic

Evaluation summary

Score Evaluator
Details Link
0.00% Matches word count (details)
82.08% Dialogue to Total Word Ratio (details)
41.0377% Overall

Model input

User/Human
You are a author of comedic heist books. Please write a 200 word scene that has 10% words of dialogue between two thieves named Molly and Bill who are planning to break into a children's party to steal all the presents. Only include the prose of the scene without any markdown or commentary.

Model response

AI
The warm evening air crackled with tension as Molly and Bill huddled behind the shrubbery across from the Thompson residence, where colorful balloons danced above the mailbox. "This is ridiculous," Bill whispered, adjusting his ski mask despite the summer heat. "We used to rob banks." Molly's binoculars reveale
id"gen-1740435085-qDzRCxoFnIL6m49q64uY"
upstream_id"msg_01JpQKfn9LFJQV4vhzmXgchA"
total_cost0
cache_discount(null)
provider_name"Anthropic"
created_at"2025-02-24T22:11:29.569388+00:00" 2/24/2025, 10:11:29 PM
model"anthropic/claude-3-7-sonnet-20250219:beta"
app_id182717
streamedtrue
cancelledfalse
latency1295
moderation_latency(null)
generation_time1724
tokens_prompt68
tokens_completion63
native_tokens_prompt75
native_tokens_completion2
native_tokens_reasoning0
num_media_prompt(null)
num_media_completion(null)
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason(null)
native_finish_reason(null)
usage0

Evaluation details

Result Evaluator Details Meta Data
0.00% Matches word count n/a
neededCleanfalse
words48
82.08% Dialogue to Total Word Ratio
Ratio: 16.67%, Deviation: 6.67%
neededCleanfalse
wordsTotal48
wordsDialogue8
41.0377%