Run: 2024-10-01-01J94RA2N1JGADC1Q1X3A0QWAS

Run Details

Model:
Rocinante 12B
Test:
N-Length Sentences
Scenario:
Write sentences with 10 words each
Duration:
4.7s
Cost:
$0.000044
Provider:
Infermatic

Evaluation summary

Score Evaluator
Details Link
26.36% Matches word count (details)

Model input

User/Human
Please write the opening scene of a murder mystery where each sentence has exactly 10 words. Please make sure that each sentence has the same length. Only return the opening itself.

Model response

AI
In the misty dawn, Inspector Flint trudged up the driveway. The grand manor loomed ahead, ominous and silent. He paused, inhaling the chilly air. A vandalized statue caught his eye. Approaching it, he noticed a cryptic message carved: "Solve my death, and I shall rest."
id"gen-1727810308-qg1Y5KvV2rHy3vRA5X30"
total_cost0.0000445
upstream_id"chatcmpl-3b6357b3-24e7-4d04-919d-1a9ce0662e2e"
created_at"2024-10-01T19:18:33.645782+00:00" 10/1/2024, 7:18:33 PM
model"thedrummer/rocinante-12b"
app_id182717
streamedtrue
cancelledfalse
provider_name"Infermatic"
latency139
moderation_latency(null)
generation_time4308
finish_reason"stop"
tokens_prompt41
tokens_completion67
native_tokens_prompt44
native_tokens_completion67
native_tokens_reasoning(null)
num_media_prompt(null)
num_media_completion(null)
origin"https://ncbench.com/"
usage0.0000445

Evaluation details

Result Evaluator Details Meta Data
26.36% Matches word count n/a
neededCleanfalse
sentences5
wordCounts
010
18
26
36
415