Run: 2024-10-01-01J94RMHCXDYPRP58WE7GEBNZA

Run Details

Model:
Rocinante 12B
Test:
N-Length Sentences
Scenario:
Write sentences with 10 words each
Duration:
2.1s
Cost:
$0.000024
Provider:
Infermatic

Evaluation summary

Score Evaluator
Details Link
0.00% Matches word count (details)

Model input

User/Human
Please write the opening scene of a murder mystery where each sentence has exactly 10 words. Please make sure that each sentence has the same length. Only return the opening itself.

Model response

AI
In the charred remains, A body lay crumpled, Smoke hung heavy, Ashes fell like snow, A mystery began.
id"gen-1727810651-BsUT2HEUPXXkDMY9mJfo"
total_cost0.0000245
upstream_id"chatcmpl-e29eced3-9735-4a92-8875-cd6845633481"
created_at"2024-10-01T19:24:13.832762+00:00" 10/1/2024, 7:24:13 PM
model"thedrummer/rocinante-12b"
app_id182717
streamedtrue
cancelledfalse
provider_name"Infermatic"
latency312
moderation_latency(null)
generation_time1620
finish_reason"stop"
tokens_prompt41
tokens_completion27
native_tokens_prompt44
native_tokens_completion27
native_tokens_reasoning(null)
num_media_prompt(null)
num_media_completion(null)
origin"https://ncbench.com/"
usage0.0000245

Evaluation details

Result Evaluator Details Meta Data
0.00% Matches word count n/a
neededCleanfalse
sentences5
wordCounts
04
14
23
34
43