Run: 2026-02-20-01KHY8WD3HZKHXQXSZE0SJCPH9

Run Details

Model:
Gemma 3 12B
Test:
N-Length Sentences
Scenario:
Write sentences with 10 words each
Duration:
4.5s
Cost:
$0.000020
Provider:
DeepInfra

Evaluation summary

Score Evaluator
Details Link
87.04% Matches word count (details)

Model input

User/Human
Please write the opening scene of a murder mystery where each sentence has exactly 10 words. Please make sure that each sentence has the same length. Only return the opening itself.

Model response

AI
Rain lashed against the windows, blurring the grand manor's lights. Lord Ashworth lay lifeless upon the Persian rug below. A single crimson stain bloomed, spreading slowly across his chest. The opulent study felt frigid, despite the crackling fireplace glow. Inspector Davies surveyed the scene, his face etched with grim concern. Lady Ashworth sobbed quietly, clutching a delicate porcelain teacup. Mr. Finch, the butler, stood stiffly, observing with a blank stare. Young Miss Eleanor whispered prayers, trembling visibly near the doorway. A chilling silence descended, broken only by the storm’s fierce roar. Something felt terribly wrong within this wealthy, esteemed household now.
created_at"2026-02-20T19:37:00.284Z" 2/20/2026, 7:37:00 PM
model"google/gemma-3-12b-it"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency122
moderation_latency(null)
generation_time4421
tokens_prompt63
tokens_completion173
native_tokens_prompt46
native_tokens_completion136
native_tokens_completion_images(null)
native_tokens_reasoning0
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0.00001952
router(null)
provider_responses
0
endpoint_id"5aef2a85-3d1c-4659-a522-98bbb5272c6a"
is_byokfalse
latency50
model_permaslug"google/gemma-3-12b-it"
provider_name"Crusoe"
status429
1
endpoint_id"eb06dc92-5a16-47ec-a776-6ef956457c47"
id"chatcmpl-RLfMLcEjX7SWqgcjqh8hZwcn"
is_byokfalse
latency55
model_permaslug"google/gemma-3-12b-it"
provider_name"DeepInfra"
status200
api_type"completions"
id"gen-1771616220-aDiwrjPDx6efvDZY7PHy"
upstream_id"chatcmpl-RLfMLcEjX7SWqgcjqh8hZwcn"
total_cost0.00001952
cache_discount(null)
upstream_inference_cost0
provider_name"DeepInfra"

Evaluation details

Result Evaluator Details Meta Data
87.04% Matches word count n/a
neededCleanfalse
sentences10
wordCounts
010
19
210
310
411
59
611
710
811
910