NC Bench

A comprehensive benchmark for creative writing models.

Created by Novelcrafter.

Learn more here

This project is in early access and still work in progress.

Focused on Creativity

NC Bench benchmarks creativity-focused tasks in LLMs, like creative writing, instruction following, utility, tooling, and language skills.

AI as an Assistant

We test how well models enhance the writing process through text manipulation, idea generation, summarization, and translation.

Comprehensive Testing

From generating quality prose to hallucination-free extraction, NC Bench evaluates capabilities using objective tests, not AI judges.

Benchmark Overview

Tests

14

Scenarios

112

Models

147

Results

140,411

Samples per Run

8.21 runs/scen.

Category Distribution

Shows the number of scenarios in each category. Some scenarios may be in multiple categories.

Top Results