NC Bench
A comprehensive benchmark for creative writing models.
Created by Novelcrafter.
This project is in early access and still work in progress.
Focused on Creativity
NC Bench is a cutting-edge benchmark for creativity in LLMs, with focus on creative writing, instruction following, utility, tooling, and language skills.
AI as an Assistant
We test how well models enhance the writing process through text manipulation, idea generation, summarization, and translation.
Comprehensive Testing
From generating quality prose to hallucination-free extraction, NC Bench puts AI models through their paces in all aspects of writing assistance.
Benchmark Overview
Tests
11Scenarios
94Models
66Results
41,615Samples per Run
9.33 runs/scen.Category Distribution
Shows the number of scenarios in each category. Some scenarios may be in multiple categories.
Creative writing (39)
Rule following (55)
Utility (30)
Mathematics (1)
Tooling (13)
Language (9)
Logic (8)
Top Results
Top Models
| 86.19% | o4 Mini High |
| 83.82% | Claude Opus 4.6 |
| 83.53% | Gemini 3 Flash (Preview) |
Creative writing
| 86.97% | Gemini 3 Flash (Preview) |
| 83.00% | Claude 3.7 Sonnet |
| 82.10% | Claude 3.5 Sonnet |
Rule following
| 92.07% | o4 Mini High |
| 90.50% | Gemini 3 Flash (Preview) |
| 87.60% | o4 Mini |
Utility
| 95.00% | Claude Sonnet 4 |
| 92.83% | Claude Opus 4.6 |
| 91.83% | Claude 3.5 Sonnet (new) |
Mathematics
| 100.00% | Claude 3.5 Sonnet |
| 100.00% | Claude 3.7 Sonnet |
| 100.00% | Hermes 3 70B |
Tooling
| 100.00% | Gemini 3 Pro (Preview) |
| 100.00% | MoonshotAI: Kimi K2.5 |
| 99.23% | Gemini 2.5 Pro |
Language
| 98.13% | Hermes 3 405B |
| 96.28% | DeepSeek-V2 Chat |
| 95.68% | Z.AI GLM 4.5 |
Logic
| 93.75% | GPT-4o Mini (temp=0) |
| 93.75% | Claude Sonnet 4 |
| 93.75% | Z.AI GLM 4.6 |