Categories
NC Bench evaluates models across 8 categories and 23 subcategories.
Category Distribution
Shows the number of scenarios in each category. Some scenarios may be in multiple categories.
Tooling (13)
Creative Writing (18)
Language (9)
Utility (32)
Reasoning (20)
Text Editing (18)
Rule Following (12)
Hallucination (28)
Creative Writing
18 scenarios · 6 subcategories
Top Models
| 91.17% | GPT-5.4 (Reasoning) |
| 90.94% | GPT-5.4 |
| 90.51% | GPT-5.4 (Reasoning, Low) |
Subcategories
| 81.52% | AI-isms |
| 67.93% | Prose Variety |
| 77.75% | Dialogue |
| 88.35% | Purple Prose |
| 86.16% | Mechanical Style |
| 78.22% | Clichés |
Tooling
13 scenarios · 1 subcategory
Top Models
| 100.00% | Qwen3.7 Max |
| 100.00% | Claude Opus 4.6 (Reasoning) |
| 100.00% | Qwen3.6 Max Preview |
Subcategories
| 96.04% | XML |
Language
9 scenarios · 2 subcategories
Top Models
| 100.00% | Qwen3.6 Max Preview |
| 100.00% | Claude Sonnet 4.6 |
| 100.00% | DeepSeek-V2 Chat |
Subcategories
| 83.58% | Comprehension |
| 87.20% | Generation |
Utility
32 scenarios · 5 subcategories
Top Models
| 99.91% | Gemini 3.1 Pro (Preview) |
| 99.54% | Qwen3.7 Max |
| 99.26% | Claude Opus 4.8 (Reasoning) |
Subcategories
| 65.78% | Word Counting |
| 89.58% | Sentence Counting |
| 96.04% | Paragraph Counting |
| 74.58% | Structural Counting |
| 98.06% | Data Extraction |
Reasoning
20 scenarios · 2 subcategories
Top Models
| 98.45% | Gemini 3.5 Flash (Reasoning) |
| 98.05% | Gemini 3 Flash (Preview, Reasoning) |
| 97.19% | Gemma 4 31B (Reasoning) |
Text Editing
18 scenarios · 3 subcategories
Top Models
| 99.13% | Claude Sonnet 4 |
| 99.02% | Claude Sonnet 4.5 |
| 98.90% | Z.AI GLM 5.1 |
Subcategories
| 83.94% | Transformation |
| 93.68% | Preservation |
| 98.32% | Structural Integrity |
Rule Following
12 scenarios · 1 subcategory
Top Models
| 95.76% | Qwen3.7 Max |
| 92.04% | Gemini 3.5 Flash (Reasoning) |
| 91.21% | Gemini 3.1 Pro (Preview) |
Subcategories
| 61.63% | Constraint Adherence |
Hallucination
28 scenarios · 3 subcategories
Top Models
| 99.93% | Stealth: Aurora Alpha |
| 99.69% | Nemotron 3 Super |
| 99.06% | o4 Mini High |
Subcategories
| 57.58% | False Positives |
| 96.74% | Content Invention |
| 99.13% | Output Corruption |