anthropic/claude-opus-4.5

Claude Opus 4.5

Release Date

Nov 24th, 2025

Parameters

Context Size

200k

Creative writing

68.57%

Rule following

84.22%

Utility

84.50%

Mathematics

100.00%

Tooling

87.31%

Language

93.75%

Logic

81.25%

Dialogue tags

Various tasks related to dialogue tags in text.

Scenario Run 1 Run 2 Run 3 Run 4 Run 5 Run 6 Run 7 Run 8 Run 9 Run 10 Total
0-shot Creative writingRule following
100%100%100%100%100%100%100%100%100%100%100%
0-shot Creative writingRule following
100%100%100%100%100%100%97%97%89%82%96%
0-shot Creative writingRule following
100%96%94%79%69%50%50%49%49%47%68%
0-shot Creative writingRule following
99%98%96%96%95%91%87%67%52%49%83%
0-shot Creative writingRule following
96%65%65%60%58%52%50%50%50%47%59%
0-shot Creative writingRule following
68%67%66%66%54%50%49%22%10%0%45%
0-shot Creative writingRule following
50%50%48%45%41%14%10%10%5%3%28%
68.57%

Language Comprehension

Does the model understand more than just English?

Scenario Run 1 Run 2 Run 3 Run 4 Run 5 Total
0-shot Language
100%100%100%100%100%100%
0-shot Language
100%100%100%100%100%100%
0-shot Language
100%100%100%100%100%100%
0-shot Language
100%100%100%100%100%100%
100.00%

Language Writing

Can the model generate text in different languages?

Scenario Run 1 Run 2 Run 3 Run 4 Run 5 Total
0-shot Language
93%93%88%87%87%90%
0-shot Language
89%89%83%78%71%82%
0-shot Language
92%88%84%81%79%85%
0-shot Language
100%93%87%86%80%89%
0-shot Language
100%100%100%96%95%98%
88.76%

Tool usage within Novelcrafter

Output messages that are related to tool usage within Novelcrafter

Scenario Run 1 Run 2 Run 3 Run 4 Run 5 Run 6 Run 7 Run 8 Run 9 Run 10 Total
0-shot ToolingUtility
100%100%100%100%100%100%100%100%100%100%100%
100.00%

N-Length Sentences

Write sentences with exactly N words

Scenario Run 1 Run 2 Run 3 Run 4 Run 5 Run 6 Run 7 Run 8 Run 9 Run 10 Total
0-shot Rule following
100%100%100%100%100%100%100%100%100%89%99%
0-shot Rule following
100%100%100%100%100%100%100%100%100%97%100%
0-shot Rule following
96%92%88%88%84%80%80%75%74%60%82%
93.49%

Voice/dialogue sheets

Extract dialogue from given text as voice sheets.

Scenario Run 1 Run 2 Run 3 Run 4 Run 5 Run 6 Run 7 Run 8 Run 9 Run 10 Total
0-shot Utility
0%0%0%0%0%0%0%0%0%0%0%
1-shot Utility
100%100%100%100%100%100%100%100%100%100%100%
Few-shot Utility
100%100%100%100%100%100%100%100%100%100%100%
0-shot Utility
100%100%100%100%100%0%0%0%0%0%50%
0-shot Utility
100%100%100%100%100%100%100%100%100%100%100%
70.00%