google/gemini-3-pro-preview

Gemini 3 Pro (Preview)

Release Date

Nov 18th, 2025

Parameters

Context Size

1m

Creative writing

43.43%

Rule following

82.40%

Utility

91.33%

Mathematics

100.00%

Tooling

100.00%

Language

84.25%

Logic

87.50%

Dialogue tags

Various tasks related to dialogue tags in text.

Scenario Run 1 Run 2 Run 3 Run 4 Run 5 Run 6 Run 7 Run 8 Run 9 Run 10 Total
0-shot Creative writingRule following
100%100%100%100%100%100%100%100%100%100%100%
0-shot Creative writingRule following
100%100%97%95%72%68%68%64%26%19%71%
0-shot Creative writingRule following
100%100%98%95%91%83%50%48%48%38%75%
0-shot Creative writingRule following
50%49%49%47%43%5%5%3%1%0%25%
0-shot Creative writingRule following
50%45%43%27%0%0%0%0%0%0%17%
0-shot Creative writingRule following
48%41%5%0%0%0%0%0%0%0%9%
0-shot Creative writingRule following
71%1%0%0%0%0%0%0%0%0%7%
43.43%

Language Comprehension

Does the model understand more than just English?

Scenario Run 1 Run 2 Run 3 Run 4 Run 5 Total
0-shot Language
100%100%100%100%100%100%
0-shot Language
100%100%100%100%0%80%
0-shot Language
100%100%100%100%100%100%
0-shot Language
100%100%100%100%100%100%
95.00%

Language Writing

Can the model generate text in different languages?

Scenario Run 1 Run 2 Run 3 Run 4 Run 5 Total
0-shot Language
94%93%89%78%69%85%
0-shot Language
94%93%83%82%71%85%
0-shot Language
100%100%95%93%0%78%
0-shot Language
95%92%90%82%79%88%
0-shot Language
56%54%54%53%0%43%
75.64%

Tool usage within Novelcrafter

Output messages that are related to tool usage within Novelcrafter

Scenario Run 1 Run 2 Run 3 Run 4 Run 5 Run 6 Run 7 Run 8 Run 9 Run 10 Total
0-shot ToolingUtility
100%100%100%100%100%100%100%100%100%100%100%
100.00%

N-Length Sentences

Write sentences with exactly N words

Scenario Run 1 Run 2 Run 3 Run 4 Run 5 Run 6 Run 7 Run 8 Run 9 Run 10 Total
0-shot Rule following
100%100%100%100%100%100%100%100%100%100%100%
0-shot Rule following
100%100%100%100%100%100%100%100%100%100%100%
0-shot Rule following
100%100%100%100%100%100%100%100%93%80%97%
99.13%

Voice/dialogue sheets

Extract dialogue from given text as voice sheets.

Scenario Run 1 Run 2 Run 3 Run 4 Run 5 Run 6 Run 7 Run 8 Run 9 Run 10 Total
0-shot Utility
100%100%100%0%0%0%0%0%0%0%30%
1-shot Utility
100%100%100%100%100%0%0%0%0%0%50%
Few-shot Utility
100%100%100%100%100%100%0%0%0%0%60%
0-shot Utility
100%100%100%100%100%100%100%100%100%100%100%
0-shot Utility
100%100%100%100%100%100%100%100%100%100%100%
68.00%