Tests

This page shows the performance of each test and its scenarios.

Data extraction

Extract key details from a given block of text.

Scenarios

12

Dialogue tags

Various tasks related to dialogue tags in text.

Scenarios

7

Language Comprehension

Does the model understand more than just English?

Scenarios

4

Language Writing

Can the model generate text in different languages?

Scenarios

5

Novel outline

Handle questions about the outline of a novel in various formats

Scenarios

12

Tool usage within Novelcrafter

Output messages that are related to tool usage within Novelcrafter

Scenarios

1

N-Length Sentences

Write sentences with exactly N words

Scenarios

3

Voice/dialogue sheets

Extract dialogue from given text as voice sheets.

Scenarios

5

Write N of X

Write exactly N words/sentences/paragraphs...

Scenarios

13