Codex Extraction
Evaluates a model's ability to extract structured codex entries (characters, locations, objects, lore) from prose passages and return them as well-formed XML.
Medium: Through the Thornveil (Scattered)
ToolingReasoning
Performance Score Distribution (Top 20)
Click a model name to view its detail page.
Price-Performance Score Distribution (Top 20)
Click a model name to view its detail page.
| Score | Cost | Time | ||
|---|---|---|---|---|
| Gemini 3 Flash (Preview) | 98% | $0.0027 | 3.7s | |
| Grok 4 Fast | 97% | $0.0013 | 10.2s | |
| Mistral Medium 3.1 | 96% | $0.0025 | 5.1s | |
| Mistral Small 3.2 24B | 94% | $0.0005 | 4.4s | |
| Gemini 2.5 Flash | 95% | $0.0021 | 2.4s | |
| Qwen 3.5 Plus (2026-02-15) | 97% | $0.0029 | 11.0s | |
| Arcee AI: Trinity Large (Preview) | 94% | $0.0000 | 18.6s | |
| Ministral 3 8B | 92% | $0.0006 | 3.1s | |
| Claude Haiku 4.5 | 97% | $0.0071 | 4.3s | |
| DeepSeek V3 (2024-12-26) | 94% | $0.0017 | 13.5s | |
| Z.AI GLM 4.5 | 95% | $0.0018 | 13.7s | |
| Mistral Small Creative | 92% | $0.0005 | 3.6s | |
| Gemini 2.5 Flash Lite | 89% | $0.0005 | 1.8s | |
| GPT-4.1 Mini | 92% | $0.0013 | 5.6s | |
| Ministral 8B | 90% | $0.0004 | 3.5s | |
| DeepSeek-V2 Chat | 94% | $0.0019 | 14.0s | |
| Grok 4.1 Fast | 98% | $0.0019 | 29.4s | |
| Ministral 3B | 88% | $0.0002 | 1.7s | |
| Gemma 3 27B | 93% | $0.0005 | 17.7s | |
| DeepSeek V3.1 | 95% | $0.0012 | 22.2s | |
Most Stable Models (Top 20)
Ranked by stability (median × consistency). Click a model name to view its detail page.
| Score | Consistency | Stability | ||
|---|---|---|---|---|
| Claude Opus 4.6 (Reasoning) | 99% | 100% | 98% | |
| Grok 4 | 99% | 99% | 98% | |
| Grok 4.1 Fast | 98% | 99% | 97% | |
| Claude Opus 4.5 | 98% | 99% | 97% | |
| Z.AI GLM 5 | 98% | 99% | 97% | |
| Claude Sonnet 4.6 (Reasoning) | 98% | 99% | 97% | |
| Gemini 3 Pro (Preview) | 98% | 99% | 97% | |
| Claude Haiku 4.5 | 97% | 99% | 97% | |
| Gemini 3.1 Pro (Preview) | 98% | 98% | 96% | |
| GPT-5 | 98% | 98% | 96% | |
| Claude Sonnet 4.6 | 97% | 98% | 96% | |
| Claude 3.5 Sonnet | 97% | 99% | 96% | |
| Claude Opus 4 | 97% | 99% | 96% | |
| Qwen 3.5 Plus (2026-02-15) | 97% | 99% | 96% | |
| o4 Mini High | 97% | 99% | 96% | |
| Mistral Medium 3.1 | 96% | 99% | 96% | |
| Claude Sonnet 4.5 | 97% | 99% | 95% | |
| Claude Sonnet 4 | 97% | 99% | 95% | |
| Gemini 3 Flash (Preview, Reasoning) | 97% | 97% | 95% | |
| Gemini 3 Flash (Preview) | 98% | 97% | 95% | |
Top Overall Models (Top 20)
Ranked by composite score (performance, cost, speed & stability). Click a model name to view its detail page.
| Score | Cost | Speed | Stability | ||
|---|---|---|---|---|---|
| Gemini 3 Flash (Preview) | 98% | $0.0027 | 3.7s | 95% | |
| Claude Haiku 4.5 | 97% | $0.0071 | 4.3s | 97% | |
| Mistral Medium 3.1 | 96% | $0.0025 | 5.1s | 96% | |
| Qwen 3.5 Plus (2026-02-15) | 97% | $0.0029 | 11.0s | 96% | |
| Grok 4 Fast | 97% | $0.0013 | 10.2s | 94% | |
| Mistral Small 3.2 24B | 94% | $0.0005 | 4.4s | 93% | |
| Gemini 2.5 Flash | 95% | $0.0021 | 2.4s | 89% | |
| Z.AI GLM 4.5 | 95% | $0.0018 | 13.7s | 93% | |
| Ministral 3 8B | 92% | $0.0006 | 3.1s | 89% | |
| Grok 4.1 Fast | 98% | $0.0019 | 29.4s | 97% | |
| GPT-4.1 Mini | 92% | $0.0013 | 5.6s | 91% | |
| Gemini 3 Flash (Preview, Reasoning) | 97% | $0.0100 | 16.7s | 95% | |
| GPT-4o, Aug. 6th (temp=0) | 93% | $0.0098 | 3.0s | 92% | |
| Claude Sonnet 4.6 | 97% | $0.021 | 6.7s | 96% | |
| Claude Sonnet 4.5 | 97% | $0.021 | 6.1s | 95% | |
| Arcee AI: Trinity Large (Preview) | 94% | $0.0000 | 18.6s | 92% | |
| DeepSeek-V2 Chat | 94% | $0.0019 | 14.0s | 90% | |
| Ministral 8B | 90% | $0.0004 | 3.5s | 88% | |
| GPT-4o, Aug. 6th (temp=1) | 93% | $0.0089 | 3.5s | 90% | |
| DeepSeek V3 (2024-12-26) | 94% | $0.0017 | 13.5s | 89% | |
| Median | Evaluator | Top 3 | Flop 3 |
|---|---|---|---|
| 82.2% | Accuracy | ||
| 98.6% | Precision | ||
| 96.3% | Recall | ||
| 100.0% | Structural validity |