Content Invention

Subcategory of Hallucination. 146 models scored.

Model Leaderboard

All models ranked by their Content Invention subcategory score.

# Model Content Invention Hallucination Overall
1 GPT-5.6 Sol (Reasoning) 100.00% 91.72% 95.15%
2 Claude Opus 4.6 (Reasoning) 100.00% 99.06% 95.06%
3 Qwen3.7 Max 100.00% 97.15% 94.55%
4 Grok 4.5 (Reasoning, High) 100.00% 99.06% 94.12%
5 Gemini 3.1 Pro (Preview) 100.00% 94.53% 94.08%
6 GPT-5.4 (Reasoning) 100.00% 95.22% 93.85%
7 Z.AI GLM 5.1 100.00% 98.84% 93.74%
8 Qwen3.6 Max Preview 100.00% 95.86% 93.72%
9 GPT-5.5 (Reasoning) 100.00% 92.12% 93.72%
10 Claude Sonnet 4.6 (Reasoning) 100.00% 96.98% 93.64%
11 Z.AI GLM 5.2 (Reasoning, High) 100.00% 98.99% 93.41%
12 Gemini 3.5 Flash (Reasoning) 100.00% 95.61% 93.35%
13 Z.AI GLM 5 Turbo 100.00% 99.32% 93.29%
14 MoonshotAI: Kimi K2.6 100.00% 94.43% 92.57%
15 Claude Opus 4.7 (Reasoning) 100.00% 98.69% 92.53%
16 GPT-5.5 (Reasoning, Low) 100.00% 91.37% 92.51%
17 GPT-5.6 Terra (Reasoning) 100.00% 94.98% 92.49%
18 Claude Opus 4.8 (Reasoning) 100.00% 97.41% 92.33%
19 Claude Opus 4.6 100.00% 96.80% 92.31%
20 Claude Opus 4.8 (Reasoning, Low) 100.00% 97.33% 91.89%
21 GPT-5 100.00% 95.92% 91.48%
22 GPT-5 Mini 100.00% 98.28% 91.31%
23 Qwen 3.5 397B A17B 100.00% 90.04% 91.09%
24 Grok 4.3 (Reasoning) 100.00% 97.86% 90.99%
25 Grok 4.5 (Reasoning, Low) 100.00% 99.01% 90.94%
26 GPT-5.4 (Reasoning, Low) 100.00% 95.71% 90.91%
27 Grok 4.20 (Reasoning) 100.00% 96.30% 90.87%
28 MoonshotAI: Kimi K2.5 100.00% 94.01% 90.86%
29 GPT-5.6 Sol 100.00% 95.87% 90.76%
30 GPT-5.1 100.00% 96.22% 90.73%
31 Claude Sonnet 4.6 100.00% 94.99% 90.66%
32 GPT-5.6 Luna (Reasoning) 100.00% 98.65% 90.61%
33 MiniMax M3 100.00% 97.83% 90.45%
34 Claude Sonnet 5 (Reasoning) 100.00% 96.77% 90.40%
35 Qwen 3.5 122B 100.00% 93.29% 90.32%
36 Claude Sonnet 5 (Reasoning, Low) 100.00% 96.44% 90.16%
37 Qwen 3.5 27B 100.00% 93.29% 90.05%
38 Gemini 3 Flash (Preview, Reasoning) 100.00% 92.65% 89.93%
39 Claude Opus 4.7 100.00% 92.95% 89.90%
40 GPT-5.4 Mini (Reasoning) 100.00% 98.11% 89.82%
41 Qwen 3.5 Plus (2026-04-20) 100.00% 98.38% 89.79%
42 Gemma 4 31B (Reasoning) 100.00% 96.37% 89.64%
43 Claude Opus 4.5 100.00% 91.03% 89.60%
44 Z.AI GLM 5 100.00% 98.04% 89.60%
45 ByteDance Seed 1.6 100.00% 97.57% 89.59%
46 GPT-5.2 100.00% 97.55% 89.45%
47 GPT-5.5 100.00% 90.28% 89.37%
48 Qwen 3.6 Flash 100.00% 96.13% 89.31%
49 DeepSeek V4 Pro (Reasoning) 100.00% 95.25% 89.28%
50 Gemma 4 26B (Reasoning) 100.00% 98.79% 89.02%
51 Aion 3.0 100.00% 95.57% 88.78%
52 o4 Mini High 100.00% 99.53% 88.78%
53 Gemini 2.5 Pro 100.00% 93.05% 88.44%
54 Qwen 3.6 27B 100.00% 97.42% 88.33%
55 GPT-5.6 Terra 100.00% 90.63% 88.23%
56 Z.AI GLM 4.7 100.00% 94.23% 87.67%
57 Qwen 3.6 35B 100.00% 94.07% 87.66%
58 Z.AI GLM 4.6 100.00% 94.42% 87.64%
59 Claude Sonnet 4 100.00% 90.04% 87.64%
60 Claude Sonnet 4.5 100.00% 87.78% 87.54%
61 Claude Sonnet 5 100.00% 88.74% 87.34%
62 Claude Opus 4 100.00% 87.84% 87.22%
63 GPT-4.1 100.00% 95.60% 86.82%
64 MiniMax M2.5 100.00% 94.72% 86.71%
65 o4 Mini 100.00% 98.54% 86.56%
66 MiniMax M2.7 100.00% 94.69% 86.23%
67 Qwen 3.5 Plus (2026-02-15) 100.00% 86.62% 86.17%
68 Xiaomi MIMO v2.5 Pro 100.00% 97.02% 86.05%
69 Gemini 3.1 Flash Lite (Reasoning) 100.00% 87.63% 85.91%
70 Gemini 3.5 Flash (Reasoning, Minimal) 100.00% 89.55% 85.88%
71 ByteDance Seed 2.0 Mini 100.00% 94.07% 85.69%
72 Gemini 3 Flash (Preview) 100.00% 85.61% 85.47%
73 Gemini 3.1 Flash Lite (Preview) 100.00% 87.29% 85.41%
74 Gemma 4 31B 100.00% 95.09% 85.23%
75 Gemini 3.1 Flash Lite 100.00% 87.86% 85.09%
76 GPT-5.6 Luna 100.00% 93.37% 85.06%
77 Z.AI GLM 4.5 100.00% 91.83% 84.95%
78 Gemma 4 26B 100.00% 94.22% 84.89%
79 GPT-OSS 120B 100.00% 97.63% 84.81%
80 GPT-5.4 100.00% 86.32% 84.31%
81 Mistral Large 3 100.00% 85.18% 84.29%
82 ByteDance Seed 2.0 Lite 100.00% 89.50% 84.27%
83 Gemini 2.5 Flash (Reasoning) 100.00% 97.79% 84.14%
84 Xiaomi MIMO v2.5 100.00% 97.61% 83.95%
85 GPT-5.4 Mini (Reasoning, Low) 100.00% 98.78% 83.57%
86 Claude Haiku 4.5 100.00% 91.93% 83.36%
87 DeepSeek V3 (2024-12-26) 100.00% 85.69% 82.62%
88 DeepSeek V3.1 100.00% 85.55% 82.35%
89 DeepSeek V3.2 100.00% 86.25% 82.22%
90 GPT-4o, Aug. 6th (temp=0) 100.00% 83.33% 82.18%
91 DeepSeek V4 Pro 100.00% 89.36% 82.05%
92 DeepSeek V4 Flash 100.00% 87.73% 82.02%
93 Nemotron 3 Super 100.00% 97.34% 81.69%
94 Mistral Large 2 100.00% 85.45% 81.50%
95 GPT-4.1 Mini 100.00% 86.23% 81.40%
96 GPT-4o, Aug. 6th (temp=1) 100.00% 86.00% 81.28%
97 Grok 4.20 100.00% 80.48% 81.21%
98 Hermes 3 405B 100.00% 87.02% 80.80%
99 Z.AI GLM 4.5 Air 100.00% 94.00% 80.74%
100 Gemini 2.5 Flash 100.00% 85.27% 80.61%
101 GPT-5.4 Mini 100.00% 81.85% 80.45%
102 GPT-5.4 Nano (Reasoning) 100.00% 96.98% 80.02%
103 Gemini 2.5 Flash Lite 100.00% 88.08% 79.91%
104 Qwen 3 32B 100.00% 89.06% 79.37%
105 Grok 4.3 100.00% 87.79% 78.00%
106 GPT-4o Mini (temp=1) 100.00% 85.28% 77.82%
107 GPT-5.4 Nano (Reasoning, Low) 100.00% 95.71% 77.46%
108 Mistral Small 3.2 24B 100.00% 86.84% 77.36%
109 GPT-4o Mini (temp=0) 100.00% 82.23% 76.86%
110 Mistral Medium 3.1 100.00% 88.93% 76.08%
111 Gemma 3 12B 100.00% 77.13% 76.07%
112 Gemma 3 27B 100.00% 80.53% 75.70%
113 Mistral Small 4 100.00% 81.83% 75.23%
114 Qwen 2.5 72B 100.00% 85.54% 73.17%
115 GPT-5.4 Nano 100.00% 86.86% 72.16%
116 Ministral 3 14B 100.00% 83.19% 70.45%
117 Ministral 3 8B 100.00% 94.02% 69.98%
118 GPT-4.1 Nano 100.00% 90.07% 69.90%
119 Arcee AI: Trinity Mini 100.00% 88.35% 67.68%
120 Gemma 3 4B 100.00% 75.94% 66.33%
121 Ministral 8B 100.00% 91.89% 63.77%
122 DeepSeek V4 Flash (Reasoning) 96.43% 96.92% 88.06%
123 Qwen 3.5 9B 96.43% 91.81% 84.05%
124 Mistral Small 4 (Reasoning) 96.43% 93.18% 79.48%
125 Aion 3.0 Mini 95.24% 94.08% 83.69%
126 Gemini 2.5 Flash Lite (Reasoning) 95.24% 96.99% 83.10%
127 Qwen 3.5 Flash 92.90% 88.70% 85.66%
128 Aion 2.0 92.89% 93.10% 86.66%
129 Qwen 3.5 35B 92.86% 89.24% 87.01%
130 Z.AI GLM 4.7 Flash 92.86% 90.00% 82.21%
131 Writer: Palmyra X5 92.86% 80.49% 78.11%
132 Llama 3.1 70B 92.86% 80.47% 77.41%
133 Cydonia 24B V4.1 91.07% 85.22% 72.68%
134 DeepSeek-V2 Chat 90.48% 82.48% 84.09%
135 ByteDance Seed 1.6 Flash 89.88% 90.83% 70.92%
136 Ministral 3 3B 89.29% 75.10% 65.02%
137 GPT-5 Nano 88.10% 92.99% 80.16%
138 DeepSeek V3 (2025-03-24) 88.10% 76.88% 79.93%
139 WizardLM 2 8x22b 85.73% 79.28% 71.45%
140 Qwen3 235B A22B Instruct 2507 85.71% 76.34% 78.07%
141 Ministral 3B 85.71% 73.79% 59.25%
142 Nemotron 3 Nano 82.14% 88.55% 74.50%
143 Inception Mercury 2 81.55% 93.22% 81.99%
144 Mistral NeMO 76.19% 69.32% 63.80%
145 Hermes 3 70B 60.79% 70.71% 69.74%
146 Cohere Command R+ (Aug. 2024) 37.90% 66.30% 67.04%