False Positives
Subcategory of Hallucination. 89 models scored.
Model Leaderboard
All models ranked by their False Positives subcategory score.
| # | Model | False Positives | Hallucination | Overall |
|---|---|---|---|---|
| 1 | o4 Mini High | 97.19% | 99.06% | 90.29% |
| 2 | Grok 4.1 Fast | 97.08% | 99.02% | 89.55% |
| 3 | o4 Mini | 96.25% | 98.75% | 88.35% |
| 4 | GPT-5.1 | 95.31% | 98.44% | 92.54% |
| 5 | Claude Opus 4.6 (Reasoning) | 94.38% | 98.13% | 95.02% |
| 6 | ByteDance Seed 1.6 Flash | 94.11% | 94.52% | 73.27% |
| 7 | Z.AI GLM 5 | 93.23% | 97.74% | 91.23% |
| 8 | GPT-5 Mini | 93.12% | 97.71% | 92.62% |
| 9 | GPT-5 Nano | 92.50% | 93.53% | 82.60% |
| 10 | Gemini 2.5 Flash Lite (Reasoning) | 91.56% | 95.59% | 85.75% |
| 11 | Aion 2.0 | 87.81% | 93.57% | 89.21% |
| 12 | Gemini 2.5 Flash (Reasoning) | 86.87% | 95.60% | 86.51% |
| 13 | GPT-4.1 | 85.76% | 95.24% | 88.68% |
| 14 | ByteDance Seed 1.6 | 85.42% | 95.14% | 90.70% |
| 15 | GPT-5.2 | 85.28% | 95.09% | 90.26% |
| 16 | Claude Sonnet 4.6 (Reasoning) | 81.88% | 93.96% | 93.66% |
| 17 | Claude Opus 4.6 | 80.81% | 93.60% | 92.35% |
| 18 | Minimax M2.5 | 79.32% | 92.94% | 88.71% |
| 19 | Ministral 3 8B | 77.55% | 92.52% | 71.76% |
| 20 | Z.AI GLM 4.7 Flash | 76.72% | 89.86% | 84.82% |
| 21 | GPT-5 | 75.52% | 91.84% | 91.93% |
| 22 | Arcee AI: Trinity Mini | 73.37% | 91.12% | 70.90% |
| 23 | Grok 4 Fast | 73.28% | 91.09% | 86.15% |
| 24 | LFM2 24B | 71.58% | 90.53% | 58.77% |
| 25 | Z.AI GLM 4.6 | 71.35% | 90.08% | 89.11% |
| 26 | Claude Sonnet 4.6 | 69.98% | 89.99% | 91.15% |
| 27 | Grok 4 | 68.35% | 89.45% | 88.12% |
| 28 | Ministral 8B | 67.57% | 89.19% | 64.87% |
| 29 | Gemini 3.1 Pro (Preview) | 67.19% | 89.06% | 94.37% |
| 30 | Z.AI GLM 4.7 | 65.47% | 88.47% | 88.69% |
| 31 | Gemini 3 Pro (Preview) | 64.69% | 88.23% | 88.79% |
| 32 | MoonshotAI: Kimi K2.5 | 64.06% | 88.02% | 91.04% |
| 33 | GPT-4.1 Nano | 63.25% | 87.73% | 71.94% |
| 34 | Z.AI GLM 4.5 | 62.31% | 87.05% | 86.27% |
| 35 | Qwen 3.5 122B | 59.74% | 86.58% | 91.53% |
| 36 | Qwen 3.5 27B | 59.73% | 86.58% | 90.85% |
| 37 | Gemini 2.5 Pro | 58.32% | 86.11% | 88.53% |
| 38 | Gemini 3 Flash (Preview, Reasoning) | 55.98% | 85.32% | 90.50% |
| 39 | Cohere Command R+ (Aug. 2024) | 55.29% | 64.40% | 69.03% |
| 40 | Claude Haiku 4.5 | 51.59% | 83.86% | 85.14% |
| 41 | Qwen 3.5 35B | 49.74% | 80.87% | 88.00% |
| 42 | Qwen 3.5 Flash | 49.01% | 80.63% | 86.38% |
| 43 | Qwen 3.5 397B A17B | 46.35% | 82.10% | 91.73% |
| 44 | Mistral Medium 3.1 | 46.27% | 82.09% | 77.83% |
| 45 | Claude Opus 4.5 | 46.19% | 82.06% | 89.69% |
| 46 | GPT-4.1 Mini | 43.42% | 81.14% | 83.20% |
| 47 | Hermes 3 70B | 42.95% | 67.05% | 72.57% |
| 48 | Qwen 2.5 72B | 40.41% | 79.56% | 75.46% |
| 49 | Claude Sonnet 4 | 40.23% | 80.08% | 88.72% |
| 50 | Ministral 3 14B | 39.97% | 79.99% | 72.54% |
| 51 | Hermes 3 405B | 39.09% | 79.70% | 82.86% |
| 52 | GPT-4o, Aug. 6th (temp=1) | 38.76% | 79.53% | 82.62% |
| 53 | Mistral Large 3 | 34.52% | 78.17% | 85.43% |
| 54 | Mistral Large 2 | 33.60% | 77.87% | 82.41% |
| 55 | Mistral Large | 32.50% | 77.50% | 80.15% |
| 56 | GPT-4o Mini (temp=1) | 30.35% | 76.78% | 79.08% |
| 57 | WizardLM 2 8x22b | 29.74% | 70.24% | 71.07% |
| 58 | Arcee AI: Trinity Large (Preview) | 29.41% | 76.47% | 73.33% |
| 59 | Llama 3.1 70B | 29.26% | 69.78% | 78.40% |
| 60 | Claude 3.5 Sonnet | 28.94% | 76.31% | 84.24% |
| 61 | Llama 3.1 Nemotron 70B | 28.79% | 74.99% | 74.70% |
| 62 | Mistral Small 3.2 24B | 28.78% | 75.83% | 78.60% |
| 63 | Gemini 2.5 Flash Lite | 28.56% | 76.17% | 81.08% |
| 64 | Rocinante 12B | 27.40% | 52.09% | 54.55% |
| 65 | Claude Opus 4 | 27.04% | 75.68% | 87.69% |
| 66 | Claude Sonnet 4.5 | 26.70% | 75.57% | 88.03% |
| 67 | Ministral 3B | 26.52% | 70.75% | 61.29% |
| 68 | Claude 3.7 Sonnet | 25.54% | 75.18% | 83.39% |
| 69 | Mistral Small Creative | 23.38% | 74.46% | 73.27% |
| 70 | Writer: Palmyra X5 | 23.27% | 72.04% | 79.57% |
| 71 | Ministral 3 3B | 22.08% | 70.45% | 67.22% |
| 72 | GPT-4o Mini (temp=0) | 20.67% | 73.56% | 78.29% |
| 73 | Qwen 3.5 Plus (2026-02-15) | 20.40% | 73.35% | 85.96% |
| 74 | GPT-4o, May 13th (temp=1) | 20.21% | 73.40% | 83.80% |
| 75 | GPT-4o, Aug. 6th (temp=0) | 20.06% | 73.35% | 82.45% |
| 76 | Claude 3 Haiku | 19.94% | 60.81% | 71.19% |
| 77 | DeepSeek V3 (2024-12-26) | 19.33% | 73.11% | 83.68% |
| 78 | DeepSeek V3 (2025-03-24) | 18.55% | 67.07% | 81.99% |
| 79 | DeepSeek V3.1 | 18.52% | 72.80% | 82.39% |
| 80 | Llama 3.1 8B | 18.43% | 43.41% | 63.37% |
| 81 | DeepSeek-V2 Chat | 17.97% | 69.48% | 84.83% |
| 82 | DeepSeek V3.2 | 17.51% | 72.50% | 82.25% |
| 83 | Gemini 2.5 Flash | 16.03% | 71.70% | 80.60% |
| 84 | Gemini 3 Flash (Preview) | 13.77% | 71.24% | 85.35% |
| 85 | Mistral NeMO | 11.73% | 62.63% | 65.04% |
| 86 | GPT-4o, May 13th (temp=0) | 9.29% | 69.76% | 85.36% |
| 87 | Gemma 3 12B | 7.45% | 69.15% | 78.41% |
| 88 | Gemma 3 27B | 6.23% | 68.74% | 77.85% |
| 89 | Gemma 3 4B | 2.80% | 67.60% | 68.57% |