Sample Page

AI Source Verification uses large language models to check whether a Wikipedia citation actually supports the claim it’s attached to. Click any reference, and the tool will analyze the source content and tell you if the claim is supported, partially supported, or not supported.

First install User:Enterprisey/script-installer, then return to this page and click the “Install” button in the infobox. Alternatively, add this line to your Special:MyPage/common.js:

{{subst:iusc|User:Alaexis/Scripts/AI Source Verification.js}}

• Click the “Verify” tab (next to Article / Talk) to open the sidebar. On Vector Legacy and MinervaNeue skins, click the “More” menu and select “Verify” instead.
• With the sidebar open, click any inline citation (e.g., ^[1]) in the article
• Select an AI provider from the dropdown (optional)
• Click “Verify” to check if the source supports the cited claim
• The tool will fetch the source content and return a verdict with an explanation

Qwen Sea Lion (open-source), Claude (AI), ChatGPT, Gemini (chatbot).

Something missing? Feel free to drop a note at the talk page. There is also an issue tracker here.

The tool successfully detects about 70% of citations that don’t support the claims they are supposed to support. For “good” citations, it misfires in <15% of cases. Since the overwhelming majority of citations support the sources they’re attached to, most hits will be false positives and thus manual review is always necessary. That said, the underlying problem is real: across all references checked (not just flagged ones), roughly 1 in 20–50 contains a genuine accuracy issue. See here for more details.

• Online sources only: The tool can only verify sources available on the web. For paywalled or offline sources, you can paste the text manually.
• Complex citations: The tool may struggle with sentences that have multiple references supporting different parts.
• Accuracy varies by model: Commercial models (Claude, GPT, Gemini) significantly outperform the free option.
• Limited support of PDF sources

This script is based on Polygnotus’s AI Source Verification script. The free option is powered by an open-source model hosted by PublicAI.

Source content is fetched via a proxy that also handles rate limiting (code: [1]). API keys are stored locally in your browser (localStorage) and can be removed at any time.