AI Disinformation Benchmark
Data updated on 13 October 2026
How often popular AI assistants cite Kremlin propaganda sources
AssistantResponses to test questions that repeated a pro-Kremlin false claim or showed a Kremlin-linked source4,309 responses: 2,306 of Dosimeter and 2,003 of other organisations1 square is 1% of responses
- DeepSeek
- Perplexity
- Grok
- Meta AI
- Microsoft Copilot
- Mistral Vibe
- Claude
- Gemini
- Google AI Overviews
- ChatGPT
- All assistants
AssistantResponses to our test questions citing at least one listed source632 responses of Dosimeter1 square is 1% of responses
- PerplexityWeb version, default model20.0%20 September · Cited Russia Today, Anti-Spiegel, NachDenkSeiten0.0%7 October, after Perplexity stated on 28 September that it had blocked the cited sites
- Meta AIWeb version, default model10.0%Cited Apolut, NachDenkSeiten
- Microsoft CopilotWeb version, default model3.0%Cited Compact
- ChatGPTWeb version with search, default model1.0%Cited Sputnik
- GeminiWeb version, default model
- Google AI OverviewsGoogle Search
- Google AI ModeGoogle Search, AI Mode
Cases found by journalists and researchers
These are public responses with Kremlin propaganda that journalists and researchers found
DeepSeek2 cases
- October 2025Gave 13 citations of Kremlin state media, among them Sputnik, Russia Today and EADaily · Institute for Strategic Dialogue
- February 2026Called the Maidan a coup and used the Kremlin's term for the invasion · The Kyiv Independent
Perplexity1 case
- March 2025Gave Pravda network content with no warning about the network · DFRLab and CheckFirst
Grok5 cases
- October 2026Wrote in a public post on X that Ukraine, backed by NATO, is the aggressor · Grok on X
- August 2026Summarised the news of sanctioned state outlets on request, with no refusal · Reporters Without Borders
- October 2025Carried Kremlin state-attributed sources in 40% of responses about military recruitment in Ukraine · Institute for Strategic Dialogue
- October 2025Used the Kremlin's term for the invasion in a public reply on X and blamed Kyiv for the war in Donbas · Grok on X
- September 2025Gave 25 propaganda sources, among them Pravda, Sputnik and Baltnews · Re:Baltica
Meta AI1 case
- July 2026Repeated the fake report about Ukrainian soldiers in France and credited it to Le Point · NPR and NewsGuard
Microsoft Copilot3 cases
- June 2026Repeated a false claim about a Dane killed in Kryvyi Rih in Finnish, Danish and Slovenian · France 24 Observers
- April 2025Answered yes to the same false claim in Danish, with the Danish Pravda site as its only source · NORDIS
- March 2025Gave Pravda network content with no warning about the network · DFRLab and CheckFirst
Mistral Vibe4 cases
- August 2026Found Sputnik and Russia Today content through other platforms when asked for sanctioned outlets · Reporters Without Borders
- July 2026A Mistral model backed a false claim about Zelensky and cited the sanctioned site R-FBI · Euronews
- June 2026At least 12 responses of Mistral models referred to sanctioned sources such as Russia Today and Sputnik · Euronews
- April 2026Repeated false claims about the Iran war in 50% of tests in English and 57% in French, and cited a Pravda network page for one of them · NewsGuard
Claude5 cases
- August 2026Summarised a Russia Today article on request · Reporters Without Borders
- May 2026Used Pravda network domains seven times in news searches, in a study of Agora Digitale Transformation · Der Spiegel
- April 2026Repeated the fake report about 20,000 deserters and cited a Pravda network page · NewsGuard
- April 2026Confirmed a false figure of deaths on the Tisza river and cited a Pravda network page and a Russia Today article · NewsGuard
- September 2025Cited Pravda, Russia Today, RIA Novosti, Sputnik and Izvestia in responses about the Baltic states · Re:Baltica
Gemini3 cases
- August 2026Gave a summary of sanctioned outlets with links to Russia Today posts · Reporters Without Borders
- April 2025Quoted Pravda network headlines in four Nordic languages with no warning · NORDIS
- March 2025Gave Pravda network content with no warning about the network · DFRLab and CheckFirst
Google AI Overviews1 case
- April 2026Declared the fake Le Point story about 20,000 deserters to be true and cited the fake report · NewsGuard
ChatGPT5 cases
- August 2026Gave paragraphs taken from Russia Today articles when asked for the news of sanctioned outlets · Reporters Without Borders
- October 2025Cited a Russia Today article reposted by another site in responses about the war in Ukraine · Institute for Strategic Dialogue
- September 2025Cited the sanctioned site R-FBI and a Sputnik article in responses in Latvian · Re:Baltica
- April 2025Linked to Pravda network articles as sources in Norwegian, Danish and Finnish · NORDIS
- March 2025Gave Pravda network content with no warning about the network · DFRLab and CheckFirst
Colleagues' work
The board also rests on the published measurements of colleagues who counter disinformation
- June 2026European University Institute, thesis of Arianna StechResponses that repeated a pro-Kremlin false claim
- May 2026NewsGuardResponses that repeated a pro-Kremlin false claim
- February 2026NewsGuardResponses that repeated a pro-Kremlin false claim
- October 2025Institute for Strategic DialogueResponses that cited Kremlin-linked sources
- October 2025Harvard Kennedy School Misinformation ReviewResponses that repeated a pro-Kremlin false claim or cited Kremlin-linked sources
- May 2025NewsGuardResponses that repeated a pro-Kremlin false claim or cited Kremlin-linked sources
- April 2025Detector MediaResponses that repeated a pro-Kremlin false claim or cited Kremlin-linked sources
- March 2025NewsGuardResponses that repeated a pro-Kremlin false claim or cited Kremlin-linked sources
- June 2024NewsGuardResponses that repeated a pro-Kremlin false claim
These are 2,003 responses from 9 published reports
Method
We ask test questions, not everyday ones: debunked false claims, claims that the Pravda network published on the same day, and topics with little reliable coverage, which researchers call data voids
We count a response if it shows at least one Kremlin-linked source
Kremlin-linked sources are:
- sites on the European Union sanctions list
- sites of the Pravda network (lists of VIGINUM and CheckFirst)
- Kremlin state bodies and state media
- pro-Kremlin outlets and their mirror sites
The Germany board counts only the two lists and the outlets with documented links to Russia Today
ChatGPT folds part of its sources into groups: the sources shown in the response text are counted
Overall dataset: 2,446 responses collected · 18,525 cited sources checked
EU Funding & Tenders PortalParticipant Register, Participant ID (PIC) 862736819
Portal managed byEuropean Commission
Research dataResponses, cited sources and scripts
Persistent identifierDOI 10.5281/zenodo.22925952
LicenceData: CC BY 4.0 · Scripts: EUPL-1.2, the open-source licence of the European Union
Sources classified by official listsEU Council Regulation 833/2014, Annex XV
Network listsVIGINUM · CheckFirst
Cryptographic sealQuestions and source lists are fixed before the first response
GitHubgithub.com/gurovdigital
GDPR complianceNo cookies, no visitor profiles, anonymous visit statistics
EU AI Act complianceData handled by humans
FrameworksRegulation (EU) 2024/1689 · Ethics Guidelines for Trustworthy AI