Phase pilote
Corroboré Sévérité : Important Version 1

A large-scale AI-enabled fraud and disinformation campaign targeting a Canadian election, documented across multiple platforms and months of operation. According to the CDMRN, Meta's Canadian news ban under the Online News Act meant no legitimate news content circulated on Facebook, creating conditions where fabricated AI-generated news content faced limited competition from real journalism. The campaign persisted for months across rotating platform names despite serial regulatory warnings from Saskatchewan's FCAA.

Survenu : 1 avril 2025 (month) au 30 novembre 2025 Signalé : 14 avril 2025

Récit

During and after the April 2025 Canadian federal election, an extensive AI-enabled disinformation and fraud campaign targeted Canadians using deepfake videos of Prime Minister Mark Carney, CBC journalist Rosemary Barton, CTV news anchors, and Elon Musk.

The campaign had two dimensions. First, a viral deepfake video — created using Fish Audio, a free AI voice cloning tool — falsely depicted Carney announcing that the government would ban vehicles manufactured before 2000. The video, which manipulated authentic footage from a March 27 press conference on tariff response, appeared on TikTok one day before the April 28 election and reached over 3 million views in a single day, spreading to X where it garnered an additional 2.4 million views. Although TikTok labeled the video as AI-generated, it continued to be amplified by influencers even after removal.

Second, a sophisticated network of over 40 Facebook pages and 25+ accounts — managed by operators traced to Ukraine, Indonesia, the United States, Angola, Romania, and Vietnam — ran AI-generated deepfake “news segments” featuring Carney, Barton, and Canadian news anchors to funnel victims into fraudulent cryptocurrency investment platforms. The scam operated through a multi-step funnel: Facebook ads pushed deepfake CBC and CTV reports to fake news websites, where Canadians were invited to provide contact information and invest a minimum of approximately $350 on platforms with rotating names — CanFirst, QuilCapital, Quantum AI, TokenTact, and others. “Financial advisers” would then pressure victims for larger investments, sometimes depositing small “profits” to build trust before extracting larger sums.

Lynn Phaneuf, a 70-year-old retired teacher from Prince Albert, Saskatchewan, lost approximately $3,000 after encountering what appeared to be a CBC News interview with Rosemary Barton and Mark Carney promoting a government-backed crypto opportunity. Saskatchewan’s Financial and Consumer Affairs Authority issued at least four separate investor alerts between June and September 2025, reporting that losses from the QuilCapital scam alone were expected to exceed $1 million.

A critical enabler was Meta’s Canadian news ban under the Online News Act, which removed legitimate news content from Facebook and Instagram. With no real journalism circulating on the platform, AI-generated fake news content faced no competition and appeared authoritative to users unfamiliar with the ban’s effects. Meta removed pages and accounts when flagged by CBC and researchers, but only approximately half of identified scam pages were taken down, and new ones were created daily. Meta’s January 2025 decision to end its fact-checking programs further compounded the problem.

An academic study analyzing 187,778 social media posts during the election period found that 5.86% of election-related images were flagged as deepfakes, with right-leaning users posting deepfakes at a rate of 9.24% compared to 3.87% for left-leaning users. While most deepfakes were benign memes rather than deliberate misinformation, the study confirmed that realistic fabricated images drew higher engagement. No criminal charges related to the scam operation have been reported.

Préjudices

A network of over 40 Facebook pages and 25+ accounts ran AI-generated deepfake videos impersonating Prime Minister Mark Carney, CBC journalist Rosemary Barton, and CTV news anchors to funnel Canadians into fraudulent cryptocurrency investment platforms. Saskatchewan's FCAA reported losses from a single platform expected to exceed $1 million.

Important Population

A viral AI deepfake video falsely depicting Prime Minister Carney announcing a ban on older vehicles reached over 3 million views on TikTok and 2.4 million views on X in the days surrounding the April 2025 federal election, injecting fabricated policy into political discourse.

Important Population

Individual Canadians suffered direct financial losses, including a 70-year-old retired teacher from Saskatchewan who lost approximately $3,000 after encountering what appeared to be a legitimate CBC News interview with the Prime Minister promoting a government-backed investment opportunity.

Important Groupe

Populations touchées

  • Canadian voters during the 2025 federal election
  • Canadians who lost money to fraudulent investment schemes
  • elderly Canadians targeted by sophisticated AI-enabled scams
  • Canadian news media whose brands were impersonated

Entités impliquées

Operated the Facebook platform where 40+ scam pages ran deepfake-laden ads targeting Canadians; removed pages reactively when flagged by researchers but only approximately half were taken down; ended its fact-checking programs in January 2025 and blocked Canadian news content under the Online News Act

Issued at least four investor alerts (June–September 2025) warning about fraudulent investment platforms using deepfake impersonations of Prime Minister Carney

Systèmes d'IA impliqués

Fish Audio

AI voice cloning tool used to generate the deepfake audio in the viral TikTok video falsely depicting Prime Minister Carney announcing vehicle bans; the video carried a Fish Audio watermark

Réponses et résultats

Autorité des affaires financières et de la consommation de la Saskatchewan

Issued first investor alert warning about impersonation scam using Prime Minister Carney's image and fake news articles to promote fraudulent investment platform 'Canfirst'

Autorité des affaires financières et de la consommation de la Saskatchewan

Issued second investor alert about 'QuilCapital' scam using Carney's image; reported losses expected to exceed $1 million

Autorité des affaires financières et de la consommation de la Saskatchewan

Issued investor alert about scam using AI deepfakes of both PM Carney and Alberta Premier Danielle Smith

Contexte du système d'IA

Multiple AI systems were used in this campaign: Fish Audio (a free AI voice cloning tool) created realistic speech impersonating Prime Minister Carney; AI video generation or manipulation tools created fake news segments impersonating CBC and CTV broadcasts; and AI-generated content was used across Facebook, TikTok, and X to create a sophisticated multi-platform scam network designed to appear as legitimate Canadian journalism.

Mesures préventives

  • Require social media platforms to implement proactive detection and removal of AI-generated deepfake content impersonating public figures, rather than reactive removal only when flagged
  • Establish mandatory AI content provenance and labeling requirements for political content distributed on social media platforms operating in Canada
  • Create a rapid-response mechanism for election-period disinformation involving AI-generated content, with authority to compel platform action
  • Address the information vacuum created by the Canadian news ban on Meta platforms, which left AI-generated scam content as the dominant "news" format on Facebook during the election
  • Strengthen cross-jurisdictional enforcement against international scam operations that use AI to target Canadians

Matérialisé à partir de

Fiches connexes

Taxonomie

Domaine
Élections et intégrité de l'informationFinance et banques
Type de préjudice
Fraude et usurpation d'identitéDésinformationPréjudice économique
Implication de l'IA
Utilisation abusive
Phase du cycle de vie
Déploiement

Sources

  1. Social media platforms host and profit from scams using AI and fake news websites during Canada's 2025 federal election Académique — Canadian Digital Media Research Network (1 juin 2025)
  2. Deepfake video of Canadian Prime Minister reaches millions on TikTok, X Académique — DFRLab (Atlantic Council) (19 juin 2025)
  3. Sask. retiree warns others after losing $3K to crypto fraud using AI video of prime minister Média — CBC News (1 déc. 2025)
  4. Facebook is being flooded with deepfake news reports about Mark Carney Média — The Logic (14 avr. 2025)
  5. Fake election news ads are luring people into investment schemes. We got some taken down Média — CBC News (1 mai 2025)
  6. Canadian PM Carney targeted by viral deepfakes on social media Média — France 24 (6 mai 2025)
  7. Investor Alert: Impersonation Scam Uses Prime Minister Carney's Image Réglementaire — Saskatchewan Financial and Consumer Affairs Authority (4 juin 2025)
  8. Investor Alert: QuilCapital Scam Using Prime Minister Carney's Image Réglementaire — Saskatchewan Financial and Consumer Affairs Authority (31 juill. 2025)
  9. Deepfakes in the 2025 Canadian Election: Prevalence, Partisanship, and Platform Dynamics Académique — arXiv (18 déc. 2025)
  10. AI Incident Database: Incident 1199 — AI-Generated Deepfake Image Linking Carney to Epstein Autre — AI Incident Database

AIID : Incident #1199

Historique des modifications

VersionDateModification
v1 8 mars 2026 Initial publication