This site is a work-in-progress prototype.
Corroborated Severity: Significant Version 1

A large-scale AI-enabled fraud and disinformation campaign targeting a Canadian election, documented across multiple platforms and months of operation. Meta's Canadian news ban under the Online News Act meant no legitimate news content circulated on Facebook, creating conditions where fabricated AI-generated news content faced limited competition from real journalism. The campaign persisted for months across rotating platform names despite serial regulatory warnings from Saskatchewan's FCAA.

Occurred: April 1, 2025 (month) to November 30, 2025 Reported: April 14, 2025

Narrative

During and after the April 2025 Canadian federal election, an extensive AI-enabled disinformation and fraud campaign targeted Canadians using deepfake videos of Prime Minister Mark Carney, CBC journalist Rosemary Barton, CTV news anchors, and Elon Musk.

The campaign had two dimensions. First, a viral deepfake video — created using Fish Audio, a free AI voice cloning tool — falsely depicted Carney announcing that the government would ban vehicles manufactured before 2000. The video, which manipulated authentic footage from a March 27 press conference on tariff response, appeared on TikTok one day before the April 28 election and reached over 3 million views in a single day, spreading to X where it garnered an additional 2.4 million views. Although TikTok labeled the video as AI-generated, it continued to be amplified by influencers even after removal.

Second, a sophisticated network of over 40 Facebook pages and 25+ accounts — managed by operators traced to Ukraine, Indonesia, the United States, Angola, Romania, and Vietnam — ran AI-generated deepfake “news segments” featuring Carney, Barton, and Canadian news anchors to funnel victims into fraudulent cryptocurrency investment platforms. The scam operated through a multi-step funnel: Facebook ads pushed deepfake CBC and CTV reports to fake news websites, where Canadians were invited to provide contact information and invest a minimum of approximately $350 on platforms with rotating names — CanFirst, QuilCapital, Quantum AI, TokenTact, and others. “Financial advisers” would then pressure victims for larger investments, sometimes depositing small “profits” to build trust before extracting larger sums.

Lynn Phaneuf, a 70-year-old retired teacher from Prince Albert, Saskatchewan, lost approximately $3,000 after encountering what appeared to be a CBC News interview with Rosemary Barton and Mark Carney promoting a government-backed crypto opportunity. Saskatchewan’s Financial and Consumer Affairs Authority issued at least four separate investor alerts between June and September 2025, reporting that losses from the QuilCapital scam alone were expected to exceed $1 million.

A critical enabler was Meta’s Canadian news ban under the Online News Act, which removed legitimate news content from Facebook and Instagram. With no real journalism circulating on the platform, AI-generated fake news content faced no competition and appeared authoritative to users unfamiliar with the ban’s effects. Meta removed pages and accounts when flagged by CBC and researchers, but only approximately half of identified scam pages were taken down, and new ones were created daily. Meta’s January 2025 decision to end its fact-checking programs further compounded the problem.

An academic study analyzing 187,778 social media posts during the election period found that 5.86% of election-related images were flagged as deepfakes, with right-leaning users posting deepfakes at a rate of 9.24% compared to 3.87% for left-leaning users. While most deepfakes were benign memes rather than deliberate misinformation, the study confirmed that realistic fabricated images drew higher engagement. No criminal charges related to the scam operation have been reported.

Harms

A network of over 40 Facebook pages and 25+ accounts ran AI-generated deepfake videos impersonating Prime Minister Mark Carney, CBC journalist Rosemary Barton, and CTV news anchors to funnel Canadians into fraudulent cryptocurrency investment platforms. Saskatchewan's FCAA reported losses from a single platform expected to exceed $1 million.

Significant Population

A viral AI deepfake video falsely depicting Prime Minister Carney announcing a ban on older vehicles reached over 3 million views on TikTok and 2.4 million views on X in the days surrounding the April 2025 federal election, injecting fabricated policy into political discourse.

Significant Population

Individual Canadians suffered direct financial losses, including a 70-year-old retired teacher from Saskatchewan who lost approximately $3,000 after encountering what appeared to be a legitimate CBC News interview with the Prime Minister promoting a government-backed investment opportunity.

Significant Group

Affected Populations

  • Canadian voters during the 2025 federal election
  • Canadians who lost money to fraudulent investment schemes
  • elderly Canadians targeted by sophisticated AI-enabled scams
  • Canadian news media whose brands were impersonated

Entities Involved

Operated the Facebook platform where 40+ scam pages ran deepfake-laden ads targeting Canadians; removed pages reactively when flagged by researchers but only approximately half were taken down; Meta's January 2025 decision to end fact-checking programs and the Canadian news ban under the Online News Act created an information vacuum exploited by scammers

Issued at least four investor alerts (June–September 2025) warning about fraudulent investment platforms using deepfake impersonations of Prime Minister Carney

AI Systems Involved

Fish Audio

AI voice cloning tool used to generate the deepfake audio in the viral TikTok video falsely depicting Prime Minister Carney announcing vehicle bans; the video carried a Fish Audio watermark

Responses & Outcomes

Saskatchewan Financial and Consumer Affairs Authority

Issued first investor alert warning about impersonation scam using Prime Minister Carney's image and fake news articles to promote fraudulent investment platform 'Canfirst'

Saskatchewan Financial and Consumer Affairs Authority

Issued second investor alert about 'QuilCapital' scam using Carney's image; reported losses expected to exceed $1 million

Saskatchewan Financial and Consumer Affairs Authority

Issued investor alert about scam using AI deepfakes of both PM Carney and Alberta Premier Danielle Smith

AI System Context

Multiple AI systems were used in this campaign: Fish Audio (a free AI voice cloning tool) created realistic speech impersonating Prime Minister Carney; AI video generation or manipulation tools created fake news segments impersonating CBC and CTV broadcasts; and AI-generated content was used across Facebook, TikTok, and X to create a sophisticated multi-platform scam network designed to appear as legitimate Canadian journalism.

Preventive Measures

  • Require social media platforms to implement proactive detection and removal of AI-generated deepfake content impersonating public figures, rather than reactive removal only when flagged
  • Establish mandatory AI content provenance and labeling requirements for political content distributed on social media platforms operating in Canada
  • Create a rapid-response mechanism for election-period disinformation involving AI-generated content, with authority to compel platform action
  • Address the information vacuum created by the Canadian news ban on Meta platforms, which left AI-generated scam content as the dominant "news" format on Facebook during the election
  • Strengthen cross-jurisdictional enforcement against international scam operations that use AI to target Canadians

Materialized From

Related Records

Taxonomy

Domain
Elections & Info IntegrityFinance & Banking
Harm type
Fraud & ImpersonationMisinformationEconomic Harm
AI involvement
Misuse
Lifecycle phase
Deployment

Sources

  1. Social media platforms host and profit from scams using AI and fake news websites during Canada's 2025 federal election Academic — Canadian Digital Media Research Network (Jun 1, 2025)
  2. Deepfake video of Canadian Prime Minister reaches millions on TikTok, X Academic — DFRLab (Atlantic Council) (Jun 19, 2025)
  3. Sask. retiree warns others after losing $3K to crypto fraud using AI video of prime minister Media — CBC News (Dec 1, 2025)
  4. Facebook is being flooded with deepfake news reports about Mark Carney Media — The Logic (Apr 14, 2025)
  5. Fake election news ads are luring people into investment schemes. We got some taken down Media — CBC News (May 1, 2025)
  6. Canadian PM Carney targeted by viral deepfakes on social media Media — France 24 (May 6, 2025)
  7. Investor Alert: Impersonation Scam Uses Prime Minister Carney's Image Regulatory — Saskatchewan Financial and Consumer Affairs Authority (Jun 4, 2025)
  8. Investor Alert: QuilCapital Scam Using Prime Minister Carney's Image Regulatory — Saskatchewan Financial and Consumer Affairs Authority (Jul 31, 2025)
  9. Deepfakes in the 2025 Canadian Election: Prevalence, Partisanship, and Platform Dynamics Academic — arXiv (Dec 18, 2025)
  10. AI Incident Database: Incident 1199 — AI-Generated Deepfake Image Linking Carney to Epstein Other — AI Incident Database

AIID: Incident #1199

Changelog

VersionDateChange
v1 Mar 8, 2026 Initial publication