AI Deepfake Videos of Prime Minister Carney Used to Defraud Canadians and Disrupt 2025 Federal Election
A large-scale AI-enabled fraud and disinformation campaign targeting a Canadian election, documented across multiple platforms and months of operation. Meta's Canadian news ban under the Online News Act meant no legitimate news content circulated on Facebook, creating conditions where fabricated AI-generated news content faced limited competition from real journalism. The campaign persisted for months across rotating platform names despite serial regulatory warnings from Saskatchewan's FCAA.
Narrative
During and after the April 2025 Canadian federal election, an extensive AI-enabled disinformation and fraud campaign targeted Canadians using deepfake videos of Prime Minister Mark Carney, CBC journalist Rosemary Barton, CTV news anchors, and Elon Musk.
The campaign had two dimensions. First, a viral deepfake video — created using Fish Audio, a free AI voice cloning tool — falsely depicted Carney announcing that the government would ban vehicles manufactured before 2000. The video, which manipulated authentic footage from a March 27 press conference on tariff response, appeared on TikTok one day before the April 28 election and reached over 3 million views in a single day, spreading to X where it garnered an additional 2.4 million views. Although TikTok labeled the video as AI-generated, it continued to be amplified by influencers even after removal.
Second, a sophisticated network of over 40 Facebook pages and 25+ accounts — managed by operators traced to Ukraine, Indonesia, the United States, Angola, Romania, and Vietnam — ran AI-generated deepfake “news segments” featuring Carney, Barton, and Canadian news anchors to funnel victims into fraudulent cryptocurrency investment platforms. The scam operated through a multi-step funnel: Facebook ads pushed deepfake CBC and CTV reports to fake news websites, where Canadians were invited to provide contact information and invest a minimum of approximately $350 on platforms with rotating names — CanFirst, QuilCapital, Quantum AI, TokenTact, and others. “Financial advisers” would then pressure victims for larger investments, sometimes depositing small “profits” to build trust before extracting larger sums.
Lynn Phaneuf, a 70-year-old retired teacher from Prince Albert, Saskatchewan, lost approximately $3,000 after encountering what appeared to be a CBC News interview with Rosemary Barton and Mark Carney promoting a government-backed crypto opportunity. Saskatchewan’s Financial and Consumer Affairs Authority issued at least four separate investor alerts between June and September 2025, reporting that losses from the QuilCapital scam alone were expected to exceed $1 million.
A critical enabler was Meta’s Canadian news ban under the Online News Act, which removed legitimate news content from Facebook and Instagram. With no real journalism circulating on the platform, AI-generated fake news content faced no competition and appeared authoritative to users unfamiliar with the ban’s effects. Meta removed pages and accounts when flagged by CBC and researchers, but only approximately half of identified scam pages were taken down, and new ones were created daily. Meta’s January 2025 decision to end its fact-checking programs further compounded the problem.
An academic study analyzing 187,778 social media posts during the election period found that 5.86% of election-related images were flagged as deepfakes, with right-leaning users posting deepfakes at a rate of 9.24% compared to 3.87% for left-leaning users. While most deepfakes were benign memes rather than deliberate misinformation, the study confirmed that realistic fabricated images drew higher engagement. No criminal charges related to the scam operation have been reported.
Harms
A network of over 40 Facebook pages and 25+ accounts ran AI-generated deepfake videos impersonating Prime Minister Mark Carney, CBC journalist Rosemary Barton, and CTV news anchors to funnel Canadians into fraudulent cryptocurrency investment platforms. Saskatchewan's FCAA reported losses from a single platform expected to exceed $1 million.
A viral AI deepfake video falsely depicting Prime Minister Carney announcing a ban on older vehicles reached over 3 million views on TikTok and 2.4 million views on X in the days surrounding the April 2025 federal election, injecting fabricated policy into political discourse.
Individual Canadians suffered direct financial losses, including a 70-year-old retired teacher from Saskatchewan who lost approximately $3,000 after encountering what appeared to be a legitimate CBC News interview with the Prime Minister promoting a government-backed investment opportunity.
Affected Populations
- Canadian voters during the 2025 federal election
- Canadians who lost money to fraudulent investment schemes
- elderly Canadians targeted by sophisticated AI-enabled scams
- Canadian news media whose brands were impersonated
Entities Involved
Operated the Facebook platform where 40+ scam pages ran deepfake-laden ads targeting Canadians; removed pages reactively when flagged by researchers but only approximately half were taken down; Meta's January 2025 decision to end fact-checking programs and the Canadian news ban under the Online News Act created an information vacuum exploited by scammers
Issued at least four investor alerts (June–September 2025) warning about fraudulent investment platforms using deepfake impersonations of Prime Minister Carney
AI Systems Involved
AI voice cloning tool used to generate the deepfake audio in the viral TikTok video falsely depicting Prime Minister Carney announcing vehicle bans; the video carried a Fish Audio watermark
Responses & Outcomes
Issued first investor alert warning about impersonation scam using Prime Minister Carney's image and fake news articles to promote fraudulent investment platform 'Canfirst'
Issued second investor alert about 'QuilCapital' scam using Carney's image; reported losses expected to exceed $1 million
Issued investor alert about scam using AI deepfakes of both PM Carney and Alberta Premier Danielle Smith
AI System Context
Multiple AI systems were used in this campaign: Fish Audio (a free AI voice cloning tool) created realistic speech impersonating Prime Minister Carney; AI video generation or manipulation tools created fake news segments impersonating CBC and CTV broadcasts; and AI-generated content was used across Facebook, TikTok, and X to create a sophisticated multi-platform scam network designed to appear as legitimate Canadian journalism.
Preventive Measures
- Require social media platforms to implement proactive detection and removal of AI-generated deepfake content impersonating public figures, rather than reactive removal only when flagged
- Establish mandatory AI content provenance and labeling requirements for political content distributed on social media platforms operating in Canada
- Create a rapid-response mechanism for election-period disinformation involving AI-generated content, with authority to compel platform action
- Address the information vacuum created by the Canadian news ban on Meta platforms, which left AI-generated scam content as the dominant "news" format on Facebook during the election
- Strengthen cross-jurisdictional enforcement against international scam operations that use AI to target Canadians
Materialized From
Related Records
- AI-Generated Deepfake Videos of Elon Musk and Dragon's Den Used in $2.3M Crypto Fraud Targeting Canadians related
- AI-Generated Content and Bot Networks Targeted Canada's 2025 Federal Election at Scale related
- AI Threats to Election and Information Integrity in Canada related
- AI-Enabled Fraud and Impersonation related
Taxonomy
Sources
- Social media platforms host and profit from scams using AI and fake news websites during Canada's 2025 federal election
- Deepfake video of Canadian Prime Minister reaches millions on TikTok, X
- Sask. retiree warns others after losing $3K to crypto fraud using AI video of prime minister
- Facebook is being flooded with deepfake news reports about Mark Carney
- Fake election news ads are luring people into investment schemes. We got some taken down
- Canadian PM Carney targeted by viral deepfakes on social media
- Investor Alert: Impersonation Scam Uses Prime Minister Carney's Image
- Investor Alert: QuilCapital Scam Using Prime Minister Carney's Image
- Deepfakes in the 2025 Canadian Election: Prevalence, Partisanship, and Platform Dynamics
- AI Incident Database: Incident 1199 — AI-Generated Deepfake Image Linking Carney to Epstein
AIID: Incident #1199
Changelog
| Version | Date | Change |
|---|---|---|
| v1 | Mar 8, 2026 | Initial publication |