Particle.news
Download on the App Store

Meta Ran Ads for an AI App That Promised Unrestricted ‘Nudify’ Deepfakes

The ads led Apple to remove the Kromix app and prompted renewed scrutiny of automated ad review and app‑store enforcement.

Overview

  • Meta ran a 32‑ad campaign on Facebook and Instagram that promoted Kromix as an AI tool with “no restrictions” and showed a woman resembling a prominent female U.S. politician transformed into explicit footage, and Meta removed the ads after reporting by WIRED.
  • Apple said it pulled Kromix from the App Store because the app appeared to add prohibited sexual content and features after initial review, and the company has removed similar apps such as MaskAI following media inquiries.
  • Meta says it bans nonconsensual intimate imagery but relies mainly on automated ad review, and the company acknowledged adversarial tactics helped some violating ads bypass its systems while it investigates how that happened.
  • Researchers found Kromix invited paid users to upload photos for sexualized scenarios using labels like “bedroom rape,” showing how low‑ and no‑code AI tools can make realistic deepfakes that enable sexual exploitation and political harassment.
  • Regulators and advocates are pressing for stronger oversight after earlier actions from San Francisco’s city attorney and Meta’s prior removals of hundreds of thousands of similar ads, because removals after discovery do not stop wider distribution or the emergence of replacement apps.