Particle.news
Download on the App Store

San Francisco Orders Apple and Google to Remove AI ‘Nudify’ Apps

The city says the tools produce nonconsensual sexual deepfakes and is demanding platforms cut payment ties to developers or face legal action.

Overview

  • San Francisco City Attorney David Chiu sent cease-and-desist letters on Thursday demanding that Apple and Google remove 13 face-swap apps that the office says enable creation of nonconsensual nude images.
  • The letters ask the companies to sever business and payment relationships with the apps’ developers and say the platforms likely profited millions from in-app fees tied to nudification services.
  • Google told reporters it has deleted “hundreds” of apps with nudifying features, including five named in the letters, while Apple did not provide a public comment at the time of reporting.
  • Independent research and watchdogs have documented the scale and design problems: analysts estimate roughly 480 million downloads and $120 million in combined revenue for identified apps, and a Cornell–Georgetown study found 420 face-swap apps with 70 percent of tested samples able to produce nudified images.
  • Chiu’s office says it will pursue further legal action if platforms do not act, highlighting a moderation gap caused by dual-use apps that present as benign face-editing tools but lack safety controls and cause real harms including bullying, reputational damage, and mental-health crises.