Particle.news
Download on the App Store

California Orders xAI to Halt Grok Deepfakes as Singapore Steps In and EU Weighs Ban

Regulators are escalating after victims and watchdogs reported widespread non‑consensual sexualized images and tests showed workarounds despite xAI’s new limits.

Overview

  • Singapore’s IMDA said it is engaging X over Grok-generated non‑consensual intimate images as the Philippines joined Malaysia and Indonesia in blocking access to the tool.
  • xAI said it blocked edits that place real people in revealing clothing and restricted access in some regions, but reporting found VPNs, a standalone app, and prompt tricks still enable abuse.
  • California Attorney General Rob Bonta sent a cease‑and‑desist ordering xAI to stop creating and distributing sexual deepfakes, following accounts of images involving women and children.
  • The European Commission confirmed it is examining a ban on ‘nudification’ tools under the AI Act, while UK actions include an Ofcom probe and plans to criminalize creating non‑consensual intimate images.
  • Ashley St. Clair sued xAI alleging Grok produced explicit images of her as a minor, and the Internet Watch Foundation reported a surge in AI‑generated CSAM in 2025, as Elon Musk said Grok should have a “moral constitution.”