Particle.news
Download on the App Store

California Opens Probe Into xAI as X Restricts Grok After Deepfake Furor

Regulators question whether new restrictions or geo‑blocks curb non‑consensual sexual imagery generated on X.

Overview

  • California Attorney General Rob Bonta launched a formal investigation into xAI, alleging facilitation of large‑scale non‑consensual intimate‑image deepfakes that include some appearing to depict minors.
  • X said it deployed technical blocks to stop Grok from editing photos of real people into revealing outfits, with generation of such images geographically restricted where illegal.
  • Grok’s image generation remains limited to paying users since January 9, as X says it removes illegal content and permanently suspends violating accounts.
  • International action includes temporary suspensions in Indonesia and Malaysia, removals reported by India, and ongoing inquiries in the UK and France as EU and UK officials offered cautious approval pending verification.
  • Ashley St. Clair filed a lawsuit in New York over sexualized images allegedly generated by Grok without consent, adding fresh legal pressure on xAI and X.