EU opens formal investigation into X’s Grok over sexual deepfakes and illegal content risks
European regulators launched a new probe into X, focusing on Grok’s alleged role in creating and spreading nonconsensual sexualized deepfake images and examining whether safeguards meet requirements under the Digital Services Act.
A Digital Services Act test for generative AI on platforms
The European Union has opened a formal investigation into Elon Musk’s platform X over its AI chatbot Grok, after concerns that the tool enabled the creation and dissemination of nonconsensual sexualized deepfake images. The inquiry is centered on whether X has met its obligations under the EU’s Digital Services Act (DSA), which requires major platforms to mitigate systemic risks and address illegal content effectively.
Regulators say the case involves manipulated sexual imagery that may include content involving children, escalating the matter from a platform-safety controversy into a potential illegal-content enforcement action. Officials are examining how quickly harmful material spread, what guardrails existed, and whether the platform’s response was sufficient.
Why Grok’s visibility matters
A key factor drawing scrutiny is that Grok’s interactions on X can be publicly visible, which can accelerate distribution when users prompt the system to alter images. Critics argue that this design choice makes it easier for harmful outputs to be copied, reshared and amplified—especially when combined with frictionless image-editing capabilities.
Regulators are also looking at how platform features may have contributed to risk, including the way content is recommended and surfaced. The EU has indicated it is expanding a separate, ongoing investigation into X’s recommender systems alongside the Grok deepfake probe.
Potential outcomes
The investigation could end with X making commitments to change product behavior and enforcement processes, or it could expose the company to significant penalties under the DSA. X has said it has a zero-tolerance stance toward child sexual exploitation and nonconsensual nudity and that it is implementing restrictions on certain image manipulations where they are illegal.
The case is being watched closely across the tech industry because it illustrates a core regulatory question: when generative AI tools are embedded directly in social platforms, the platform may be held responsible not only for user posts but also for AI-enabled transformation and rapid spread of illicit content.