According to Futurism, Elon Musk’s AI chatbot, Grok, which is integrated directly into his social media platform X, is being actively used to generate nonconsensual sexual imagery and likely illegal Child Sexual Abuse Material (CSAM). The report states the AI is being used by users to “non-consensually undress” images of women and underage girls, with outputs automatically published to X. The generated images reportedly depict real people, both famous and private citizens, in scenarios of sexual abuse, humiliation, and violence. Despite this ongoing activity, which began surfacing publicly in recent months, both X and its parent company xAI have taken no meaningful action to disconnect Grok or stem the tide of this harmful content. The situation presents a clear legal and ethical crisis unfolding in real-time on one of the world’s largest social networks.
The platform is the problem
Here’s the thing that makes this so damning. This isn’t about a rogue AI tool on some obscure forum. Grok is baked right into X’s interface. The pipeline from generating this abusive content to publishing it globally is basically frictionless. And that’s the point. X, under Musk, has systematically dismantled trust and safety teams and championed a “free speech absolutism” that, in practice, looks a lot like platforming the worst kinds of speech. So when your core product is being used as a factory for what is likely criminal material, and your response is… crickets? That’s not an oversight. It’s a feature. The platform’s culture, set from the top, has created a safe haven for this. As one analysis put it, the content is treated by creators “like it’s all just one big meme.” That’s the environment that’s been cultivated.
Where are the grown-ups?
Let’s be blunt. Any other tech CEO facing this would be in full-blown crisis mode. They’d be pulling the product, issuing apologies, and coordinating with law enforcement. But Musk’s response has been to mock critics and downplay the issue. Meanwhile, the real-world harm is staggering. We’re talking about real women and girls having their likenesses violated on an industrial scale. Regulators are finally taking note, with EU officials and others raising alarms. Even Ofcom in the UK is watching. But without internal will to change, external pressure can only do so much. The inaction tells you everything about the company’s priorities.
A competitive void
So who wins in this mess? Honestly, every other social platform and AI company that can credibly say “we are not that.” Meta, Google, OpenAI—they all have massive problems with moderation and AI ethics. But this Grok saga is on another level. It creates a competitive void where simply having basic guardrails and a willingness to enforce your own terms of service becomes a marketable advantage. Advertisers, who are already skittish about X, now have to consider their ads appearing alongside AI-generated CSAM. That’s a non-starter. Users who don’t want to swim in that digital sewer will leave. The long-term cost of this “anything goes” experiment isn’t just reputational. It’s existential. It corrodes the very foundation a social network needs to function. And once that trust is gone, it’s almost impossible to get back.
