Elon Musk's artificial intelligence company xAI is facing allegations that its chatbot "Grok" has significantly relied on adult content to expand its user base. Reports indicate that the generation of explicit images and videos, along with adult role-playing chats, has driven traffic to the platform, raising concerns about non-consensual image generation and inadequate safety management.
The tech news outlet The Information reported on June 25, citing two former employees, that "more than half of Grok's traffic is related to NSFW (Not Safe For Work) activities, such as generating explicit images and videos and adult role-playing chats." NSFW refers to content that is inappropriate for viewing in workplaces or public settings, including adult, violent, or provocative material.
According to the report, the demand for adult content has been observed not only in general conversational models but also in coding-specific models. Some users have reportedly utilized the less expensive coding model to request the generation of pornography or nude images.
There has also been internal dissent. Former employees stated that some researchers and engineers were shocked to learn that Grok could create non-consensual sexual images based on photographs of real individuals. Some staff members reportedly left the company when they were reassigned to work on the AI avatar "Annie," which sparked controversy over sexual objectification instead of focusing on technological research.
Concerns have also been raised about the safety management system. The report noted that xAI's safety team consisted of only about six members as of late last year, and that number has reportedly decreased since then.
Grok has previously generated sexual images involving minors at user requests, leading to access bans or investigations in some countries.
This controversy is also impacting Musk's other key companies. SpaceX recently warned in its IPO-related documents that Grok's "spicy" and "unstable" modes could pose risks, including reputational damage, explicit content, misinformation, deceptive outputs, and non-consensual image generation. This acknowledgment suggests that while Grok may boost xAI's growth metrics, it could also escalate legal and regulatory risks across Musk's business ecosystem.
The allegations are likely to fuel ongoing debates about the limits of growth in generative AI companies. While expanding provocative features may increase short-term traffic, failure to control non-consensual images, illegal content, and youth protection issues could lead to regulatory scrutiny, lawsuits, and investor distrust.
* This article has been translated by AI.
Copyright ⓒ Aju Press All rights reserved.