Lawsuit Alleges Grok Used to Create CSAM from Childhood Photo

A woman identified as Jane Doe 4 has joined a lawsuit against Elon Musk's xAI, alleging that her stepfather used the company's Grok chatbot to transform a photograph of her at age 11 into more than 7,000 explicit images. The stepfather was found dead by suicide two days after a law enforcement raid uncovered the images, according to a report in The Washington Post.

“Limitless access to these tools is spreading so quickly,” the woman said. “It is taking everyday life and turning it into child sexual abuse.”

The lawsuit, originally filed by three Tennessee teenagers, accuses xAI—now part of SpaceX—of failing to implement basic safeguards to prevent Grok from generating sexualized images of real people, including minors. The suit, which seeks class action status, comes amid broader concerns about AI-generated deepfakes and the ease with which powerful image-generation models can be misused.

TechCrunch has reached out to xAI for comment. The case highlights a dark side of the rapid deployment of generative AI tools, which have also been used to create non-consensual intimate images of adults. As AI models become more capable and accessible, the potential for abuse grows, raising urgent questions about platform responsibility and content moderation.

For developers and tech companies, this case underscores the need for robust safety measures beyond simple prompt filters, such as proactive detection of known individuals and tighter controls on image generation. The industry is still grappling with how to balance innovation with protections against misuse, and this lawsuit could set a precedent for liability.

If you are in crisis or having thoughts of suicide, call or text 988 to reach the 988 Suicide and Crisis Lifeline.