Lawsuit: Man used Grok to make sexual images of 7,000 photos of his stepdaughter, then shot himself



The xAI class covers all U.S. persons whose “actual images of themselves as minors” were altered using Grok “to produce images or videos of sexually explicit conduct or content featuring their faces and/or other reasonably identifiable distinguishing characteristics.” And the Stability AI class includes Americans who suffered similar harm using “an app built on a Stability AI model.”

Attorneys estimate that thousands of minors may be eligible to join the classes and continue searching for victims harmed by AI CSAM.

NCMEC did not respond to Ars’ request for comment.

However, the group has called on platforms, lawmakers, child safety organizations and law enforcement to work together to address the “growing urgency for coordinated action.”

In March, NCMEC warned of a “sharp increase” in “generative AI-related reports” (GAI) in 2025. According to NCMEC, more than 1.5 million CyberTipline reports were made last year, “indicating a nexus between GAI and child sexual exploitation.” Worryingly, in more than 133,000 cases, NCMEC “lacked sufficient information to determine how the technology was used.”

That report didn’t mention X or xAI, but it did suggest that it’s probably common for AI companies to avoid sharing information about AI CSAM that police officers can use to make arrests. For another example, NCMEC noted that Amazon’s AI services submitted the vast majority of leads (1.1 million), and none of those leads provided “actionable information” that law enforcement could use to identify perpetrators.

As scrutiny over the harm inflicted on children by AI companies intensifies, advocates hope the companies will fine-tune models to block all nudity. The girls who sued

In the press release, one of the attorneys representing minors, Annika K. Martin, criticized xAI and Stability AI for allegedly building models “capable of producing deepfake CSAM,” with “complete disregard for the devastation they knew would come.”

“AI-generated CSAM is a scourge on society that affects every community and every demographic,” Martin said. “The magnitude of the damage is staggering and the companies whose products enable it must be held accountable.”

This story was updated on July 8 to include comments from Stability AI.



Source link

Leave a Reply

Your email address will not be published. Required fields are marked *