San Francisco City Attorney David Chiu has given instructions Apple and Google to remove dozens of “nudify” apps from the App Store and Google Play.
His office warned that both companies could face civil penalties for violating California law, according to letters reviewed by TechCrunch.
These apps use artificial intelligence to digitally alter photographs, depicting naked clothed subjects, and are marketed through both stores with payments processed by Apple and Google.
The letters give the companies 28 days to respond. Apple says it has already removed three of the mentioned apps and is working to terminate related developer accounts. Google reports that all five apps referenced in the Play Store have been suspended.
The Laws Behind San Francisco’s Crackdown on Nudify Apps
California law makes it a crime to knowingly facilitate or recklessly assist in the creation of non-consensual deepfake pornography. A separate law that will come into effect in 2025 allows victims to bring civil action against third-party facilitators of such content. Chiu’s office references both statutes in its letters to Apple and Google.
“Apple and Google are profiting from apps that exploit women and girls by creating intimate, non-consensual deepfakes,” Chiu said in an email to TechCrunch.
“While companies have removed some problematic apps, they still have a responsibility to be proactive and vigilant to prevent sexual abuse.”
The letters note that Apple and Google have known about their role in processing payments for these apps for almost a year. Chiu told Wired that both companies had likely earned millions of dollars in fees from apps that offered nudification services.
This order follows two reports from the Tech Transparency Project, published in January and April, that identified dozens of apps on the App Store and Google Play that sold non-consensual intimate imaging in exchange for payments processed by the companies.
The April report claimed that Google and Apple had steered users toward such apps and described both as key players in the spread of artificial intelligence tools that can turn real people into sexualized images.
The Tech Transparency Project sent letters to Apple and Google with each report. Chiu’s letters cite this prior notice as part of the rationale for warning of civil penalties.
The response of Apple and Google and the impact on users and developers
An Apple spokesperson told TechCrunch that nudified apps are not allowed on the App Store under existing policies. “We have removed three of the apps in question and are in the process of terminating their developer accounts,” the spokesperson said.
“We are also in contact with four other individuals who need to correct policy violations or may be removed.” A Google spokesperson said the five Play Store apps mentioned in Chiu’s letter have been suspended. “When violations are reported to us, we investigate and take swift action.
“In the case of these apps, that has included suspending hundreds of infringing apps and restricting related search terms like ‘nudify’ from our store,” the spokesperson added. Neither company provided details on the total revenue processed through these apps or the number of downloads involved.
The focus appears to be on store-level distribution and payment processing, rather than underlying models or websites that host similar tools outside of app stores.
Users who purchased or subscribed to any of the affected apps may lose access after developer accounts are terminated, but neither company has shared refund details.
Developers creating apps that combine photo editing with generative AI features for iOS or Android should review the specific policies cited by Apple and Google.
Apple’s App Store guidelines already restrict content that sexualizes real people without consent, while Google has restricted search terms, including “nudify,” on the Play Store.
Apps that generate edited images of identifiable people without safeguards against non-consensual use are at higher risk of being removed on both platforms.
How to Report Nudify Apps and Protect Yourself
Users who identify such apps in either store can report them directly using the App Store and Google Play reporting tools.
On iOS, the “Report a problem” option appears in every app list. On Android, the “Flag as inappropriate” option can be found in the list of apps in the developer contact section. When reporting on the generation of non-consensual intimate images, it is important to reference that specific policy category.
Victims of non-consensual deepfake images in California have the option of taking civil action against third-party facilitators under the 2025 law mentioned in Chiu’s letters.
The letters ask Apple and Google to respond within 28 days. So far, neither company has confirmed whether they plan to review related apps beyond those specifically named.
