App Store icon
3 Facebook x.com Reddit
Apple has removed apps from the App Store that claim they create non-consensual nudity. The move demonstrates Apple is now more willing to tackle the dangerous app category.
Generative AI's ability to create images based on clues has become a very useful tool in photography and design. However, this technology was also misused in creating deep fakes – — and non-consensual pornography.
Despite the danger, Apple surprisingly did not intervene in the problem. Until the recent move, the company had done little to address the potentially serious problem.
In a 404 Media report, Apple revealed a number of AI-powered imaging apps are available on the App Store. Specifically, these were apps that were advertised as capable of producing nude images without users' consent.
Apps offered features such as replacing faces in adult images. Others were marketed as “Take Your Clothes” apps, essentially removing clothes from innocuous photographs.
After receiving warnings about the apps and their associated advertising, Apple removed three of them from the App Store. Google has similarly removed apps from the Play Store.
The report's investigation previously raised questions about Instagram advertising apps through the Meta ad library. Once the ad was flagged, Meta removed it.
Slow start
Apple removing apps from the App Store is good news, but with some lingering problems. To begin with, Apple failed to ban the apps as part of the App Store review process, instead having to notify third parties of their existence.
However, this is a step forward compared to the publication's previous attempts to fight applications.
2022 reports on these apps explained that they initially appeared innocent on the App Store pages. However, deepfake porn features have been advertised on porn sites.
Apple and Google were warned about them at the time, but refused to remove the apps. Instead, companies were ordered to stop running ads on adult websites and the apps were allowed to remain on the App Store.
Despite the order, one of the apps continued to promote its adult features until 2024. when it was removed from the Google Play Store.
Apple's decision to permanently remove offending apps from the App Store is the latest step Apple has taken to try to keep its relationship with artificial intelligence as open as possible.
In addition to using privacy-preserving methods for training artificial intelligence language models, Apple also avoids illegal use of copyrighted works. While the New York Times sued Microsoft and OpenAI for copyright infringement when using its articles to teach artificial intelligence, Apple instead tried to license the work of major publishers in exchange for millions of dollars.
Follow AppleInsider on Google News.
