Apple Bans Non-Consensual AI-Generated Intimate Images in App Review Guidelines

On October 16, Apple updated its App Review Guidelines to explicitly prohibit AI-generated intimate images shared without consent, applying the rule to apps with user-generated content or social networking features. Apps must now implement content filtering, provide reporting mechanisms, suspend abusive users, and publish contact information.

According to 9to5Mac, the change follows recent controversies around the App Store. The Tech Transparency Project had found dozens of AI "nudify" apps, with App Store search suggestions and ads also directing users to such services. San Francisco officials subsequently asked Apple to remove eight apps capable of generating non-consensual intimate images. Separately, xAI's Grok chatbot was reported to have been used to create sexualized deepfakes; Apple reportedly warned xAI earlier this year that Grok could be removed from the App Store if such content continued, prompting xAI to add safeguards and update its app to gain approval.

Apple also introduced rule 2.5.19, which prohibits apps from hiding their real functionality during review and later enabling harmful capabilities such as "nudify" features. This "bait-and-switch" practice may now lead to app removal and termination of developers' Apple Developer Program membership. Apple also extended its ban on apps facilitating human trafficking or child exploitation to alternative app distribution channels, stating it will not hesitate to remove violating apps and end cooperation with offending developers.