Apple disapproves app update with ChatGPT integration due to danger to children

Apple has rejected an update to the BlueMail app because it has ChatGPT integration and the developer makes the app available to children. According to Apple, the app may generate language that Apple does not want minors to see.

Apple cites a lack of content filtering from the ChatGPT integration as the reason for the rejection, writes The Wall Street Journal. It is unknown whether this is a new rule or an incident. There are many AI-enabled apps on the App Store, and kids can install many of them.

The problem, according to Apple, is that chatbots such as ChatGPT can generate text that may be about sex, drugs or violence, for example. Apple has rules to prevent apps that children can install from showing such content. The developer of BlueMail says it has filters to prevent this. BlueMail uses ChatGPT to generate emails based on sent emails, says the developer. The chatbot can also summarize emails. The update of the app is already in the Google Play Store for Android.

Apple would be willing to approve the app if the developer indicates that it is for ages 17 and older. Currently the app is for ages 4 and older. The developer thinks it’s shrinking its audience and doesn’t want to do that. Apple responds to the case by saying it is investigating the case.