TECH

Apple's new Photos app will use generative AI to edit images

New cleanup feature will make deleting objects much easier

New teaser on AppleInsider has learned that Apple's website may hint at some of the company's future software plans, namely a new version of the ubiquitous Photos app that will use generative artificial intelligence to give the average consumer Photoshop-level editing capabilities.

A logo promoting Tuesday's event on Apple's website suddenly became interactive on Monday, allowing users to erase part or all of the logo with a mouse. This was initially thought to be a hint at an improved Apple Pencil, but it could also refer to an improved editing feature that Apple plans to release later this year.

People familiar with Apple's next-generation operating systems told AppleInsider that the iPad maker is internally testing an advanced feature for its built-in Photos app that will use generative artificial intelligence to edit photos. The feature is called Cleanup in preview versions of Apple's macOS 15 and is located in the editing menu of the new version of the Photos app, next to the existing settings, filters, and cropping options.

This feature appears to replace Apple's Retouch tool, available in macOS versions of the Photos app. However, unlike the Retouch tool, the Cleanup feature is expected to offer improved editing capabilities and the ability to remove larger objects from a photo.

With the Cleanup feature, users will be able to select an area of ​​a photo using a brush and remove certain objects from the image. In internal versions of the app, testers can also adjust the brush size to make it easier to remove smaller or larger objects.

While the feature itself is being tested on Apple's next-generation operating systems, the company may also decide to preview or announce it early to promote its new iPad models.

The Cleanup feature will replace Apple's current retouching tool.

During the iPad “Let Loose” event, Apple is expected to introduce two new iPad Air and iPad Pro models, the latter of which is rumored to introduce the company's next-generation M4 chip. The M4 could provide greater AI capabilities with an improved Neural Engine, at least with an increase in the number of cores.

An earlier rumor claimed that there is a high chance that Apple's new iPad Pro will feature an integrated M4 system. Apple is also expected to market the new tablet as a device with enhanced AI capabilities, after the M3 MacBook Air was named the best laptop for AI.

Although Apple has been working on its own large language model (LLM) for quite some time, it's unlikely that we'll see any text-related AI features debut during “Let Loose.” event. However, the Cleanup feature will provide an opportunity to showcase the new AI capabilities associated with the iPad.

If the company decides to use the new Clean Up feature ahead of its annual developer conference in June, Apple will have the opportunity to promote its new iPads as devices equipped with artificial intelligence. Giving users the ability to delete an object from a photo using the Apple Pencil would be a good way to demonstrate the practical benefits of artificial intelligence.

By demonstrating real-world use cases for AI, the company is likely aiming to gain an edge over existing third-party AI solutions, many of which use artificial intelligence only to offer short-term entertainment value in the form of chatbots.

Apple unveils new Apple Pencil erasing feature at its event

While this feature gives some idea of ​​what an AI-powered iPad might look like, it's not yet It is unknown when exactly Apple will announce the cleaning feature. Apple could instead choose to preview the feature at the Worldwide Developers Conference (WWDC) in June.

Adobe Photoshop for iPad users have access to a similar feature called Content-Aware Fill starting in 2022. It allows users to remove objects from an image using generative artificial intelligence, making it appear as if the objects were never there in the first place.

Content Aware Fill has evolved into Generative Fill, which offers additional functionality and is available in various Adobe products. Besides Photoshop, this feature can be found in Adobe Express and Adobe Firefly.

With Generative Fill, Adobe app users simply paint over an area of ​​a photo to remove objects of their choice. Adobe apps even offer the ability to adjust the brush size. Apple's new Clean Up feature is somewhat similar to Adobe's feature.

Clean Up is expected to debut alongside Apple's new operating systems in June, although there's always a chance it could slip through at Tuesday's iPad media event. Apple also plans to update Notes, Calculator, Calendar, and Spotlight in iOS 18.

Follow AppleInsider on Google News.

Leave a Reply