by Hartley Charlton
Apple plans to introduce new AI features in iOS 18, including smart replies for messages and a generative photo retouching tool in iOS 18.
Today's new AppleInsider article revealed some additional details about some of the widely anticipated AI features in iOS 18. Siri is rumored to be receiving several major updates, including:
- Improved Replies: Significantly updated response generation capabilities with a new intelligent reply system that takes into account objects. such as people, companies, calendar events, places, dates, etc.
- Advanced voice features: “more natural” voices with improved text-to-speech features.
- Control media across multiple devices: Use Siri on one device to control playback on another, for example, via Apple Watch for Apple TV. This feature is expected to arrive later in 2024.
- Catch up: Users can request an overview of their latest notifications via Siri.
A number of other AI-powered features are also in development for specific apps in iOS 18:
- Smart Replies: Allows users to respond to messages and emails with automatically generated text replies.
- Transcription and Summarizing. New AI tools for the Notes app, allowing users to edit audio within the app, transcribe audio, and summarize text.
- Math Notes: Supports correct math calculations. notations in the Notes app with Calculator app integration. Math Notes will allow the Notes app to recognize math equations, find solutions, and create graphs.
- Keyboard Math Predictions: Math input enhancements to allow you to complete complex math expressions when recognized as part text input, similar to predictive text input or inline text completion.
- Cleanup: Remove objects from photos using generative AI. This tool will replace Apple's current Retouch feature.
- Generative Playground: An app that uses generative artificial intelligence to create and edit images using an iMessage app extension. It's currently only intended for Apple's internal testing environments, but indicates that there are plans to allow users to create images and then share them via iMessage. This could be linked to rumors of plans to allow users to create their own emoji.
VisionOS 2 will apparently also feature an improved predictive text input model thanks to integration with Apple's Transformer LM, as well as an updated design. Voice command interface. Updates are also reportedly planned for the Calendar and Freeform apps, as well as system settings for macOS. A selection of Apple's new AI features are expected to be revealed during the company's WWDC keynote on June 10.
Related Review: iOS 18 Tags: AppleInsider, Artificial Intelligence[98 comments]
