Apple’s Worldwide Developers Conference next week guarantees to be a pivotal moment within the iPhone maker’s history. Though the Vision Pro debuted ultimately yr’s event, don’t expect hardware to be the foremost attraction at WWDC 2024, which kicks off Monday at 10 a.m. PT.
WWDC is for developers, and far of the main focus shall be on iOS 18. The Cupertino tech giant will showcase the way it’s chosen to integrate AI technology into its devices and software, including through a historic partnership with OpenAI. As the massive event nears, all types of leaks have emerged about what iOS 18 and its rumored AI-powered apps and features have in store.
Among the many changes, Apple is claimed to be powering a few of its latest AI features with its Ajax LLM, including suggested email replies. Other reports indicate that Apple plans to process data from AI in a way that even employees won’t find a way to access, which might help Apple proceed to deliver on its promise of information privacy for its users.
Below, we’ll take a take a look at how Apple is claimed to be adding AI to its apps and services in the following big update for the iPhone, alongside other improvements and changes coming to iOS 18.
Siri’s AI-enabled future
- Apple’s digital assistant is ready to get an AI revamp. The digital assistant will leverage Apple’s own large language models and can allow Siri to manage individual features inside applications. This may work with none vital setup by developers or users, like App Intents or Siri Shortcuts currently require. As a substitute, users will find a way to ask Siri to do things like delete an email or edit a photograph.
- A few of Siri’s upgraded AI capabilities won’t be ready until next yr. For instance, the power for Siri to handle tasks with multiple steps is probably going delayed.
- A more advanced Siri may even come to Apple Look ahead to on-the-go use. You may use Siri in your Watch to play music on one other device, one report said.
- Siri will receive more natural-sounding voices.
- Siri will find a way to summarize notifications that include people, firms, calendar events, locations, dates and more.
- Could Siri’s latest look be hinted at within the animations below?
Apple Photos’ latest look
- A brand new interface is being teased.
- People may have the power to retouch photos with AI, perhaps difficult Google Photos on this area.
- A “Clean Up” feature would, for example, allow you to remove objects out of your photos using generative AI technology, just like Google’s Magic Eraser.
- One report noted that Apple made an internal-only application called Generative Playground that uses GenAI to create and edit images. It’s unclear how this functionality shall be presented to finish users, though iMessage integration was spotted in the shape of an app extension.
Safari with more AI
- AI recaps of Safari web pages and news articles shall be available through a brand new Intelligent Search feature. (Be careful, Arc?)
Notes injected with AI
- Users will find a way to ask for AI recaps of Notes.
- GenAI may even help to transcribe audio in Notes.
- In-app audio recording shall be supported alongside audio transcription and AI summarization.
- Math Notes will help users create graphs and solve equations through AI by recognizing the text of mathematical equations after which helping you to unravel them.
- Notes users may have the choice to auto-complete their mathematical equations when typing.
- Project Greymatter is the code name for a set of AI tools which might be being integrated into core like Safari, Photos and Notes, Bloomberg reported.
Voice Memos transcriptions
- Real-time transcription for voice memos can be coming.
iMessages’ gets an AI makeover
- Generative AI emojis shall be supported, letting users create their very own emojis with technology.
- AI recaps of missed texts may even be available.
- Overall deeper Siri integration is predicted.
- Tapbacks will get latest icons.
- Message effects for individual words shall be supported along with effects for the message itself.
- Messages will offer suggested replies generated by Apple’s on-device Ajax LLM to make texting back easier.
- RCS support can be expected to reach this yr to bring read recipes, typing indicators and high-quality video and pictures when texting with Android users via iMessage.
Calendar refresh
- Apple’s LLM will find a way to speak with the Calendar app to examine for events when composing responses to messages.
Mail with support for AI
- Mail may even get suggested email replies generated by Ajax.
- Project BlackPearl is the code name for the AI upgrade that’s enhancing Apple Mail.
- Search inside Apple Mail will include information from Contacts, locations, and locally stored documents.
- Users may find a way to ask Siri to make their emails “sound more skilled” amongst other things.
Recent Settings interface
- Settings will hopefully get less confusing with a revamped interface and updates that include higher organization and improved search.
Control Center updates
- A brand new Music widget shall be available — possibly to feature larger artwork?
- Improvements to HomeKit for smart home integrations.
Notifications
- AI recaps of missed notifications shall be available.
- Apple is working on something called “Enhanced” notifications.
Highlight
- Highlight is predicted to get faster, more reliable search.
Home Screen updates
- iOS 18 will bring the power to place app icons wherever you would like, as a substitute of getting to align them to the grid without spaces in between them.
- Users may even find a way to change the colour of app icons, perhaps as Apple’s answer to Google’s Material You.
Maps with route creation
Music with AI-powered playlists
More improvements
Other apps with planned updates include Freeform, Xcode and Apple’s productivity apps, like Keynote and Pages, which can get GenAI features.
We’re launching an AI newsletter! Enroll here to start out receiving it in your inboxes on June 5.