Monday was the kickoff of WWDC 2024, the annual event where Apple broadcasts among the biggest features headed to its devices, apps and software. And this yr’s WWDC is a doozy. Because of Apple’s newfound — and heavy — investment in generative AI tech, the corporate had loads to showcase on the AI front, from an upgraded Siri to AI-generated emoji.
Apple announced a take care of OpenAI to bring ChatGPT, OpenAI’s AI-powered chatbot experience, to a variety of its devices. It introduced recent photo editing tools to remove objects and other people from photos. And it rolled out an AI capability to proofread, rewrite and summarize text across content, including notes to emails.
Here’s a roundup of just a few of the more noteworthy Apple AI announcements from WWDC 2024.
Recent Siri
Siri got a makeover courtesy of Apple’s overarching generative AI push this yr, called Apple Intelligence.
Because of Apple Intelligence, Siri, which has a revamped look, including a brand new icon and glowing indicator light around the sides of a tool’s screen, can now handle stumbles in speech and higher understand context. You possibly can now also type to Siri, and it may well answer questions, including questions on how you can use your iPhone, iPad or Mac.
Soon, Siri will develop into much more capable with onscreen awareness and the flexibility to take motion in and across apps — so you may ask Siri to, for instance, “make this photo pop” after which “add this photo” to a different app. Throughout the WWDC keynote on Monday, Apple gave the instance of Siri finding a photograph of your license, extracting your ID number and entering it into an internet form for you.
To reap the benefits of the brand new Siri, you’ll need an Apple device that supports Apple Intelligence — specifically the iPhone 15 Pro and devices with M1 or newer chips.
ChatGPT integration
Apple’s bringing ChatGPT to Siri and other first-party apps and capabilities across its operating systems.
Siri users will soon have the opportunity to route inquiries to ChatGPT for “expertise” where it is perhaps helpful, Apple says. You possibly can include photos with the questions you ask ChatGPT via Siri, or ask questions related to your docs or PDFs.
Apple’s also integrated ChatGPT into OS-wide tools equivalent to Writing Tools (powered by Apple Intelligence), which means that you can create content with ChatGPT — including images — or ask an initial idea and send it to ChatGPT to get a revision or variation back.
ChatGPT integrations will arrive on iOS 18, iPadOS 18 and macOS Sequoia later this yr, Apple says, and shall be free without the necessity to create a ChatGPT or OpenAI account. Initially, they’ll be powered by GPT-4o, OpenAI’s recently introduced flagship generative AI model.
Genmoji and Image Playground
Genmoji, coming soon to iOS 18 on devices that support Apple Intelligence, helps you to create AI emoji-like images of anyone in your photo library — or simply custom emoji. Genmoji will be used as a sticker for reacting to messages with a Tapback or inline together with your messages, Apple says.
A separate recent image generation capability allows iPhone users to create AI images of individuals they’re messaging with. Apple Intelligence could have an understanding of who you’re chatting with, Apple says — so if you must personalize the chat with a custom AI image, you may achieve this on the fly.
There’s also Image Playground, a brand new image-generating feature that works across apps like Notes, Freeform, Keynote and Pages.
Available as a standalone app and API for developers, Image Playground allows users to create images using concepts equivalent to themes, costumes, accessories, places and more. You choose the themes you must include and, minutes later, Image Playground creates a preview of your image.
AI photo editing
Apple’s recent Clean Up tool, built into the upgraded Photos app, removes unwanted people and objects from pics.
Clean Up will be used on any picture in Photos by circling or highlighting the thing — or person — to be removed. Counting on AI, Clean Up removes the chosen element and replaces it with contextually-aware pixels to attempt to make it look like the thing (or person) was never there to start with.
As regards to Photos, it’s now higher organized because of AI. Coming in iOS 18, Photos will show collections of photos mechanically organized by topics like time, people, favorite memories, trips and more. And also you’ll have the opportunity to make use of more specific terms to look across photos.
Transcribed calls
Coming soon to iPhone 15 Pro and newer models, iOS will optionally record and transcribe your phone calls.
The feature — which have to be enabled manually, and which informs the party on the opposite end of the road that the decision is being recorded in order to not run afoul of privacy laws — transcribes what’s said throughout the call after which provides a summary of the important thing points discussed in iOS’ Notes app.
Apple noted (no pun intended) throughout the keynote on Monday that you simply’ll also have the opportunity to record and transcribe audio from inside the Notes app.
