The Future of iOS 18
We are a little over a week away from the WWDC keynote, where Apple is expected to announce a variety of new AI features as part of iOS 18. This is the moment when Siri will finally be equipped with generative AI, thanks to a partnership with OpenAI to integrate ChatGPT technology.
2024: The Year of Generative AI Features
It’s unfair to say that Apple is a newcomer in the field of AI. The company has already used extensive machine learning technologies, particularly in its camera app. These technologies include computational photography features ranging from exposure bracketing to artificial depth-of-field effects.
While Siri has been overtaken by other intelligent assistants, this is partly because Apple has prioritized user privacy protection. Meanwhile, generative AI has fundamentally changed our expectations of intelligent assistants. We now expect more conversational interactions and a better understanding of context and intent.
Therefore, Apple will focus on AI features in its software updates this year. But what exactly is the future of iOS 18?
A Much Smarter Siri
Apple’s top AI priority is to make Siri smarter. The goal is to eliminate the often halting responses and misunderstandings of what we want. Siri will no longer just refer to the web but provide direct, spoken answers.
The company plans to redesign Siri fundamentally, using large language models (LLM), likely a combination of Apple’s own LLM and OpenAI’s ChatGPT technology. However, the full rollout is expected next year, with an interim update in the first version of iOS 18.
Specific Improvements
- Better Understanding of User Intent: Siri will better understand users’ specific needs.
- Spoken Answers Instead of Web Links: Instead of simply referring to websites, Siri will provide direct answers.
- Knowledge of Contacts, Appointments, and Locations: Siri will give more contextually intelligent answers by knowing more about personal data.
- Ability to Summarize Notifications and Messages: Siri will be able to provide summarized information.
- Interaction with Apps: Commands like “Move this note to my new folder” will be possible.
- Chaining Multiple Commands: Complex commands like “Crop this photo to a square and send it to Sam” will be supported.
These improvements will make Siri much more useful, especially in controlling HomeKit devices, where only single commands were previously possible.
AI Photo Editing Features
Reports point to AI-driven object removal to eliminate unwanted people and objects from photos. A new “Clean Up” function will allow users to remove objects from images through generative AI software.
Additionally, Apple is working on text-based photo editing, where users simply state what they want to achieve, such as “Make the sky bluer.” The device interprets this as “Identify and select the sky, and increase the saturation in that area by 20%.”
Possible Capabilities Include:
- Cropping, resizing, rotating, flipping
- Adding filters
- Editing specific photo elements like eyes, hair, and clothing
While these features will be introduced gradually, the end goal is for Siri to understand and execute such commands.
Custom Emojis
A standout new feature is the use of generative AI to create custom emojis. Apple is developing software that can create custom emojis based on the text users input. This could happen either on request or iOS 18 will automatically suggest a custom emoji when the emoji button is pressed.
Additional Possibilities
Besides the definite improvements to Siri, photo editing features, and custom emojis, there are reports of additional AI-powered features:
- Smarter Spotlight Searches: Improved search functions within the system.
- AI-assisted Coding in Xcode: Support for developers through AI.
- AI-assisted Health and Fitness Coaching: Personalized health and fitness suggestions.
- AI-enhanced Journaling: Assistance in keeping a digital journal.
Apple could use AI to further enhance the user experience, such as enabling intelligent search functions for apps or supporting developers in coding.
Don’t miss the exciting new developments at the upcoming WWDC! For more information and current updates, follow Sophie Pochtler on LinkedIn and sign up for our newsletter. What do you think about the new AI features? Share your thoughts in the comments!
