The Apple Intelligence toolkit has experienced a mixed rollout, featuring both postponed functionalities and lackluster enhancements. However, it appears that the most promising set of AI tools unveiled by Apple during WWDC earlier this year will soon be available.
According to the latest edition of his PowerOn newsletter, Mark Gurman from Bloomberg states that the iOS 18.2 update is expected to launch through the stable channel in the first week of December.
This latest version of iOS is already undergoing beta testing and introduces an exciting trio of AI enhancements designed for the iPhone. One notable feature is Siri’s integration with OpenAI’s ChatGPT, which facilitates complex queries being processed through the chatbot.
Another addition is Visual Intelligence, which enables users to simply point their phone’s camera at their surroundings and extract useful information about what they see. Currently, it can perform tasks such as identifying different dog breeds or reading details off a poster.
Considering the extensive integration with OpenAI’s technology, it’s likely that Visual Intelligence will evolve to include capabilities similar to the latest version of ChatGPT, expanding its multi-modal understanding.
The iOS 18.2 beta also includes creative features like the Image Playgrounds app, allowing users to produce playful images based on their own snapshots. Furthermore, the new custom Genmoji system is part of the upcoming update.
Mr. Gurman notes that with the iOS 18.4 release, Siri is poised to undergo a significant transformation that has fans excited about the digital assistant’s potential resurgence in the AI landscape. He mentions, “Siri will be able to access users’ data and respond to inquiries based on the information displayed on their screens.”
Currently, Google’s Gemini can access both local text and media files and provide responses based on that information. Its deep integration with the Workspace platform enables it to reference documents in Google Drive and other essential tools, like Docs.
Similarly, the Notebook LM tool can engage with YouTube videos and third-party web page URLs without requiring a subscription.
In Apple’s scenario, Siri—enhanced by OpenAI’s technology—will be able to answer queries using information retrieved from local files and data stored on the device. This could include accessing travel details from emails, scheduling items from calendar events, and extracting business information from PDFs and spreadsheets.
Moreover, a significant feature will be enhanced integration with third-party applications, enabling the digital assistant to complete tasks in those apps using only voice or text commands.
Apple plans to allow users to explore other third-party options like Gemini in the future. Additionally, Siri will be able to provide answers based on the content visible on the user’s screen.
The release of iOS 18.4 is anticipated sometime in April of next year. This timeframe coincides with when Apple is expected to unveil the next-generation iPhone SE, featuring an updated design, enhanced processing capabilities, and support for Apple Intelligence.