Apple has released new developer betas for iOS 18.2, iPadOS 18.2, and macOS Sequoia 15.2, bringing with them an expansion of Apple Intelligence. This update provides developers with access to several new AI tools, including Genmoji for custom emoji creation, Image Playground for generating visuals, and ChatGPT integration in Siri. The betas are available to developers starting today, October 23, 2024. Apple Intelligence’s own models operate both on-device and through Apple’s cloud-based Private Cloud Compute, which processes data securely while prioritizing user privacy.
Siri Integrates ChatGPT for Complex Queries
Siri’s functionality has been expanded with deeper ChatGPT integration, enhancing how it handles complex questions. The new feature dynamically routes certain queries to ChatGPT when appropriate, such as when users need detailed trip planning or other intricate tasks. Apple says privacy is still a priority, and no personal data will be stored by OpenAI. Additionally, users are prompted before sharing any personal details, ensuring control over what information is passed to ChatGPT.
The ChatGPT integration doesn’t require an account, but users with ChatGPT subscriptions can link their accounts for more advanced features. This setup makes Apple’s assistant more versatile, handling requests that previously would have been beyond its standard functionality.
Apple’s AI strategy has been underlined by its collaboration with OpenAI to integrate ChatGPT into Siri and other applications. First announced at WWDC 2024 in June, this partnership enhances Siri’s functionality by utilizing GPT-4o for tasks that go beyond simple commands. The system can now summarize emails, generate text, and manage notifications with more precision than before.
Recently leaked internal documents have put Apple´s cooperation with OpenAi into a new perspective, stating that Siri is lagging significantly behind OpenAI’s ChatGPT in terms of performance.
AI Image Tools with Genmoji and Image Playground
Among the notable features introduced is Genmoji, a tool allowing users to create their own emoji based on text prompts. This feature goes beyond standard emoji use, providing various styles for users to play with. Genmoji is also capable of pulling images from the Photos library to make personalized emoji. The generated emoji can be shared across different messaging apps, with an API offered to developers to integrate this capability into their apps.
Meanwhile, Image Playground enables users to generate custom images based on written descriptions, offering a range of visual styles, from animations to hand-drawn sketches. Like Genmoji, developers can also take advantage of an API to embed Image Playground’s features into their apps. Apple’s decision to allow developer access to these APIs signifies a larger push to incorporate AI tools across its software ecosystem.
Enhanced Visual Intelligence for iPhone 16
Owners of the iPhone 16 models are also getting a first look at Visual Intelligence, a tool that lets users point their cameras at an object to receive information about it. Whether it’s identifying a restaurant’s hours, translating a sign, or pulling up event details from a poster, the camera becomes a powerful search tool. The tool can also read QR codes and even work with ChatGPT to provide more in-depth details about what the camera sees.
This feature enhances the already advanced camera system in the iPhone 16 and 16 Pro models. The potential to scan text, pull up relevant information, and interact with the world around you gives users more ways to interact with the physical and digital spaces they occupy.
Delayed AI Rollouts Delayed
The introduction of these AI features follows a staggered rollout plan that started with the release of iOS 18 earlier this year. However, in July, Apple announced that several AI enhancements initially slated for September would be delayed to allow for additional testing. The company used the extra time to fine-tune these features, ensuring a smoother user experience. Developers were given early access to these tools to optimize apps for the new technology, a move that highlights Apple’s dedication to providing stable software releases.
AI-Powered iPad Mini with A17 Pro Chip
On October 15, Apple launched a new version of its iPad Mini, which includes the powerful A17 Pro chip and expanded Apple Intelligence capabilities. The upgraded chip improves overall performance, providing a 30% boost in processing speeds and a 25% increase in graphics performance compared to its predecessor. With this power, the iPad Mini is now capable of handling more intensive tasks, such as augmented reality applications and advanced image editing.
The A17 Pro chip also allows Apple Intelligence to run faster, offering new creative features like automatic photo editing and smarter note-taking. This makes the iPad Mini a more versatile tool, especially for professionals who need a compact device with strong capabilities. For artists, Apple Pencil Pro integration adds pressure sensitivity, gesture controls, and haptic feedback, enhancing the overall experience of drawing or sketching on the iPad Mini.
Vision Pro Integration and In-Store Demonstrations
Apple’s ongoing AI expansion is not limited to its tablets and smartphones. The company is also integrating Apple Intelligence into its Vision Pro mixed-reality headset, expected to roll out by the end of the year. These AI enhancements will make the Vision Pro more interactive and responsive, improving both entertainment and productivity features. Apple is upgrading its in-store demos to showcase these capabilities, including a new feature called “Go Deeper,” which offers potential buyers the opportunity to explore office tools and personal media through the headset.
This development aims to make the Vision Pro more user-friendly, although the headset’s high price tag remains a sticking point. While the AI features add significant value to the device, Apple is reportedly working on a more affordable version of the headset, which could be released by the end of 2025.
Responsible AI Development and Privacy Focus
Throughout the development of Apple Intelligence, the company has emphasized privacy and safety. Apple guarantees that no user data is included in its AI training processes, and its models are designed to avoid mishandling personal information. The inclusion of Secure Enclave and Secure Boot in Apple’s server infrastructure adds an extra layer of protection, ensuring that AI computations are not vulnerable to external threats.
Last Updated on November 7, 2024 2:22 pm CET
