With the release of iOS 18.2 Beta 2, Apple has introduced an API allowing developers to enable content awareness for Siri and Apple Intelligence, adding enhanced functionality for users to interact with onscreen content. This new feature, available to developers via the Apple Developer program, allows users to request a summary of documents or content on their screens simply by saying, “Hey Siri, what’s this document about?”
Key Features of the API
The API allows apps to send screen content to Siri for analysis, enabling the assistant to understand and interact with the information displayed. Developers can integrate this API across various applications, such as browsers, document readers, and file managers. This expands Siri’s capabilities, allowing third-party services, including AI like ChatGPT, to provide deeper analysis and insights.
Availability and Future Updates
Currently, iOS 18.2 Beta 2 is accessible to developers, with the public rollout expected in December. Apple is also planning future updates, with Siri’s enhanced functionality, including in-app actions, projected for iOS 18.4 in April 2025. This release will give developers ample time to integrate the content-awareness API, potentially making Siri a more versatile tool across iOS apps.
