Android 16 QPR3 Screen automation on Pixel 10 is for computer use
9to5Google • • technology
Key Points:
- Google is preparing to expand Gemini's "Computer Use" capabilities to Android, as indicated by the new "Screen automation" permission found in Android 16 QPR3 Beta 2, currently available only on Pixel 10 devices.
- The "Screen automation" permission allows apps to interact with other apps' screen content to help users complete tasks, even when those apps run in the background, with the Google app being the sole supported application initially.
- Gemini's approach involves AI agents navigating web and app interfaces by mimicking human actions such as clicking, typing, and scrolling, as demonstrated in Google's Project Astra tests on Chrome and YouTube for Android.
- While these features are in development and visible through APK decompilation, Google
