From the source
Lead story
Ask your AI
Top stories
Models & availability
Latest
GitHub Copilot can now interact with desktop apps with computer use
Computer use in public preview for desktop apps
GitHub Copilot can now interact with desktop applications on macOS and Windows in public preview, reading accessible content and visual context, clicking controls, entering text, pressing keys, scrolling, dragging, and navigating workflows across apps.
The feature works in Copilot CLI and the GitHub Copilot app, requires user approval before controlling an app, and can be disabled by organization-managed settings.
From the source
Copilot can interact with desktop applications on your behalf (e.g., reading accessible app content and visual context, clicking controls, entering and editing text, pressing keys, scrolling, dragging, and navigating workflows across applications).
github.blog
