Microsoft is expanding the capabilities of Copilot Vision for Windows Insiders by enabling the AI tool to view everything displayed on your screen. Before the update, it could only analyze two applications simultaneously and link information between them. Now, it can examine your entire desktop or any specific browser or application window, according to Microsoft.
In contrast to Recall, which automatically captures regular images of your screen’s content, Copilot Vision functions more like screen sharing in a video call. You can enable this feature by clicking the glasses icon in the Copilot app and choosing the desktop you wish to display.
Microsoft claims that Copilot Vision can assist by analyzing content, providing insights, and answering your queries, guiding you aloud. It offers suggestions for improving creative projects, enhancing resumes, or navigating new games.
Microsoft initially started testing Copilot Vision last year as a feature that could see what you’re looking at while browsing the web in Edge. Copilot Vision can also answer questions about what it sees through your mobile phone’s camera.
