Microsoft expands the Copilot vision with highlights on Windows, can work together with two apps

Microsoft on Wednesday announced the expansion of the Copilot vision for Windows with highlights. Initially, the new Artificial Intelligence (AI) feature will be available only in the US, but the company plans to bring it to other areas soon. It uses computer vision and tool uses to analyze the material on the user’s screen and assists them with questions. The Copilot Vision was first unveiled by the Redmond-based tech giants in December 2024, and in April, it was integrated within the Microsoft Edge browser.

Copilot vision on Windows gets a new highlight facility

One in blog postTech veteran announced that the Copilot Vision was finally being rolled out for Windows devices in the US. It will be available for both Windows 10 and Windows 11. The company said that this facility will soon be introduced in more non-European countries. In particular, Copilot Vision on Windows is part of Copilot Labs.

Copilot vision on Windows supports real -time voice, allowing users to ask oral questions about materials. This version of the feature supports two apps simultaneously and can draw reference from both screens at the same time. This means that users can ask more complex questions, such as, “Which image from my gallery is well with the story written by me?”

This version will allow the new highlights feature users to command the Copilot to show some settings and other accessories. This can tell users how to click on an option and how to navigate. Sharing some examples of feature use cases, Microsoft said that users may ask Copilot to give tips while playing a game, to improve the light in a picture, or ask for help to review the journey journey.

To use the Copilot vision on Windows, users have to open the Copilot app and click on the new glasses icon in the composer. Then, users can choose a browser window or app that they want to share with AI chatboats, and it can begin to help them. To prevent the app or browser window from sharing, the user can press the X button in the musician. The company highlighted that this feature is completely opt-in.