- Microsoft has updated its Copilot Vision Tool to see AI assistant to see their desktop
- This feature will allow Copilot to respond to any material that you are seeing
- To give control to users, Copilot vision must be enabled, so it will only see what you want to see AI
Microsoft has opened his Kopilot AI’s eyes on the desktop to see the entire screen. This feature, which enables Copilot to see and analyze things on your screen, you can see any window or browser, as a feature Microsoft says “Desktop Share”.
When the Copilot Vision was first launched, it was limited to limit what was happening only on the shore. You will ask a question about a webpage, it will scan that page, and AI will help explain what was there. With this update, it can now zoom out and see your entire desktop or any specific app window that you choose to share
You can see AI assistant by clicking on the glasses icon in the Copilot app. Then you choose the area you want to look at AI, and you can discuss what is on the screen with AI what you are looking at endlessly.
Suppose you are starting a re -start and want it to sound more like a confident human and be low like a nervous grade student. You can open a word document, share the window with coopelot, and ask it to highlight specific types of experiences. Copilot sees the document itself and suggests editing.
The same goes to PowerPoint, Photoshop and even some games. You can ask Copilot to help with the Settings menu in the game you have never played before, and it will run through options with tips and suggestions when you get stuck.
Visionary scheme
If you are worried about Copilot Snuping on your secret romance novel or something you will not see, you can always close it. For now, the update is available only to Windows interiors that already have Copilot Vision. This will probably come to General Windows 11 population soon.
This may not seem to be a much larger deal than other generative AI features, but it is a subtle way to microsoft that you embed your AI anything literally on your computer. Instead of writing an email in a tab and for help to describe AI in another tab, all this is there. Copilot makes the vision process more comfortable. You digitally point to something that you want help, ask a basic question, and get an answer that makes sense in context.
It is difficult to overstate how much friction it can end. This is simply not true. Some specificity is required because AI cannot read your brain. But there is nothing to help you on the hump to design a powerpoint or shorten the meeting summary.
AI’s dream as a personal assistant has always been about reference, the idea of AI that can know what we mean, not only what we say. Copilot vision is yet the most obvious step of Microsoft in that direction. Copilot vision can quietly become one of the most useful AI devices that Microsoft has ever created. And unlike clippy, it will only pass the decision if you ask.
