Microsoft has expanded the powers and access to its Copilot Vision AI to help you with all types of content. One in Blog post published on ThursdayThe company revealed that Copilot Vision is now cooked in the Copilot Windows app, where you can ask it to analyze and answer questions about any item on your screen.
A big leap ahead
Windows is available in the US for 10 and 11 and soon coming to other non-European countries, Copillot Vision on Windows serves as a virtual partner, which offers another set of eyes to help you with files, apps and other items displayed and shared on screen. You can ask it to analyze or summarize the material or answer any question about it.
It is not certain how to use a specific application? With highlights option, you are able to ask Copilot how to complete a certain task. AI will then show you where to go and what to do.
Too: 8 Methods I use Microsoft’s Copilot Vision AI to save time on my phone and PC
For example, perhaps you are playing a game and got stuck at a certain level. Ask Copilot Vision for suggestions about how to move forward, and it will be naked with you. Perhaps you are looking at a picture in a program like Adobe Photoshop elements and wondering how to improve the lighting. Ask Copilot vision for advice, and it will explain specific steps to follow in Photoshop elements.
You can also share two apps or files at a time, and Copilot Vision will add dots between them. For example, you can share both your calendar and a web page of interesting events and ask AI that when you will be free to participate in the events of your choice. Copilot Vision will find a suitable date and even will talk to you through steps to add the event to your calendar.
This is a big leap for the latest skills Copilot Vision. Earlier, the desktop version of the tool worked only on the edge and could only analyze and answer questions about your current web page. Now you open in windows. It is available for you to share with Copilot.
How to try it
In Windows 10 or 11, open Copilot Windows App. Click on the glasses icon to the right of the prompt. You will see a list of all your open files, apps and Windows. Turn on the switch for the item you want to share with Copilot. AI should be congratulated you in whatever voice you should be made then. (I use the sound of a wave with my best British pronunciation.)
Too: Microsoft’s copillot for gaming comes in beta – how to try it on your phone
Then you can ask it a question about shared material, and it should provide you the necessary information through a specific process or you should guide you. When you are doing with the conversation, click on bus stop or X to return to Copilot Prompt.
Should you include a second item in the conversation, click on the glasses icon again and turn on the switch for additional window. Then you can ask a question that refers to two open objects.
My experience
I took the Copilot vision for a spin using some examples that I listed. For example, I opened a picture in Photoshop elements, which had some reflections of light on it and asked Napilot how to remove them. It explained where and how to use spot healing brush tools in the program to eliminate reflections.
I also opened my calendar and a schedule of the upcoming New York Yankies Games. I would be free to see a game between Yankis and Oriols when I asked Copilot to find a date. This indicated a specific date and even asked me if I wanted to add the event to my calendar and offered me to show me how to do it.
Too: Microsoft 9 unveils new copilot features – now you can try something
Privacy is always a concern with screen-sharing and capturing tools (remember, I am thinking of you). But with the Copilot vision, you are on the driver’s seat. You must actively choose to share a specific window with AI; Otherwise, it cannot see or analyze what is on your screen.
Microsoft said in a blog post, “Copillot Vision on Windows is a new way to connect with your Windows PC, helping you when needed,” Microsoft said in the blog post. “When you choose to enable it, the Copilot Vision can see what you see and talk to you about it in real time. It acts as a second set of your eyes, is able to analyze the material, when you are lost, help, provide insight, provide insight, and answer your questions as you go, work, or a project, or a project, or a project, the Kopilot, or a project in a project, is working in a project, or a project in a project. And provides answers, ”
Get top stories of morning with us in your inbox every day Tech Today Newsletter.
