How to use Copilot Vision to get AI assistance on Windows 11

Copilot Vision is now gradually becoming available on Windows 11 for devices enrolled in any of the Windows Insider Program (Release Preview, Beta, Dev, and Canary) channels.

Initially, the AI feature, part of the Copilot app version 1.25034.133.0 and higher, is rolling out for users in the United States, but it will eventually become available to everyone, according to Microsoft.

In addition, Microsoft is also making Copilot Vision available to everyone on Microsoft Edge.

What’s Copilot Vision?

Vision is a feature that allows you to share any browser or application with the Microsoft Copilot app. When you share a particular window, the chatbot AI can “see” and “understand” the screen’s contents, enabling it to offer help and insights, answer questions, or guide you through a specific task using voice.

If you’re using the Edge browser, you can also access the Vision feature from the Copilot option to get assistance on anything you’re doing on the web.

The feature is also available for iOS and Android, but for Copilot Pro subscribers. If you have a subscription, Copilot will have access to your screen and camera, and then you can use voice interaction with the chatbot AI.

In general, Copilot Vision works on any app or website as long as it doesn’t include any restricted content or is DRM-protected material.

In this guide, I’ll show you how to get started using Copilot Vision on Windows 11.

Get started with Copilot Vision on Windows 11
Get started with Copilot Vision on Microsoft Edge

Get started with Copilot Vision on Windows 11

To start using Copilot Vision, while using a web browser or a particular app, follow these steps:

Open the Copilot app.
Click the “Share screen with Copilot” (glasses) button next to the text prompt.
Select the screen and click the Share button.
Ask Copilot for assistance.
Click the Stop button to stop sharing the screen.

Once you complete the steps, Copilot will be able to analyze the contents on the screen and assist you with any questions you may have.

For example, if you’re on an application, you can ask about how to use a specific feature or the steps to complete a particular task.

Get started with Copilot Vision on Microsoft Edge

To start using Copilot Vision, while using a web browser or a particular app, follow these steps:

Open Microsoft Edge.
Open the web page you want to interact with Copilot.
Click the Copilot button on the top right.
Click the “Talk to Copilot” (microphone) button.
Ask Copilot for assistance as Vision will be activated by default.
(Optional) Click the “Copilot Vision” (glasses) button next to the microphone button to activate the feature.
Click the “Copilot Vision” (glasses) button to stop sharing the browser screen.

After you complete the steps, you can interact with Copilot using your voice to discuss anything on the screen.

If you want to disable Copilot Vision on Microsoft Edge, open the edge://settings/appearance/copilotAndSidebar page and turn off the “Allow Copilot Vision to view your webpage” option.

The Copilot app for Windows 11 doesn’t have an option to disable the feature because it’s an opt-in feature.

It’s important to note that, according to Microsoft, Copilot Vision is only active when you initiate a session with the feature, so it’s not always on. Also, after some time of inactivity, the feature will turn off automatically.

In addition, user images, voice audio, and context will not be logged or stored. However, your voice conversations will be transcribed and saved as part of your history, which you can delete at any time.

Microsoft also says that when using the feature on the web, it’s not capturing any data, nor is it using any data for AI training purposes.

In addition, the company is testing a new file search functionality that allows you to find, open, and ask questions about files stored on your computer with Copilot.

What do you think about this screen-sharing feature with Copilot? Let me know in the comments.