Caution: Copilot Web Actions is a preview feature. Copilot Web Actions may misinterpret your instructions, make significant mistakes, or be deceived by malicious instructions hidden on web pages. Always monitor its behavior closely. Be especially careful if you give it access to or ask it to perform an action related to sensitive information such as email or banking systems.
Copilot Web Actions is a new way for Copilot to act on your behalf from any modern desktop browser. To initiate a Web Action, visit Copilot.com and select Action from the chat mode menu, then using simple chat prompts, Copilot can help you handle common online tasks like booking tickets, grabbing dinner reservations, or sending a gift.
Web Actions is available only to subscribers of Microsoft 365 Premium (former Copilot Pro subscribers will retain access). It is currently available worldwide, except in the European Economic Area (EEA). You must sign in with a personal Microsoft Account to use it.
How Copilot Web Actions work
When you invoke a Web Action, Copilot fulfills the action by opening a browser that runs in the cloud and using it the same way a person would: via mouse clicks, scrolling, and typing. After an Action begins, you can pause, stop, take control, or modify your request.
When a task requires your attention, for example when your personal info or payment details are needed, Copilot will ask you for your input or for you to take control of the remote browser.
How to use Copilot Web Actions?
-
Go to copilot.com using any modern browser.
-
Select Open (the + icon) in the composer and select Start an action fromthe drop-down menu. “Action” should now appear below where you type your prompt.
-
Type and submit the action you want Copilot to take. If there is a specific service or website you and Copilot to use, specify that in your prompt.
-
After you submit your prompt, a browser will appear in the center of the Copilot chat window where you can see what Copilot is doing for you. On the right you will see a column that displays the steps Copilot is taking on your behalf.
-
You can control the flow of actions at any time by selecting Pause, Cancel, or Take Control. Once you take control, you can complete the task yourself in the same browser window.
-
Once Copilot has completed the action, you will see a notification that “this action is closed”.
-
You can rewatch the steps Copilot took at any time by selecting View Steps. Copilot will let you play, pause, rewind, or step forward through each action already Copilot took for you.
Example prompts to use with Copilot Web Actions
Here are some prompt ideas to get you started with Copilot Web Actions:
-
Order a bouquet of flowers using 1800Flowers.com
-
Book a stay using Booking.com
-
Book a travel package using Expedia.com
-
Reserve a hotel room using Hotels.com
-
Book a car rental using Kayak.com
-
Make a dinner reservation using OpenTable.com
-
Book a cruise using Priceline.com
-
Find a cheap flight using Skyscanner.com
-
Find the highest rated restaurants using Tripadvisor.com
-
Book a vacation rental on VRBO.com
-
Schedule a tour using Viator.com
How Copilot Web Actions handles your data
When running Web Actions, Copilot takes screenshots of the pages it visits in the browser and uses them to inform the next step Copilot should take. These screenshots are linked to and retained with the conversation in your conversation history, giving you an opportunity to check Copilot’s work.
When you delete a conversation, the screenshots associated with it are also deleted. Otherwise, they are retained for up to 30 days.
Copilot Web Actions model responses are monitored for unsafe interactions and outputs.
Copilot does not have access to:
-
Any information you input into the Copilot Web Actions browser. For example, personal data entered into a form.
-
Any information once you take control of the browser using the Take Control option. At that point, Copilot will no longer take screenshots until you hand back control of the browser to Copilot.
-
Any passwords or personal information saved on your local browser. When completing an Action, Copilot is opening its own instance of Edge in a virtual machine.
Copilot Web Actions FAQ
When will Web Actions ask for confirmation, supervision, or for the user to take control?
At this time, Web Actions will not make important decisions on its own and will ask for your attention and supervision for certain actions: For example, buying an item, booking a reservation, sending an email, or deleting an event from a calendar. For certain websites it will ask you to take control of the remote browser entirely.
How can I stop Web Actions from running?
You can stop Web Actions from continuing a running task by clicking the pause button (with an option to resume) it or use the cancel button to completely cancel the task.
Does Web Actions work with every site?
Web Actions can interact with most publicly available sites on the web. Sites that don’t align to Copilot’s policies, such as sites containing offensive content, will not be accessible. For more information on policy see Terms of Use and Content Policy.
Are there usage limits for Web Actions?
Yes, there is a limit to how many Copilot Web Actions you can perform. Copilot will let you know when a limit is reached and will explain the next steps.
What prevents Web Actions from being used for harmful, offensive, or illegal purposes?
Security, digital safety, and responsible AI are top priorities for Microsoft. Web Actions will not be available to work with sites that Copilot has determined to contain harmful content or content not aligned with policies. Copilot Web Actions may not be used for harmful, offensive, or illegal activity. Copilot will refuse these tasks. Serious or repeated violations of the Code of Conduct may result in your suspension from using Copilot Actions.
To learn more visit Transparency Note for Microsoft Copilot, Responsible AI at Microsoft and Terms of Use and Content Policy.
