Microsoft supercharges Copilot with Google integration, smarter vision

From PC World: Copilot Vision’s eyesight is improving, as the integrated Windows AI technology will soon be able to see entire documents, plus link to apps like Google Drive via a new connectors function.

Separately, Microsoft is adding Copilot to the Windows 11 taskbar and making “Hey Copilot” a wake word for the Windows AI app. It’s part of the company’s effort to expand its presence across your PC. The biggest update, though, is Copilot Actions, which will let the assistant actually modify files and system settings.

Copilot Vision is the “visual” aspect of Copilot, able to “see” your PC’s screen and guide you through troubleshooting steps. In my hands-on testing, I found it more than capable of assisting with certain tasks, though it struggled consistently to recognize on-screen symbols in simple games like Solitaire. Microsoft plans to improve it in one key area: right now, it can only see what you see. Soon, in Office apps (Word, PowerPoint, and Excel), it will be able to view the entire document, even sections not currently visible on your screen.

Copilot Vision is also rolling out to all markets where Copilot is available, Microsoft said. You won’t need a specialized PC either; if you have Copilot, you’ll have Vision capabilities.

View: Full Article