Windows 11's AI functionality taught users how to perform screen scanning
Microsoft has recently rolled out a significant update for Windows 11, introducing an innovative AI tool called Copilot Vision. This feature is now available on all Windows 11 PCs, revolutionising the way users interact with their devices.
Copilot Vision analyses on-screen content in real-time, allowing users to ask questions about information displayed across multiple applications and active web pages. It also provides guidance on performing tasks, such as adjusting an image’s lighting or configuring settings.
Key capabilities of Copilot Vision include screen content analysis, task assistance, and natural language interaction. The AI scans the entire screen, enabling users to inquire about details displayed anywhere on their device. Users can request help with specific computer operations and receive tailored recommendations or instructions. Moreover, users can speak or type commands or questions, making the interface more accessible and intuitive.
Additional AI-powered features complement the Copilot Vision experience, particularly on Copilot+ PCs (Windows 11 devices with enhanced AI capabilities, often powered by Snapdragon processors). These include a Settings app AI agent, an enhanced Snipping Tool, a Photos app Relight feature, a Microsoft Paint sticker generator, and the Click to Do feature.
The Settings app AI agent allows natural language requests for configuration, such as “enable quiet hours” or “connect Bluetooth device,” and can execute these changes automatically. The Enhanced Snipping Tool includes an AI-powered perfect screenshot feature for precise capture and a new colour picker available on all Windows 11 PCs. The Photos app Relight is exclusive to Snapdragon-powered Copilot+ PCs, allowing users to add up to three virtual light sources to an image for professional lighting effects. The Microsoft Paint sticker generator enables the creation of AI-generated stickers from prompts for a more playful user experience. The Click to Do feature brings up a context menu based on the situation.
In summary, Copilot Vision and its companion AI features integrate generative AI deeply into Windows 11, making it possible to interact with the PC visually and linguistically. This simplifies tasks, boosts productivity, and enhances creativity through new AI tools embedded across core apps. Microsoft has promised to roll out these new features to all supported devices by the end of August.
Copilot Vision, an AI tool on Windows 11, not only analyzes screen content in real-time for questions about displayed information across applications, but also offers task assistance, such as adjusting image lighting or configuring settings, by utilizing natural language interaction.
Additionally, other AI-powered features on Copilot+ PCs, which are Windows 11 devices with enhanced AI capabilities, include a Settings app AI agent, an enhanced Snipping Tool, a Photos app Relight feature exclusive to Snapdragon-powered Copilot+ PCs, a Microsoft Paint sticker generator, and the Click to Do feature, all of which further amplify the Copilot Vision experience.
