Microsoft Edge has incorporated a new feature into its Copilot service. The browser's AI-powered assistant now has the capability to analyze screenshots directly uploaded by the user. The latest update enables users to take a screenshot from within the Edge browser and submit it directly to Copilot for analysis and summary. Microsoft tipster Leopeva64 discovered the update and revealed it on Twitter/X.
Utilizing Advanced AI Technologies
The tool employs the existing browser screenshot functionality to capture a user-selected area of the screen. Users can then send the screenshot to the Copilot chat box and ask questions about its content. This leverages the advanced AI technology that powers Copilot, which until now, was limited to analyzing standard images and providing summaries of text content.
Edge Copilot now lets you add screenshots to the chat box, here's how it works:https://t.co/JUQv9r0DoY
.https://t.co/x40bOZjVeL
.https://t.co/ignzaphcqW pic.twitter.com/Z3d5ZxKl0q— Leopeva64 (@Leopeva64) January 6, 2024
Streamlining the Information Gathering Process
The expansion of Copilot's capabilities signifies a strengthened synergy between AI and web browsing experiences, allowing the AI to interpret visual content as well as textual information. This makes Edge's Copilot a more robust tool for information gathering and summarizes webpage content, searches, and answers queries in real-time. The feature integration is currently available across all versions of Microsoft Edge, highlighting the company's commitment to enhancing AI-supported user experiences.
While the implementation restricts full-page screenshot uploads, the initiative opens doors for seamless information extraction from visual elements without needing additional software or services. This development is part of a broader trend of incorporating artificial intelligence into everyday software to enhance productivity and user engagement. As per the industry feedback, Microsoft may be considering extending the screenshot feature to Windows Copilot as well. The feature not only contributes to the field of AI but also signals potential new directions for AI and browser integration in the near future.
