AI Computer Vision is an AI Skill that enables all UiPath Robots to see every element on a computer screen. Now, businesses and RPA developers can automate tasks on most virtual desktop interface (VDI) environments–regardless of framework or operating system.
With AI Computer Vision, your robot can see on-screen elements with human-like recognition.
Robots recognize and interact with more on-screen fields and components—even Flash, Silverlight, PDFs, and images
Relieves issues with failure-prone image automation techniques and with selector-based targeting on desktops
Includes VDI environments (Citrix, VMWare, Microsoft RDP, VNC, and others) for desktop and web applications
The on-screen wizard provides details, validation, and notifications about on-screen selections
You don’t need to know advanced image recognition techniques; the recorder can generate full vision-based automation
Supports automation on Windows, Linux, Android, and other operating systems
Simplifies VDI-to-desktop automation by reducing necessary modifications
SaaS or available on-premises for Linux and Windows deployments
Enable automations that include drop-down and checkbox elements
Robotic Process Automation depends on a robot’s ability to see selectors on a webpage or computer interface. But a virtual desktop interface (VDI) doesn’t present a traditional user interface; instead, it streams an image of a remote desktop. VDIs make it virtually impossible for robots to easily or accurately recognize—much less interact with—the selectors they need to see.
UiPath Robots' human-like vision comes from a neural network with a combination of custom Screen OCR and text fuzzy matching with a multi-anchoring system.
See how AI Computer Vision compares to traditional selector-based activities. Watch AI Computer Vision at work in this training video.
AI Computer Vision eliminates the reliance on selectors, while still maintaining familiar workflows for RPA developers. With an increase in visible screen elements, more automations are possible.