AI Computer Vision enables all UiPath Robots to see every element of an interface. You can easily build a vision-based automation that will run on most virtual desktop interface (VDI) environments—regardless of framework or operating system.
With AI Computer Vision, your robot can see on-screen elements with human-like recognition.
Automation beyond selectors
Enable robots to recognize and interact with more on-screen fields and components—even Flash, Silverlight, PDFs, and images
Reliable on VDIs and desktops
Relieves issues with failure-prone image automation techniques and with selector-based targeting on desktops
Broad range of interface types
Includes VDI environments (Citrix, VMWare, Microsoft RDP, VNC, and others) for desktop and web applications
Intelligent, intuitive capabilities
Provides details, validation, and notifications about on-screen selections via an on-screen wizard. Uses the recorder to easily generate full vision-based automations
Run-time Auto-scroll Support
Easily automate scrollable content in webpages or apps using CV activities
Automate for Windows, Linux, Android and other operating systems through remote desktops
Automation between VDI & non-VDI
Simplifies VDI-to-desktop automation by reducing necessary modifications
Multiple deployment options
Deploys via SaaS; available on-premises for Linux and Windows, or right from your desktop
Dynamic UI elements
Enables automations that include tables, drop-down lists, and checkbox elements
“We've been successful with UiPath products where other vendors couldn't do the job. Using AI Computer Vision, we can do it quickly and ensure it's consistent, without having to worry about constantly updating the automations.”
Solutions Architect, ApprioHealthSee the case study
RPA depends on a robot’s ability to see selectors on a webpage or computer interface.
But a virtual desktop interface (VDI) doesn’t present a traditional user interface; instead, it streams an image of a remote desktop.
VDIs make it virtually impossible for robots to easily or accurately recognize—much less interact with—the selectors they need to see.
But with AI Computer Vision, robots can “see” the elements they need—even through a VDI.
UiPath robots' human-like vision is powered by a neural network with a combination of custom Screen OCR, text matching, and a multi-anchoring system.
AI Computer Vision eliminates the reliance on selectors, while still maintaining familiar workflows for RPA developers. With an increase in visible screen elements, more automations are possible.
Unstructured data is everywhere, hiding in places like documents, audio files, videos, emails, images, and log files—the list goes on.
Check out the UIAutomation activities package and discover all the basic activities used for creating automation projects.
Join the AI Computer Vision Community Forum and get help with your automation projects , share feedback, report bugs or just drop us any questions you may have.