Start Trial

AI Computer Vision

Automate business processes that use virtual desktops – and more

Your Robot needs to be able to ‘see’ everything you’re automating.

So what do you do about on-screen elements that are invisible to Robots?

AI Computer Vision solves this problem. It’s an artificial intelligence (AI) skill that helps UiPath Robots see every element on a computer screen.

Now, businesses and RPA developers can automate tasks on most virtual desktop interface (VDI) environments – regardless of framework or operating system.

↓   Why VDI automations need AI Computer Vision ↓   How does AI Computer Vision work? ↓   Why RPA developers love AI Computer Vision
Video Play Button Video Placeholder

Automation without limitation

With AI Computer Vision, your Robot can see on-screen elements with human-like recognition.

Automation beyond selectors

Robots recognize and interact with more on-screen fields and components – even Flash, Silverlight, PDFs, and images.

Reliable on VDIs and desktops

Relieves issues with failure-prone image automation techniques and with selector-based targeting on desktops

‘See’ more interface types

Includes VDI environments (Citrix, VMWare, Microsoft RDP, VNC, and others) for desktop and web applications

Intelligent, intuitive capabilities

The on-screen wizard provides details, validation, and notifications about on-screen selections

Drag and Drop AI

You don’t need to know advanced image recognition techniques; the recorder can generate full vision-based automation

Cross-platform capabilities

Supports automation on Windows, Linux, Android, and other operating systems

Automation between VDI & non-VDI

Simplifies VDI-to-desktop automation by reducing necessary modifications

Multiple development options

SaaS or on-premises

Want to talk with RPA AI experts? Check out the UiPath AI Computer Vision Forum



Why VDI automations need AI Computer Vision

Robotic Process Automation depends on a Robot’s ability to see selectors on a webpage or computer interface.

But a virtual desktop interface (VDI) doesn’t present a traditional user interface; instead, it streams an image of a remote desktop. VDIs make it virtually impossible for Robots to easily or accurately recognize – much less interact with – the selectors they need to see.

How does AI Computer Vision work?

AI Computer Vision uses a mix of machine learning, OCR, text fuzzy matching, and a multi-anchoring system to enable UiPath Robots to automatically recognize on-screen elements within a user interface.

See how AI Computer Vision compares to traditional selector-based activities. Watch AI Computer Vision at work in this training video.

Video Play Button Video Placeholder

Why RPA developers love AI Computer Vision

AI Computer Vision eliminates the reliance on selectors, while still maintaining familiar workflows for RPA developers. With an increase in visible screen elements, more automations are possible.

Give AI Computer Vision a try

Dive into our Robots’ visual understanding capability.