Overview

Introduction

The UI Automation package in Robility provides a comprehensive set of activities designed to automate graphical user interface interactions within a variety of software applications. These activities include tasks such as selecting elements, entering data into text fields, clicking buttons, navigating between web pages, and verifying information, among others.

By replicating human interactions with the application interface, UI Automation enables tasks to be executed with efficiency, accuracy, and consistency. It plays a crucial role in automation strategies, driving productivity, reducing errors, cutting costs, ensuring compliance, and enhancing customer experiences across diverse industries.

About the UI Automation package

Web Automation: These activities are tailored for automating web-based applications and processes. Users can interact with web elements, extract data, fill out forms, click buttons, and navigate between pages.

Desktop Automation: Desktop Automation activities automate tasks related to desktop applications. These include interacting with desktop UI elements, extracting data, simulating keyboard and mouse actions, and performing various operations within desktop-based applications.

Image Automation: Image Automation activities use image recognition to automate tasks based on screen elements. This includes actions like identifying and clicking on specific screen areas, verifying visual elements, and triggering automation actions based on images.

Form Builder: These activities streamline form-filling processes within applications. Users can automate the input of data into forms, validate form fields, submit forms, and handle related actions.

Screen Recording: Screen recording activities capture, and document actions performed on the screen. This feature is useful for creating automated workflows by recording user interactions, generating automation scripts, and replaying recorded steps.

Terminal: Terminal in Robility is designed to interact with and automate legacy mainframe systems accessed through terminal emulators. These activities allow users to seamlessly automate data entry, retrieval, and system navigation within terminal applications, improving efficiency and reducing the need for manual intervention.

UI involved Activities

The following are the list of activities that involves UI:

• Web Automation
• Desktop Automation
• Image Automation
• Terminal

These activities are segregated based on their interaction with different aspects of the user interface for several reasons:

Target Platform: Activities like Web Automation are specifically designed to interact with elements within web browsers, such as HTML elements, buttons, and forms. These activities are optimized for web-based applications and workflows.

User Interface Elements: Desktop Automation activities focus on interacting with UI elements within desktop applications, such as windows, buttons, input fields, and menus. These activities are tailored for desktop-based tasks and workflows.

Interaction Methods: Image Automation activities use image recognition and processing techniques to interact with elements represented as images on the screen. They are used when direct access to UI elements or conventional interaction methods is not feasible or available.

Certain applications have dynamic or constantly changing UI elements, making it challenging to target them accurately, in that we do recommend to use “Dynamic” accuracy option in “Image Automation”.

Unsupported Applications